2024-09-16T00:41:29.125 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T00:41:29.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T00:41:29.235 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906420' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK3+ujBxwO4aLlxuvdaRswNwIwks18/kwTq92pFQ7m37acBVQcHlwvVtvveul/sSVxS11V4ASwHudy147IumTo0= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOckQ0upxb01Y2EFEdh7LE9CoayF3Kpc8QFz2oahwCWrP4+fLJxzXkzTLNKSKuEGovoFWSB2Rp5+DK66ccf9gFE= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVtIvavZisU1BRA7+YTA7VNNC32++KFH1ptVsCVAvGPF8MVaWhbxhaafAuJrzl1M/KsGGrYS97mdc0ParxG0Lo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - quiescer: null - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T00:41:29.235 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-16T00:41:29.236 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-16T00:41:29.236 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T00:41:29.237 INFO:teuthology.task.internal:Checking packages... 2024-09-16T00:41:29.259 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-16T00:41:29.259 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T00:41:29.259 INFO:teuthology.packaging:ref: None 2024-09-16T00:41:29.259 INFO:teuthology.packaging:tag: None 2024-09-16T00:41:29.260 INFO:teuthology.packaging:branch: squid 2024-09-16T00:41:29.260 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:41:29.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T00:41:29.506 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-16T00:41:29.507 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T00:41:29.518 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T00:41:29.518 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T00:41:29.528 INFO:teuthology.task.internal:Saving configuration 2024-09-16T00:41:29.546 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T00:41:29.553 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T00:41:29.578 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:36:30.769570', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK3+ujBxwO4aLlxuvdaRswNwIwks18/kwTq92pFQ7m37acBVQcHlwvVtvveul/sSVxS11V4ASwHudy147IumTo0='} 2024-09-16T00:41:29.602 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:36:30.767844', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOckQ0upxb01Y2EFEdh7LE9CoayF3Kpc8QFz2oahwCWrP4+fLJxzXkzTLNKSKuEGovoFWSB2Rp5+DK66ccf9gFE='} 2024-09-16T00:41:29.624 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:36:30.770858', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVtIvavZisU1BRA7+YTA7VNNC32++KFH1ptVsCVAvGPF8MVaWhbxhaafAuJrzl1M/KsGGrYS97mdc0ParxG0Lo='} 2024-09-16T00:41:29.624 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T00:41:29.630 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-16T00:41:29.630 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-16T00:41:29.631 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-16T00:41:29.631 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T00:41:29.722 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb171cc7be0>, signals=[15]) 2024-09-16T00:41:29.722 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T00:41:29.728 INFO:teuthology.task.internal:Opening connections... 2024-09-16T00:41:29.728 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-09-16T00:41:29.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:41:29.813 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T00:41:29.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:41:29.895 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-09-16T00:41:29.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:41:29.971 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T00:41:29.978 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-09-16T00:41:29.996 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-09-16T00:41:29.996 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-09-16T00:41:30.054 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-09-16T00:41:30.054 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T00:41:30.055 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T00:41:30.056 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-09-16T00:41:30.077 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-16T00:41:30.096 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-16T00:41:30.096 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T00:41:30.154 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-16T00:41:30.155 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T00:41:30.155 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T00:41:30.155 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T00:41:30.155 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-16T00:41:30.177 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-09-16T00:41:30.196 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-09-16T00:41:30.196 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-09-16T00:41:30.255 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-09-16T00:41:30.255 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-09-16T00:41:30.255 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-09-16T00:41:30.255 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-09-16T00:41:30.255 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-09-16T00:41:30.255 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-09-16T00:41:30.255 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T00:41:30.256 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-09-16T00:41:30.256 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-09-16T00:41:30.256 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T00:41:30.256 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-09-16T00:41:30.256 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T00:41:30.256 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T00:41:30.256 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T00:41:30.256 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-09-16T00:41:30.277 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T00:41:30.288 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T00:41:30.294 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T00:41:30.294 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-09-16T00:41:30.296 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-16T00:41:30.298 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-09-16T00:41:30.315 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T00:41:30.323 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T00:41:30.324 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-09-16T00:41:30.353 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-16T00:41:30.355 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-09-16T00:41:30.399 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T00:41:30.474 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T00:41:30.488 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-16T00:41:30.488 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-16T00:41:30.488 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-16T00:41:30.489 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T00:41:30.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:41:30.505 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-16T00:41:30.563 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-503.el9.x86_64 2024-09-16T00:41:30.563 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.14.0-503.el9.x86_64 2024-09-16T00:41:30.563 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum install -y kernel 2024-09-16T00:41:33.041 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-16T00:41:35.017 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-16T00:41:39.551 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-16T00:41:41.251 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-16T00:41:42.047 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-16T00:41:47.702 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T00:41:49.880 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-16T00:41:49.891 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-16T00:41:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-09-16T00:41:49.891 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-16T00:41:49.891 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-16T00:41:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T00:41:49.892 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-16T00:41:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T00:41:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T00:41:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T00:41:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:41:49.892 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-16T00:41:49.892 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-16T00:41:49.892 INFO:teuthology.orchestra.run.smithi012.stdout:Install 4 Packages 2024-09-16T00:41:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:41:49.893 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 79 M 2024-09-16T00:41:49.893 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 126 M 2024-09-16T00:41:49.893 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-16T00:41:50.078 INFO:teuthology.orchestra.run.smithi012.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 259 kB/s | 23 kB 00:00 2024-09-16T00:41:50.462 INFO:teuthology.orchestra.run.smithi012.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-16T00:41:50.962 INFO:teuthology.orchestra.run.smithi012.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-16T00:41:51.354 INFO:teuthology.orchestra.run.smithi012.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 22 MB/s | 29 MB 00:01 2024-09-16T00:41:51.356 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:41:51.356 INFO:teuthology.orchestra.run.smithi012.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-16T00:41:52.069 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-16T00:41:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-16T00:41:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-16T00:41:53.422 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-16T00:41:53.422 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-16T00:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-16T00:41:56.647 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:41:56.729 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:41:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:41:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:42:04.780 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:42:04.826 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:42:09.962 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:42:48.745 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:42:48.789 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:42:49.138 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:42:49.139 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:42:49.139 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:42:49.139 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:42:49.960 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:42:49.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:42:49.961 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-16T00:42:49.961 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T00:42:49.961 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T00:42:49.961 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T00:42:49.961 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T00:42:49.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:42:49.961 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-16T00:42:50.322 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:42:50.466 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:42:50.466 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:42:50.466 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T00:42:50.466 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T00:42:50.466 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T00:42:50.467 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-16T00:42:50.467 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T00:42:50.467 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:42:50.526 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:42:50.526 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:42:50.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2024-09-16T00:42:50.564 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2024-09-16T00:42:50.564 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2024-09-16T00:42:50.564 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.06 2024-09-16T00:42:50.564 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 82.el9 2024-09-16T00:42:50.564 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2024-09-16T00:42:50.564 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T00:42:50.564 INFO:teuthology.orchestra.run.smithi012.stdout:Group : Unspecified 2024-09-16T00:42:50.564 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 8274670 2024-09-16T00:42:50.564 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : builder@centos.org 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : CentOS 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T00:42:50.565 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T00:42:50.566 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2024-09-16T00:42:50.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:42:50.566 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T00:42:50.566 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T00:42:50.567 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 5.14.0-505.el9.x86_64 2024-09-16T00:42:50.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T00:42:51.210 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2024-09-16T00:42:52.516 INFO:teuthology.orchestra.run.smithi012.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T00:42:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:done 2024-09-16T00:42:52.543 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-16T00:42:52.557 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.0BwkZeSLK9 2024-09-16T00:42:52.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0BwkZeSLK9 2024-09-16T00:42:52.623 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.0BwkZeSLK9 2024-09-16T00:42:52.763 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.0BwkZeSLK9 is 6KB 2024-09-16T00:42:52.811 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.0BwkZeSLK9 2024-09-16T00:42:52.826 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T00:42:52.890 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T00:42:52.890 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T00:42:52.890 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T00:42:52.890 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T00:42:52.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T00:42:53.049 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2024-09-16T00:43:23.052 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-16T00:43:23.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-16T00:43:23.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:43:41.501 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-16T00:43:50.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-16T00:43:50.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:44:08.893 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-16T00:44:20.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-16T00:44:20.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:44:21.976 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-16T00:44:22.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-16T00:44:22.473 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-16T00:44:22.473 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-16T00:44:22.488 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-505.el9.x86_64 2024-09-16T00:44:22.488 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T00:44:22.488 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T00:44:22.488 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T00:44:23.489 DEBUG:teuthology.parallel:result is None 2024-09-16T00:44:23.490 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T00:44:23.496 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T00:44:23.496 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T00:44:23.499 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T00:44:23.502 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T00:44:23.520 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T00:44:23.526 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T00:44:23.532 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T00:44:23.533 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T00:44:23.555 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T00:44:23.560 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T00:44:23.628 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T00:44:23.635 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T00:44:23.635 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T00:44:23.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:44:23.652 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T00:44:23.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:44:23.670 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T00:44:23.672 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T00:44:23.694 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T00:44:23.739 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:44:23.757 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:44:23.772 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:44:23.777 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:44:23.778 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:44:23.788 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:44:23.790 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T00:44:23.797 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T00:44:23.798 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T00:44:23.800 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T00:44:23.804 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T00:44:23.832 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T00:44:23.843 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T00:44:23.843 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T00:44:23.868 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T00:44:23.871 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T00:44:23.891 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:44:23.962 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:44:24.021 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:44:24.104 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:44:24.146 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:44:24.146 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T00:44:24.232 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:44:24.277 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:44:24.337 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:44:24.421 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:44:24.464 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:44:24.464 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T00:44:24.531 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:44:24.576 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:44:24.638 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:44:24.682 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:44:24.725 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:44:24.725 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T00:44:24.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-09-16T00:44:24.797 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-16T00:44:24.799 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-09-16T00:44:24.834 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T00:44:24.842 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T00:44:24.874 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T00:44:25.260 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T00:44:25.267 INFO:teuthology.task.internal:Starting timer... 2024-09-16T00:44:25.267 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T00:44:25.277 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T00:44:25.285 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-16T00:44:25.285 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-09-16T00:44:25.346 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-09-16T00:44:25.348 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-16T00:44:25.404 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-16T00:44:25.406 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-09-16T00:44:25.471 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-09-16T00:44:25.473 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T00:44:25.474 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-09-16T00:44:25.497 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-09-16T00:44:25.498 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-16T00:44:25.523 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-16T00:44:25.523 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-09-16T00:44:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-09-16T00:44:25.554 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive'} 2024-09-16T00:44:25.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T00:44:25.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:44:25.582 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T00:44:25.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:44:25.611 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T00:44:25.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:44:25.639 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T00:44:25.639 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-09-16T00:44:25.669 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-16T00:44:25.699 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-09-16T00:44:25.734 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T00:44:25.742 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T00:44:25.745 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T00:44:25.863 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T00:44:25.874 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T00:44:25.875 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi098.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T00:48:23.751 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2024-09-16T00:48:23.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-16T00:48:23.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:48:23.837 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-16T00:48:23.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-16T00:48:23.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-16T00:48:23.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:48:23.995 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-16T00:48:24.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-16T00:48:24.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-16T00:48:24.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:48:24.163 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-16T00:48:24.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-16T00:48:24.243 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T00:48:24.253 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T00:48:24.253 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T00:48:24.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T00:48:24.256 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T00:48:24.256 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T00:48:24.258 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T00:48:24.258 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T00:48:24.288 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T00:48:24.288 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T00:48:24.303 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T00:48:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T00:48:24.313 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T00:48:24.328 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-16T00:48:24.329 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T00:48:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-09-16T00:48:24.339 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-16T00:48:24.346 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-09-16T00:48:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T00:48:24.355 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-09-16T00:48:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T00:48:24.366 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-09-16T00:48:24.368 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T00:48:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T00:48:24.381 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T00:48:24.395 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T00:48:24.422 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-16T00:48:24.425 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T00:48:24.425 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-16T00:48:24.425 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.425 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.425 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.425 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.440 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-16T00:48:24.443 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T00:48:24.443 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-16T00:48:24.443 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.443 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.443 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.443 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.464 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-16T00:48:24.467 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T00:48:24.467 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-16T00:48:24.467 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.467 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.468 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.468 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:48:24.468 INFO:teuthology.run_tasks:Running task install... 2024-09-16T00:48:24.476 DEBUG:teuthology.task.install:project ceph 2024-09-16T00:48:24.476 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-16T00:48:24.476 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T00:48:24.476 INFO:teuthology.task.install:Using flavor: default 2024-09-16T00:48:24.483 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T00:48:24.483 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-16T00:48:24.483 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T00:48:24.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:48:24.485 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T00:48:24.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:48:24.486 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T00:48:24.487 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:48:24.631 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T00:48:24.631 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T00:48:24.642 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T00:48:24.642 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T00:48:24.645 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T00:48:24.645 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T00:48:24.739 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T00:48:24.740 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:48:24.740 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T00:48:24.751 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T00:48:24.751 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:48:24.751 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T00:48:24.759 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T00:48:24.759 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:48:24.759 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T00:48:24.767 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T00:48:24.767 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T00:48:24.779 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T00:48:24.779 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T00:48:24.784 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T00:48:24.784 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T00:48:24.833 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T00:48:24.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T00:48:24.849 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T00:48:24.910 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T00:48:24.925 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T00:48:24.926 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T00:48:24.974 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-09-16T00:48:24.975 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-09-16T00:48:24.989 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-16T00:48:24.991 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-16T00:48:24.992 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-09-16T00:48:24.994 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-09-16T00:48:25.200 INFO:teuthology.orchestra.run.smithi119.stdout:45 files removed 2024-09-16T00:48:25.216 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-16T00:48:25.228 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T00:48:25.229 INFO:teuthology.orchestra.run.smithi012.stdout:45 files removed 2024-09-16T00:48:25.242 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T00:48:25.256 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T00:48:25.767 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 313 kB/s | 83 kB 00:00 2024-09-16T00:48:25.792 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 308 kB/s | 83 kB 00:00 2024-09-16T00:48:25.807 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 333 kB/s | 83 kB 00:00 2024-09-16T00:48:26.035 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-16T00:48:26.067 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-16T00:48:26.083 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-16T00:48:26.285 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-09-16T00:48:26.318 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-09-16T00:48:26.342 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-16T00:48:26.777 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-16T00:48:26.944 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-16T00:48:27.084 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-16T00:48:28.926 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-16T00:48:29.703 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-16T00:48:31.195 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-16T00:48:33.560 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-16T00:48:35.011 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 110 kB/s | 19 kB 00:00 2024-09-16T00:48:35.649 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-16T00:48:35.679 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-16T00:48:35.898 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-16T00:48:37.379 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-16T00:48:37.963 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-16T00:48:38.550 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-16T00:48:38.759 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-16T00:48:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-16T00:48:43.933 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:48:43.933 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:48:43.945 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T00:48:43.945 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T00:48:43.946 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T00:48:43.947 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T00:48:43.949 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T00:48:43.951 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T00:48:43.952 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T00:48:43.956 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T00:48:44.022 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-16T00:48:44.043 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-16T00:48:44.043 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-16T00:48:44.043 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T00:48:44.044 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T00:48:44.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T00:48:44.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T00:48:44.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T00:48:44.045 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T00:48:44.045 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T00:48:44.049 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T00:48:44.049 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T00:48:44.049 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T00:48:44.049 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T00:48:44.049 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T00:48:44.049 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T00:48:44.049 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T00:48:44.049 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T00:48:44.049 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T00:48:44.049 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T00:48:44.050 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T00:48:44.051 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-09-16T00:48:44.051 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T00:48:44.051 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T00:48:44.051 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T00:48:44.051 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T00:48:44.051 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T00:48:44.052 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T00:48:44.052 INFO:teuthology.orchestra.run.smithi012.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T00:48:44.052 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T00:48:44.052 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-16T00:48:44.052 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T00:48:44.052 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T00:48:44.053 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T00:48:44.053 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T00:48:44.053 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T00:48:44.053 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T00:48:44.053 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T00:48:44.053 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T00:48:44.053 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T00:48:44.053 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T00:48:44.053 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T00:48:44.054 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T00:48:44.055 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T00:48:44.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T00:48:44.057 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T00:48:44.058 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T00:48:44.059 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T00:48:44.060 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T00:48:44.060 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T00:48:44.060 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T00:48:44.060 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T00:48:44.060 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T00:48:44.060 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T00:48:44.060 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T00:48:44.060 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T00:48:44.060 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T00:48:44.060 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T00:48:44.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:48:44.062 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-16T00:48:44.062 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-16T00:48:44.062 INFO:teuthology.orchestra.run.smithi012.stdout:Install 148 Packages 2024-09-16T00:48:44.062 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 8 Packages 2024-09-16T00:48:44.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:48:44.063 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 226 M 2024-09-16T00:48:44.063 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-16T00:48:44.224 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-16T00:48:44.922 INFO:teuthology.orchestra.run.smithi012.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-16T00:48:45.122 INFO:teuthology.orchestra.run.smithi012.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 4.4 MB/s | 896 kB 00:00 2024-09-16T00:48:45.230 INFO:teuthology.orchestra.run.smithi012.stdout:(3/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 13 MB/s | 5.4 MB 00:00 2024-09-16T00:48:45.255 INFO:teuthology.orchestra.run.smithi012.stdout:(4/156): ceph-immutable-object-cache-19.1.1-326 1.1 MB/s | 145 kB 00:00 2024-09-16T00:48:45.347 INFO:teuthology.orchestra.run.smithi012.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 20 MB/s | 2.4 MB 00:00 2024-09-16T00:48:45.464 INFO:teuthology.orchestra.run.smithi012.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-16T00:48:45.598 INFO:teuthology.orchestra.run.smithi012.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-16T00:48:46.056 INFO:teuthology.orchestra.run.smithi012.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 17 MB/s | 21 MB 00:01 2024-09-16T00:48:46.098 INFO:teuthology.orchestra.run.smithi012.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 606 kB/s | 25 kB 00:00 2024-09-16T00:48:46.207 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:48:46.208 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:48:46.219 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T00:48:46.220 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T00:48:46.220 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T00:48:46.221 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T00:48:46.223 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T00:48:46.223 INFO:teuthology.orchestra.run.smithi012.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 17 MB/s | 11 MB 00:00 2024-09-16T00:48:46.225 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T00:48:46.226 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T00:48:46.287 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-16T00:48:46.307 INFO:teuthology.orchestra.run.smithi012.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 2.7 MB/s | 228 kB 00:00 2024-09-16T00:48:46.314 INFO:teuthology.orchestra.run.smithi119.stdout:====================================================================================== 2024-09-16T00:48:46.314 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-16T00:48:46.314 INFO:teuthology.orchestra.run.smithi119.stdout:====================================================================================== 2024-09-16T00:48:46.314 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-16T00:48:46.314 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T00:48:46.314 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T00:48:46.314 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T00:48:46.314 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T00:48:46.314 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T00:48:46.314 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T00:48:46.315 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T00:48:46.316 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T00:48:46.317 INFO:teuthology.orchestra.run.smithi119.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T00:48:46.318 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T00:48:46.319 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T00:48:46.320 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T00:48:46.321 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T00:48:46.322 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T00:48:46.323 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T00:48:46.324 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T00:48:46.325 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T00:48:46.326 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T00:48:46.326 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T00:48:46.326 INFO:teuthology.orchestra.run.smithi119.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T00:48:46.326 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T00:48:46.326 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T00:48:46.326 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T00:48:46.326 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T00:48:46.326 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T00:48:46.326 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2024-09-16T00:48:46.327 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T00:48:46.327 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:48:46.327 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-16T00:48:46.327 INFO:teuthology.orchestra.run.smithi119.stdout:====================================================================================== 2024-09-16T00:48:46.327 INFO:teuthology.orchestra.run.smithi119.stdout:Install 148 Packages 2024-09-16T00:48:46.327 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 8 Packages 2024-09-16T00:48:46.327 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:48:46.328 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 226 M 2024-09-16T00:48:46.328 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-16T00:48:46.391 INFO:teuthology.orchestra.run.smithi012.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 324 kB/s | 27 kB 00:00 2024-09-16T00:48:46.537 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:48:46.537 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:48:46.551 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T00:48:46.552 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T00:48:46.553 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T00:48:46.554 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T00:48:46.556 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T00:48:46.558 INFO:teuthology.orchestra.run.smithi012.stdout:(13/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 15 MB/s | 17 MB 00:01 2024-09-16T00:48:46.559 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T00:48:46.560 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T00:48:46.583 INFO:teuthology.orchestra.run.smithi012.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 165 kB/s | 32 kB 00:00 2024-09-16T00:48:46.617 INFO:teuthology.orchestra.run.smithi012.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 751 kB 00:00 2024-09-16T00:48:46.622 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-16T00:48:46.638 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-16T00:48:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-16T00:48:46.638 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-16T00:48:46.638 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T00:48:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T00:48:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-16T00:48:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T00:48:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T00:48:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T00:48:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T00:48:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T00:48:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T00:48:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T00:48:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T00:48:46.642 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-16T00:48:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T00:48:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T00:48:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T00:48:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T00:48:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T00:48:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T00:48:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T00:48:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T00:48:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T00:48:46.650 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-16T00:48:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T00:48:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:48:46.651 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-16T00:48:46.651 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-16T00:48:46.651 INFO:teuthology.orchestra.run.smithi098.stdout:Install 148 Packages 2024-09-16T00:48:46.651 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 8 Packages 2024-09-16T00:48:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:48:46.652 INFO:teuthology.orchestra.run.smithi012.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.7 MB/s | 163 kB 00:00 2024-09-16T00:48:46.652 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 226 M 2024-09-16T00:48:46.652 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-16T00:48:46.667 INFO:teuthology.orchestra.run.smithi012.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-16T00:48:46.701 INFO:teuthology.orchestra.run.smithi012.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 8.5 MB/s | 506 kB 00:00 2024-09-16T00:48:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 773 kB/s | 45 kB 00:00 2024-09-16T00:48:46.843 INFO:teuthology.orchestra.run.smithi012.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.6 MB/s | 136 kB 00:00 2024-09-16T00:48:46.918 INFO:teuthology.orchestra.run.smithi012.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 21 MB/s | 5.3 MB 00:00 2024-09-16T00:48:46.944 INFO:teuthology.orchestra.run.smithi012.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.6 MB/s | 161 kB 00:00 2024-09-16T00:48:46.969 INFO:teuthology.orchestra.run.smithi012.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 6.2 MB/s | 320 kB 00:00 2024-09-16T00:48:47.002 INFO:teuthology.orchestra.run.smithi012.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.0 MB/s | 300 kB 00:00 2024-09-16T00:48:47.007 INFO:teuthology.orchestra.run.smithi119.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-16T00:48:47.028 INFO:teuthology.orchestra.run.smithi012.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.7 MB/s | 99 kB 00:00 2024-09-16T00:48:47.053 INFO:teuthology.orchestra.run.smithi012.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-16T00:48:47.112 INFO:teuthology.orchestra.run.smithi012.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.8 MB/s | 170 kB 00:00 2024-09-16T00:48:47.170 INFO:teuthology.orchestra.run.smithi012.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 22 MB/s | 3.1 MB 00:00 2024-09-16T00:48:47.187 INFO:teuthology.orchestra.run.smithi012.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 425 kB/s | 32 kB 00:00 2024-09-16T00:48:47.221 INFO:teuthology.orchestra.run.smithi012.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.9 MB/s | 146 kB 00:00 2024-09-16T00:48:47.424 INFO:teuthology.orchestra.run.smithi119.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 2.1 MB/s | 896 kB 00:00 2024-09-16T00:48:47.425 INFO:teuthology.orchestra.run.smithi098.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 27 kB/s | 6.5 kB 00:00 2024-09-16T00:48:47.438 INFO:teuthology.orchestra.run.smithi012.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 14 MB/s | 3.6 MB 00:00 2024-09-16T00:48:47.500 INFO:teuthology.orchestra.run.smithi119.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.9 MB/s | 145 kB 00:00 2024-09-16T00:48:47.521 INFO:teuthology.orchestra.run.smithi012.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.9 MB/s | 249 kB 00:00 2024-09-16T00:48:47.663 INFO:teuthology.orchestra.run.smithi012.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-16T00:48:47.689 INFO:teuthology.orchestra.run.smithi012.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 295 kB/s | 49 kB 00:00 2024-09-16T00:48:47.722 INFO:teuthology.orchestra.run.smithi012.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 282 kB/s | 16 kB 00:00 2024-09-16T00:48:47.747 INFO:teuthology.orchestra.run.smithi012.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.7 MB/s | 285 kB 00:00 2024-09-16T00:48:47.806 INFO:teuthology.orchestra.run.smithi012.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-16T00:48:47.831 INFO:teuthology.orchestra.run.smithi012.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 218 kB/s | 18 kB 00:00 2024-09-16T00:48:47.915 INFO:teuthology.orchestra.run.smithi012.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 735 kB/s | 80 kB 00:00 2024-09-16T00:48:47.974 INFO:teuthology.orchestra.run.smithi012.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-16T00:48:48.000 INFO:teuthology.orchestra.run.smithi098.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.5 MB/s | 896 kB 00:00 2024-09-16T00:48:48.007 INFO:teuthology.orchestra.run.smithi012.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-16T00:48:48.032 INFO:teuthology.orchestra.run.smithi012.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-16T00:48:48.058 INFO:teuthology.orchestra.run.smithi119.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 4.3 MB/s | 2.4 MB 00:00 2024-09-16T00:48:48.083 INFO:teuthology.orchestra.run.smithi012.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-16T00:48:48.101 INFO:teuthology.orchestra.run.smithi098.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.4 MB/s | 145 kB 00:00 2024-09-16T00:48:48.108 INFO:teuthology.orchestra.run.smithi012.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-16T00:48:48.136 INFO:teuthology.orchestra.run.smithi012.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-16T00:48:48.159 INFO:teuthology.orchestra.run.smithi012.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-16T00:48:48.184 INFO:teuthology.orchestra.run.smithi012.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-16T00:48:48.209 INFO:teuthology.orchestra.run.smithi119.stdout:(5/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 4.0 MB/s | 5.4 MB 00:01 2024-09-16T00:48:48.300 INFO:teuthology.orchestra.run.smithi119.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 6.3 MB/s | 1.5 MB 00:00 2024-09-16T00:48:48.492 INFO:teuthology.orchestra.run.smithi098.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 4.1 MB/s | 5.4 MB 00:01 2024-09-16T00:48:48.635 INFO:teuthology.orchestra.run.smithi098.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 4.5 MB/s | 2.4 MB 00:00 2024-09-16T00:48:48.651 INFO:teuthology.orchestra.run.smithi012.stdout:(48/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 19 MB/s | 49 MB 00:02 2024-09-16T00:48:48.667 INFO:teuthology.orchestra.run.smithi119.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-16T00:48:48.693 INFO:teuthology.orchestra.run.smithi098.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 7.6 MB/s | 1.5 MB 00:00 2024-09-16T00:48:48.793 INFO:teuthology.orchestra.run.smithi012.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-09-16T00:48:48.843 INFO:teuthology.orchestra.run.smithi012.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-16T00:48:48.910 INFO:teuthology.orchestra.run.smithi012.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 917 kB/s | 689 kB 00:00 2024-09-16T00:48:48.960 INFO:teuthology.orchestra.run.smithi012.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-16T00:48:48.985 INFO:teuthology.orchestra.run.smithi012.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-09-16T00:48:49.044 INFO:teuthology.orchestra.run.smithi012.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-16T00:48:49.069 INFO:teuthology.orchestra.run.smithi012.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-09-16T00:48:49.095 INFO:teuthology.orchestra.run.smithi012.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-16T00:48:49.101 INFO:teuthology.orchestra.run.smithi119.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 9.5 MB/s | 21 MB 00:02 2024-09-16T00:48:49.145 INFO:teuthology.orchestra.run.smithi012.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 908 kB/s | 45 kB 00:00 2024-09-16T00:48:49.170 INFO:teuthology.orchestra.run.smithi012.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-16T00:48:49.193 INFO:teuthology.orchestra.run.smithi119.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 275 kB/s | 25 kB 00:00 2024-09-16T00:48:49.362 INFO:teuthology.orchestra.run.smithi012.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-09-16T00:48:49.421 INFO:teuthology.orchestra.run.smithi012.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-09-16T00:48:49.462 INFO:teuthology.orchestra.run.smithi012.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 244 kB/s | 24 kB 00:00 2024-09-16T00:48:49.468 INFO:teuthology.orchestra.run.smithi098.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 5.6 MB/s | 4.7 MB 00:00 2024-09-16T00:48:49.479 INFO:teuthology.orchestra.run.smithi012.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-16T00:48:49.555 INFO:teuthology.orchestra.run.smithi012.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-16T00:48:49.588 INFO:teuthology.orchestra.run.smithi012.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-16T00:48:49.605 INFO:teuthology.orchestra.run.smithi012.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-16T00:48:49.676 INFO:teuthology.orchestra.run.smithi119.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 11 MB/s | 11 MB 00:01 2024-09-16T00:48:49.760 INFO:teuthology.orchestra.run.smithi119.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 2.7 MB/s | 228 kB 00:00 2024-09-16T00:48:49.835 INFO:teuthology.orchestra.run.smithi119.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 360 kB/s | 27 kB 00:00 2024-09-16T00:48:49.872 INFO:teuthology.orchestra.run.smithi012.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-16T00:48:50.002 INFO:teuthology.orchestra.run.smithi119.stdout:(13/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 9.9 MB/s | 17 MB 00:01 2024-09-16T00:48:50.027 INFO:teuthology.orchestra.run.smithi119.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 165 kB/s | 32 kB 00:00 2024-09-16T00:48:50.094 INFO:teuthology.orchestra.run.smithi119.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-16T00:48:50.119 INFO:teuthology.orchestra.run.smithi119.stdout:(16/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 6.3 MB/s | 751 kB 00:00 2024-09-16T00:48:50.169 INFO:teuthology.orchestra.run.smithi119.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 1.6 MB/s | 127 kB 00:00 2024-09-16T00:48:50.195 INFO:teuthology.orchestra.run.smithi119.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 6.6 MB/s | 506 kB 00:00 2024-09-16T00:48:50.239 INFO:teuthology.orchestra.run.smithi012.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-09-16T00:48:50.262 INFO:teuthology.orchestra.run.smithi119.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 675 kB/s | 45 kB 00:00 2024-09-16T00:48:50.319 INFO:teuthology.orchestra.run.smithi098.stdout:(8/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86_ 10 MB/s | 17 MB 00:01 2024-09-16T00:48:50.320 INFO:teuthology.orchestra.run.smithi119.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.3 MB/s | 136 kB 00:00 2024-09-16T00:48:50.387 INFO:teuthology.orchestra.run.smithi119.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.4 MB/s | 161 kB 00:00 2024-09-16T00:48:50.439 INFO:teuthology.orchestra.run.smithi012.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-09-16T00:48:50.471 INFO:teuthology.orchestra.run.smithi119.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 3.8 MB/s | 320 kB 00:00 2024-09-16T00:48:50.498 INFO:teuthology.orchestra.run.smithi012.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-16T00:48:50.527 INFO:teuthology.orchestra.run.smithi098.stdout:(9/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 6.3 MB/s | 21 MB 00:03 2024-09-16T00:48:50.544 INFO:teuthology.orchestra.run.smithi098.stdout:(10/156): ceph-selinux-19.1.1-326.g8921c8ef.el9 112 kB/s | 25 kB 00:00 2024-09-16T00:48:50.546 INFO:teuthology.orchestra.run.smithi119.stdout:(23/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-16T00:48:50.571 INFO:teuthology.orchestra.run.smithi119.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 2.9 MB/s | 300 kB 00:00 2024-09-16T00:48:50.595 INFO:teuthology.orchestra.run.smithi098.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 4.4 MB/s | 228 kB 00:00 2024-09-16T00:48:50.596 INFO:teuthology.orchestra.run.smithi119.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-16T00:48:50.630 INFO:teuthology.orchestra.run.smithi119.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-16T00:48:50.636 INFO:teuthology.orchestra.run.smithi098.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 652 kB/s | 27 kB 00:00 2024-09-16T00:48:50.706 INFO:teuthology.orchestra.run.smithi119.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-09-16T00:48:50.720 INFO:teuthology.orchestra.run.smithi098.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 380 kB/s | 32 kB 00:00 2024-09-16T00:48:50.757 INFO:teuthology.orchestra.run.smithi012.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-16T00:48:50.773 INFO:teuthology.orchestra.run.smithi119.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 479 kB/s | 32 kB 00:00 2024-09-16T00:48:50.845 INFO:teuthology.orchestra.run.smithi098.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 5.9 MB/s | 751 kB 00:00 2024-09-16T00:48:50.856 INFO:teuthology.orchestra.run.smithi119.stdout:(29/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.7 MB/s | 146 kB 00:00 2024-09-16T00:48:50.906 INFO:teuthology.orchestra.run.smithi119.stdout:(30/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 10 MB/s | 3.1 MB 00:00 2024-09-16T00:48:50.982 INFO:teuthology.orchestra.run.smithi012.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-16T00:48:50.987 INFO:teuthology.orchestra.run.smithi098.stdout:(15/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 7.0 MB/s | 11 MB 00:01 2024-09-16T00:48:51.013 INFO:teuthology.orchestra.run.smithi098.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 977 kB/s | 163 kB 00:00 2024-09-16T00:48:51.057 INFO:teuthology.orchestra.run.smithi012.stdout:(72/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.4 MB/s | 4.9 MB 00:01 2024-09-16T00:48:51.091 INFO:teuthology.orchestra.run.smithi012.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 804 kB/s | 87 kB 00:00 2024-09-16T00:48:51.149 INFO:teuthology.orchestra.run.smithi012.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-16T00:48:51.173 INFO:teuthology.orchestra.run.smithi119.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 11 MB/s | 3.6 MB 00:00 2024-09-16T00:48:51.204 INFO:teuthology.orchestra.run.smithi098.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 585 kB/s | 127 kB 00:00 2024-09-16T00:48:51.233 INFO:teuthology.orchestra.run.smithi012.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-16T00:48:51.248 INFO:teuthology.orchestra.run.smithi119.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 3.3 MB/s | 249 kB 00:00 2024-09-16T00:48:51.288 INFO:teuthology.orchestra.run.smithi098.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 1.8 MB/s | 506 kB 00:00 2024-09-16T00:48:51.316 INFO:teuthology.orchestra.run.smithi012.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-16T00:48:51.332 INFO:teuthology.orchestra.run.smithi119.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 590 kB/s | 49 kB 00:00 2024-09-16T00:48:51.372 INFO:teuthology.orchestra.run.smithi098.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 539 kB/s | 45 kB 00:00 2024-09-16T00:48:51.375 INFO:teuthology.orchestra.run.smithi012.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-16T00:48:51.424 INFO:teuthology.orchestra.run.smithi119.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 179 kB/s | 16 kB 00:00 2024-09-16T00:48:51.425 INFO:teuthology.orchestra.run.smithi012.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-16T00:48:51.448 INFO:teuthology.orchestra.run.smithi098.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.8 MB/s | 136 kB 00:00 2024-09-16T00:48:51.517 INFO:teuthology.orchestra.run.smithi012.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-16T00:48:51.522 INFO:teuthology.orchestra.run.smithi098.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.1 MB/s | 161 kB 00:00 2024-09-16T00:48:51.550 INFO:teuthology.orchestra.run.smithi119.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-16T00:48:51.575 INFO:teuthology.orchestra.run.smithi119.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 285 kB 00:00 2024-09-16T00:48:51.576 INFO:teuthology.orchestra.run.smithi012.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-09-16T00:48:51.581 INFO:teuthology.orchestra.run.smithi098.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 5.4 MB/s | 320 kB 00:00 2024-09-16T00:48:51.642 INFO:teuthology.orchestra.run.smithi119.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 8.2 MB/s | 765 kB 00:00 2024-09-16T00:48:51.659 INFO:teuthology.orchestra.run.smithi119.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 218 kB/s | 18 kB 00:00 2024-09-16T00:48:51.665 INFO:teuthology.orchestra.run.smithi098.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 3.5 MB/s | 300 kB 00:00 2024-09-16T00:48:51.710 INFO:teuthology.orchestra.run.smithi012.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 4.8 MB/s | 5.8 MB 00:01 2024-09-16T00:48:51.715 INFO:teuthology.orchestra.run.smithi098.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-16T00:48:51.765 INFO:teuthology.orchestra.run.smithi098.stdout:(25/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-16T00:48:51.793 INFO:teuthology.orchestra.run.smithi012.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-16T00:48:51.841 INFO:teuthology.orchestra.run.smithi098.stdout:(26/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 8.4 MB/s | 5.3 MB 00:00 2024-09-16T00:48:51.891 INFO:teuthology.orchestra.run.smithi098.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-16T00:48:51.893 INFO:teuthology.orchestra.run.smithi012.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-16T00:48:51.942 INFO:teuthology.orchestra.run.smithi098.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 639 kB/s | 32 kB 00:00 2024-09-16T00:48:51.944 INFO:teuthology.orchestra.run.smithi012.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-16T00:48:51.994 INFO:teuthology.orchestra.run.smithi012.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-16T00:48:52.017 INFO:teuthology.orchestra.run.smithi098.stdout:(29/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-16T00:48:52.051 INFO:teuthology.orchestra.run.smithi098.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.3 MB/s | 146 kB 00:00 2024-09-16T00:48:52.076 INFO:teuthology.orchestra.run.smithi119.stdout:(39/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 17 MB/s | 49 MB 00:02 2024-09-16T00:48:52.077 INFO:teuthology.orchestra.run.smithi012.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-16T00:48:52.136 INFO:teuthology.orchestra.run.smithi012.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-16T00:48:52.193 INFO:teuthology.orchestra.run.smithi119.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 145 kB/s | 80 kB 00:00 2024-09-16T00:48:52.220 INFO:teuthology.orchestra.run.smithi012.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-16T00:48:52.242 INFO:teuthology.orchestra.run.smithi098.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 16 MB/s | 3.6 MB 00:00 2024-09-16T00:48:52.276 INFO:teuthology.orchestra.run.smithi119.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 956 kB/s | 191 kB 00:00 2024-09-16T00:48:52.293 INFO:teuthology.orchestra.run.smithi098.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 4.9 MB/s | 249 kB 00:00 2024-09-16T00:48:52.295 INFO:teuthology.orchestra.run.smithi012.stdout:(89/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-09-16T00:48:52.310 INFO:teuthology.orchestra.run.smithi119.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-16T00:48:52.320 INFO:teuthology.orchestra.run.smithi012.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 508 kB/s | 51 kB 00:00 2024-09-16T00:48:52.334 INFO:teuthology.orchestra.run.smithi098.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 1.2 MB/s | 49 kB 00:00 2024-09-16T00:48:52.345 INFO:teuthology.orchestra.run.smithi012.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-16T00:48:52.369 INFO:teuthology.orchestra.run.smithi119.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-16T00:48:52.377 INFO:teuthology.orchestra.run.smithi098.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 396 kB/s | 16 kB 00:00 2024-09-16T00:48:52.394 INFO:teuthology.orchestra.run.smithi119.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-16T00:48:52.396 INFO:teuthology.orchestra.run.smithi012.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-16T00:48:52.428 INFO:teuthology.orchestra.run.smithi119.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-16T00:48:52.435 INFO:teuthology.orchestra.run.smithi098.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.8 MB/s | 285 kB 00:00 2024-09-16T00:48:52.461 INFO:teuthology.orchestra.run.smithi119.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-16T00:48:52.486 INFO:teuthology.orchestra.run.smithi119.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-16T00:48:52.504 INFO:teuthology.orchestra.run.smithi012.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-09-16T00:48:52.520 INFO:teuthology.orchestra.run.smithi119.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-09-16T00:48:52.527 INFO:teuthology.orchestra.run.smithi098.stdout:(36/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 8.2 MB/s | 765 kB 00:00 2024-09-16T00:48:52.529 INFO:teuthology.orchestra.run.smithi012.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 331 kB/s | 44 kB 00:00 2024-09-16T00:48:52.563 INFO:teuthology.orchestra.run.smithi012.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-16T00:48:52.569 INFO:teuthology.orchestra.run.smithi098.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 438 kB/s | 18 kB 00:00 2024-09-16T00:48:52.588 INFO:teuthology.orchestra.run.smithi012.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-16T00:48:52.614 INFO:teuthology.orchestra.run.smithi012.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-16T00:48:52.620 INFO:teuthology.orchestra.run.smithi119.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-16T00:48:52.645 INFO:teuthology.orchestra.run.smithi119.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-16T00:48:52.664 INFO:teuthology.orchestra.run.smithi012.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-16T00:48:52.671 INFO:teuthology.orchestra.run.smithi119.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-16T00:48:52.689 INFO:teuthology.orchestra.run.smithi012.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-16T00:48:52.696 INFO:teuthology.orchestra.run.smithi119.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-16T00:48:52.711 INFO:teuthology.orchestra.run.smithi098.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-16T00:48:52.714 INFO:teuthology.orchestra.run.smithi012.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-16T00:48:52.730 INFO:teuthology.orchestra.run.smithi119.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-16T00:48:52.740 INFO:teuthology.orchestra.run.smithi012.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T00:48:52.755 INFO:teuthology.orchestra.run.smithi119.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-16T00:48:52.765 INFO:teuthology.orchestra.run.smithi012.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-16T00:48:52.805 INFO:teuthology.orchestra.run.smithi119.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-16T00:48:52.820 INFO:teuthology.orchestra.run.smithi098.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 319 kB/s | 80 kB 00:00 2024-09-16T00:48:52.846 INFO:teuthology.orchestra.run.smithi119.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 122 kB/s | 11 kB 00:00 2024-09-16T00:48:52.865 INFO:teuthology.orchestra.run.smithi012.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-16T00:48:52.872 INFO:teuthology.orchestra.run.smithi119.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-16T00:48:52.898 INFO:teuthology.orchestra.run.smithi119.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 889 kB/s | 45 kB 00:00 2024-09-16T00:48:52.903 INFO:teuthology.orchestra.run.smithi098.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-16T00:48:52.915 INFO:teuthology.orchestra.run.smithi012.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-16T00:48:52.950 INFO:teuthology.orchestra.run.smithi012.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-16T00:48:52.956 INFO:teuthology.orchestra.run.smithi119.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-09-16T00:48:52.966 INFO:teuthology.orchestra.run.smithi012.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-16T00:48:52.970 INFO:teuthology.orchestra.run.smithi098.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-16T00:48:52.996 INFO:teuthology.orchestra.run.smithi098.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-16T00:48:53.015 INFO:teuthology.orchestra.run.smithi119.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.4 MB/s | 3.0 MB 00:00 2024-09-16T00:48:53.040 INFO:teuthology.orchestra.run.smithi119.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-16T00:48:53.046 INFO:teuthology.orchestra.run.smithi098.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-16T00:48:53.065 INFO:teuthology.orchestra.run.smithi119.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-16T00:48:53.083 INFO:teuthology.orchestra.run.smithi012.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-16T00:48:53.084 INFO:teuthology.orchestra.run.smithi098.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-16T00:48:53.099 INFO:teuthology.orchestra.run.smithi119.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-16T00:48:53.100 INFO:teuthology.orchestra.run.smithi012.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-16T00:48:53.109 INFO:teuthology.orchestra.run.smithi098.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 135 kB 00:00 2024-09-16T00:48:53.132 INFO:teuthology.orchestra.run.smithi119.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.4 MB/s | 581 kB 00:00 2024-09-16T00:48:53.134 INFO:teuthology.orchestra.run.smithi012.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-16T00:48:53.158 INFO:teuthology.orchestra.run.smithi119.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-16T00:48:53.159 INFO:teuthology.orchestra.run.smithi098.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-16T00:48:53.167 INFO:teuthology.orchestra.run.smithi012.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 725 kB/s | 49 kB 00:00 2024-09-16T00:48:53.183 INFO:teuthology.orchestra.run.smithi119.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-16T00:48:53.184 INFO:teuthology.orchestra.run.smithi098.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-16T00:48:53.201 INFO:teuthology.orchestra.run.smithi012.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-16T00:48:53.234 INFO:teuthology.orchestra.run.smithi012.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 673 kB/s | 67 kB 00:00 2024-09-16T00:48:53.277 INFO:teuthology.orchestra.run.smithi012.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-16T00:48:53.300 INFO:teuthology.orchestra.run.smithi119.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-16T00:48:53.310 INFO:teuthology.orchestra.run.smithi012.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-16T00:48:53.336 INFO:teuthology.orchestra.run.smithi012.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 743 kB/s | 43 kB 00:00 2024-09-16T00:48:53.342 INFO:teuthology.orchestra.run.smithi119.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-16T00:48:53.360 INFO:teuthology.orchestra.run.smithi012.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-16T00:48:53.376 INFO:teuthology.orchestra.run.smithi119.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-16T00:48:53.376 INFO:teuthology.orchestra.run.smithi098.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-16T00:48:53.387 INFO:teuthology.orchestra.run.smithi012.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-16T00:48:53.401 INFO:teuthology.orchestra.run.smithi119.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-16T00:48:53.411 INFO:teuthology.orchestra.run.smithi012.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-16T00:48:53.418 INFO:teuthology.orchestra.run.smithi098.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-16T00:48:53.444 INFO:teuthology.orchestra.run.smithi098.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-16T00:48:53.445 INFO:teuthology.orchestra.run.smithi012.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-16T00:48:53.459 INFO:teuthology.orchestra.run.smithi119.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 15 MB/s | 4.9 MB 00:00 2024-09-16T00:48:53.460 INFO:teuthology.orchestra.run.smithi098.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 517 kB/s | 22 kB 00:00 2024-09-16T00:48:53.470 INFO:teuthology.orchestra.run.smithi012.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-16T00:48:53.495 INFO:teuthology.orchestra.run.smithi012.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-16T00:48:53.501 INFO:teuthology.orchestra.run.smithi119.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-16T00:48:53.526 INFO:teuthology.orchestra.run.smithi119.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-16T00:48:53.529 INFO:teuthology.orchestra.run.smithi012.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-16T00:48:53.554 INFO:teuthology.orchestra.run.smithi012.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-16T00:48:53.569 INFO:teuthology.orchestra.run.smithi119.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-16T00:48:53.579 INFO:teuthology.orchestra.run.smithi012.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2024-09-16T00:48:53.605 INFO:teuthology.orchestra.run.smithi012.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-16T00:48:53.630 INFO:teuthology.orchestra.run.smithi012.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-09-16T00:48:53.644 INFO:teuthology.orchestra.run.smithi119.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-16T00:48:53.655 INFO:teuthology.orchestra.run.smithi012.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-16T00:48:53.670 INFO:teuthology.orchestra.run.smithi119.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-16T00:48:53.695 INFO:teuthology.orchestra.run.smithi119.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-16T00:48:53.706 INFO:teuthology.orchestra.run.smithi012.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-09-16T00:48:53.720 INFO:teuthology.orchestra.run.smithi119.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-16T00:48:53.731 INFO:teuthology.orchestra.run.smithi012.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T00:48:53.745 INFO:teuthology.orchestra.run.smithi119.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-16T00:48:53.756 INFO:teuthology.orchestra.run.smithi012.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T00:48:53.770 INFO:teuthology.orchestra.run.smithi119.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-16T00:48:53.795 INFO:teuthology.orchestra.run.smithi119.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-16T00:48:53.806 INFO:teuthology.orchestra.run.smithi012.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-09-16T00:48:53.832 INFO:teuthology.orchestra.run.smithi012.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-09-16T00:48:53.866 INFO:teuthology.orchestra.run.smithi012.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 492 kB/s | 16 kB 00:00 2024-09-16T00:48:53.879 INFO:teuthology.orchestra.run.smithi119.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-16T00:48:53.890 INFO:teuthology.orchestra.run.smithi012.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-16T00:48:53.903 INFO:teuthology.orchestra.run.smithi098.stdout:(52/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 14 MB/s | 49 MB 00:03 2024-09-16T00:48:53.904 INFO:teuthology.orchestra.run.smithi119.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-16T00:48:53.916 INFO:teuthology.orchestra.run.smithi012.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-16T00:48:53.920 INFO:teuthology.orchestra.run.smithi098.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 71 kB/s | 33 kB 00:00 2024-09-16T00:48:53.929 INFO:teuthology.orchestra.run.smithi119.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-16T00:48:53.941 INFO:teuthology.orchestra.run.smithi012.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-16T00:48:53.945 INFO:teuthology.orchestra.run.smithi098.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 626 kB/s | 313 kB 00:00 2024-09-16T00:48:53.955 INFO:teuthology.orchestra.run.smithi119.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-16T00:48:53.967 INFO:teuthology.orchestra.run.smithi012.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-16T00:48:53.970 INFO:teuthology.orchestra.run.smithi098.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-16T00:48:53.971 INFO:teuthology.orchestra.run.smithi119.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-16T00:48:53.992 INFO:teuthology.orchestra.run.smithi012.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T00:48:53.995 INFO:teuthology.orchestra.run.smithi098.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-16T00:48:53.997 INFO:teuthology.orchestra.run.smithi119.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-16T00:48:54.017 INFO:teuthology.orchestra.run.smithi012.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-16T00:48:54.022 INFO:teuthology.orchestra.run.smithi119.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-16T00:48:54.029 INFO:teuthology.orchestra.run.smithi098.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-16T00:48:54.042 INFO:teuthology.orchestra.run.smithi012.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-16T00:48:54.048 INFO:teuthology.orchestra.run.smithi119.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-16T00:48:54.054 INFO:teuthology.orchestra.run.smithi098.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-16T00:48:54.072 INFO:teuthology.orchestra.run.smithi119.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-16T00:48:54.076 INFO:teuthology.orchestra.run.smithi012.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.2 MB/s | 74 kB 00:00 2024-09-16T00:48:54.089 INFO:teuthology.orchestra.run.smithi119.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-16T00:48:54.096 INFO:teuthology.orchestra.run.smithi098.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-16T00:48:54.109 INFO:teuthology.orchestra.run.smithi012.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-16T00:48:54.121 INFO:teuthology.orchestra.run.smithi098.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-16T00:48:54.135 INFO:teuthology.orchestra.run.smithi012.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-16T00:48:54.147 INFO:teuthology.orchestra.run.smithi098.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-16T00:48:54.156 INFO:teuthology.orchestra.run.smithi119.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-16T00:48:54.160 INFO:teuthology.orchestra.run.smithi012.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-16T00:48:54.172 INFO:teuthology.orchestra.run.smithi098.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-16T00:48:54.173 INFO:teuthology.orchestra.run.smithi119.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-09-16T00:48:54.185 INFO:teuthology.orchestra.run.smithi012.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-16T00:48:54.190 INFO:teuthology.orchestra.run.smithi119.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-16T00:48:54.197 INFO:teuthology.orchestra.run.smithi098.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-16T00:48:54.211 INFO:teuthology.orchestra.run.smithi012.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-16T00:48:54.223 INFO:teuthology.orchestra.run.smithi098.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-16T00:48:54.224 INFO:teuthology.orchestra.run.smithi119.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-16T00:48:54.248 INFO:teuthology.orchestra.run.smithi098.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 760 kB/s | 38 kB 00:00 2024-09-16T00:48:54.249 INFO:teuthology.orchestra.run.smithi119.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-16T00:48:54.262 INFO:teuthology.orchestra.run.smithi012.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-16T00:48:54.274 INFO:teuthology.orchestra.run.smithi119.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-16T00:48:54.307 INFO:teuthology.orchestra.run.smithi098.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-09-16T00:48:54.308 INFO:teuthology.orchestra.run.smithi119.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-16T00:48:54.333 INFO:teuthology.orchestra.run.smithi119.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-09-16T00:48:54.359 INFO:teuthology.orchestra.run.smithi119.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-16T00:48:54.391 INFO:teuthology.orchestra.run.smithi098.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-16T00:48:54.392 INFO:teuthology.orchestra.run.smithi119.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-16T00:48:54.418 INFO:teuthology.orchestra.run.smithi119.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 763 kB/s | 45 kB 00:00 2024-09-16T00:48:54.466 INFO:teuthology.orchestra.run.smithi098.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-16T00:48:54.499 INFO:teuthology.orchestra.run.smithi098.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-16T00:48:54.501 INFO:teuthology.orchestra.run.smithi119.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-16T00:48:54.503 INFO:teuthology.orchestra.run.smithi012.stdout:(148/156): librados2-19.1.1-326.g8921c8ef.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-16T00:48:54.525 INFO:teuthology.orchestra.run.smithi098.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-16T00:48:54.570 INFO:teuthology.orchestra.run.smithi012.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-16T00:48:54.592 INFO:teuthology.orchestra.run.smithi098.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-16T00:48:54.625 INFO:teuthology.orchestra.run.smithi098.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-16T00:48:54.651 INFO:teuthology.orchestra.run.smithi098.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-16T00:48:54.668 INFO:teuthology.orchestra.run.smithi119.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-16T00:48:54.693 INFO:teuthology.orchestra.run.smithi098.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-16T00:48:54.710 INFO:teuthology.orchestra.run.smithi119.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.6 MB/s | 548 kB 00:00 2024-09-16T00:48:54.736 INFO:teuthology.orchestra.run.smithi119.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 838 kB/s | 19 kB 00:00 2024-09-16T00:48:54.768 INFO:teuthology.orchestra.run.smithi098.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-16T00:48:54.769 INFO:teuthology.orchestra.run.smithi119.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-16T00:48:54.793 INFO:teuthology.orchestra.run.smithi098.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-16T00:48:54.802 INFO:teuthology.orchestra.run.smithi119.stdout:(108/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.3 MB/s | 308 kB 00:00 2024-09-16T00:48:54.818 INFO:teuthology.orchestra.run.smithi098.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-16T00:48:54.835 INFO:teuthology.orchestra.run.smithi098.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 611 kB/s | 26 kB 00:00 2024-09-16T00:48:54.836 INFO:teuthology.orchestra.run.smithi119.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-16T00:48:54.852 INFO:teuthology.orchestra.run.smithi098.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 570 kB/s | 19 kB 00:00 2024-09-16T00:48:54.861 INFO:teuthology.orchestra.run.smithi119.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 282 kB/s | 26 kB 00:00 2024-09-16T00:48:54.878 INFO:teuthology.orchestra.run.smithi098.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-16T00:48:54.886 INFO:teuthology.orchestra.run.smithi119.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T00:48:54.894 INFO:teuthology.orchestra.run.smithi098.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 833 kB/s | 35 kB 00:00 2024-09-16T00:48:54.920 INFO:teuthology.orchestra.run.smithi119.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-16T00:48:54.970 INFO:teuthology.orchestra.run.smithi098.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-16T00:48:54.971 INFO:teuthology.orchestra.run.smithi119.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-16T00:48:54.995 INFO:teuthology.orchestra.run.smithi098.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-16T00:48:54.996 INFO:teuthology.orchestra.run.smithi119.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-16T00:48:55.021 INFO:teuthology.orchestra.run.smithi098.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-16T00:48:55.021 INFO:teuthology.orchestra.run.smithi119.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 865 kB/s | 43 kB 00:00 2024-09-16T00:48:55.046 INFO:teuthology.orchestra.run.smithi098.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-16T00:48:55.046 INFO:teuthology.orchestra.run.smithi119.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 639 kB/s | 32 kB 00:00 2024-09-16T00:48:55.063 INFO:teuthology.orchestra.run.smithi098.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-16T00:48:55.072 INFO:teuthology.orchestra.run.smithi119.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-16T00:48:55.088 INFO:teuthology.orchestra.run.smithi098.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-16T00:48:55.095 INFO:teuthology.orchestra.run.smithi012.stdout:(150/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.9 MB/s | 16 MB 00:02 2024-09-16T00:48:55.097 INFO:teuthology.orchestra.run.smithi119.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-16T00:48:55.113 INFO:teuthology.orchestra.run.smithi098.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-16T00:48:55.122 INFO:teuthology.orchestra.run.smithi119.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-16T00:48:55.137 INFO:teuthology.orchestra.run.smithi012.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 3.2 MB/s | 1.8 MB 00:00 2024-09-16T00:48:55.147 INFO:teuthology.orchestra.run.smithi098.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-16T00:48:55.147 INFO:teuthology.orchestra.run.smithi119.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-16T00:48:55.172 INFO:teuthology.orchestra.run.smithi098.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-16T00:48:55.195 INFO:teuthology.orchestra.run.smithi012.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 408 kB/s | 41 kB 00:00 2024-09-16T00:48:55.197 INFO:teuthology.orchestra.run.smithi098.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-16T00:48:55.214 INFO:teuthology.orchestra.run.smithi119.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-09-16T00:48:55.240 INFO:teuthology.orchestra.run.smithi119.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-16T00:48:55.246 INFO:teuthology.orchestra.run.smithi012.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.2 MB/s | 249 kB 00:00 2024-09-16T00:48:55.265 INFO:teuthology.orchestra.run.smithi119.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-16T00:48:55.284 INFO:teuthology.orchestra.run.smithi098.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-16T00:48:55.291 INFO:teuthology.orchestra.run.smithi119.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-16T00:48:55.306 INFO:teuthology.orchestra.run.smithi098.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-16T00:48:55.315 INFO:teuthology.orchestra.run.smithi119.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-16T00:48:55.321 INFO:teuthology.orchestra.run.smithi012.stdout:(154/156): NetworkManager-1.49.90-1.el9.x86_64. 2.8 MB/s | 2.3 MB 00:00 2024-09-16T00:48:55.340 INFO:teuthology.orchestra.run.smithi098.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 755 kB/s | 44 kB 00:00 2024-09-16T00:48:55.341 INFO:teuthology.orchestra.run.smithi119.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-16T00:48:55.366 INFO:teuthology.orchestra.run.smithi098.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-16T00:48:55.366 INFO:teuthology.orchestra.run.smithi119.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-16T00:48:55.391 INFO:teuthology.orchestra.run.smithi098.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-16T00:48:55.391 INFO:teuthology.orchestra.run.smithi119.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-16T00:48:55.417 INFO:teuthology.orchestra.run.smithi119.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T00:48:55.417 INFO:teuthology.orchestra.run.smithi098.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-16T00:48:55.441 INFO:teuthology.orchestra.run.smithi098.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-16T00:48:55.442 INFO:teuthology.orchestra.run.smithi119.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T00:48:55.463 INFO:teuthology.orchestra.run.smithi012.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.1 MB/s | 1.4 MB 00:00 2024-09-16T00:48:55.466 INFO:teuthology.orchestra.run.smithi098.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-16T00:48:55.467 INFO:teuthology.orchestra.run.smithi119.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-16T00:48:55.492 INFO:teuthology.orchestra.run.smithi098.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-16T00:48:55.492 INFO:teuthology.orchestra.run.smithi119.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-16T00:48:55.517 INFO:teuthology.orchestra.run.smithi098.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T00:48:55.526 INFO:teuthology.orchestra.run.smithi119.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-16T00:48:55.543 INFO:teuthology.orchestra.run.smithi098.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 888 kB/s | 45 kB 00:00 2024-09-16T00:48:55.551 INFO:teuthology.orchestra.run.smithi119.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-16T00:48:55.577 INFO:teuthology.orchestra.run.smithi119.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-16T00:48:55.602 INFO:teuthology.orchestra.run.smithi119.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-16T00:48:55.618 INFO:teuthology.orchestra.run.smithi098.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-16T00:48:55.627 INFO:teuthology.orchestra.run.smithi119.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-16T00:48:55.653 INFO:teuthology.orchestra.run.smithi119.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T00:48:55.668 INFO:teuthology.orchestra.run.smithi098.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-16T00:48:55.678 INFO:teuthology.orchestra.run.smithi119.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-16T00:48:55.703 INFO:teuthology.orchestra.run.smithi119.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-16T00:48:55.720 INFO:teuthology.orchestra.run.smithi119.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-16T00:48:55.746 INFO:teuthology.orchestra.run.smithi119.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-16T00:48:55.787 INFO:teuthology.orchestra.run.smithi119.stdout:(143/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-16T00:48:55.796 INFO:teuthology.orchestra.run.smithi012.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 2.4 MB 00:00 2024-09-16T00:48:55.802 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:48:55.802 INFO:teuthology.orchestra.run.smithi012.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-16T00:48:55.812 INFO:teuthology.orchestra.run.smithi119.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-16T00:48:55.844 INFO:teuthology.orchestra.run.smithi098.stdout:(105/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-16T00:48:55.855 INFO:teuthology.orchestra.run.smithi119.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 297 kB/s | 20 kB 00:00 2024-09-16T00:48:55.877 INFO:teuthology.orchestra.run.smithi098.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 1.4 MB/s | 308 kB 00:00 2024-09-16T00:48:55.880 INFO:teuthology.orchestra.run.smithi119.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-16T00:48:55.905 INFO:teuthology.orchestra.run.smithi119.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-16T00:48:55.919 INFO:teuthology.orchestra.run.smithi098.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-16T00:48:55.945 INFO:teuthology.orchestra.run.smithi098.stdout:(108/156): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-09-16T00:48:55.947 INFO:teuthology.orchestra.run.smithi119.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-16T00:48:55.978 INFO:teuthology.orchestra.run.smithi098.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.8 MB/s | 49 kB 00:00 2024-09-16T00:48:56.003 INFO:teuthology.orchestra.run.smithi098.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-16T00:48:56.020 INFO:teuthology.orchestra.run.smithi098.stdout:(111/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 258 kB/s | 26 kB 00:00 2024-09-16T00:48:56.046 INFO:teuthology.orchestra.run.smithi098.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-16T00:48:56.088 INFO:teuthology.orchestra.run.smithi098.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-16T00:48:56.104 INFO:teuthology.orchestra.run.smithi098.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-16T00:48:56.122 INFO:teuthology.orchestra.run.smithi098.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-16T00:48:56.138 INFO:teuthology.orchestra.run.smithi098.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 858 kB/s | 14 kB 00:00 2024-09-16T00:48:56.147 INFO:teuthology.orchestra.run.smithi119.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-16T00:48:56.172 INFO:teuthology.orchestra.run.smithi098.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-16T00:48:56.197 INFO:teuthology.orchestra.run.smithi098.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 839 kB 00:00 2024-09-16T00:48:56.206 INFO:teuthology.orchestra.run.smithi119.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-16T00:48:56.239 INFO:teuthology.orchestra.run.smithi098.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-16T00:48:56.265 INFO:teuthology.orchestra.run.smithi098.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-16T00:48:56.290 INFO:teuthology.orchestra.run.smithi098.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.2 MB/s | 220 kB 00:00 2024-09-16T00:48:56.316 INFO:teuthology.orchestra.run.smithi098.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-16T00:48:56.323 INFO:teuthology.orchestra.run.smithi119.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 349 kB/s | 41 kB 00:00 2024-09-16T00:48:56.333 INFO:teuthology.orchestra.run.smithi098.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-09-16T00:48:56.350 INFO:teuthology.orchestra.run.smithi098.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-16T00:48:56.366 INFO:teuthology.orchestra.run.smithi098.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-16T00:48:56.425 INFO:teuthology.orchestra.run.smithi098.stdout:(126/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2024-09-16T00:48:56.448 INFO:teuthology.orchestra.run.smithi119.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 1.9 MB/s | 249 kB 00:00 2024-09-16T00:48:56.450 INFO:teuthology.orchestra.run.smithi098.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-09-16T00:48:56.476 INFO:teuthology.orchestra.run.smithi098.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-16T00:48:56.490 INFO:teuthology.orchestra.run.smithi119.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 4.3 MB/s | 2.3 MB 00:00 2024-09-16T00:48:56.501 INFO:teuthology.orchestra.run.smithi098.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T00:48:56.535 INFO:teuthology.orchestra.run.smithi098.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-16T00:48:56.560 INFO:teuthology.orchestra.run.smithi098.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-16T00:48:56.594 INFO:teuthology.orchestra.run.smithi098.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-16T00:48:56.607 INFO:teuthology.orchestra.run.smithi119.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 3.9 MB/s | 1.8 MB 00:00 2024-09-16T00:48:56.627 INFO:teuthology.orchestra.run.smithi098.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-16T00:48:56.653 INFO:teuthology.orchestra.run.smithi098.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2024-09-16T00:48:56.678 INFO:teuthology.orchestra.run.smithi098.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-16T00:48:56.729 INFO:teuthology.orchestra.run.smithi098.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 895 kB/s | 90 kB 00:00 2024-09-16T00:48:56.749 INFO:teuthology.orchestra.run.smithi119.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-16T00:48:56.754 INFO:teuthology.orchestra.run.smithi098.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-16T00:48:56.804 INFO:teuthology.orchestra.run.smithi098.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-16T00:48:56.829 INFO:teuthology.orchestra.run.smithi098.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 787 kB/s | 59 kB 00:00 2024-09-16T00:48:56.854 INFO:teuthology.orchestra.run.smithi098.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-16T00:48:56.857 INFO:teuthology.orchestra.run.smithi119.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 2.4 MB 00:00 2024-09-16T00:48:56.863 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:48:56.863 INFO:teuthology.orchestra.run.smithi119.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-16T00:48:56.880 INFO:teuthology.orchestra.run.smithi098.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-16T00:48:56.905 INFO:teuthology.orchestra.run.smithi098.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-16T00:48:56.930 INFO:teuthology.orchestra.run.smithi098.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-16T00:48:56.956 INFO:teuthology.orchestra.run.smithi098.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-09-16T00:48:56.981 INFO:teuthology.orchestra.run.smithi098.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-16T00:48:57.006 INFO:teuthology.orchestra.run.smithi098.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-16T00:48:57.032 INFO:teuthology.orchestra.run.smithi098.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-16T00:48:57.032 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-16T00:48:57.084 INFO:teuthology.orchestra.run.smithi098.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-16T00:48:57.202 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-16T00:48:57.202 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-16T00:48:57.299 INFO:teuthology.orchestra.run.smithi098.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-16T00:48:57.366 INFO:teuthology.orchestra.run.smithi098.stdout:(150/156): librados2-19.1.1-326.g8921c8ef.el9.x 9.5 MB/s | 3.4 MB 00:00 2024-09-16T00:48:57.416 INFO:teuthology.orchestra.run.smithi098.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 6.9 MB/s | 2.3 MB 00:00 2024-09-16T00:48:57.475 INFO:teuthology.orchestra.run.smithi098.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-16T00:48:57.525 INFO:teuthology.orchestra.run.smithi098.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 257 kB/s | 41 kB 00:00 2024-09-16T00:48:57.567 INFO:teuthology.orchestra.run.smithi098.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 6.7 MB/s | 1.8 MB 00:00 2024-09-16T00:48:57.601 INFO:teuthology.orchestra.run.smithi098.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-16T00:48:57.759 INFO:teuthology.orchestra.run.smithi098.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-09-16T00:48:57.765 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:48:57.765 INFO:teuthology.orchestra.run.smithi098.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-16T00:48:58.072 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-16T00:48:58.220 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-16T00:48:58.220 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-16T00:48:59.003 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-16T00:48:59.153 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-16T00:48:59.153 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-16T00:48:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-16T00:48:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-16T00:49:00.018 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-16T00:49:00.019 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-16T00:49:00.963 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-16T00:49:00.964 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-16T00:49:06.139 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-16T00:49:06.250 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T00:49:06.291 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T00:49:06.357 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T00:49:06.392 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T00:49:06.418 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T00:49:06.475 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T00:49:06.683 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-16T00:49:06.795 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T00:49:06.833 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T00:49:06.840 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T00:49:06.885 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T00:49:06.928 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T00:49:06.952 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:49:06.954 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T00:49:06.996 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T00:49:07.077 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:49:07.103 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:49:07.195 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:49:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-16T00:49:07.234 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:49:07.318 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T00:49:07.330 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T00:49:07.368 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T00:49:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T00:49:07.430 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:49:07.433 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T00:49:07.464 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T00:49:07.480 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T00:49:07.490 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T00:49:07.507 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:49:07.552 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:49:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T00:49:07.581 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:49:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:49:07.641 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:49:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:49:07.702 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:49:07.703 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:49:07.725 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:49:07.755 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:49:07.855 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T00:49:07.915 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T00:49:07.943 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:49:07.955 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:49:07.972 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T00:49:08.047 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:49:08.069 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:49:08.083 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:49:08.109 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:49:08.132 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:49:08.154 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:49:08.173 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:49:08.204 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:49:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T00:49:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:49:08.355 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:49:08.363 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:49:08.495 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:49:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T00:49:08.560 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T00:49:08.588 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:49:08.627 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T00:49:08.657 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:49:08.691 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:49:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:49:08.744 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:49:08.767 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T00:49:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:49:08.799 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:49:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:49:08.828 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:49:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T00:49:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T00:49:08.932 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T00:49:09.008 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T00:49:09.059 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T00:49:09.062 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:49:09.098 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T00:49:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T00:49:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T00:49:09.178 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T00:49:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T00:49:09.273 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T00:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T00:49:09.302 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:49:09.317 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T00:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T00:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T00:49:09.360 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T00:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T00:49:09.433 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T00:49:09.465 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T00:49:09.486 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T00:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T00:49:09.518 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T00:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T00:49:09.562 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T00:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T00:49:09.602 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T00:49:09.614 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T00:49:09.630 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T00:49:09.656 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T00:49:09.702 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T00:49:09.704 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T00:49:09.710 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:49:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T00:49:09.781 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T00:49:09.782 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:49:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T00:49:09.838 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T00:49:09.914 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T00:49:09.926 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T00:49:09.949 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T00:49:09.983 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T00:49:09.992 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T00:49:10.007 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:49:10.029 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T00:49:10.101 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T00:49:10.113 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T00:49:10.144 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T00:49:10.218 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T00:49:10.226 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T00:49:10.246 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T00:49:10.281 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T00:49:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T00:49:10.369 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T00:49:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T00:49:10.421 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T00:49:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T00:49:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T00:49:10.535 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T00:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T00:49:10.563 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T00:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T00:49:10.633 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T00:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T00:49:10.686 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T00:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T00:49:10.716 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T00:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T00:49:10.751 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T00:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T00:49:10.836 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T00:49:10.871 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T00:49:10.914 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T00:49:10.943 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T00:49:10.943 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T00:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T00:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T00:49:11.012 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T00:49:11.025 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T00:49:11.055 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T00:49:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T00:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T00:49:11.097 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T00:49:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T00:49:11.135 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T00:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T00:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T00:49:11.177 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T00:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T00:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T00:49:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T00:49:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T00:49:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T00:49:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T00:49:11.343 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T00:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T00:49:11.397 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T00:49:11.459 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T00:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T00:49:11.541 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T00:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T00:49:11.572 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T00:49:11.611 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T00:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T00:49:11.658 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T00:49:11.694 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T00:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T00:49:11.737 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T00:49:11.779 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T00:49:11.851 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T00:49:11.914 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T00:49:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T00:49:11.964 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T00:49:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T00:49:12.013 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T00:49:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T00:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T00:49:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T00:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T00:49:12.108 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T00:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T00:49:12.124 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T00:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T00:49:12.155 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T00:49:12.195 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T00:49:12.221 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T00:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T00:49:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T00:49:12.327 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T00:49:12.382 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T00:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T00:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T00:49:12.446 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T00:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T00:49:12.468 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T00:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T00:49:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T00:49:12.528 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T00:49:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T00:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T00:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T00:49:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T00:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T00:49:12.620 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T00:49:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T00:49:12.658 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T00:49:12.663 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T00:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T00:49:12.705 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T00:49:12.720 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T00:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T00:49:12.748 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T00:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T00:49:12.782 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T00:49:12.821 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T00:49:12.839 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T00:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T00:49:12.852 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T00:49:12.890 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T00:49:12.891 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T00:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T00:49:12.926 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T00:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T00:49:12.931 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T00:49:12.959 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T00:49:13.001 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T00:49:13.035 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T00:49:13.035 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T00:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T00:49:13.065 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T00:49:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T00:49:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T00:49:13.121 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T00:49:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T00:49:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T00:49:13.165 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T00:49:13.196 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T00:49:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T00:49:13.306 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T00:49:13.364 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T00:49:13.516 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T00:49:13.555 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T00:49:13.583 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T00:49:13.617 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T00:49:13.657 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T00:49:13.688 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T00:49:13.718 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T00:49:13.752 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T00:49:13.786 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T00:49:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T00:49:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T00:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T00:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T00:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T00:49:13.948 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T00:49:13.992 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T00:49:14.032 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T00:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T00:49:14.078 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T00:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T00:49:14.128 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T00:49:14.135 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T00:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T00:49:14.161 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T00:49:14.183 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T00:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T00:49:14.263 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T00:49:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T00:49:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T00:49:14.450 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T00:49:14.481 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T00:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T00:49:14.664 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T00:49:14.695 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T00:49:14.772 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T00:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T00:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T00:49:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T00:49:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T00:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T00:49:14.989 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T00:49:15.088 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T00:49:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T00:49:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T00:49:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T00:49:15.309 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T00:49:15.411 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T00:49:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T00:49:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T00:49:15.526 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T00:49:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T00:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T00:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T00:49:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T00:49:16.363 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T00:49:16.726 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T00:49:16.798 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T00:49:16.826 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T00:49:16.859 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T00:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T00:49:17.168 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T00:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T00:49:17.217 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T00:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T00:49:17.297 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:49:17.327 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T00:49:17.363 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T00:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T00:49:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T00:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:49:17.694 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T00:49:17.722 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T00:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T00:49:17.755 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T00:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T00:49:17.841 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T00:49:17.945 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:49:18.064 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:49:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T00:49:18.102 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T00:49:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:49:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:49:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T00:49:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T00:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T00:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T00:49:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T00:49:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:49:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:49:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T00:49:20.424 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:49:20.465 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:49:20.735 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:49:20.767 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:49:21.007 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:49:21.052 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:49:21.144 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:49:21.145 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T00:49:21.145 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T00:49:21.145 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:21.178 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:49:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:49:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:49:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:49:21.387 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:49:21.470 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:49:21.470 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T00:49:21.471 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T00:49:21.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:21.505 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:49:21.810 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:49:21.871 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:49:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:49:21.963 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T00:49:21.963 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T00:49:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:49:32.979 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:49:32.979 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-09-16T00:49:32.980 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-09-16T00:49:32.980 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-09-16T00:49:32.980 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-09-16T00:49:32.980 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-09-16T00:49:32.980 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2024-09-16T00:49:32.980 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-09-16T00:49:32.980 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:33.154 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:49:33.170 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:49:33.171 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:33.171 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T00:49:33.171 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:49:33.750 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-09-16T00:49:33.750 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-09-16T00:49:33.750 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-09-16T00:49:33.750 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-09-16T00:49:33.750 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-09-16T00:49:33.750 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-09-16T00:49:33.750 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-09-16T00:49:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:49:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:49:33.953 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:33.953 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T00:49:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:49:34.265 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-16T00:49:34.265 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-16T00:49:34.265 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-16T00:49:34.266 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-16T00:49:34.266 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-16T00:49:34.266 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-16T00:49:34.266 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-16T00:49:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:34.438 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:49:34.455 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:49:34.455 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:34.455 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T00:49:34.456 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:34.640 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:49:34.667 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:49:34.668 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:34.668 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T00:49:34.668 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:49:34.668 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:49:34.668 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:34.917 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:49:34.940 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:49:34.940 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:34.940 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T00:49:34.940 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:49:34.940 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:49:34.941 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:35.385 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:49:35.409 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:49:35.409 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:35.409 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T00:49:35.409 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:49:35.409 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:49:35.409 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:35.493 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:49:35.521 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:49:35.521 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:35.521 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T00:49:35.521 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:49:35.521 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:49:35.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T00:49:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T00:49:35.626 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T00:49:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:49:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:49:35.793 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:35.793 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T00:49:35.793 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:49:35.793 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:49:35.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:35.813 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T00:49:35.860 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T00:49:35.937 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T00:49:35.941 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:49:35.968 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:49:35.968 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:35.969 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T00:49:35.969 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:49:35.969 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:49:35.969 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:36.027 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T00:49:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T00:49:36.192 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:49:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T00:49:36.216 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:49:36.216 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:36.216 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T00:49:36.217 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:49:36.217 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:49:36.217 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T00:49:36.252 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:49:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T00:49:36.277 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:49:36.277 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:36.277 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T00:49:36.277 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:49:36.277 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:49:36.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:36.384 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T00:49:36.442 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T00:49:36.505 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T00:49:36.659 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:49:36.666 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:49:36.683 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:49:36.684 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:36.684 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T00:49:36.684 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:49:36.684 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:49:36.684 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:36.694 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:49:36.713 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T00:49:36.725 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T00:49:36.770 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T00:49:36.789 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T00:49:36.790 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T00:49:36.816 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:49:36.846 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T00:49:36.851 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T00:49:36.903 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T00:49:36.949 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T00:49:37.087 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T00:49:37.102 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T00:49:37.135 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T00:49:37.150 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T00:49:37.185 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T00:49:37.205 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T00:49:37.212 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T00:49:37.294 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T00:49:37.426 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T00:49:37.477 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T00:49:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T00:49:37.537 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T00:49:37.676 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:49:37.703 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:49:37.735 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T00:49:37.800 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T00:49:37.849 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:49:37.850 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:49:37.885 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:49:37.999 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:49:38.019 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:49:38.051 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T00:49:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T00:49:38.142 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:49:38.839 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:49:38.869 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:49:38.959 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:49:38.970 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:49:39.002 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:49:39.122 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T00:49:39.146 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:49:39.170 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:49:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T00:49:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:49:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:49:39.171 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:39.183 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:49:39.213 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:49:39.219 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:49:39.225 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:49:39.323 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T00:49:39.377 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T00:49:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:49:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:49:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:49:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:49:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:49:40.299 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T00:49:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:49:40.330 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T00:49:40.332 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:49:40.354 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:49:40.356 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:49:40.356 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:40.356 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T00:49:40.356 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:49:40.356 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:49:40.356 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:40.380 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:49:40.380 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:40.380 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T00:49:40.380 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:49:40.381 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:49:40.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:40.399 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:49:40.422 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:49:40.423 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:40.423 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T00:49:40.423 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:40.430 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:49:40.442 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:49:40.474 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T00:49:40.492 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:49:40.497 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:49:40.515 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:49:40.516 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:40.516 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T00:49:40.516 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:49:40.516 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:49:40.516 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:40.521 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:49:40.521 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:40.521 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T00:49:40.521 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:49:40.521 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:49:40.521 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:40.535 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T00:49:40.564 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:49:40.576 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T00:49:40.674 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T00:49:40.721 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T00:49:40.817 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:49:40.841 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:49:40.841 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:40.841 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T00:49:40.841 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:49:40.841 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:49:40.842 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:41.582 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T00:49:41.616 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:49:41.641 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:49:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T00:49:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:49:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:49:41.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:41.645 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T00:49:41.675 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:49:41.683 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:49:41.699 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:49:41.700 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:41.700 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T00:49:41.700 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:49:41.700 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:49:41.700 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:41.707 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:49:41.708 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:41.708 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T00:49:41.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:41.742 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:49:41.759 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:49:41.766 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:49:41.766 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:41.766 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T00:49:41.766 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:41.783 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:49:41.783 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:41.783 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T00:49:41.783 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:49:41.783 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:49:41.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:41.818 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:49:41.842 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:49:41.842 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:41.842 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T00:49:41.842 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:49:41.843 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:49:41.843 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:42.101 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:49:42.125 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:49:42.126 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:42.126 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T00:49:42.126 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:49:42.126 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:49:42.126 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:42.144 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:49:42.168 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:49:42.168 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:49:42.168 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T00:49:42.168 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:49:42.169 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:49:42.169 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T00:49:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T00:49:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T00:49:45.477 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T00:49:45.504 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T00:49:45.684 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T00:49:45.734 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T00:49:45.764 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T00:49:45.793 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T00:49:45.831 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T00:49:46.435 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:49:46.471 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:49:46.491 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:49:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T00:49:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T00:49:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T00:49:46.829 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T00:49:46.856 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T00:49:46.962 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T00:49:47.004 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T00:49:47.037 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T00:49:47.046 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T00:49:47.077 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T00:49:47.086 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T00:49:47.104 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T00:49:47.117 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T00:49:47.171 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T00:49:47.209 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T00:49:47.311 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T00:49:47.324 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T00:49:47.359 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T00:49:47.389 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T00:49:47.417 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T00:49:47.419 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T00:49:47.456 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T00:49:47.458 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T00:49:47.540 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T00:49:47.569 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T00:49:47.595 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T00:49:47.630 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T00:49:47.630 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:49:47.722 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:49:47.722 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:49:47.768 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:49:47.806 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:49:47.807 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:49:47.828 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:49:47.831 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T00:49:47.836 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:49:47.836 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:49:48.016 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:49:48.016 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:49:48.070 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:49:48.092 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:49:48.112 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:49:48.134 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:49:48.155 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:49:48.672 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T00:49:48.763 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T00:49:48.803 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T00:49:48.886 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T00:49:48.924 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T00:49:48.950 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T00:49:48.976 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T00:49:48.976 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:49:49.050 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T00:49:49.060 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:49:49.060 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:49:49.142 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T00:49:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:49:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T00:49:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:49:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:49:49.193 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T00:49:49.285 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T00:49:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T00:49:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T00:49:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:49:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:49:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T00:49:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:49:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:49:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:49:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:49:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:49:49.547 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:49:49.572 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T00:49:49.578 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:49:49.578 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:49:49.766 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:49:49.766 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:49:49.851 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:49:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:49:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:49:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T00:49:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T00:49:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T00:49:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T00:49:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T00:49:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T00:49:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T00:49:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:49:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T00:49:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T00:49:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T00:49:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T00:49:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T00:49:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T00:49:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T00:49:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T00:49:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T00:49:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T00:49:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T00:49:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T00:49:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T00:49:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T00:49:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T00:49:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T00:49:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T00:49:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T00:49:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T00:49:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T00:49:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T00:49:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T00:49:55.418 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T00:49:55.419 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T00:49:55.420 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T00:49:55.421 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T00:49:55.421 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T00:49:55.421 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T00:49:55.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T00:49:55.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T00:49:55.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T00:49:55.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T00:49:55.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T00:49:55.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T00:49:55.434 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T00:49:55.435 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T00:49:55.436 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T00:49:55.437 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T00:49:55.437 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T00:49:55.437 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T00:49:55.437 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T00:49:55.437 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T00:49:55.437 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T00:49:55.437 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T00:49:55.437 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T00:49:55.437 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T00:49:55.438 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T00:49:55.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T00:49:55.440 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T00:49:55.440 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T00:49:55.440 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T00:49:55.440 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T00:49:55.440 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T00:49:55.440 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T00:49:55.440 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T00:49:55.441 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T00:49:55.442 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T00:49:55.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T00:49:55.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T00:49:55.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T00:49:55.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T00:49:55.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T00:49:55.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T00:49:55.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T00:49:55.444 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T00:49:55.445 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T00:49:55.445 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T00:49:55.445 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T00:49:55.445 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T00:49:55.445 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T00:49:55.445 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T00:49:55.445 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T00:49:55.445 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T00:49:55.446 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T00:49:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:49:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T00:49:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T00:49:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T00:49:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T00:49:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T00:49:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T00:49:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T00:49:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:49:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:49:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:49:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T00:49:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T00:49:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T00:49:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T00:49:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T00:49:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T00:49:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T00:49:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T00:49:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T00:49:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T00:49:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T00:49:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T00:49:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T00:49:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T00:49:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T00:49:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T00:49:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T00:49:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T00:49:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T00:49:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T00:49:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T00:49:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T00:49:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T00:49:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T00:49:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T00:49:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T00:49:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T00:49:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T00:49:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T00:49:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T00:49:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T00:49:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T00:49:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T00:49:56.824 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:49:56.825 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:56.825 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-09-16T00:49:56.825 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:56.825 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:56.825 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:56.826 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:56.826 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.826 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.826 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T00:49:56.826 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T00:49:56.826 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-16T00:49:56.827 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T00:49:56.827 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T00:49:56.827 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T00:49:56.827 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T00:49:56.827 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.827 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.827 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.828 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.828 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:56.828 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.828 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.828 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.829 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:56.829 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:56.829 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:56.829 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:56.829 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:56.829 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.830 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.830 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:56.830 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.830 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.830 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.830 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:56.831 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:56.831 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.831 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.831 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:56.831 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T00:49:56.831 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T00:49:56.831 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T00:49:56.832 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T00:49:56.832 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T00:49:56.832 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T00:49:56.832 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T00:49:56.832 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T00:49:56.832 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T00:49:56.833 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T00:49:56.833 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T00:49:56.833 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.833 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.833 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.833 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T00:49:56.834 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T00:49:56.834 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T00:49:56.834 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T00:49:56.834 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T00:49:56.834 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.834 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.835 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T00:49:56.835 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.835 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T00:49:56.835 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T00:49:56.835 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T00:49:56.835 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T00:49:56.836 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T00:49:56.836 INFO:teuthology.orchestra.run.smithi119.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T00:49:56.836 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T00:49:56.836 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T00:49:56.836 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T00:49:56.836 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T00:49:56.837 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T00:49:56.837 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T00:49:56.837 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T00:49:56.837 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T00:49:56.837 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T00:49:56.837 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T00:49:56.838 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T00:49:56.838 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T00:49:56.838 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T00:49:56.839 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T00:49:56.840 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T00:49:56.841 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T00:49:56.842 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T00:49:56.843 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T00:49:56.844 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T00:49:56.845 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:49:56.845 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-16T00:49:57.259 DEBUG:teuthology.parallel:result is None 2024-09-16T00:49:58.166 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:49:58.166 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:58.166 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-16T00:49:58.166 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:58.166 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:58.166 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.167 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.168 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T00:49:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T00:49:58.170 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T00:49:58.170 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T00:49:58.170 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T00:49:58.170 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T00:49:58.170 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T00:49:58.170 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T00:49:58.170 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.170 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.172 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T00:49:58.173 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T00:49:58.174 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T00:49:58.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T00:49:58.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T00:49:58.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T00:49:58.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T00:49:58.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T00:49:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T00:49:58.181 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T00:49:58.181 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:49:58.181 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-16T00:49:58.430 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:49:58.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:58.430 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-09-16T00:49:58.430 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T00:49:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.432 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T00:49:58.433 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T00:49:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T00:49:58.435 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T00:49:58.436 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T00:49:58.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T00:49:58.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T00:49:58.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T00:49:58.440 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.441 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.442 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:49:58.442 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T00:49:58.442 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T00:49:58.442 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T00:49:58.442 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T00:49:58.442 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T00:49:58.442 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T00:49:58.442 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T00:49:58.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:49:58.442 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-16T00:49:58.616 DEBUG:teuthology.parallel:result is None 2024-09-16T00:49:58.984 DEBUG:teuthology.parallel:result is None 2024-09-16T00:49:58.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:49:59.128 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T00:49:59.153 INFO:teuthology.orchestra.run.smithi012.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T00:49:59.153 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T00:49:59.153 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T00:49:59.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:49:59.293 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T00:49:59.319 INFO:teuthology.orchestra.run.smithi098.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T00:49:59.319 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T00:49:59.319 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T00:49:59.321 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:49:59.459 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T00:49:59.486 INFO:teuthology.orchestra.run.smithi119.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T00:49:59.486 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T00:49:59.487 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T00:49:59.488 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T00:49:59.489 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:49:59.489 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T00:49:59.521 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:49:59.522 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T00:49:59.554 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:49:59.554 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T00:49:59.585 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T00:49:59.586 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:49:59.586 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T00:49:59.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T00:49:59.688 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:49:59.688 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T00:49:59.723 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T00:49:59.798 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:49:59.798 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T00:49:59.828 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T00:49:59.897 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T00:49:59.898 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:49:59.898 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T00:49:59.928 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T00:49:59.997 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:49:59.997 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T00:50:00.027 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T00:50:00.095 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:50:00.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T00:50:00.125 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T00:50:00.194 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T00:50:00.195 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:50:00.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T00:50:00.226 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T00:50:00.294 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:50:00.294 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T00:50:00.322 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T00:50:00.389 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:50:00.389 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T00:50:00.418 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T00:50:00.487 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-16T00:50:00.589 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-16T00:50:00.589 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:50:00.589 INFO:tasks.cephadm:Cluster fsid is 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:50:00.590 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-16T00:50:00.590 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.12', 'mon.b': '172.21.15.98', 'mon.c': '172.21.15.119'} 2024-09-16T00:50:00.590 INFO:tasks.cephadm:First mon is mon.a on smithi012 2024-09-16T00:50:00.590 INFO:tasks.cephadm:First mgr is x 2024-09-16T00:50:00.590 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-16T00:50:00.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname $(hostname -s) 2024-09-16T00:50:00.622 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname $(hostname -s) 2024-09-16T00:50:00.651 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname $(hostname -s) 2024-09-16T00:50:00.680 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-16T00:50:00.681 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:50:00.820 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-16T00:50:00.963 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:50:00.965 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-16T00:50:00.965 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-16T00:50:00.965 DEBUG:teuthology.orchestra.run.smithi012:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T00:50:01.335 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 16 00:50 /home/ubuntu/cephtest/cephadm 2024-09-16T00:50:01.336 DEBUG:teuthology.orchestra.run.smithi098:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T00:50:01.780 INFO:teuthology.orchestra.run.smithi098.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 16 00:50 /home/ubuntu/cephtest/cephadm 2024-09-16T00:50:01.780 DEBUG:teuthology.orchestra.run.smithi119:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T00:50:02.504 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 16 00:50 /home/ubuntu/cephtest/cephadm 2024-09-16T00:50:02.504 DEBUG:teuthology.orchestra.run.smithi012:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T00:50:02.525 DEBUG:teuthology.orchestra.run.smithi098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T00:50:02.545 DEBUG:teuthology.orchestra.run.smithi119:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T00:50:02.581 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-16T00:50:02.581 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T00:50:02.583 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T00:50:02.587 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T00:50:04.221 INFO:teuthology.orchestra.run.smithi098.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T00:50:04.278 INFO:teuthology.orchestra.run.smithi119.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T00:50:04.328 INFO:teuthology.orchestra.run.smithi012.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T00:50:30.929 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T00:50:30.930 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T00:50:30.930 INFO:teuthology.orchestra.run.smithi098.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T00:50:30.930 INFO:teuthology.orchestra.run.smithi098.stdout: "repo_digests": [ 2024-09-16T00:50:30.930 INFO:teuthology.orchestra.run.smithi098.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T00:50:30.930 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T00:50:30.930 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T00:50:35.740 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-16T00:50:35.740 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T00:50:35.740 INFO:teuthology.orchestra.run.smithi119.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T00:50:35.740 INFO:teuthology.orchestra.run.smithi119.stdout: "repo_digests": [ 2024-09-16T00:50:35.740 INFO:teuthology.orchestra.run.smithi119.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T00:50:35.741 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-16T00:50:35.741 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-16T00:50:36.048 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T00:50:36.048 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T00:50:36.048 INFO:teuthology.orchestra.run.smithi012.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T00:50:36.048 INFO:teuthology.orchestra.run.smithi012.stdout: "repo_digests": [ 2024-09-16T00:50:36.049 INFO:teuthology.orchestra.run.smithi012.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T00:50:36.049 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-16T00:50:36.049 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T00:50:36.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph 2024-09-16T00:50:36.113 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph 2024-09-16T00:50:36.147 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph 2024-09-16T00:50:36.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /etc/ceph 2024-09-16T00:50:36.203 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /etc/ceph 2024-09-16T00:50:36.232 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /etc/ceph 2024-09-16T00:50:36.260 INFO:tasks.cephadm:Writing seed config... 2024-09-16T00:50:36.262 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-16T00:50:36.262 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-16T00:50:36.262 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-16T00:50:36.262 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-16T00:50:36.263 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-16T00:50:36.264 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-16T00:50:36.265 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-16T00:50:36.266 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-16T00:50:36.266 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-16T00:50:36.266 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-16T00:50:36.266 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-16T00:50:36.266 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-16T00:50:36.267 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:50:36.267 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-16T00:50:36.283 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 9a476aac-73c5-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-16T00:50:36.284 DEBUG:teuthology.orchestra.run.smithi012:mon.a> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.a.service 2024-09-16T00:50:36.326 DEBUG:teuthology.orchestra.run.smithi012:mgr.x> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.x.service 2024-09-16T00:50:36.369 INFO:tasks.cephadm:Bootstrapping... 2024-09-16T00:50:36.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.12 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-16T00:50:36.578 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:50:36.578 INFO:teuthology.orchestra.run.smithi012.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', '9a476aac-73c5-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.12', '--skip-admin-label'] 2024-09-16T00:50:36.579 INFO:teuthology.orchestra.run.smithi012.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-16T00:50:36.579 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying podman|docker is present... 2024-09-16T00:50:36.604 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 5.2.2 2024-09-16T00:50:36.604 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying lvm2 is present... 2024-09-16T00:50:36.605 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying time synchronization is in place... 2024-09-16T00:50:36.612 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T00:50:36.613 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T00:50:36.619 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T00:50:36.619 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-16T00:50:36.627 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2024-09-16T00:50:36.634 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2024-09-16T00:50:36.634 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2024-09-16T00:50:36.634 INFO:teuthology.orchestra.run.smithi012.stdout:Repeating the final host check... 2024-09-16T00:50:36.657 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 5.2.2 2024-09-16T00:50:36.657 INFO:teuthology.orchestra.run.smithi012.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-16T00:50:36.657 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl is present 2024-09-16T00:50:36.657 INFO:teuthology.orchestra.run.smithi012.stdout:lvcreate is present 2024-09-16T00:50:36.664 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T00:50:36.664 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T00:50:36.670 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T00:50:36.670 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-16T00:50:36.677 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2024-09-16T00:50:36.684 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2024-09-16T00:50:36.684 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2024-09-16T00:50:36.684 INFO:teuthology.orchestra.run.smithi012.stdout:Host looks OK 2024-09-16T00:50:36.684 INFO:teuthology.orchestra.run.smithi012.stdout:Cluster fsid: 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:50:36.684 INFO:teuthology.orchestra.run.smithi012.stdout:Acquiring lock 140158729790464 on /run/cephadm/9a476aac-73c5-11ef-bceb-c7b262605968.lock 2024-09-16T00:50:36.684 INFO:teuthology.orchestra.run.smithi012.stdout:Lock 140158729790464 acquired on /run/cephadm/9a476aac-73c5-11ef-bceb-c7b262605968.lock 2024-09-16T00:50:36.685 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 3300 ... 2024-09-16T00:50:36.685 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 6789 ... 2024-09-16T00:50:36.685 INFO:teuthology.orchestra.run.smithi012.stdout:Base mon IP(s) is [172.21.15.12:3300, 172.21.15.12:6789], mon addrv is [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-16T00:50:36.688 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.12 metric 100 2024-09-16T00:50:36.688 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.12 metric 100 2024-09-16T00:50:36.691 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-16T00:50:36.691 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-16T00:50:36.691 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2024-09-16T00:50:36.694 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-16T00:50:36.694 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-16T00:50:36.694 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T00:50:36.694 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-16T00:50:36.694 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-16T00:50:36.694 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T00:50:36.695 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2024-09-16T00:50:36.695 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2024-09-16T00:50:36.695 INFO:teuthology.orchestra.run.smithi012.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-16T00:50:36.695 INFO:teuthology.orchestra.run.smithi012.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-16T00:50:36.696 INFO:teuthology.orchestra.run.smithi012.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T00:50:37.143 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-16T00:50:37.143 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T00:50:37.143 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Getting image source signatures 2024-09-16T00:50:37.143 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:c0574da0c3174f3dc49daa274908f97d06456bd6a3cfab87e94022c1369a83a6 2024-09-16T00:50:37.144 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-16T00:50:37.144 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying config sha256:f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-16T00:50:37.144 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-16T00:50:38.123 INFO:teuthology.orchestra.run.smithi012.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-16T00:50:38.123 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-16T00:50:38.124 INFO:teuthology.orchestra.run.smithi012.stdout:Extracting ceph user uid/gid from container image... 2024-09-16T00:50:39.021 INFO:teuthology.orchestra.run.smithi012.stdout:stat: stdout 167 167 2024-09-16T00:50:39.022 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial keys... 2024-09-16T00:50:39.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQDfgOdmko28FRAANMS25y4Vskg3mY5CQ/x0lQ== 2024-09-16T00:50:40.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQDggOdmKZIIExAA1Tk4IzYAW6pLjFmOrY1OpQ== 2024-09-16T00:50:41.813 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQDhgOdmu2T1DhAA70JvLG45oTmyu5mry0kl+Q== 2024-09-16T00:50:41.814 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial monmap... 2024-09-16T00:50:42.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T00:50:42.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-16T00:50:42.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:50:42.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T00:50:42.829 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool for a [v2:172.21.15.12:3300,v1:172.21.15.12:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T00:50:42.829 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-09-16T00:50:42.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: set fsid to 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:50:42.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T00:50:42.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:50:42.830 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mon... 2024-09-16T00:50:43.718 INFO:teuthology.orchestra.run.smithi012.stdout:create mon.a on 2024-09-16T00:50:43.937 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-16T00:50:44.091 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-16T00:50:44.278 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-9a476aac-73c5-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-9a476aac-73c5-11ef-bceb-c7b262605968.target. 2024-09-16T00:50:44.278 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-9a476aac-73c5-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-9a476aac-73c5-11ef-bceb-c7b262605968.target. 2024-09-16T00:50:44.519 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.a 2024-09-16T00:50:44.520 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-16T00:50:44.690 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9a476aac-73c5-11ef-bceb-c7b262605968.target.wants/ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-9a476aac-73c5-11ef-bceb-c7b262605968@.service. 2024-09-16T00:50:45.194 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:50:45.194 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-16T00:50:45.201 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:50:45.202 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-16T00:50:45.202 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-16T00:50:45.202 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T00:50:45.202 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon to start... 2024-09-16T00:50:45.202 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon... 2024-09-16T00:50:47.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:50:47 smithi012 ceph-mon[30827]: from='client.? 172.21.15.12:0/2725129435' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-16T00:50:53.253 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout cluster: 2024-09-16T00:50:53.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout id: 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout services: 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 2s) 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout data: 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pgs: 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:50:53.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.100+0000 7f8c96654640 1 Processor -- start 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.100+0000 7f8c96654640 1 -- start start 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.100+0000 7f8c96654640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c90107950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.100+0000 7f8c96654640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8c90107f20 con 0x7f8c90107550 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.101+0000 7f8c8ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c90107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.101+0000 7f8c8ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c90107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52058/0 (socket says 172.21.15.12:52058) 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.101+0000 7f8c8ffff640 1 -- 172.21.15.12:0/361894155 learned_addr learned my addr 172.21.15.12:0/361894155 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.101+0000 7f8c8ffff640 1 -- 172.21.15.12:0/361894155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c90108750 con 0x7f8c90107550 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.103+0000 7f8c8ffff640 1 --2- 172.21.15.12:0/361894155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c90107950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009820 tx=0x7f8c8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e686299a4a15931c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.104+0000 7f8c8effd640 1 -- 172.21.15.12:0/361894155 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c80037070 con 0x7f8c90107550 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.104+0000 7f8c8effd640 1 -- 172.21.15.12:0/361894155 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c80032440 con 0x7f8c90107550 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.104+0000 7f8c8effd640 1 -- 172.21.15.12:0/361894155 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c80032740 con 0x7f8c90107550 2024-09-16T00:50:53.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.104+0000 7f8c96654640 1 -- 172.21.15.12:0/361894155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 msgr2=0x7f8c90107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.104+0000 7f8c96654640 1 --2- 172.21.15.12:0/361894155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c90107950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009820 tx=0x7f8c8002a270 comp rx=0 tx=0).stop 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.104+0000 7f8c96654640 1 -- 172.21.15.12:0/361894155 shutdown_connections 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.104+0000 7f8c96654640 1 --2- 172.21.15.12:0/361894155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c90107950 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.104+0000 7f8c96654640 1 -- 172.21.15.12:0/361894155 >> 172.21.15.12:0/361894155 conn(0x7f8c90102ce0 msgr2=0x7f8c90105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.104+0000 7f8c96654640 1 -- 172.21.15.12:0/361894155 shutdown_connections 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.104+0000 7f8c96654640 1 -- 172.21.15.12:0/361894155 wait complete. 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.105+0000 7f8c96654640 1 Processor -- start 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.105+0000 7f8c96654640 1 -- start start 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.105+0000 7f8c96654640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c9007e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.105+0000 7f8c96654640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8c90108cf0 con 0x7f8c90107550 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.105+0000 7f8c8ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c9007e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.105+0000 7f8c8ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c9007e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52074/0 (socket says 172.21.15.12:52074) 2024-09-16T00:50:53.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.105+0000 7f8c8ffff640 1 -- 172.21.15.12:0/2725129435 learned_addr learned my addr 172.21.15.12:0/2725129435 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.106+0000 7f8c8ffff640 1 -- 172.21.15.12:0/2725129435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9007e8e0 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.106+0000 7f8c8ffff640 1 --2- 172.21.15.12:0/2725129435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c9007e3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8c800090b0 tx=0x7f8c800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.106+0000 7f8c8d7fa640 1 -- 172.21.15.12:0/2725129435 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c80041070 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.106+0000 7f8c8d7fa640 1 -- 172.21.15.12:0/2725129435 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8003c7a0 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.106+0000 7f8c8d7fa640 1 -- 172.21.15.12:0/2725129435 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c80037040 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.106+0000 7f8c96654640 1 -- 172.21.15.12:0/2725129435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9007cad0 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.106+0000 7f8c96654640 1 -- 172.21.15.12:0/2725129435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9007d010 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.106+0000 7f8c8d7fa640 1 -- 172.21.15.12:0/2725129435 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8c80044070 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.106+0000 7f8c8d7fa640 1 -- 172.21.15.12:0/2725129435 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8c8003d3f0 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.107+0000 7f8c96654640 1 -- 172.21.15.12:0/2725129435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c90109340 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.110+0000 7f8c8d7fa640 1 -- 172.21.15.12:0/2725129435 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8c80046450 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.172+0000 7f8c96654640 1 -- 172.21.15.12:0/2725129435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f8c9007d710 con 0x7f8c90107550 2024-09-16T00:50:53.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.172+0000 7f8c8d7fa640 1 -- 172.21.15.12:0/2725129435 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+310 (secure 0 0 0) 0x7f8c80046630 con 0x7f8c90107550 2024-09-16T00:50:53.263 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.172+0000 7f8c96654640 1 -- 172.21.15.12:0/2725129435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 msgr2=0x7f8c9007e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:53.263 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.172+0000 7f8c96654640 1 --2- 172.21.15.12:0/2725129435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c9007e3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8c800090b0 tx=0x7f8c800046c0 comp rx=0 tx=0).stop 2024-09-16T00:50:53.263 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.173+0000 7f8c96654640 1 -- 172.21.15.12:0/2725129435 shutdown_connections 2024-09-16T00:50:53.263 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.173+0000 7f8c96654640 1 --2- 172.21.15.12:0/2725129435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c90107550 0x7f8c9007e3a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:53.263 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.173+0000 7f8c96654640 1 -- 172.21.15.12:0/2725129435 >> 172.21.15.12:0/2725129435 conn(0x7f8c90102ce0 msgr2=0x7f8c9018f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:53.263 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.173+0000 7f8c96654640 1 -- 172.21.15.12:0/2725129435 shutdown_connections 2024-09-16T00:50:53.263 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:47.173+0000 7f8c96654640 1 -- 172.21.15.12:0/2725129435 wait complete. 2024-09-16T00:50:53.263 INFO:teuthology.orchestra.run.smithi012.stdout:mon is available 2024-09-16T00:50:53.263 INFO:teuthology.orchestra.run.smithi012.stdout:Assimilating anything we can from ceph.conf... 2024-09-16T00:50:56.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:50:56 smithi012 ceph-mon[30827]: from='client.? 172.21.15.12:0/1602432130' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T00:50:56.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:50:56 smithi012 ceph-mon[30827]: from='client.? 172.21.15.12:0/1602432130' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-16T00:50:58.737 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:50:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T00:50:58.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T00:50:58.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T00:50:58.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T00:50:58.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T00:50:58.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T00:50:58.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.159+0000 7f63a7892640 1 Processor -- start 2024-09-16T00:50:58.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.160+0000 7f63a7892640 1 -- start start 2024-09-16T00:50:58.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.160+0000 7f63a7892640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a0107950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:58.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.160+0000 7f63a7892640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f63a0107f20 con 0x7f63a0107550 2024-09-16T00:50:58.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.160+0000 7f63a562e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a0107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:58.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.160+0000 7f63a562e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a0107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38950/0 (socket says 172.21.15.12:38950) 2024-09-16T00:50:58.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.160+0000 7f63a562e640 1 -- 172.21.15.12:0/3110723998 learned_addr learned my addr 172.21.15.12:0/3110723998 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:50:58.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.160+0000 7f63a562e640 1 -- 172.21.15.12:0/3110723998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a0108750 con 0x7f63a0107550 2024-09-16T00:50:58.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.161+0000 7f63a562e640 1 --2- 172.21.15.12:0/3110723998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a0107950 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6390009e80 tx=0x7f639002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ee59e13ae5bc60 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:58.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.161+0000 7f639ffff640 1 -- 172.21.15.12:0/3110723998 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6390036070 con 0x7f63a0107550 2024-09-16T00:50:58.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.161+0000 7f639ffff640 1 -- 172.21.15.12:0/3110723998 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6390031400 con 0x7f63a0107550 2024-09-16T00:50:58.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.161+0000 7f639ffff640 1 -- 172.21.15.12:0/3110723998 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6390031700 con 0x7f63a0107550 2024-09-16T00:50:58.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.162+0000 7f63a7892640 1 -- 172.21.15.12:0/3110723998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 msgr2=0x7f63a0107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:58.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.162+0000 7f63a7892640 1 --2- 172.21.15.12:0/3110723998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a0107950 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6390009e80 tx=0x7f639002a7a0 comp rx=0 tx=0).stop 2024-09-16T00:50:58.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.162+0000 7f63a7892640 1 -- 172.21.15.12:0/3110723998 shutdown_connections 2024-09-16T00:50:58.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.162+0000 7f63a7892640 1 --2- 172.21.15.12:0/3110723998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a0107950 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:58.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.162+0000 7f63a7892640 1 -- 172.21.15.12:0/3110723998 >> 172.21.15.12:0/3110723998 conn(0x7f63a0102ce0 msgr2=0x7f63a0105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:58.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.162+0000 7f63a7892640 1 -- 172.21.15.12:0/3110723998 shutdown_connections 2024-09-16T00:50:58.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.162+0000 7f63a7892640 1 -- 172.21.15.12:0/3110723998 wait complete. 2024-09-16T00:50:58.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.163+0000 7f63a7892640 1 Processor -- start 2024-09-16T00:50:58.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.163+0000 7f63a7892640 1 -- start start 2024-09-16T00:50:58.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.163+0000 7f63a7892640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a007e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:58.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.163+0000 7f63a7892640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f63a0108cf0 con 0x7f63a0107550 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.163+0000 7f63a562e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a007e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.163+0000 7f63a562e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a007e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38966/0 (socket says 172.21.15.12:38966) 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.163+0000 7f63a562e640 1 -- 172.21.15.12:0/1602432130 learned_addr learned my addr 172.21.15.12:0/1602432130 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.163+0000 7f63a562e640 1 -- 172.21.15.12:0/1602432130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a007e8e0 con 0x7f63a0107550 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.164+0000 7f63a562e640 1 --2- 172.21.15.12:0/1602432130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a007e3a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6390034040 tx=0x7f6390004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.164+0000 7f639e7fc640 1 -- 172.21.15.12:0/1602432130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6390041070 con 0x7f63a0107550 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.164+0000 7f639e7fc640 1 -- 172.21.15.12:0/1602432130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639003c650 con 0x7f63a0107550 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.164+0000 7f63a7892640 1 -- 172.21.15.12:0/1602432130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a007cad0 con 0x7f63a0107550 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.164+0000 7f639e7fc640 1 -- 172.21.15.12:0/1602432130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6390036040 con 0x7f63a0107550 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.164+0000 7f63a7892640 1 -- 172.21.15.12:0/1602432130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a007d010 con 0x7f63a0107550 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.164+0000 7f639e7fc640 1 -- 172.21.15.12:0/1602432130 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6390044070 con 0x7f63a0107550 2024-09-16T00:50:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.164+0000 7f639e7fc640 1 -- 172.21.15.12:0/1602432130 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6390046c10 con 0x7f63a0107550 2024-09-16T00:50:58.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.165+0000 7f63a7892640 1 -- 172.21.15.12:0/1602432130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a0109340 con 0x7f63a0107550 2024-09-16T00:50:58.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.167+0000 7f639e7fc640 1 -- 172.21.15.12:0/1602432130 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f639003c950 con 0x7f63a0107550 2024-09-16T00:50:58.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.227+0000 7f63a7892640 1 -- 172.21.15.12:0/1602432130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f63a007d310 con 0x7f63a0107550 2024-09-16T00:50:58.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.230+0000 7f639e7fc640 1 -- 172.21.15.12:0/1602432130 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f639003cb30 con 0x7f63a0107550 2024-09-16T00:50:58.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.231+0000 7f639e7fc640 1 -- 172.21.15.12:0/1602432130 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6390031400 con 0x7f63a0107550 2024-09-16T00:50:58.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.232+0000 7f63a7892640 1 -- 172.21.15.12:0/1602432130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 msgr2=0x7f63a007e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:58.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.232+0000 7f63a7892640 1 --2- 172.21.15.12:0/1602432130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a007e3a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6390034040 tx=0x7f6390004a40 comp rx=0 tx=0).stop 2024-09-16T00:50:58.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.232+0000 7f63a7892640 1 -- 172.21.15.12:0/1602432130 shutdown_connections 2024-09-16T00:50:58.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.232+0000 7f63a7892640 1 --2- 172.21.15.12:0/1602432130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63a0107550 0x7f63a007e3a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:58.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.232+0000 7f63a7892640 1 -- 172.21.15.12:0/1602432130 >> 172.21.15.12:0/1602432130 conn(0x7f63a0102ce0 msgr2=0x7f63a018f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:58.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.232+0000 7f63a7892640 1 -- 172.21.15.12:0/1602432130 shutdown_connections 2024-09-16T00:50:58.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:56.232+0000 7f63a7892640 1 -- 172.21.15.12:0/1602432130 wait complete. 2024-09-16T00:50:58.745 INFO:teuthology.orchestra.run.smithi012.stdout:Generating new minimal ceph.conf... 2024-09-16T00:50:59.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:50:59 smithi012 ceph-mon[30827]: from='client.? 172.21.15.12:0/599975658' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.287+0000 7fd02abc8640 1 Processor -- start 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.288+0000 7fd02abc8640 1 -- start start 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.288+0000 7fd02abc8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02410a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.288+0000 7fd02abc8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd02407c6a0 con 0x7fd024108000 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.288+0000 7fd028964640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02410a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.288+0000 7fd028964640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02410a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38976/0 (socket says 172.21.15.12:38976) 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.288+0000 7fd028964640 1 -- 172.21.15.12:0/151073798 learned_addr learned my addr 172.21.15.12:0/151073798 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.288+0000 7fd028964640 1 -- 172.21.15.12:0/151073798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02410a930 con 0x7fd024108000 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.289+0000 7fd028964640 1 --2- 172.21.15.12:0/151073798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02410a3f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009820 tx=0x7fd00c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b160c4dfcb2f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.289+0000 7fd0237fe640 1 -- 172.21.15.12:0/151073798 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd00c037070 con 0x7fd024108000 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.289+0000 7fd0237fe640 1 -- 172.21.15.12:0/151073798 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd00c032900 con 0x7fd024108000 2024-09-16T00:50:59.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.289+0000 7fd0237fe640 1 -- 172.21.15.12:0/151073798 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd00c030850 con 0x7fd024108000 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.290+0000 7fd02abc8640 1 -- 172.21.15.12:0/151073798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 msgr2=0x7fd02410a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.290+0000 7fd02abc8640 1 --2- 172.21.15.12:0/151073798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02410a3f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009820 tx=0x7fd00c02a270 comp rx=0 tx=0).stop 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.290+0000 7fd02abc8640 1 -- 172.21.15.12:0/151073798 shutdown_connections 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.290+0000 7fd02abc8640 1 --2- 172.21.15.12:0/151073798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02410a3f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.290+0000 7fd02abc8640 1 -- 172.21.15.12:0/151073798 >> 172.21.15.12:0/151073798 conn(0x7fd024101be0 msgr2=0x7fd024104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.290+0000 7fd02abc8640 1 -- 172.21.15.12:0/151073798 shutdown_connections 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.290+0000 7fd02abc8640 1 -- 172.21.15.12:0/151073798 wait complete. 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.291+0000 7fd02abc8640 1 Processor -- start 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.291+0000 7fd02abc8640 1 -- start start 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.291+0000 7fd02abc8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.291+0000 7fd02abc8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd02410b970 con 0x7fd024108000 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.291+0000 7fd028964640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.291+0000 7fd028964640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02419b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38982/0 (socket says 172.21.15.12:38982) 2024-09-16T00:50:59.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.291+0000 7fd028964640 1 -- 172.21.15.12:0/599975658 learned_addr learned my addr 172.21.15.12:0/599975658 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.292+0000 7fd028964640 1 -- 172.21.15.12:0/599975658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02419ba60 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.292+0000 7fd028964640 1 --2- 172.21.15.12:0/599975658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02419b520 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0097f0 tx=0x7fd00c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.292+0000 7fd021ffb640 1 -- 172.21.15.12:0/599975658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd00c037040 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.292+0000 7fd021ffb640 1 -- 172.21.15.12:0/599975658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd00c040070 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.292+0000 7fd02abc8640 1 -- 172.21.15.12:0/599975658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02419bcf0 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.292+0000 7fd021ffb640 1 -- 172.21.15.12:0/599975658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd00c03a390 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.292+0000 7fd02abc8640 1 -- 172.21.15.12:0/599975658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02419e9e0 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.292+0000 7fd021ffb640 1 -- 172.21.15.12:0/599975658 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd00c03a630 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.292+0000 7fd021ffb640 1 -- 172.21.15.12:0/599975658 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd00c0459a0 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.293+0000 7fd02abc8640 1 -- 172.21.15.12:0/599975658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd024108460 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.296+0000 7fd021ffb640 1 -- 172.21.15.12:0/599975658 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd00c045460 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.356+0000 7fd02abc8640 1 -- 172.21.15.12:0/599975658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd02419ebb0 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.357+0000 7fd021ffb640 1 -- 172.21.15.12:0/599975658 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fd00c03b430 con 0x7fd024108000 2024-09-16T00:50:59.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.358+0000 7fd02abc8640 1 -- 172.21.15.12:0/599975658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 msgr2=0x7fd02419b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:59.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.358+0000 7fd02abc8640 1 --2- 172.21.15.12:0/599975658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02419b520 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0097f0 tx=0x7fd00c030d80 comp rx=0 tx=0).stop 2024-09-16T00:50:59.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.358+0000 7fd02abc8640 1 -- 172.21.15.12:0/599975658 shutdown_connections 2024-09-16T00:50:59.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.358+0000 7fd02abc8640 1 --2- 172.21.15.12:0/599975658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd024108000 0x7fd02419b520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:59.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.358+0000 7fd02abc8640 1 -- 172.21.15.12:0/599975658 >> 172.21.15.12:0/599975658 conn(0x7fd024101be0 msgr2=0x7fd024102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:59.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.358+0000 7fd02abc8640 1 -- 172.21.15.12:0/599975658 shutdown_connections 2024-09-16T00:50:59.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:50:59.358+0000 7fd02abc8640 1 -- 172.21.15.12:0/599975658 wait complete. 2024-09-16T00:50:59.929 INFO:teuthology.orchestra.run.smithi012.stdout:Restarting the monitor... 2024-09-16T00:51:00.222 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:50:59 smithi012 systemd[1]: Stopping Ceph mon.a for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:51:00.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:00 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a[30823]: 2024-09-16T00:51:00.221+0000 7f9e7f52a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:51:00.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:00 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a[30823]: 2024-09-16T00:51:00.221+0000 7f9e7f52a640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-16T00:51:00.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:00 smithi012 podman[31070]: 2024-09-16 00:51:00.314005516 +0000 UTC m=+0.215839954 container died 0792617ad31dae9c138f4d6db639d2bdbf9f48ca0a96e8dc5f558cab190710fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-16T00:51:00.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:00 smithi012 podman[31070]: 2024-09-16 00:51:00.655005979 +0000 UTC m=+0.556840458 container cleanup 0792617ad31dae9c138f4d6db639d2bdbf9f48ca0a96e8dc5f558cab190710fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:51:00.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:00 smithi012 bash[31070]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a 2024-09-16T00:51:01.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:00 smithi012 podman[31082]: 2024-09-16 00:51:00.814186749 +0000 UTC m=+0.501177419 container remove 0792617ad31dae9c138f4d6db639d2bdbf9f48ca0a96e8dc5f558cab190710fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS) 2024-09-16T00:51:01.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 systemd[1]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-16T00:51:01.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 systemd[1]: Stopped Ceph mon.a for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:51:01.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 systemd[1]: Starting Ceph mon.a for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:51:01.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 podman[31178]: 2024-09-16 00:51:01.223418001 +0000 UTC m=+0.102034833 container create f5366c394d4579134564679847e4357bc3aa7d08ef5059c59a6c54e64ad2879e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-16T00:51:01.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 podman[31178]: 2024-09-16 00:51:01.137890705 +0000 UTC m=+0.016507545 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:51:01.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 podman[31178]: 2024-09-16 00:51:01.434031675 +0000 UTC m=+0.312648509 container init f5366c394d4579134564679847e4357bc3aa7d08ef5059c59a6c54e64ad2879e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-16T00:51:01.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 podman[31178]: 2024-09-16 00:51:01.437274447 +0000 UTC m=+0.315891274 container start f5366c394d4579134564679847e4357bc3aa7d08ef5059c59a6c54e64ad2879e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: pidfile_write: ignore empty --pid-file 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: load: jerasure load: lrc 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: RocksDB version: 7.9.2 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Git sha 0 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: DB SUMMARY 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: DB Session ID: GABZ61COH3MCB5EGURBY 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: CURRENT file: CURRENT 2024-09-16T00:51:01.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T00:51:01.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-16T00:51:01.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-16T00:51:01.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105091 ; 2024-09-16T00:51:01.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.error_if_exists: 0 2024-09-16T00:51:01.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.create_if_missing: 0 2024-09-16T00:51:01.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.paranoid_checks: 1 2024-09-16T00:51:01.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T00:51:01.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T00:51:01.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T00:51:01.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.env: 0x563dc347a940 2024-09-16T00:51:01.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T00:51:01.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.info_log: 0x563dc48896e0 2024-09-16T00:51:01.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T00:51:01.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.statistics: (nil) 2024-09-16T00:51:01.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.use_fsync: 0 2024-09-16T00:51:01.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_log_file_size: 0 2024-09-16T00:51:01.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.allow_fallocate: 1 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.use_direct_reads: 0 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.db_log_dir: 2024-09-16T00:51:01.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.wal_dir: 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.write_buffer_manager: 0x563dc4898dc0 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T00:51:01.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T00:51:01.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T00:51:01.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T00:51:01.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T00:51:01.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T00:51:01.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.unordered_write: 0 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.row_cache: None 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.wal_filter: None 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.two_write_queues: 0 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.wal_compression: 0 2024-09-16T00:51:01.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.atomic_flush: 0 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.log_readahead_size: 0 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_background_jobs: 2 2024-09-16T00:51:01.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_background_compactions: -1 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_subcompactions: 1 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_open_files: -1 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T00:51:01.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_background_flushes: -1 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Compression algorithms supported: 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: kZSTD supported: 0 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: kXpressCompression supported: 0 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: kBZip2Compression supported: 0 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: kLZ4Compression supported: 1 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: kZlibCompression supported: 1 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: kSnappyCompression supported: 1 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T00:51:01.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.merge_operator: 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_filter: None 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563dc4889320) 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks: 1 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T00:51:01.522 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_top_level_index_and_filter: 1 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_type: 0 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_index_type: 0 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_shortening: 1 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: checksum: 4 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: no_block_cache: 0 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache: 0x563dc487d1f0 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_name: BinnedLRUCache 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_options: 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: capacity : 536870912 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_shard_bits : 4 2024-09-16T00:51:01.523 INFO:journalctl@ceph.mon.a.smithi012.stdout: strict_capacity_limit : 0 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: high_pri_pool_ratio: 0.000 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_compressed: (nil) 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: persistent_cache: (nil) 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size: 4096 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size_deviation: 10 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_restart_interval: 16 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_block_restart_interval: 1 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: metadata_block_size: 4096 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: partition_filters: 0 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: use_delta_encoding: 1 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: filter_policy: bloomfilter 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: whole_key_filtering: 1 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: verify_compression: 0 2024-09-16T00:51:01.524 INFO:journalctl@ceph.mon.a.smithi012.stdout: read_amp_bytes_per_bit: 0 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout: format_version: 5 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_index_compression: 1 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_align: 0 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout: max_auto_readahead_size: 262144 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout: prepopulate_block_cache: 0 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout: initial_auto_readahead_size: 8192 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compression: NoCompression 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T00:51:01.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.num_levels: 7 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:51:01.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T00:51:01.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T00:51:01.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T00:51:01.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T00:51:01.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T00:51:01.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T00:51:01.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T00:51:01.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.inplace_update_support: 0 2024-09-16T00:51:01.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.bloom_locality: 0 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.max_successive_merges: 0 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.ttl: 2592000 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T00:51:01.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.enable_blob_files: false 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.min_blob_size: 0 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-16T00:51:01.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 068438d7-61b2-4aee-a815-7466a7a1a0df 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447861464323, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447861465438, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100047, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 332, "table_properties": {"data_size": 97933, "index_size": 306, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14209, "raw_average_key_size": 49, "raw_value_size": 90243, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726447861, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "068438d7-61b2-4aee-a815-7466a7a1a0df", "db_session_id": "GABZ61COH3MCB5EGURBY", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447861465536, "job": 1, "event": "recovery_finished"} 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563dc48aae00 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: DB pointer 0x563dc49a6000 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** DB Stats ** 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T00:51:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: L0 2/0 99.56 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: Sum 2/0 99.56 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-16T00:51:01.534 INFO:journalctl@ceph.mon.a.smithi012.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative compaction: 0.00 GB write, 28.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval compaction: 0.00 GB write, 28.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:51:01.535 INFO:journalctl@ceph.mon.a.smithi012.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache BinnedLRUCache@0x563dc487d1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: starting mon.a rank 0 at public addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] at bind addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: mon.a@-1(???) e1 preinit fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: mon.a@-1(???).mds e1 new map 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: mon.a@-1(???).mds e1 print_map 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout: e1 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout: btime 2024-09-16T00:50:45:145115+0000 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout: legacy client fscid: -1 2024-09-16T00:51:01.536 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-16T00:51:01.537 INFO:journalctl@ceph.mon.a.smithi012.stdout: No filesystems configured 2024-09-16T00:51:01.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-16T00:51:01.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:51:01.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:51:01.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:51:01.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-16T00:51:01.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 bash[31178]: f5366c394d4579134564679847e4357bc3aa7d08ef5059c59a6c54e64ad2879e 2024-09-16T00:51:01.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 systemd[1]: Started Ceph mon.a for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:51:01.537 INFO:teuthology.orchestra.run.smithi012.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-16T00:51:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-16T00:51:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: monmap epoch 1 2024-09-16T00:51:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:51:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: last_changed 2024-09-16T00:50:42.130126+0000 2024-09-16T00:51:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: created 2024-09-16T00:50:42.130126+0000 2024-09-16T00:51:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: min_mon_release 19 (squid) 2024-09-16T00:51:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: election_strategy: 1 2024-09-16T00:51:01.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-16T00:51:01.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: fsmap 2024-09-16T00:51:01.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T00:51:01.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:01 smithi012 ceph-mon[31197]: mgrmap e1: no daemons active 2024-09-16T00:51:02.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.895+0000 7f9f9be55640 1 Processor -- start 2024-09-16T00:51:02.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.896+0000 7f9f9be55640 1 -- start start 2024-09-16T00:51:02.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.896+0000 7f9f9be55640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f94107950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:02.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.896+0000 7f9f9be55640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94107f20 con 0x7f9f94107550 2024-09-16T00:51:02.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.896+0000 7f9f99bf1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f94107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:02.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.896+0000 7f9f99bf1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f94107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38998/0 (socket says 172.21.15.12:38998) 2024-09-16T00:51:02.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.897+0000 7f9f99bf1640 1 -- 172.21.15.12:0/1694452468 learned_addr learned my addr 172.21.15.12:0/1694452468 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:02.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.897+0000 7f9f99bf1640 1 -- 172.21.15.12:0/1694452468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f94108750 con 0x7f9f94107550 2024-09-16T00:51:02.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.898+0000 7f9f99bf1640 1 --2- 172.21.15.12:0/1694452468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f94107950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009820 tx=0x7f9f9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb39dc449a8900a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:02.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.899+0000 7f9f98bef640 1 -- 172.21.15.12:0/1694452468 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f90037070 con 0x7f9f94107550 2024-09-16T00:51:02.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.899+0000 7f9f98bef640 1 -- 172.21.15.12:0/1694452468 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f90032900 con 0x7f9f94107550 2024-09-16T00:51:02.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.899+0000 7f9f98bef640 1 -- 172.21.15.12:0/1694452468 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f90030850 con 0x7f9f94107550 2024-09-16T00:51:02.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.899+0000 7f9f9be55640 1 -- 172.21.15.12:0/1694452468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 msgr2=0x7f9f94107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:02.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.899+0000 7f9f9be55640 1 --2- 172.21.15.12:0/1694452468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f94107950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009820 tx=0x7f9f9002a270 comp rx=0 tx=0).stop 2024-09-16T00:51:02.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.899+0000 7f9f9be55640 1 -- 172.21.15.12:0/1694452468 shutdown_connections 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.899+0000 7f9f9be55640 1 --2- 172.21.15.12:0/1694452468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f94107950 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.899+0000 7f9f9be55640 1 -- 172.21.15.12:0/1694452468 >> 172.21.15.12:0/1694452468 conn(0x7f9f94102ce0 msgr2=0x7f9f94105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.899+0000 7f9f9be55640 1 -- 172.21.15.12:0/1694452468 shutdown_connections 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.899+0000 7f9f9be55640 1 -- 172.21.15.12:0/1694452468 wait complete. 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.900+0000 7f9f9be55640 1 Processor -- start 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.900+0000 7f9f9be55640 1 -- start start 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.900+0000 7f9f9be55640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f9419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.900+0000 7f9f9be55640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9410bb00 con 0x7f9f94107550 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.900+0000 7f9f99bf1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f9419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.900+0000 7f9f99bf1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f9419b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39010/0 (socket says 172.21.15.12:39010) 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.900+0000 7f9f99bf1640 1 -- 172.21.15.12:0/963865227 learned_addr learned my addr 172.21.15.12:0/963865227 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.901+0000 7f9f99bf1640 1 -- 172.21.15.12:0/963865227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9419ba80 con 0x7f9f94107550 2024-09-16T00:51:02.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.901+0000 7f9f99bf1640 1 --2- 172.21.15.12:0/963865227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f9419b540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9f900097f0 tx=0x7f9f90030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:02.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.901+0000 7f9f8affd640 1 -- 172.21.15.12:0/963865227 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f90037040 con 0x7f9f94107550 2024-09-16T00:51:02.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.901+0000 7f9f8affd640 1 -- 172.21.15.12:0/963865227 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f90040070 con 0x7f9f94107550 2024-09-16T00:51:02.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.901+0000 7f9f9be55640 1 -- 172.21.15.12:0/963865227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9419bd10 con 0x7f9f94107550 2024-09-16T00:51:02.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.901+0000 7f9f8affd640 1 -- 172.21.15.12:0/963865227 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f9003a390 con 0x7f9f94107550 2024-09-16T00:51:02.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.901+0000 7f9f9be55640 1 -- 172.21.15.12:0/963865227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9419ea00 con 0x7f9f94107550 2024-09-16T00:51:02.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.901+0000 7f9f8affd640 1 -- 172.21.15.12:0/963865227 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9f9003a5e0 con 0x7f9f94107550 2024-09-16T00:51:02.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.901+0000 7f9f8affd640 1 -- 172.21.15.12:0/963865227 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9f90045950 con 0x7f9f94107550 2024-09-16T00:51:02.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.902+0000 7f9f9be55640 1 -- 172.21.15.12:0/963865227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f941079d0 con 0x7f9f94107550 2024-09-16T00:51:02.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.904+0000 7f9f8affd640 1 -- 172.21.15.12:0/963865227 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9f90045460 con 0x7f9f94107550 2024-09-16T00:51:02.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.963+0000 7f9f9be55640 1 -- 172.21.15.12:0/963865227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f9f9419c190 con 0x7f9f94107550 2024-09-16T00:51:02.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.965+0000 7f9f8affd640 1 -- 172.21.15.12:0/963865227 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f9f9003b430 con 0x7f9f94107550 2024-09-16T00:51:02.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.966+0000 7f9f9be55640 1 -- 172.21.15.12:0/963865227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 msgr2=0x7f9f9419b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:02.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.966+0000 7f9f9be55640 1 --2- 172.21.15.12:0/963865227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f9419b540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9f900097f0 tx=0x7f9f90030d80 comp rx=0 tx=0).stop 2024-09-16T00:51:02.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.966+0000 7f9f9be55640 1 -- 172.21.15.12:0/963865227 shutdown_connections 2024-09-16T00:51:02.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.966+0000 7f9f9be55640 1 --2- 172.21.15.12:0/963865227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f94107550 0x7f9f9419b540 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:02.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.966+0000 7f9f9be55640 1 -- 172.21.15.12:0/963865227 >> 172.21.15.12:0/963865227 conn(0x7f9f94102ce0 msgr2=0x7f9f94103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:02.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.966+0000 7f9f9be55640 1 -- 172.21.15.12:0/963865227 shutdown_connections 2024-09-16T00:51:02.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:01.966+0000 7f9f9be55640 1 -- 172.21.15.12:0/963865227 wait complete. 2024-09-16T00:51:02.486 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-16T00:51:02.498 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-16T00:51:02.498 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mgr... 2024-09-16T00:51:02.499 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-16T00:51:02.499 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-16T00:51:02.740 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.x 2024-09-16T00:51:02.740 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-16T00:51:02.897 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9a476aac-73c5-11ef-bceb-c7b262605968.target.wants/ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-9a476aac-73c5-11ef-bceb-c7b262605968@.service. 2024-09-16T00:51:03.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:02 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/963865227' entity='client.admin' 2024-09-16T00:51:04.606 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:04.512+0000 7fe4af753040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T00:51:04.865 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:51:04.865 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-16T00:51:04.872 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:51:04.873 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-16T00:51:04.873 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-16T00:51:04.873 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T00:51:04.882 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:51:04.882 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-16T00:51:04.889 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:51:04.889 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-16T00:51:04.890 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-16T00:51:04.890 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-16T00:51:04.890 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr to start... 2024-09-16T00:51:04.890 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr... 2024-09-16T00:51:04.993 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:04.669+0000 7fe4af753040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T00:51:04.993 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:04.739+0000 7fe4af753040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T00:51:04.993 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:04 smithi012 bash[31409]: f5f7edc6258704c57745a20eae384b3c539513cb7b9d69d5cbc53b0bbf1e35e3 2024-09-16T00:51:04.993 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:04 smithi012 systemd[1]: Started Ceph mgr.x for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:51:04.993 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:04.896+0000 7fe4af753040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:51:05.287 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:05 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:05.046+0000 7fe4af753040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T00:51:05.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1257173544' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T00:51:05.606 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:05 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:05.389+0000 7fe4af753040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T00:51:05.607 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:05 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:05.454+0000 7fe4af753040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T00:51:05.932 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:05 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:05.652+0000 7fe4af753040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T00:51:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:51:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:51:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T00:51:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T00:51:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T00:51:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T00:51:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T00:51:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T00:51:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T00:51:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T00:51:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T00:50:45:145115+0000", 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T00:51:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T00:50:45.145961+0000", 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T00:51:05.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.292+0000 7f3159571640 1 Processor -- start 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.292+0000 7f3159571640 1 -- start start 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.293+0000 7f3159571640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f315410a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.293+0000 7f3159571640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f315407be50 con 0x7f3154107fa0 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.293+0000 7f3152ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f315410a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.293+0000 7f3152ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f315410a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39054/0 (socket says 172.21.15.12:39054) 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.293+0000 7f3152ffd640 1 -- 172.21.15.12:0/3126529673 learned_addr learned my addr 172.21.15.12:0/3126529673 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.293+0000 7f3152ffd640 1 -- 172.21.15.12:0/3126529673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315410a8d0 con 0x7f3154107fa0 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.294+0000 7f3152ffd640 1 --2- 172.21.15.12:0/3126529673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f315410a390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3144009820 tx=0x7f314402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188108249c7762d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.294+0000 7f3151ffb640 1 -- 172.21.15.12:0/3126529673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3144037070 con 0x7f3154107fa0 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.294+0000 7f3151ffb640 1 -- 172.21.15.12:0/3126529673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3144032900 con 0x7f3154107fa0 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.294+0000 7f3151ffb640 1 -- 172.21.15.12:0/3126529673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3144030850 con 0x7f3154107fa0 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.295+0000 7f3159571640 1 -- 172.21.15.12:0/3126529673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 msgr2=0x7f315410a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:05.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.295+0000 7f3159571640 1 --2- 172.21.15.12:0/3126529673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f315410a390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3144009820 tx=0x7f314402a270 comp rx=0 tx=0).stop 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.295+0000 7f3159571640 1 -- 172.21.15.12:0/3126529673 shutdown_connections 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.295+0000 7f3159571640 1 --2- 172.21.15.12:0/3126529673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f315410a390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.295+0000 7f3159571640 1 -- 172.21.15.12:0/3126529673 >> 172.21.15.12:0/3126529673 conn(0x7f3154101bc0 msgr2=0x7f3154104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.295+0000 7f3159571640 1 -- 172.21.15.12:0/3126529673 shutdown_connections 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.295+0000 7f3159571640 1 -- 172.21.15.12:0/3126529673 wait complete. 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.296+0000 7f3159571640 1 Processor -- start 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.296+0000 7f3159571640 1 -- start start 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.296+0000 7f3159571640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f3154107820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.296+0000 7f3159571640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f315410b970 con 0x7f3154107fa0 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.296+0000 7f3152ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f3154107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.296+0000 7f3152ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f3154107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39062/0 (socket says 172.21.15.12:39062) 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.296+0000 7f3152ffd640 1 -- 172.21.15.12:0/1257173544 learned_addr learned my addr 172.21.15.12:0/1257173544 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.297+0000 7f3152ffd640 1 -- 172.21.15.12:0/1257173544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3154107d60 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.297+0000 7f3152ffd640 1 --2- 172.21.15.12:0/1257173544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f3154107820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3144032ce0 tx=0x7f3144032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.297+0000 7f314bfff640 1 -- 172.21.15.12:0/1257173544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3144042070 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.297+0000 7f314bfff640 1 -- 172.21.15.12:0/1257173544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31440308c0 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.297+0000 7f3159571640 1 -- 172.21.15.12:0/1257173544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3154105f50 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.297+0000 7f314bfff640 1 -- 172.21.15.12:0/1257173544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3144037040 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.297+0000 7f3159571640 1 -- 172.21.15.12:0/1257173544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3154106490 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.297+0000 7f314bfff640 1 -- 172.21.15.12:0/1257173544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3144045070 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.297+0000 7f314bfff640 1 -- 172.21.15.12:0/1257173544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f31440463b0 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.298+0000 7f3159571640 1 -- 172.21.15.12:0/1257173544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3154108400 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.300+0000 7f314bfff640 1 -- 172.21.15.12:0/1257173544 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3144047440 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.362+0000 7f3159571640 1 -- 172.21.15.12:0/1257173544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f31541067d0 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.363+0000 7f314bfff640 1 -- 172.21.15.12:0/1257173544 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f3144047620 con 0x7f3154107fa0 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.364+0000 7f3159571640 1 -- 172.21.15.12:0/1257173544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 msgr2=0x7f3154107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.364+0000 7f3159571640 1 --2- 172.21.15.12:0/1257173544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f3154107820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3144032ce0 tx=0x7f3144032d10 comp rx=0 tx=0).stop 2024-09-16T00:51:05.954 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.364+0000 7f3159571640 1 -- 172.21.15.12:0/1257173544 shutdown_connections 2024-09-16T00:51:05.954 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.364+0000 7f3159571640 1 --2- 172.21.15.12:0/1257173544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3154107fa0 0x7f3154107820 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:05.954 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.364+0000 7f3159571640 1 -- 172.21.15.12:0/1257173544 >> 172.21.15.12:0/1257173544 conn(0x7f3154101bc0 msgr2=0x7f3154102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:05.954 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.364+0000 7f3159571640 1 -- 172.21.15.12:0/1257173544 shutdown_connections 2024-09-16T00:51:05.954 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:05.364+0000 7f3159571640 1 -- 172.21.15.12:0/1257173544 wait complete. 2024-09-16T00:51:05.954 INFO:teuthology.orchestra.run.smithi012.stdout:mgr not available, waiting (1/15)... 2024-09-16T00:51:06.856 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:06 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:06.585+0000 7fe4af753040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T00:51:06.856 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:06 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:06.656+0000 7fe4af753040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T00:51:07.691 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:07.420+0000 7fe4af753040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T00:51:07.691 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:07.541+0000 7fe4af753040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T00:51:07.985 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:07.690+0000 7fe4af753040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:51:07.985 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:07.754+0000 7fe4af753040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T00:51:07.985 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:07.911+0000 7fe4af753040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T00:51:07.985 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:07.984+0000 7fe4af753040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T00:51:08.286 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:08.047+0000 7fe4af753040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T00:51:08.286 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:08.217+0000 7fe4af753040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T00:51:08.286 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:08.285+0000 7fe4af753040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T00:51:08.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:08 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/50503905' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T00:51:08.594 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:08.357+0000 7fe4af753040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T00:51:08.594 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:08.447+0000 7fe4af753040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T00:51:08.594 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:08.526+0000 7fe4af753040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T00:51:08.594 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:08.593+0000 7fe4af753040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T00:51:08.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T00:51:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T00:51:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T00:51:09.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T00:50:45:145115+0000", 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T00:51:09.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T00:50:45.145961+0000", 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.372+0000 7f0e726f7640 1 Processor -- start 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.372+0000 7f0e726f7640 1 -- start start 2024-09-16T00:51:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.372+0000 7f0e726f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c07caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.372+0000 7f0e726f7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c07cfe0 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.372+0000 7f0e6bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c07caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.372+0000 7f0e6bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c07caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40420/0 (socket says 172.21.15.12:40420) 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.372+0000 7f0e6bfff640 1 -- 172.21.15.12:0/112106363 learned_addr learned my addr 172.21.15.12:0/112106363 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.372+0000 7f0e6bfff640 1 -- 172.21.15.12:0/112106363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c07d160 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.373+0000 7f0e6bfff640 1 --2- 172.21.15.12:0/112106363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c07caa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009820 tx=0x7f0e5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39a579fc577ae34 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.373+0000 7f0e6affd640 1 -- 172.21.15.12:0/112106363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e5c037070 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.373+0000 7f0e6affd640 1 -- 172.21.15.12:0/112106363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e5c032900 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.373+0000 7f0e6affd640 1 -- 172.21.15.12:0/112106363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e5c030850 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.374+0000 7f0e726f7640 1 -- 172.21.15.12:0/112106363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 msgr2=0x7f0e6c07caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.374+0000 7f0e726f7640 1 --2- 172.21.15.12:0/112106363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c07caa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009820 tx=0x7f0e5c02a270 comp rx=0 tx=0).stop 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.374+0000 7f0e726f7640 1 -- 172.21.15.12:0/112106363 shutdown_connections 2024-09-16T00:51:09.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.374+0000 7f0e726f7640 1 --2- 172.21.15.12:0/112106363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c07caa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.374+0000 7f0e726f7640 1 -- 172.21.15.12:0/112106363 >> 172.21.15.12:0/112106363 conn(0x7f0e6c102de0 msgr2=0x7f0e6c1051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.374+0000 7f0e726f7640 1 -- 172.21.15.12:0/112106363 shutdown_connections 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.374+0000 7f0e726f7640 1 -- 172.21.15.12:0/112106363 wait complete. 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.375+0000 7f0e726f7640 1 Processor -- start 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.375+0000 7f0e726f7640 1 -- start start 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.375+0000 7f0e726f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.375+0000 7f0e726f7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c10db90 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.375+0000 7f0e6bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.375+0000 7f0e6bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c19d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40424/0 (socket says 172.21.15.12:40424) 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.375+0000 7f0e6bfff640 1 -- 172.21.15.12:0/50503905 learned_addr learned my addr 172.21.15.12:0/50503905 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.375+0000 7f0e6bfff640 1 -- 172.21.15.12:0/50503905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c19dc70 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.376+0000 7f0e6bfff640 1 --2- 172.21.15.12:0/50503905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c19d730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c032ce0 tx=0x7f0e5c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.376+0000 7f0e697fa640 1 -- 172.21.15.12:0/50503905 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e5c042070 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.376+0000 7f0e726f7640 1 -- 172.21.15.12:0/50503905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6c19df00 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.376+0000 7f0e697fa640 1 -- 172.21.15.12:0/50503905 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e5c0308c0 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.376+0000 7f0e697fa640 1 -- 172.21.15.12:0/50503905 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e5c037040 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.376+0000 7f0e726f7640 1 -- 172.21.15.12:0/50503905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6c1a0bf0 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.376+0000 7f0e697fa640 1 -- 172.21.15.12:0/50503905 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e5c045070 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.376+0000 7f0e697fa640 1 -- 172.21.15.12:0/50503905 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0e5c047bc0 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.377+0000 7f0e726f7640 1 -- 172.21.15.12:0/50503905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6c07cb20 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.379+0000 7f0e697fa640 1 -- 172.21.15.12:0/50503905 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0e5c03c7e0 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.441+0000 7f0e726f7640 1 -- 172.21.15.12:0/50503905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0e6c1a1100 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.442+0000 7f0e697fa640 1 -- 172.21.15.12:0/50503905 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f0e5c03c9c0 con 0x7f0e6c07e5f0 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.443+0000 7f0e726f7640 1 -- 172.21.15.12:0/50503905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 msgr2=0x7f0e6c19d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.443+0000 7f0e726f7640 1 --2- 172.21.15.12:0/50503905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c19d730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c032ce0 tx=0x7f0e5c032d10 comp rx=0 tx=0).stop 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.443+0000 7f0e726f7640 1 -- 172.21.15.12:0/50503905 shutdown_connections 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.443+0000 7f0e726f7640 1 --2- 172.21.15.12:0/50503905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e6c07e5f0 0x7f0e6c19d730 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:09.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.443+0000 7f0e726f7640 1 -- 172.21.15.12:0/50503905 >> 172.21.15.12:0/50503905 conn(0x7f0e6c102de0 msgr2=0x7f0e6c103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:09.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.443+0000 7f0e726f7640 1 -- 172.21.15.12:0/50503905 shutdown_connections 2024-09-16T00:51:09.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:08.443+0000 7f0e726f7640 1 -- 172.21.15.12:0/50503905 wait complete. 2024-09-16T00:51:09.011 INFO:teuthology.orchestra.run.smithi012.stdout:mgr not available, waiting (2/15)... 2024-09-16T00:51:09.856 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:09.430+0000 7fe4af753040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: Activating manager daemon x 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: mgrmap e2: x(active, starting, since 0.00290871s) 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: from='mgr.14100 172.21.15.12:0/271825839' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: from='mgr.14100 172.21.15.12:0/271825839' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: from='mgr.14100 172.21.15.12:0/271825839' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: from='mgr.14100 172.21.15.12:0/271825839' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: from='mgr.14100 172.21.15.12:0/271825839' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: Manager daemon x is now available 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: from='mgr.14100 172.21.15.12:0/271825839' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: from='mgr.14100 172.21.15.12:0/271825839' entity='mgr.x' 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: from='mgr.14100 172.21.15.12:0/271825839' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: from='mgr.14100 172.21.15.12:0/271825839' entity='mgr.x' 2024-09-16T00:51:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:09 smithi012 ceph-mon[31197]: from='mgr.14100 172.21.15.12:0/271825839' entity='mgr.x' 2024-09-16T00:51:11.676 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:11 smithi012 ceph-mon[31197]: mgrmap e3: x(active, since 1.00722s) 2024-09-16T00:51:12.218 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:51:12.218 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:51:12.218 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T00:51:12.218 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T00:51:12.218 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T00:51:12.218 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T00:51:12.218 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T00:51:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T00:51:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T00:51:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T00:51:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T00:51:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T00:51:12.229 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T00:51:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T00:50:45:145115+0000", 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T00:51:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T00:50:45.145961+0000", 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:51:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:51:12.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T00:51:12.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:51:12.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.418+0000 7fe676c24640 1 Processor -- start 2024-09-16T00:51:12.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.418+0000 7fe676c24640 1 -- start start 2024-09-16T00:51:12.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.418+0000 7fe676c24640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe670107960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:12.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.418+0000 7fe676c24640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe670107f30 con 0x7fe670107560 2024-09-16T00:51:12.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.419+0000 7fe6749c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe670107960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:12.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.419+0000 7fe6749c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe670107960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40482/0 (socket says 172.21.15.12:40482) 2024-09-16T00:51:12.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.419+0000 7fe6749c0640 1 -- 172.21.15.12:0/1189730331 learned_addr learned my addr 172.21.15.12:0/1189730331 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:12.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.419+0000 7fe6749c0640 1 -- 172.21.15.12:0/1189730331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe670108710 con 0x7fe670107560 2024-09-16T00:51:12.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.420+0000 7fe6749c0640 1 --2- 172.21.15.12:0/1189730331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe670107960 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe668009820 tx=0x7fe66802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbaf820b906b9de server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:12.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.420+0000 7fe66f7fe640 1 -- 172.21.15.12:0/1189730331 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe668037070 con 0x7fe670107560 2024-09-16T00:51:12.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.420+0000 7fe66f7fe640 1 -- 172.21.15.12:0/1189730331 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe668032900 con 0x7fe670107560 2024-09-16T00:51:12.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.420+0000 7fe66f7fe640 1 -- 172.21.15.12:0/1189730331 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe668030850 con 0x7fe670107560 2024-09-16T00:51:12.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.420+0000 7fe676c24640 1 -- 172.21.15.12:0/1189730331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 msgr2=0x7fe670107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:12.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.420+0000 7fe676c24640 1 --2- 172.21.15.12:0/1189730331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe670107960 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe668009820 tx=0x7fe66802a270 comp rx=0 tx=0).stop 2024-09-16T00:51:12.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.421+0000 7fe676c24640 1 -- 172.21.15.12:0/1189730331 shutdown_connections 2024-09-16T00:51:12.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.421+0000 7fe676c24640 1 --2- 172.21.15.12:0/1189730331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe670107960 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.421+0000 7fe676c24640 1 -- 172.21.15.12:0/1189730331 >> 172.21.15.12:0/1189730331 conn(0x7fe670102de0 msgr2=0x7fe6701051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.421+0000 7fe676c24640 1 -- 172.21.15.12:0/1189730331 shutdown_connections 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.421+0000 7fe676c24640 1 -- 172.21.15.12:0/1189730331 wait complete. 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.421+0000 7fe676c24640 1 Processor -- start 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.421+0000 7fe676c24640 1 -- start start 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.421+0000 7fe676c24640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe67019b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.421+0000 7fe676c24640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe67010bac0 con 0x7fe670107560 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.422+0000 7fe6749c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe67019b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.422+0000 7fe6749c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe67019b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40488/0 (socket says 172.21.15.12:40488) 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.422+0000 7fe6749c0640 1 -- 172.21.15.12:0/752010943 learned_addr learned my addr 172.21.15.12:0/752010943 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.422+0000 7fe6749c0640 1 -- 172.21.15.12:0/752010943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67019ba70 con 0x7fe670107560 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.422+0000 7fe6749c0640 1 --2- 172.21.15.12:0/752010943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe67019b530 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6680097f0 tx=0x7fe668030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.422+0000 7fe66dffb640 1 -- 172.21.15.12:0/752010943 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe668037040 con 0x7fe670107560 2024-09-16T00:51:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.422+0000 7fe66dffb640 1 -- 172.21.15.12:0/752010943 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe668040070 con 0x7fe670107560 2024-09-16T00:51:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.422+0000 7fe66dffb640 1 -- 172.21.15.12:0/752010943 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe66803a390 con 0x7fe670107560 2024-09-16T00:51:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.422+0000 7fe676c24640 1 -- 172.21.15.12:0/752010943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67019bd00 con 0x7fe670107560 2024-09-16T00:51:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.423+0000 7fe676c24640 1 -- 172.21.15.12:0/752010943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67019e9f0 con 0x7fe670107560 2024-09-16T00:51:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.424+0000 7fe66dffb640 1 -- 172.21.15.12:0/752010943 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7fe66803b430 con 0x7fe670107560 2024-09-16T00:51:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.424+0000 7fe66dffb640 1 --2- 172.21.15.12:0/752010943 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe65c0390a0 0x7fe65c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.424+0000 7fe676c24640 1 -- 172.21.15.12:0/752010943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67010bc40 con 0x7fe670107560 2024-09-16T00:51:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.424+0000 7fe66dffb640 1 -- 172.21.15.12:0/752010943 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe66806c160 con 0x7fe670107560 2024-09-16T00:51:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.424+0000 7fe66ffff640 1 --2- 172.21.15.12:0/752010943 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe65c0390a0 0x7fe65c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.424+0000 7fe66ffff640 1 --2- 172.21.15.12:0/752010943 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe65c0390a0 0x7fe65c03b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe66000ad30 tx=0x7fe6600093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.429+0000 7fe66dffb640 1 -- 172.21.15.12:0/752010943 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe66803a590 con 0x7fe670107560 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.437+0000 7fe66dffb640 1 -- 172.21.15.12:0/752010943 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fe668032900 con 0x7fe670107560 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.676+0000 7fe676c24640 1 -- 172.21.15.12:0/752010943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe67019efe0 con 0x7fe670107560 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.676+0000 7fe66dffb640 1 -- 172.21.15.12:0/752010943 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fe668041e00 con 0x7fe670107560 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.679+0000 7fe676c24640 1 -- 172.21.15.12:0/752010943 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe65c0390a0 msgr2=0x7fe65c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.679+0000 7fe676c24640 1 --2- 172.21.15.12:0/752010943 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe65c0390a0 0x7fe65c03b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe66000ad30 tx=0x7fe6600093f0 comp rx=0 tx=0).stop 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.679+0000 7fe676c24640 1 -- 172.21.15.12:0/752010943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 msgr2=0x7fe67019b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.679+0000 7fe676c24640 1 --2- 172.21.15.12:0/752010943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe67019b530 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6680097f0 tx=0x7fe668030d80 comp rx=0 tx=0).stop 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.680+0000 7fe676c24640 1 -- 172.21.15.12:0/752010943 shutdown_connections 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.680+0000 7fe676c24640 1 --2- 172.21.15.12:0/752010943 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe65c0390a0 0x7fe65c03b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.680+0000 7fe676c24640 1 --2- 172.21.15.12:0/752010943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe670107560 0x7fe67019b530 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.680+0000 7fe676c24640 1 -- 172.21.15.12:0/752010943 >> 172.21.15.12:0/752010943 conn(0x7fe670102de0 msgr2=0x7fe670103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:12.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.680+0000 7fe676c24640 1 -- 172.21.15.12:0/752010943 shutdown_connections 2024-09-16T00:51:12.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:11.680+0000 7fe676c24640 1 -- 172.21.15.12:0/752010943 wait complete. 2024-09-16T00:51:12.238 INFO:teuthology.orchestra.run.smithi012.stdout:mgr is available 2024-09-16T00:51:12.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:12 smithi012 ceph-mon[31197]: mgrmap e4: x(active, since 2s) 2024-09-16T00:51:12.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:12 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/752010943' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T00:51:13.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:51:13.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T00:51:13.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:51:13.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-16T00:51:13.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T00:51:13.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T00:51:13.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T00:51:13.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.581+0000 7f8636b66640 1 Processor -- start 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.581+0000 7f8636b66640 1 -- start start 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.581+0000 7f8636b66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f8630107950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.581+0000 7f8636b66640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8630107f20 con 0x7f8630107550 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.581+0000 7f8634902640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f8630107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.582+0000 7f8634902640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f8630107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40494/0 (socket says 172.21.15.12:40494) 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.582+0000 7f8634902640 1 -- 172.21.15.12:0/3432906674 learned_addr learned my addr 172.21.15.12:0/3432906674 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.582+0000 7f8634902640 1 -- 172.21.15.12:0/3432906674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8630108750 con 0x7f8630107550 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f8634902640 1 --2- 172.21.15.12:0/3432906674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f8630107950 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8628009e80 tx=0x7f862802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6720f1b22b35a57b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f862f7fe640 1 -- 172.21.15.12:0/3432906674 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8628036070 con 0x7f8630107550 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f862f7fe640 1 -- 172.21.15.12:0/3432906674 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86280318c0 con 0x7f8630107550 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f862f7fe640 1 -- 172.21.15.12:0/3432906674 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8628007ab0 con 0x7f8630107550 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f8636b66640 1 -- 172.21.15.12:0/3432906674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 msgr2=0x7f8630107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f8636b66640 1 --2- 172.21.15.12:0/3432906674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f8630107950 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8628009e80 tx=0x7f862802a7a0 comp rx=0 tx=0).stop 2024-09-16T00:51:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f8636b66640 1 -- 172.21.15.12:0/3432906674 shutdown_connections 2024-09-16T00:51:13.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f8636b66640 1 --2- 172.21.15.12:0/3432906674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f8630107950 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:13.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f8636b66640 1 -- 172.21.15.12:0/3432906674 >> 172.21.15.12:0/3432906674 conn(0x7f8630102ce0 msgr2=0x7f8630105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:13.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f8636b66640 1 -- 172.21.15.12:0/3432906674 shutdown_connections 2024-09-16T00:51:13.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.583+0000 7f8636b66640 1 -- 172.21.15.12:0/3432906674 wait complete. 2024-09-16T00:51:13.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.584+0000 7f8636b66640 1 Processor -- start 2024-09-16T00:51:13.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.584+0000 7f8636b66640 1 -- start start 2024-09-16T00:51:13.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.584+0000 7f8636b66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f863019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:13.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.584+0000 7f8636b66640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f863010bb00 con 0x7f8630107550 2024-09-16T00:51:13.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.584+0000 7f8634902640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f863019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:13.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.584+0000 7f8634902640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f863019b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40500/0 (socket says 172.21.15.12:40500) 2024-09-16T00:51:13.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.584+0000 7f8634902640 1 -- 172.21.15.12:0/3836151504 learned_addr learned my addr 172.21.15.12:0/3836151504 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:13.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.585+0000 7f8634902640 1 -- 172.21.15.12:0/3836151504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863019ba80 con 0x7f8630107550 2024-09-16T00:51:13.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.585+0000 7f8634902640 1 --2- 172.21.15.12:0/3836151504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f863019b540 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f862802acc0 tx=0x7f8628031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:13.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.585+0000 7f862dffb640 1 -- 172.21.15.12:0/3836151504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8628036050 con 0x7f8630107550 2024-09-16T00:51:13.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.585+0000 7f862dffb640 1 -- 172.21.15.12:0/3836151504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8628037040 con 0x7f8630107550 2024-09-16T00:51:13.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.585+0000 7f862dffb640 1 -- 172.21.15.12:0/3836151504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862803d8c0 con 0x7f8630107550 2024-09-16T00:51:13.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.585+0000 7f8636b66640 1 -- 172.21.15.12:0/3836151504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863019bd10 con 0x7f8630107550 2024-09-16T00:51:13.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.585+0000 7f8636b66640 1 -- 172.21.15.12:0/3836151504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863019ea00 con 0x7f8630107550 2024-09-16T00:51:13.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.586+0000 7f862dffb640 1 -- 172.21.15.12:0/3836151504 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f8628044020 con 0x7f8630107550 2024-09-16T00:51:13.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.586+0000 7f862dffb640 1 --2- 172.21.15.12:0/3836151504 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f86180391b0 0x7f861803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:13.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.586+0000 7f862dffb640 1 -- 172.21.15.12:0/3836151504 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8628042020 con 0x7f8630107550 2024-09-16T00:51:13.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.586+0000 7f8636b66640 1 -- 172.21.15.12:0/3836151504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863010bc80 con 0x7f8630107550 2024-09-16T00:51:13.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.586+0000 7f862ffff640 1 --2- 172.21.15.12:0/3836151504 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f86180391b0 0x7f861803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:13.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.587+0000 7f862ffff640 1 --2- 172.21.15.12:0/3836151504 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f86180391b0 0x7f861803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f86240098c0 tx=0x7f8624006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:13.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.591+0000 7f862dffb640 1 -- 172.21.15.12:0/3836151504 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f862804b020 con 0x7f8630107550 2024-09-16T00:51:13.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.768+0000 7f8636b66640 1 -- 172.21.15.12:0/3836151504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f86301079d0 con 0x7f8630107550 2024-09-16T00:51:13.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.769+0000 7f862dffb640 1 -- 172.21.15.12:0/3836151504 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f862803bb30 con 0x7f8630107550 2024-09-16T00:51:13.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.771+0000 7f8636b66640 1 -- 172.21.15.12:0/3836151504 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f86180391b0 msgr2=0x7f861803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.771+0000 7f8636b66640 1 --2- 172.21.15.12:0/3836151504 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f86180391b0 0x7f861803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f86240098c0 tx=0x7f8624006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.771+0000 7f8636b66640 1 -- 172.21.15.12:0/3836151504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 msgr2=0x7f863019b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.771+0000 7f8636b66640 1 --2- 172.21.15.12:0/3836151504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f863019b540 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f862802acc0 tx=0x7f8628031ca0 comp rx=0 tx=0).stop 2024-09-16T00:51:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.771+0000 7f8636b66640 1 -- 172.21.15.12:0/3836151504 shutdown_connections 2024-09-16T00:51:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.771+0000 7f8636b66640 1 --2- 172.21.15.12:0/3836151504 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f86180391b0 0x7f861803b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.771+0000 7f8636b66640 1 --2- 172.21.15.12:0/3836151504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8630107550 0x7f863019b540 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.771+0000 7f8636b66640 1 -- 172.21.15.12:0/3836151504 >> 172.21.15.12:0/3836151504 conn(0x7f8630102ce0 msgr2=0x7f8630103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.771+0000 7f8636b66640 1 -- 172.21.15.12:0/3836151504 shutdown_connections 2024-09-16T00:51:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:12.772+0000 7f8636b66640 1 -- 172.21.15.12:0/3836151504 wait complete. 2024-09-16T00:51:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling cephadm module... 2024-09-16T00:51:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:13 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3836151504' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T00:51:14.768 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:14 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1413856489' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-16T00:51:14.769 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: ignoring --setuser ceph since I am not root 2024-09-16T00:51:14.769 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: ignoring --setgroup ceph since I am not root 2024-09-16T00:51:14.769 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:14.601+0000 7f31cbd80040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T00:51:14.769 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:14.662+0000 7f31cbd80040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T00:51:15.047 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:14.820+0000 7f31cbd80040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T00:51:15.047 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:14.890+0000 7f31cbd80040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T00:51:15.047 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:15.046+0000 7f31cbd80040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:51:15.072 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.663+0000 7fda063ee640 1 Processor -- start 2024-09-16T00:51:15.077 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.663+0000 7fda063ee640 1 -- start start 2024-09-16T00:51:15.077 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.663+0000 7fda063ee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00106830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:15.077 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.663+0000 7fda063ee640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fda00106e00 con 0x7fda00106430 2024-09-16T00:51:15.077 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.663+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00106830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:15.077 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.663+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00106830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40510/0 (socket says 172.21.15.12:40510) 2024-09-16T00:51:15.077 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.663+0000 7fd9fffff640 1 -- 172.21.15.12:0/3572467114 learned_addr learned my addr 172.21.15.12:0/3572467114 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:15.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.664+0000 7fd9fffff640 1 -- 172.21.15.12:0/3572467114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda00107630 con 0x7fda00106430 2024-09-16T00:51:15.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.664+0000 7fd9fffff640 1 --2- 172.21.15.12:0/3572467114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00106830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009820 tx=0x7fd9f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673cd9a7faf994b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:15.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.665+0000 7fd9ff7fe640 1 -- 172.21.15.12:0/3572467114 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0037070 con 0x7fda00106430 2024-09-16T00:51:15.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.665+0000 7fd9ff7fe640 1 -- 172.21.15.12:0/3572467114 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9f0032900 con 0x7fda00106430 2024-09-16T00:51:15.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.665+0000 7fd9ff7fe640 1 -- 172.21.15.12:0/3572467114 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0030850 con 0x7fda00106430 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.665+0000 7fda063ee640 1 -- 172.21.15.12:0/3572467114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 msgr2=0x7fda00106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.665+0000 7fda063ee640 1 --2- 172.21.15.12:0/3572467114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00106830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009820 tx=0x7fd9f002a270 comp rx=0 tx=0).stop 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.665+0000 7fda063ee640 1 -- 172.21.15.12:0/3572467114 shutdown_connections 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.665+0000 7fda063ee640 1 --2- 172.21.15.12:0/3572467114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00106830 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.665+0000 7fda063ee640 1 -- 172.21.15.12:0/3572467114 >> 172.21.15.12:0/3572467114 conn(0x7fda00101bc0 msgr2=0x7fda00104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.665+0000 7fda063ee640 1 -- 172.21.15.12:0/3572467114 shutdown_connections 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.665+0000 7fda063ee640 1 -- 172.21.15.12:0/3572467114 wait complete. 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.666+0000 7fda063ee640 1 Processor -- start 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.666+0000 7fda063ee640 1 -- start start 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.666+0000 7fda063ee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00191660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.666+0000 7fda063ee640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fda0010a9e0 con 0x7fda00106430 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.666+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00191660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.666+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00191660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40526/0 (socket says 172.21.15.12:40526) 2024-09-16T00:51:15.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.666+0000 7fd9fffff640 1 -- 172.21.15.12:0/1413856489 learned_addr learned my addr 172.21.15.12:0/1413856489 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:15.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.667+0000 7fd9fffff640 1 -- 172.21.15.12:0/1413856489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda00191ba0 con 0x7fda00106430 2024-09-16T00:51:15.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.667+0000 7fd9fffff640 1 --2- 172.21.15.12:0/1413856489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00191660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00097f0 tx=0x7fd9f0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:15.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.667+0000 7fd9fdffb640 1 -- 172.21.15.12:0/1413856489 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0037040 con 0x7fda00106430 2024-09-16T00:51:15.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.667+0000 7fd9fdffb640 1 -- 172.21.15.12:0/1413856489 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9f0040070 con 0x7fda00106430 2024-09-16T00:51:15.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.667+0000 7fda063ee640 1 -- 172.21.15.12:0/1413856489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0018fd90 con 0x7fda00106430 2024-09-16T00:51:15.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.667+0000 7fd9fdffb640 1 -- 172.21.15.12:0/1413856489 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f003a390 con 0x7fda00106430 2024-09-16T00:51:15.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.667+0000 7fda063ee640 1 -- 172.21.15.12:0/1413856489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda00190270 con 0x7fda00106430 2024-09-16T00:51:15.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.668+0000 7fd9fdffb640 1 -- 172.21.15.12:0/1413856489 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fd9f003a640 con 0x7fda00106430 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.668+0000 7fda063ee640 1 -- 172.21.15.12:0/1413856489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda0010ab60 con 0x7fda00106430 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.669+0000 7fd9fdffb640 1 --2- 172.21.15.12:0/1413856489 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fd9ec0391b0 0x7fd9ec03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.669+0000 7fd9fdffb640 1 -- 172.21.15.12:0/1413856489 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd9f006c5c0 con 0x7fda00106430 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.669+0000 7fd9f7fff640 1 --2- 172.21.15.12:0/1413856489 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fd9ec0391b0 0x7fd9ec03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.669+0000 7fd9f7fff640 1 --2- 172.21.15.12:0/1413856489 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fd9ec0391b0 0x7fd9ec03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80098c0 tx=0x7fd9e8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.673+0000 7fd9fdffb640 1 -- 172.21.15.12:0/1413856489 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd9f006c320 con 0x7fda00106430 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:13.919+0000 7fda063ee640 1 -- 172.21.15.12:0/1413856489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fda001953e0 con 0x7fda00106430 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.443+0000 7fd9fdffb640 1 -- 172.21.15.12:0/1413856489 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fd9f003a930 con 0x7fda00106430 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.444+0000 7fd9fdffb640 1 -- 172.21.15.12:0/1413856489 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fd9f002fd60 con 0x7fda00106430 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.446+0000 7fda063ee640 1 -- 172.21.15.12:0/1413856489 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fd9ec0391b0 msgr2=0x7fd9ec03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.446+0000 7fda063ee640 1 --2- 172.21.15.12:0/1413856489 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fd9ec0391b0 0x7fd9ec03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80098c0 tx=0x7fd9e8006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.446+0000 7fda063ee640 1 -- 172.21.15.12:0/1413856489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 msgr2=0x7fda00191660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.446+0000 7fda063ee640 1 --2- 172.21.15.12:0/1413856489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00191660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00097f0 tx=0x7fd9f0030d80 comp rx=0 tx=0).stop 2024-09-16T00:51:15.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.446+0000 7fda063ee640 1 -- 172.21.15.12:0/1413856489 shutdown_connections 2024-09-16T00:51:15.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.446+0000 7fda063ee640 1 --2- 172.21.15.12:0/1413856489 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fd9ec0391b0 0x7fd9ec03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:15.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.446+0000 7fda063ee640 1 --2- 172.21.15.12:0/1413856489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda00106430 0x7fda00191660 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:15.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.446+0000 7fda063ee640 1 -- 172.21.15.12:0/1413856489 >> 172.21.15.12:0/1413856489 conn(0x7fda00101bc0 msgr2=0x7fda00102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:15.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.446+0000 7fda063ee640 1 -- 172.21.15.12:0/1413856489 shutdown_connections 2024-09-16T00:51:15.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:14.446+0000 7fda063ee640 1 -- 172.21.15.12:0/1413856489 wait complete. 2024-09-16T00:51:15.319 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:15.200+0000 7f31cbd80040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T00:51:15.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:15 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1413856489' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-16T00:51:15.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:15 smithi012 ceph-mon[31197]: mgrmap e5: x(active, since 5s) 2024-09-16T00:51:15.603 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:15.538+0000 7f31cbd80040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T00:51:15.603 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:15.602+0000 7f31cbd80040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T00:51:15.856 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:15.800+0000 7f31cbd80040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T00:51:16.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:51:16.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-16T00:51:16.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T00:51:16.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-16T00:51:16.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.501+0000 7f833955d640 1 Processor -- start 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.501+0000 7f833955d640 1 -- start start 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.501+0000 7f833955d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833410a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.501+0000 7f833955d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f833407c6e0 con 0x7f8334107fc0 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.502+0000 7f8332ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833410a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.502+0000 7f8332ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833410a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40538/0 (socket says 172.21.15.12:40538) 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.502+0000 7f8332ffd640 1 -- 172.21.15.12:0/3557883934 learned_addr learned my addr 172.21.15.12:0/3557883934 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.502+0000 7f8332ffd640 1 -- 172.21.15.12:0/3557883934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833410a8f0 con 0x7f8334107fc0 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.503+0000 7f8332ffd640 1 --2- 172.21.15.12:0/3557883934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833410a3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8324009820 tx=0x7f832402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1073a3f1f159d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.503+0000 7f83327fc640 1 -- 172.21.15.12:0/3557883934 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8324037070 con 0x7f8334107fc0 2024-09-16T00:51:16.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.503+0000 7f83327fc640 1 -- 172.21.15.12:0/3557883934 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8324032900 con 0x7f8334107fc0 2024-09-16T00:51:16.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.503+0000 7f83327fc640 1 -- 172.21.15.12:0/3557883934 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8324030850 con 0x7f8334107fc0 2024-09-16T00:51:16.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.504+0000 7f833955d640 1 -- 172.21.15.12:0/3557883934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 msgr2=0x7f833410a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:16.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.504+0000 7f833955d640 1 --2- 172.21.15.12:0/3557883934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833410a3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8324009820 tx=0x7f832402a270 comp rx=0 tx=0).stop 2024-09-16T00:51:16.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.504+0000 7f833955d640 1 -- 172.21.15.12:0/3557883934 shutdown_connections 2024-09-16T00:51:16.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.504+0000 7f833955d640 1 --2- 172.21.15.12:0/3557883934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833410a3b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:16.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.504+0000 7f833955d640 1 -- 172.21.15.12:0/3557883934 >> 172.21.15.12:0/3557883934 conn(0x7f8334101be0 msgr2=0x7f8334104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:16.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.504+0000 7f833955d640 1 -- 172.21.15.12:0/3557883934 shutdown_connections 2024-09-16T00:51:16.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.504+0000 7f833955d640 1 -- 172.21.15.12:0/3557883934 wait complete. 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.504+0000 7f833955d640 1 Processor -- start 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.504+0000 7f833955d640 1 -- start start 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f833955d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833419d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f833955d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f833410b990 con 0x7f8334107fc0 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f8332ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833419d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f8332ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833419d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40540/0 (socket says 172.21.15.12:40540) 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f8332ffd640 1 -- 172.21.15.12:0/558734544 learned_addr learned my addr 172.21.15.12:0/558734544 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f8332ffd640 1 -- 172.21.15.12:0/558734544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833419dce0 con 0x7f8334107fc0 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f8332ffd640 1 --2- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833419d7a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83240097f0 tx=0x7f8324030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f8330ff9640 1 -- 172.21.15.12:0/558734544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8324037040 con 0x7f8334107fc0 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f8330ff9640 1 -- 172.21.15.12:0/558734544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8324040070 con 0x7f8334107fc0 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f833955d640 1 -- 172.21.15.12:0/558734544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833419df70 con 0x7f8334107fc0 2024-09-16T00:51:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f8330ff9640 1 -- 172.21.15.12:0/558734544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f832403a390 con 0x7f8334107fc0 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.505+0000 7f833955d640 1 -- 172.21.15.12:0/558734544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83341a0c60 con 0x7f8334107fc0 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.506+0000 7f8330ff9640 1 -- 172.21.15.12:0/558734544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f8324032900 con 0x7f8334107fc0 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.506+0000 7f833955d640 1 -- 172.21.15.12:0/558734544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8334108420 con 0x7f8334107fc0 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.507+0000 7f8330ff9640 1 --2- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f8320039200 0x7f832003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.507+0000 7f8330ff9640 1 -- 172.21.15.12:0/558734544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f832406c410 con 0x7f8334107fc0 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.507+0000 7f832bfff640 1 -- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f8320039200 msgr2=0x7f832003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3324219193 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.507+0000 7f832bfff640 1 --2- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f8320039200 0x7f832003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.511+0000 7f8330ff9640 1 -- 172.21.15.12:0/558734544 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f832406c170 con 0x7f8334107fc0 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.708+0000 7f832bfff640 1 -- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f8320039200 msgr2=0x7f832003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3324219193 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.708+0000 7f832bfff640 1 --2- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f8320039200 0x7f832003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.737+0000 7f833955d640 1 -- 172.21.15.12:0/558734544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f83341a12e0 con 0x7f8334107fc0 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.738+0000 7f8330ff9640 1 -- 172.21.15.12:0/558734544 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f8324040ce0 con 0x7f8334107fc0 2024-09-16T00:51:16.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.740+0000 7f833955d640 1 -- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f8320039200 msgr2=0x7f832003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.740+0000 7f833955d640 1 --2- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f8320039200 0x7f832003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.740+0000 7f833955d640 1 -- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 msgr2=0x7f833419d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.740+0000 7f833955d640 1 --2- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833419d7a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83240097f0 tx=0x7f8324030d80 comp rx=0 tx=0).stop 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.740+0000 7f833955d640 1 -- 172.21.15.12:0/558734544 shutdown_connections 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.740+0000 7f833955d640 1 --2- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7f8320039200 0x7f832003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.740+0000 7f833955d640 1 --2- 172.21.15.12:0/558734544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8334107fc0 0x7f833419d7a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.740+0000 7f833955d640 1 -- 172.21.15.12:0/558734544 >> 172.21.15.12:0/558734544 conn(0x7f8334101be0 msgr2=0x7f8334102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.740+0000 7f833955d640 1 -- 172.21.15.12:0/558734544 shutdown_connections 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:15.740+0000 7f833955d640 1 -- 172.21.15.12:0/558734544 wait complete. 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2024-09-16T00:51:16.331 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 5... 2024-09-16T00:51:16.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:16 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/558734544' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T00:51:17.106 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:16 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:16.739+0000 7f31cbd80040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T00:51:17.106 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:16 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:16.809+0000 7f31cbd80040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T00:51:17.606 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:17 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:17.553+0000 7f31cbd80040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T00:51:18.042 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:17 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:17.673+0000 7f31cbd80040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T00:51:18.043 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:17 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:17.822+0000 7f31cbd80040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:51:18.043 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:17 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:17.885+0000 7f31cbd80040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T00:51:18.043 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:18 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:18.042+0000 7f31cbd80040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T00:51:18.340 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:18 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:18.112+0000 7f31cbd80040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T00:51:18.340 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:18 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:18.175+0000 7f31cbd80040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T00:51:18.340 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:18 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:18.339+0000 7f31cbd80040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T00:51:18.606 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:18 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:18.407+0000 7f31cbd80040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T00:51:18.606 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:18 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:18.476+0000 7f31cbd80040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T00:51:18.606 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:18 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:18.563+0000 7f31cbd80040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T00:51:19.106 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:18 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:18.625+0000 7f31cbd80040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T00:51:19.106 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:18 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:18.686+0000 7f31cbd80040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T00:51:19.856 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:19.510+0000 7f31cbd80040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T00:51:19.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: Active manager daemon x restarted 2024-09-16T00:51:19.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: Activating manager daemon x 2024-09-16T00:51:19.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: osdmap e2: 0 total, 0 up, 0 in 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: mgrmap e6: x(active, starting, since 0.00319279s) 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: Manager daemon x is now available 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:51:19.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:19 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.719+0000 7fe8faae6640 1 Processor -- start 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.719+0000 7fe8faae6640 1 -- start start 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.719+0000 7fe8faae6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f41068a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.719+0000 7fe8faae6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f4106e70 con 0x7fe8f41064a0 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.719+0000 7fe8f8882640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f41068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.719+0000 7fe8f8882640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f41068a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47856/0 (socket says 172.21.15.12:47856) 2024-09-16T00:51:21.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.719+0000 7fe8f8882640 1 -- 172.21.15.12:0/3859491967 learned_addr learned my addr 172.21.15.12:0/3859491967 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.719+0000 7fe8f8882640 1 -- 172.21.15.12:0/3859491967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f41076a0 con 0x7fe8f41064a0 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.720+0000 7fe8f8882640 1 --2- 172.21.15.12:0/3859491967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f41068a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009820 tx=0x7fe8e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f12eff16c5d5fc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.721+0000 7fe8f37fe640 1 -- 172.21.15.12:0/3859491967 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e8037070 con 0x7fe8f41064a0 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.721+0000 7fe8f37fe640 1 -- 172.21.15.12:0/3859491967 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe8e8032900 con 0x7fe8f41064a0 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.721+0000 7fe8f37fe640 1 -- 172.21.15.12:0/3859491967 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e8030850 con 0x7fe8f41064a0 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.721+0000 7fe8faae6640 1 -- 172.21.15.12:0/3859491967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 msgr2=0x7fe8f41068a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.721+0000 7fe8faae6640 1 --2- 172.21.15.12:0/3859491967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f41068a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009820 tx=0x7fe8e802a270 comp rx=0 tx=0).stop 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.721+0000 7fe8faae6640 1 -- 172.21.15.12:0/3859491967 shutdown_connections 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.721+0000 7fe8faae6640 1 --2- 172.21.15.12:0/3859491967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f41068a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.721+0000 7fe8faae6640 1 -- 172.21.15.12:0/3859491967 >> 172.21.15.12:0/3859491967 conn(0x7fe8f4101c10 msgr2=0x7fe8f4104070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.722+0000 7fe8faae6640 1 -- 172.21.15.12:0/3859491967 shutdown_connections 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.722+0000 7fe8faae6640 1 -- 172.21.15.12:0/3859491967 wait complete. 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.722+0000 7fe8faae6640 1 Processor -- start 2024-09-16T00:51:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.722+0000 7fe8faae6640 1 -- start start 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.722+0000 7fe8faae6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f419d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.722+0000 7fe8faae6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f410aa50 con 0x7fe8f41064a0 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.723+0000 7fe8f8882640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f419d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.723+0000 7fe8f8882640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f419d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47868/0 (socket says 172.21.15.12:47868) 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.723+0000 7fe8f8882640 1 -- 172.21.15.12:0/4176727484 learned_addr learned my addr 172.21.15.12:0/4176727484 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.723+0000 7fe8f8882640 1 -- 172.21.15.12:0/4176727484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f419dd70 con 0x7fe8f41064a0 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.723+0000 7fe8f8882640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f419d830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80097f0 tx=0x7fe8e8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.723+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e8042070 con 0x7fe8f41064a0 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.723+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe8e8032ca0 con 0x7fe8f41064a0 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.723+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e8037040 con 0x7fe8f41064a0 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.723+0000 7fe8faae6640 1 -- 172.21.15.12:0/4176727484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f419e000 con 0x7fe8f41064a0 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.724+0000 7fe8faae6640 1 -- 172.21.15.12:0/4176727484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f41a0cf0 con 0x7fe8f41064a0 2024-09-16T00:51:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.724+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fe8e8045070 con 0x7fe8f41064a0 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.725+0000 7fe8f1ffb640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 0x7fe8e403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.725+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 --> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe8e403bdd0 con 0x7fe8e4039200 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.725+0000 7fe8f3fff640 1 -- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 msgr2=0x7fe8e403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3324219193 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.725+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe8e806c0b0 con 0x7fe8f41064a0 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.725+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 0x7fe8e403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.926+0000 7fe8f3fff640 1 -- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 msgr2=0x7fe8e403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3324219193 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:16.926+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 0x7fe8e403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:17.327+0000 7fe8f3fff640 1 -- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 msgr2=0x7fe8e403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3324219193 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:17.327+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 0x7fe8e403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:18.128+0000 7fe8f3fff640 1 -- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 msgr2=0x7fe8e403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3324219193 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:18.128+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 0x7fe8e403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T00:51:21.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:19.513+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fe8e806ac30 con 0x7fe8f41064a0 2024-09-16T00:51:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:19.513+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 msgr2=0x7fe8e403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:51:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:19.513+0000 7fe8f1ffb640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 0x7fe8e403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.514+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fe8e803d430 con 0x7fe8f41064a0 2024-09-16T00:51:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.515+0000 7fe8f1ffb640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe8e403cb30 0x7fe8e403ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.515+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 --> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe8e800af30 con 0x7fe8e403cb30 2024-09-16T00:51:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.515+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe8e403cb30 0x7fe8e403ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.516+0000 7fe8f3fff640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe8e403cb30 0x7fe8e403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0003980 tx=0x7fe8e00092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.516+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 <== mgr.14118 v2:172.21.15.12:6800/1863535251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fe8e800af30 con 0x7fe8e403cb30 2024-09-16T00:51:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.529+0000 7fe8faae6640 1 -- 172.21.15.12:0/4176727484 --> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fe8f410abd0 con 0x7fe8e403cb30 2024-09-16T00:51:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.529+0000 7fe8f1ffb640 1 -- 172.21.15.12:0/4176727484 <== mgr.14118 v2:172.21.15.12:6800/1863535251 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fe8f410abd0 con 0x7fe8e403cb30 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.529+0000 7fe8faae6640 1 -- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe8e403cb30 msgr2=0x7fe8e403ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.529+0000 7fe8faae6640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe8e403cb30 0x7fe8e403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0003980 tx=0x7fe8e00092b0 comp rx=0 tx=0).stop 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.529+0000 7fe8faae6640 1 -- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 msgr2=0x7fe8f419d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.529+0000 7fe8faae6640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f419d830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80097f0 tx=0x7fe8e8030ec0 comp rx=0 tx=0).stop 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.529+0000 7fe8faae6640 1 -- 172.21.15.12:0/4176727484 shutdown_connections 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.529+0000 7fe8faae6640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe8e403cb30 0x7fe8e403ef20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.530+0000 7fe8faae6640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:6800/3324219193,v1:172.21.15.12:6801/3324219193] conn(0x7fe8e4039200 0x7fe8e403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.530+0000 7fe8faae6640 1 --2- 172.21.15.12:0/4176727484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8f41064a0 0x7fe8f419d830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.530+0000 7fe8faae6640 1 -- 172.21.15.12:0/4176727484 >> 172.21.15.12:0/4176727484 conn(0x7fe8f4101c10 msgr2=0x7fe8f4102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.530+0000 7fe8faae6640 1 -- 172.21.15.12:0/4176727484 shutdown_connections 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:20.530+0000 7fe8faae6640 1 -- 172.21.15.12:0/4176727484 wait complete. 2024-09-16T00:51:21.138 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 5 is available 2024-09-16T00:51:21.139 INFO:teuthology.orchestra.run.smithi012.stdout:Setting orchestrator backend to cephadm... 2024-09-16T00:51:21.675 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:21 smithi012 ceph-mon[31197]: Found migration_current of "None". Setting to last migration. 2024-09-16T00:51:21.676 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:21 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:21.676 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:21 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:21.676 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:21 smithi012 ceph-mon[31197]: mgrmap e7: x(active, since 1.00569s) 2024-09-16T00:51:22.267 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.473+0000 7fe175e9b640 1 Processor -- start 2024-09-16T00:51:22.267 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.473+0000 7fe175e9b640 1 -- start start 2024-09-16T00:51:22.267 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.474+0000 7fe175e9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe170107960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:22.267 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.474+0000 7fe175e9b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe170107f30 con 0x7fe170107560 2024-09-16T00:51:22.267 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.474+0000 7fe16f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe170107960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.474+0000 7fe16f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe170107960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47948/0 (socket says 172.21.15.12:47948) 2024-09-16T00:51:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.474+0000 7fe16f7fe640 1 -- 172.21.15.12:0/3476888346 learned_addr learned my addr 172.21.15.12:0/3476888346 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.474+0000 7fe16f7fe640 1 -- 172.21.15.12:0/3476888346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe170108760 con 0x7fe170107560 2024-09-16T00:51:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.475+0000 7fe16f7fe640 1 --2- 172.21.15.12:0/3476888346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe170107960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe160009820 tx=0x7fe16002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fc99bb27b124ff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.475+0000 7fe16effd640 1 -- 172.21.15.12:0/3476888346 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe160037070 con 0x7fe170107560 2024-09-16T00:51:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.475+0000 7fe16effd640 1 -- 172.21.15.12:0/3476888346 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe160032900 con 0x7fe170107560 2024-09-16T00:51:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.475+0000 7fe16effd640 1 -- 172.21.15.12:0/3476888346 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe160030850 con 0x7fe170107560 2024-09-16T00:51:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.476+0000 7fe175e9b640 1 -- 172.21.15.12:0/3476888346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 msgr2=0x7fe170107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:22.272 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.476+0000 7fe175e9b640 1 --2- 172.21.15.12:0/3476888346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe170107960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe160009820 tx=0x7fe16002a270 comp rx=0 tx=0).stop 2024-09-16T00:51:22.272 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.476+0000 7fe175e9b640 1 -- 172.21.15.12:0/3476888346 shutdown_connections 2024-09-16T00:51:22.272 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.476+0000 7fe175e9b640 1 --2- 172.21.15.12:0/3476888346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe170107960 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:22.272 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.476+0000 7fe175e9b640 1 -- 172.21.15.12:0/3476888346 >> 172.21.15.12:0/3476888346 conn(0x7fe170102cb0 msgr2=0x7fe170105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:22.272 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.476+0000 7fe175e9b640 1 -- 172.21.15.12:0/3476888346 shutdown_connections 2024-09-16T00:51:22.272 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.476+0000 7fe175e9b640 1 -- 172.21.15.12:0/3476888346 wait complete. 2024-09-16T00:51:22.272 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.476+0000 7fe175e9b640 1 Processor -- start 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.476+0000 7fe175e9b640 1 -- start start 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe175e9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe17019b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe175e9b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe17010bb10 con 0x7fe170107560 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe16f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe17019b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe16f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe17019b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47956/0 (socket says 172.21.15.12:47956) 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe16f7fe640 1 -- 172.21.15.12:0/723727021 learned_addr learned my addr 172.21.15.12:0/723727021 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe16f7fe640 1 -- 172.21.15.12:0/723727021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17019bb40 con 0x7fe170107560 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe16f7fe640 1 --2- 172.21.15.12:0/723727021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe17019b600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe1600097f0 tx=0x7fe160030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe16d7fa640 1 -- 172.21.15.12:0/723727021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe160037040 con 0x7fe170107560 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe16d7fa640 1 -- 172.21.15.12:0/723727021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe160040070 con 0x7fe170107560 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe175e9b640 1 -- 172.21.15.12:0/723727021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17019bdd0 con 0x7fe170107560 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe16d7fa640 1 -- 172.21.15.12:0/723727021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16003a390 con 0x7fe170107560 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.477+0000 7fe175e9b640 1 -- 172.21.15.12:0/723727021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17019eac0 con 0x7fe170107560 2024-09-16T00:51:22.273 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.478+0000 7fe16d7fa640 1 -- 172.21.15.12:0/723727021 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fe16003b430 con 0x7fe170107560 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.478+0000 7fe175e9b640 1 -- 172.21.15.12:0/723727021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1701079e0 con 0x7fe170107560 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.479+0000 7fe16d7fa640 1 --2- 172.21.15.12:0/723727021 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe15c0390f0 0x7fe15c03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.479+0000 7fe16d7fa640 1 -- 172.21.15.12:0/723727021 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe16006c550 con 0x7fe170107560 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.479+0000 7fe167fff640 1 --2- 172.21.15.12:0/723727021 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe15c0390f0 0x7fe15c03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.479+0000 7fe167fff640 1 --2- 172.21.15.12:0/723727021 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe15c0390f0 0x7fe15c03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1580098c0 tx=0x7fe158006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.484+0000 7fe16d7fa640 1 -- 172.21.15.12:0/723727021 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe160032900 con 0x7fe170107560 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.675+0000 7fe175e9b640 1 -- 172.21.15.12:0/723727021 --> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fe170103f90 con 0x7fe15c0390f0 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.681+0000 7fe16d7fa640 1 -- 172.21.15.12:0/723727021 <== mgr.14118 v2:172.21.15.12:6800/1863535251 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe170103f90 con 0x7fe15c0390f0 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.683+0000 7fe175e9b640 1 -- 172.21.15.12:0/723727021 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe15c0390f0 msgr2=0x7fe15c03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.683+0000 7fe175e9b640 1 --2- 172.21.15.12:0/723727021 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe15c0390f0 0x7fe15c03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1580098c0 tx=0x7fe158006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.683+0000 7fe175e9b640 1 -- 172.21.15.12:0/723727021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 msgr2=0x7fe17019b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:22.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.683+0000 7fe175e9b640 1 --2- 172.21.15.12:0/723727021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe17019b600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe1600097f0 tx=0x7fe160030d80 comp rx=0 tx=0).stop 2024-09-16T00:51:22.275 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.684+0000 7fe175e9b640 1 -- 172.21.15.12:0/723727021 shutdown_connections 2024-09-16T00:51:22.275 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.684+0000 7fe175e9b640 1 --2- 172.21.15.12:0/723727021 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fe15c0390f0 0x7fe15c03b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:22.275 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.684+0000 7fe175e9b640 1 --2- 172.21.15.12:0/723727021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe170107560 0x7fe17019b600 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:22.275 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.684+0000 7fe175e9b640 1 -- 172.21.15.12:0/723727021 >> 172.21.15.12:0/723727021 conn(0x7fe170102cb0 msgr2=0x7fe170103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:22.275 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.684+0000 7fe175e9b640 1 -- 172.21.15.12:0/723727021 shutdown_connections 2024-09-16T00:51:22.275 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:21.684+0000 7fe175e9b640 1 -- 172.21.15.12:0/723727021 wait complete. 2024-09-16T00:51:22.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-mon[31197]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T00:51:22.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-mon[31197]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T00:51:22.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:22.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:22.528 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:22.379+0000 7f31388a5640 -1 log_channel(cephadm) log [ERR] : [16/Sep/2024:00:51:22] ENGINE Error in HTTPServer.serve 2024-09-16T00:51:22.529 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: Traceback (most recent call last): 2024-09-16T00:51:22.529 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:51:22.529 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: self._connections.run(self.expiration_interval) 2024-09-16T00:51:22.529 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:51:22.529 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: self._run(expiration_interval) 2024-09-16T00:51:22.529 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:51:22.530 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:51:22.530 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:51:22.530 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:51:22.530 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:51:22.532 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: s = self.context.wrap_socket( 2024-09-16T00:51:22.532 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:51:22.532 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: return self.sslsocket_class._create( 2024-09-16T00:51:22.532 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:51:22.532 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: self.do_handshake() 2024-09-16T00:51:22.532 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:51:22.532 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: self._sslobj.do_handshake() 2024-09-16T00:51:22.532 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:51:22.532 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:22 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:23 smithi012 ceph-mon[31197]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:23 smithi012 ceph-mon[31197]: [16/Sep/2024:00:51:22] ENGINE Bus STARTING 2024-09-16T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:23 smithi012 ceph-mon[31197]: [16/Sep/2024:00:51:22] ENGINE Serving on https://172.21.15.12:7150 2024-09-16T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:23 smithi012 ceph-mon[31197]: [16/Sep/2024:00:51:22] ENGINE Error in HTTPServer.serve 2024-09-16T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-16T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-16T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-16T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:51:23.458 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:23 smithi012 ceph-mon[31197]: mgrmap e8: x(active, since 2s) 2024-09-16T00:51:23.458 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:23 smithi012 ceph-mon[31197]: [16/Sep/2024:00:51:22] ENGINE Serving on http://172.21.15.12:8765 2024-09-16T00:51:23.458 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:23 smithi012 ceph-mon[31197]: [16/Sep/2024:00:51:22] ENGINE Bus STARTED 2024-09-16T00:51:23.458 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:23 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:23.466 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-16T00:51:23.466 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.703+0000 7f9d5f449640 1 Processor -- start 2024-09-16T00:51:23.466 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.703+0000 7f9d5f449640 1 -- start start 2024-09-16T00:51:23.467 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.704+0000 7f9d5f449640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5810a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:23.467 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.704+0000 7f9d5f449640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5807bdd0 con 0x7f9d58108090 2024-09-16T00:51:23.467 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.704+0000 7f9d5d1e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5810a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:23.467 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.704+0000 7f9d5d1e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5810a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47970/0 (socket says 172.21.15.12:47970) 2024-09-16T00:51:23.467 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.704+0000 7f9d5d1e5640 1 -- 172.21.15.12:0/1315942434 learned_addr learned my addr 172.21.15.12:0/1315942434 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:23.467 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.704+0000 7f9d5d1e5640 1 -- 172.21.15.12:0/1315942434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5810a9c0 con 0x7f9d58108090 2024-09-16T00:51:23.467 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.705+0000 7f9d5d1e5640 1 --2- 172.21.15.12:0/1315942434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5810a480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009820 tx=0x7f9d5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3f113d7c0f2981 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:23.467 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.705+0000 7f9d4ffff640 1 -- 172.21.15.12:0/1315942434 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54037070 con 0x7f9d58108090 2024-09-16T00:51:23.467 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.705+0000 7f9d4ffff640 1 -- 172.21.15.12:0/1315942434 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d54032900 con 0x7f9d58108090 2024-09-16T00:51:23.467 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.705+0000 7f9d4ffff640 1 -- 172.21.15.12:0/1315942434 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54030850 con 0x7f9d58108090 2024-09-16T00:51:23.468 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.706+0000 7f9d5f449640 1 -- 172.21.15.12:0/1315942434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 msgr2=0x7f9d5810a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:23.468 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.706+0000 7f9d5f449640 1 --2- 172.21.15.12:0/1315942434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5810a480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009820 tx=0x7f9d5402a270 comp rx=0 tx=0).stop 2024-09-16T00:51:23.468 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.706+0000 7f9d5f449640 1 -- 172.21.15.12:0/1315942434 shutdown_connections 2024-09-16T00:51:23.468 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.706+0000 7f9d5f449640 1 --2- 172.21.15.12:0/1315942434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5810a480 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:23.468 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.706+0000 7f9d5f449640 1 -- 172.21.15.12:0/1315942434 >> 172.21.15.12:0/1315942434 conn(0x7f9d58101c10 msgr2=0x7f9d58104070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:23.468 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.706+0000 7f9d5f449640 1 -- 172.21.15.12:0/1315942434 shutdown_connections 2024-09-16T00:51:23.468 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.706+0000 7f9d5f449640 1 -- 172.21.15.12:0/1315942434 wait complete. 2024-09-16T00:51:23.468 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.706+0000 7f9d5f449640 1 Processor -- start 2024-09-16T00:51:23.468 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.706+0000 7f9d5f449640 1 -- start start 2024-09-16T00:51:23.468 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d5f449640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5819b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:23.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d5f449640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5810b9a0 con 0x7f9d58108090 2024-09-16T00:51:23.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d5d1e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5819b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:23.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d5d1e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5819b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47976/0 (socket says 172.21.15.12:47976) 2024-09-16T00:51:23.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d5d1e5640 1 -- 172.21.15.12:0/594064912 learned_addr learned my addr 172.21.15.12:0/594064912 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:23.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d5d1e5640 1 -- 172.21.15.12:0/594064912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5819bb30 con 0x7f9d58108090 2024-09-16T00:51:23.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d5d1e5640 1 --2- 172.21.15.12:0/594064912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5819b5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d540097f0 tx=0x7f9d54030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:23.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d4e7fc640 1 -- 172.21.15.12:0/594064912 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54042070 con 0x7f9d58108090 2024-09-16T00:51:23.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d4e7fc640 1 -- 172.21.15.12:0/594064912 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d54032ca0 con 0x7f9d58108090 2024-09-16T00:51:23.470 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d5f449640 1 -- 172.21.15.12:0/594064912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5819bdc0 con 0x7f9d58108090 2024-09-16T00:51:23.470 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.707+0000 7f9d4e7fc640 1 -- 172.21.15.12:0/594064912 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54037040 con 0x7f9d58108090 2024-09-16T00:51:23.470 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.708+0000 7f9d5f449640 1 -- 172.21.15.12:0/594064912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5819eab0 con 0x7f9d58108090 2024-09-16T00:51:23.470 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.708+0000 7f9d4e7fc640 1 -- 172.21.15.12:0/594064912 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9d54045070 con 0x7f9d58108090 2024-09-16T00:51:23.470 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.708+0000 7f9d5f449640 1 -- 172.21.15.12:0/594064912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d581084f0 con 0x7f9d58108090 2024-09-16T00:51:23.470 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.708+0000 7f9d4e7fc640 1 --2- 172.21.15.12:0/594064912 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f9d440391b0 0x7f9d4403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:23.470 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.709+0000 7f9d4e7fc640 1 -- 172.21.15.12:0/594064912 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9d5406c280 con 0x7f9d58108090 2024-09-16T00:51:23.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.709+0000 7f9d5c9e4640 1 --2- 172.21.15.12:0/594064912 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f9d440391b0 0x7f9d4403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:23.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.709+0000 7f9d5c9e4640 1 --2- 172.21.15.12:0/594064912 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f9d440391b0 0x7f9d4403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d480098c0 tx=0x7f9d48006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:23.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.713+0000 7f9d4e7fc640 1 -- 172.21.15.12:0/594064912 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d54045520 con 0x7f9d58108090 2024-09-16T00:51:23.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.893+0000 7f9d5f449640 1 -- 172.21.15.12:0/594064912 --> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f9d58102f90 con 0x7f9d440391b0 2024-09-16T00:51:23.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.894+0000 7f9d4e7fc640 1 -- 172.21.15.12:0/594064912 <== mgr.14118 v2:172.21.15.12:6800/1863535251 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f9d58102f90 con 0x7f9d440391b0 2024-09-16T00:51:23.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.896+0000 7f9d5f449640 1 -- 172.21.15.12:0/594064912 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f9d440391b0 msgr2=0x7f9d4403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:23.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.896+0000 7f9d5f449640 1 --2- 172.21.15.12:0/594064912 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f9d440391b0 0x7f9d4403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d480098c0 tx=0x7f9d48006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:23.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.896+0000 7f9d5f449640 1 -- 172.21.15.12:0/594064912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 msgr2=0x7f9d5819b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:23.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.896+0000 7f9d5f449640 1 --2- 172.21.15.12:0/594064912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5819b5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d540097f0 tx=0x7f9d54030ec0 comp rx=0 tx=0).stop 2024-09-16T00:51:23.472 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.896+0000 7f9d5f449640 1 -- 172.21.15.12:0/594064912 shutdown_connections 2024-09-16T00:51:23.472 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.896+0000 7f9d5f449640 1 --2- 172.21.15.12:0/594064912 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f9d440391b0 0x7f9d4403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:23.472 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.896+0000 7f9d5f449640 1 --2- 172.21.15.12:0/594064912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d58108090 0x7f9d5819b5f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:23.472 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.896+0000 7f9d5f449640 1 -- 172.21.15.12:0/594064912 >> 172.21.15.12:0/594064912 conn(0x7f9d58101c10 msgr2=0x7f9d58102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:23.472 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.896+0000 7f9d5f449640 1 -- 172.21.15.12:0/594064912 shutdown_connections 2024-09-16T00:51:23.472 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:22.896+0000 7f9d5f449640 1 -- 172.21.15.12:0/594064912 wait complete. 2024-09-16T00:51:23.472 INFO:teuthology.orchestra.run.smithi012.stdout:Generating ssh key... 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: Generating public/private rsa key pair. 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: Your identification has been saved in /tmp/tmpbfnege0n/key 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: Your public key has been saved in /tmp/tmpbfnege0n/key.pub 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: The key fingerprint is: 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: SHA256:6W/9qHK8SfaYbnpCJ9b/mNq6YEKlAuE/G8uxxnuI+jM ceph-9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: The key's randomart image is: 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: +---[RSA 3072]----+ 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: | . | 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: | . . | 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: | o . | 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: | o o . | 2024-09-16T00:51:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: | * o S. | 2024-09-16T00:51:24.358 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: | o X .+ o | 2024-09-16T00:51:24.358 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: | .B..o++oo | 2024-09-16T00:51:24.358 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: | E....oo=**o+ | 2024-09-16T00:51:24.358 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: |.o.o.. .X%**oo | 2024-09-16T00:51:24.358 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: +----[SHA256]-----+ 2024-09-16T00:51:24.737 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-mon[31197]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:24.737 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:24.737 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:24 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:24.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.894+0000 7f35759ab640 1 Processor -- start 2024-09-16T00:51:24.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.894+0000 7f35759ab640 1 -- start start 2024-09-16T00:51:24.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.894+0000 7f35759ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f3570107950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:24.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.894+0000 7f35759ab640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3570107f20 con 0x7f3570107550 2024-09-16T00:51:24.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.894+0000 7f356effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f3570107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:24.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.894+0000 7f356effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f3570107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47978/0 (socket says 172.21.15.12:47978) 2024-09-16T00:51:24.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.894+0000 7f356effd640 1 -- 172.21.15.12:0/2589642409 learned_addr learned my addr 172.21.15.12:0/2589642409 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:24.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.895+0000 7f356effd640 1 -- 172.21.15.12:0/2589642409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3570108750 con 0x7f3570107550 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.895+0000 7f356effd640 1 --2- 172.21.15.12:0/2589642409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f3570107950 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3560009820 tx=0x7f356002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d19ecac8da1eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.896+0000 7f356e7fc640 1 -- 172.21.15.12:0/2589642409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3560037070 con 0x7f3570107550 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.896+0000 7f356e7fc640 1 -- 172.21.15.12:0/2589642409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3560032900 con 0x7f3570107550 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.896+0000 7f356e7fc640 1 -- 172.21.15.12:0/2589642409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3560030850 con 0x7f3570107550 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.896+0000 7f35759ab640 1 -- 172.21.15.12:0/2589642409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 msgr2=0x7f3570107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.896+0000 7f35759ab640 1 --2- 172.21.15.12:0/2589642409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f3570107950 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3560009820 tx=0x7f356002a270 comp rx=0 tx=0).stop 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.896+0000 7f35759ab640 1 -- 172.21.15.12:0/2589642409 shutdown_connections 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.896+0000 7f35759ab640 1 --2- 172.21.15.12:0/2589642409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f3570107950 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.896+0000 7f35759ab640 1 -- 172.21.15.12:0/2589642409 >> 172.21.15.12:0/2589642409 conn(0x7f3570102ce0 msgr2=0x7f3570105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.896+0000 7f35759ab640 1 -- 172.21.15.12:0/2589642409 shutdown_connections 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.896+0000 7f35759ab640 1 -- 172.21.15.12:0/2589642409 wait complete. 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.897+0000 7f35759ab640 1 Processor -- start 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.897+0000 7f35759ab640 1 -- start start 2024-09-16T00:51:24.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.897+0000 7f35759ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f357007e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.897+0000 7f35759ab640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f357010bb00 con 0x7f3570107550 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.898+0000 7f356effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f357007e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.898+0000 7f356effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f357007e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47994/0 (socket says 172.21.15.12:47994) 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.898+0000 7f356effd640 1 -- 172.21.15.12:0/2815686869 learned_addr learned my addr 172.21.15.12:0/2815686869 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.898+0000 7f356effd640 1 -- 172.21.15.12:0/2815686869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357007e8e0 con 0x7f3570107550 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.898+0000 7f356effd640 1 --2- 172.21.15.12:0/2815686869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f357007e3a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3560009940 tx=0x7f3560032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.898+0000 7f35749a9640 1 -- 172.21.15.12:0/2815686869 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3560042070 con 0x7f3570107550 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.898+0000 7f35749a9640 1 -- 172.21.15.12:0/2815686869 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35600308c0 con 0x7f3570107550 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.898+0000 7f35759ab640 1 -- 172.21.15.12:0/2815686869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357007cad0 con 0x7f3570107550 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.898+0000 7f35749a9640 1 -- 172.21.15.12:0/2815686869 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3560037040 con 0x7f3570107550 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.898+0000 7f35759ab640 1 -- 172.21.15.12:0/2815686869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f357007d010 con 0x7f3570107550 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.899+0000 7f35749a9640 1 -- 172.21.15.12:0/2815686869 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3560045070 con 0x7f3570107550 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.899+0000 7f35759ab640 1 -- 172.21.15.12:0/2815686869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35701079d0 con 0x7f3570107550 2024-09-16T00:51:24.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.900+0000 7f35749a9640 1 --2- 172.21.15.12:0/2815686869 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f355c0391b0 0x7f355c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.900+0000 7f35749a9640 1 -- 172.21.15.12:0/2815686869 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f356006c4c0 con 0x7f3570107550 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.900+0000 7f35667fc640 1 --2- 172.21.15.12:0/2815686869 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f355c0391b0 0x7f355c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.900+0000 7f35667fc640 1 --2- 172.21.15.12:0/2815686869 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f355c0391b0 0x7f355c03b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f35580098c0 tx=0x7f3558006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:23.904+0000 7f35749a9640 1 -- 172.21.15.12:0/2815686869 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f356003cd90 con 0x7f3570107550 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.081+0000 7f35759ab640 1 -- 172.21.15.12:0/2815686869 --> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f3570103f70 con 0x7f355c0391b0 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.166+0000 7f35749a9640 1 -- 172.21.15.12:0/2815686869 <== mgr.14118 v2:172.21.15.12:6800/1863535251 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3570103f70 con 0x7f355c0391b0 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.168+0000 7f35759ab640 1 -- 172.21.15.12:0/2815686869 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f355c0391b0 msgr2=0x7f355c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.168+0000 7f35759ab640 1 --2- 172.21.15.12:0/2815686869 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f355c0391b0 0x7f355c03b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f35580098c0 tx=0x7f3558006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.168+0000 7f35759ab640 1 -- 172.21.15.12:0/2815686869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 msgr2=0x7f357007e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.168+0000 7f35759ab640 1 --2- 172.21.15.12:0/2815686869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f357007e3a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3560009940 tx=0x7f3560032ce0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.168+0000 7f35759ab640 1 -- 172.21.15.12:0/2815686869 shutdown_connections 2024-09-16T00:51:24.748 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.168+0000 7f35759ab640 1 --2- 172.21.15.12:0/2815686869 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f355c0391b0 0x7f355c03b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.748 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.168+0000 7f35759ab640 1 --2- 172.21.15.12:0/2815686869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3570107550 0x7f357007e3a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.748 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.168+0000 7f35759ab640 1 -- 172.21.15.12:0/2815686869 >> 172.21.15.12:0/2815686869 conn(0x7f3570102ce0 msgr2=0x7f3570103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:24.748 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.168+0000 7f35759ab640 1 -- 172.21.15.12:0/2815686869 shutdown_connections 2024-09-16T00:51:24.748 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:24.168+0000 7f35759ab640 1 -- 172.21.15.12:0/2815686869 wait complete. 2024-09-16T00:51:25.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:25 smithi012 ceph-mon[31197]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:25.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:25 smithi012 ceph-mon[31197]: Generating ssh key... 2024-09-16T00:51:25.977 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNdN/C9ljIKLbDexWMvxq3xi7GUi5CMitMLEKvHj7/BYhaTFPE9vKvJKxhAoIZ9Eo17Fgvl0Kf/Mx1ToLIxlrPVXUOQGIiIVV2L/CVq6R5I8hHB6x7lDZbOQnMVnUbgIeJ1xArubCCea5a/11YIe6LbhaMTUc7XnWKF85TCxQjBHS2mZ8q2zckwcCs/SpPFeitukRUb3ZvMGMgnwzsAggdgI+wKZJfQ7XlKbRCz8W84O8HrQmn9QuYVTCDCexIM6kkui7r3R3nT7ArdGSFfxFlVtX9Mz5aMFNFp4E0kJzUyP6X1qszAPm4QAEA+WlH9GtP3OoQ6WH7S9i2Vz7MvbMrB7OLExFeh2fi5YUeGGLggE2grmuUWRjFnxRwc+N7PTq6n1SIl8G1Ve8PJqe2jB28NV3f69Ol8OggSjhlAroJWKXncq7pLZo5tKxuF9WG/yNT4lZf3L3vnf7AtQflYQR+E7HwYEH3VbpmhgQFBLV0krXsfJ3NLPhFxJxxLrOFttM= ceph-9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:51:25.977 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.135+0000 7fee8a4ed640 1 Processor -- start 2024-09-16T00:51:25.977 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.135+0000 7fee8a4ed640 1 -- start start 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.135+0000 7fee8a4ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee84109b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.135+0000 7fee8a4ed640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fee8410a120 con 0x7fee84109750 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.136+0000 7fee83fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee84109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.136+0000 7fee83fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee84109b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48010/0 (socket says 172.21.15.12:48010) 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.136+0000 7fee83fff640 1 -- 172.21.15.12:0/165893205 learned_addr learned my addr 172.21.15.12:0/165893205 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.136+0000 7fee83fff640 1 -- 172.21.15.12:0/165893205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8410a950 con 0x7fee84109750 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.137+0000 7fee83fff640 1 --2- 172.21.15.12:0/165893205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee84109b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fee74009820 tx=0x7fee7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a12f7131e08b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.137+0000 7fee82ffd640 1 -- 172.21.15.12:0/165893205 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee74037070 con 0x7fee84109750 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.137+0000 7fee82ffd640 1 -- 172.21.15.12:0/165893205 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee74032900 con 0x7fee84109750 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.137+0000 7fee82ffd640 1 -- 172.21.15.12:0/165893205 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee74030850 con 0x7fee84109750 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.137+0000 7fee8a4ed640 1 -- 172.21.15.12:0/165893205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 msgr2=0x7fee84109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.137+0000 7fee8a4ed640 1 --2- 172.21.15.12:0/165893205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee84109b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fee74009820 tx=0x7fee7402a270 comp rx=0 tx=0).stop 2024-09-16T00:51:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.137+0000 7fee8a4ed640 1 -- 172.21.15.12:0/165893205 shutdown_connections 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.137+0000 7fee8a4ed640 1 --2- 172.21.15.12:0/165893205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee84109b50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.137+0000 7fee8a4ed640 1 -- 172.21.15.12:0/165893205 >> 172.21.15.12:0/165893205 conn(0x7fee8407cd10 msgr2=0x7fee8407d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.138+0000 7fee8a4ed640 1 -- 172.21.15.12:0/165893205 shutdown_connections 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.138+0000 7fee8a4ed640 1 -- 172.21.15.12:0/165893205 wait complete. 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.138+0000 7fee8a4ed640 1 Processor -- start 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.138+0000 7fee8a4ed640 1 -- start start 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.138+0000 7fee8a4ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee8419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.138+0000 7fee8a4ed640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fee8410dd00 con 0x7fee84109750 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.139+0000 7fee83fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee8419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.139+0000 7fee83fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee8419d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48022/0 (socket says 172.21.15.12:48022) 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.139+0000 7fee83fff640 1 -- 172.21.15.12:0/1145522 learned_addr learned my addr 172.21.15.12:0/1145522 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.139+0000 7fee83fff640 1 -- 172.21.15.12:0/1145522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8419dcc0 con 0x7fee84109750 2024-09-16T00:51:25.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.139+0000 7fee83fff640 1 --2- 172.21.15.12:0/1145522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee8419d780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee740097f0 tx=0x7fee74030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.139+0000 7fee817fa640 1 -- 172.21.15.12:0/1145522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee74037040 con 0x7fee84109750 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.139+0000 7fee817fa640 1 -- 172.21.15.12:0/1145522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee74040070 con 0x7fee84109750 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.139+0000 7fee8a4ed640 1 -- 172.21.15.12:0/1145522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8419df50 con 0x7fee84109750 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.139+0000 7fee817fa640 1 -- 172.21.15.12:0/1145522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee7403a390 con 0x7fee84109750 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.139+0000 7fee8a4ed640 1 -- 172.21.15.12:0/1145522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee841a0c40 con 0x7fee84109750 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.140+0000 7fee817fa640 1 -- 172.21.15.12:0/1145522 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fee7403a5e0 con 0x7fee84109750 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.140+0000 7fee8a4ed640 1 -- 172.21.15.12:0/1145522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee8410de80 con 0x7fee84109750 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.140+0000 7fee817fa640 1 --2- 172.21.15.12:0/1145522 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fee6c039200 0x7fee6c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.140+0000 7fee817fa640 1 -- 172.21.15.12:0/1145522 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fee7406c880 con 0x7fee84109750 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.141+0000 7fee837fe640 1 --2- 172.21.15.12:0/1145522 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fee6c039200 0x7fee6c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.141+0000 7fee837fe640 1 --2- 172.21.15.12:0/1145522 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fee6c039200 0x7fee6c03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee780098c0 tx=0x7fee78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.145+0000 7fee817fa640 1 -- 172.21.15.12:0/1145522 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee7403b430 con 0x7fee84109750 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.325+0000 7fee8a4ed640 1 -- 172.21.15.12:0/1145522 --> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fee8410c280 con 0x7fee6c039200 2024-09-16T00:51:25.980 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.326+0000 7fee817fa640 1 -- 172.21.15.12:0/1145522 <== mgr.14118 v2:172.21.15.12:6800/1863535251 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fee8410c280 con 0x7fee6c039200 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.328+0000 7fee8a4ed640 1 -- 172.21.15.12:0/1145522 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fee6c039200 msgr2=0x7fee6c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.328+0000 7fee8a4ed640 1 --2- 172.21.15.12:0/1145522 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fee6c039200 0x7fee6c03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee780098c0 tx=0x7fee78006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.328+0000 7fee8a4ed640 1 -- 172.21.15.12:0/1145522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 msgr2=0x7fee8419d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.328+0000 7fee8a4ed640 1 --2- 172.21.15.12:0/1145522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee8419d780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee740097f0 tx=0x7fee74030d80 comp rx=0 tx=0).stop 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.329+0000 7fee8a4ed640 1 -- 172.21.15.12:0/1145522 shutdown_connections 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.329+0000 7fee8a4ed640 1 --2- 172.21.15.12:0/1145522 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fee6c039200 0x7fee6c03b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.329+0000 7fee8a4ed640 1 --2- 172.21.15.12:0/1145522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee84109750 0x7fee8419d780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.329+0000 7fee8a4ed640 1 -- 172.21.15.12:0/1145522 >> 172.21.15.12:0/1145522 conn(0x7fee8407cd10 msgr2=0x7fee8410bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.329+0000 7fee8a4ed640 1 -- 172.21.15.12:0/1145522 shutdown_connections 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:25.329+0000 7fee8a4ed640 1 -- 172.21.15.12:0/1145522 wait complete. 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-16T00:51:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:Adding key to root@localhost authorized_keys... 2024-09-16T00:51:25.982 INFO:teuthology.orchestra.run.smithi012.stdout:Adding host smithi012... 2024-09-16T00:51:26.753 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:26 smithi012 ceph-mon[31197]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:27 smithi012 ceph-mon[31197]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:28.836 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:28 smithi012 ceph-mon[31197]: Deploying cephadm binary to smithi012 2024-09-16T00:51:31.002 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Added host 'smithi012' with addr '172.21.15.12' 2024-09-16T00:51:31.002 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.380+0000 7fafb10df640 1 Processor -- start 2024-09-16T00:51:31.002 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.380+0000 7fafb10df640 1 -- start start 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.380+0000 7fafb10df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac107950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.380+0000 7fafb10df640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fafac107f20 con 0x7fafac107550 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.380+0000 7fafaad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.380+0000 7fafaad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51250/0 (socket says 172.21.15.12:51250) 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.380+0000 7fafaad9d640 1 -- 172.21.15.12:0/1442430092 learned_addr learned my addr 172.21.15.12:0/1442430092 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.380+0000 7fafaad9d640 1 -- 172.21.15.12:0/1442430092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac108750 con 0x7fafac107550 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.381+0000 7fafaad9d640 1 --2- 172.21.15.12:0/1442430092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac107950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009820 tx=0x7faf9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e57d304b6a67c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.381+0000 7fafaa59c640 1 -- 172.21.15.12:0/1442430092 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9c037070 con 0x7fafac107550 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.382+0000 7fafaa59c640 1 -- 172.21.15.12:0/1442430092 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf9c032900 con 0x7fafac107550 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.382+0000 7fafaa59c640 1 -- 172.21.15.12:0/1442430092 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9c030850 con 0x7fafac107550 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.382+0000 7fafb10df640 1 -- 172.21.15.12:0/1442430092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 msgr2=0x7fafac107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:31.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.382+0000 7fafb10df640 1 --2- 172.21.15.12:0/1442430092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac107950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009820 tx=0x7faf9c02a270 comp rx=0 tx=0).stop 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.382+0000 7fafb10df640 1 -- 172.21.15.12:0/1442430092 shutdown_connections 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.382+0000 7fafb10df640 1 --2- 172.21.15.12:0/1442430092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac107950 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.382+0000 7fafb10df640 1 -- 172.21.15.12:0/1442430092 >> 172.21.15.12:0/1442430092 conn(0x7fafac102ce0 msgr2=0x7fafac105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.382+0000 7fafb10df640 1 -- 172.21.15.12:0/1442430092 shutdown_connections 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.382+0000 7fafb10df640 1 -- 172.21.15.12:0/1442430092 wait complete. 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.383+0000 7fafb10df640 1 Processor -- start 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.383+0000 7fafb10df640 1 -- start start 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.383+0000 7fafb10df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac07e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.383+0000 7fafb10df640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fafac10bb00 con 0x7fafac107550 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.384+0000 7fafaad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac07e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.384+0000 7fafaad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac07e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51264/0 (socket says 172.21.15.12:51264) 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.384+0000 7fafaad9d640 1 -- 172.21.15.12:0/2309385854 learned_addr learned my addr 172.21.15.12:0/2309385854 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.384+0000 7fafaad9d640 1 -- 172.21.15.12:0/2309385854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac07e8e0 con 0x7fafac107550 2024-09-16T00:51:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.384+0000 7fafaad9d640 1 --2- 172.21.15.12:0/2309385854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac07e3a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0097f0 tx=0x7faf9c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.384+0000 7fafa8d99640 1 -- 172.21.15.12:0/2309385854 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9c037040 con 0x7fafac107550 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.384+0000 7fafa8d99640 1 -- 172.21.15.12:0/2309385854 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf9c040070 con 0x7fafac107550 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.384+0000 7fafb10df640 1 -- 172.21.15.12:0/2309385854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafac07cad0 con 0x7fafac107550 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.384+0000 7fafa8d99640 1 -- 172.21.15.12:0/2309385854 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9c03a390 con 0x7fafac107550 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.384+0000 7fafb10df640 1 -- 172.21.15.12:0/2309385854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafac07cfb0 con 0x7fafac107550 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.385+0000 7fafa8d99640 1 -- 172.21.15.12:0/2309385854 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7faf9c032900 con 0x7fafac107550 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.385+0000 7fafb10df640 1 -- 172.21.15.12:0/2309385854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafac10bc80 con 0x7fafac107550 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.385+0000 7fafa8d99640 1 --2- 172.21.15.12:0/2309385854 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7faf98039200 0x7faf9803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.386+0000 7fafa3fff640 1 --2- 172.21.15.12:0/2309385854 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7faf98039200 0x7faf9803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.386+0000 7fafa8d99640 1 -- 172.21.15.12:0/2309385854 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faf9c06c6f0 con 0x7fafac107550 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.386+0000 7fafa3fff640 1 --2- 172.21.15.12:0/2309385854 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7faf98039200 0x7faf9803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faf940098c0 tx=0x7faf94006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.390+0000 7fafa8d99640 1 -- 172.21.15.12:0/2309385854 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf9c02e200 con 0x7fafac107550 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:26.572+0000 7fafb10df640 1 -- 172.21.15.12:0/2309385854 --> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}) -- 0x7fafac07d860 con 0x7faf98039200 2024-09-16T00:51:31.005 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.495+0000 7fafa8d99640 1 -- 172.21.15.12:0/2309385854 <== mgr.14118 v2:172.21.15.12:6800/1863535251 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fafac07d860 con 0x7faf98039200 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.498+0000 7fafb10df640 1 -- 172.21.15.12:0/2309385854 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7faf98039200 msgr2=0x7faf9803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.498+0000 7fafb10df640 1 --2- 172.21.15.12:0/2309385854 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7faf98039200 0x7faf9803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faf940098c0 tx=0x7faf94006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.498+0000 7fafb10df640 1 -- 172.21.15.12:0/2309385854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 msgr2=0x7fafac07e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.498+0000 7fafb10df640 1 --2- 172.21.15.12:0/2309385854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac07e3a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0097f0 tx=0x7faf9c030d80 comp rx=0 tx=0).stop 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.498+0000 7fafb10df640 1 -- 172.21.15.12:0/2309385854 shutdown_connections 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.498+0000 7fafb10df640 1 --2- 172.21.15.12:0/2309385854 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7faf98039200 0x7faf9803b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.498+0000 7fafb10df640 1 --2- 172.21.15.12:0/2309385854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafac107550 0x7fafac07e3a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.498+0000 7fafb10df640 1 -- 172.21.15.12:0/2309385854 >> 172.21.15.12:0/2309385854 conn(0x7fafac102ce0 msgr2=0x7fafac103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.498+0000 7fafb10df640 1 -- 172.21.15.12:0/2309385854 shutdown_connections 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:30.498+0000 7fafb10df640 1 -- 172.21.15.12:0/2309385854 wait complete. 2024-09-16T00:51:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mon service... 2024-09-16T00:51:31.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:31 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:31.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:31 smithi012 ceph-mon[31197]: Added host smithi012 2024-09-16T00:51:31.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:31 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:32.394 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-16T00:51:32.394 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.370+0000 7fa48ea8e640 1 Processor -- start 2024-09-16T00:51:32.394 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.370+0000 7fa48ea8e640 1 -- start start 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.370+0000 7fa48ea8e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa488106230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.371+0000 7fa48ea8e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa48807bdb0 con 0x7fa488105e30 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.371+0000 7fa48c82a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa488106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.371+0000 7fa48c82a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa488106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51268/0 (socket says 172.21.15.12:51268) 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.371+0000 7fa48c82a640 1 -- 172.21.15.12:0/2795999869 learned_addr learned my addr 172.21.15.12:0/2795999869 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.371+0000 7fa48c82a640 1 -- 172.21.15.12:0/2795999869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa488106770 con 0x7fa488105e30 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.372+0000 7fa48c82a640 1 --2- 172.21.15.12:0/2795999869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa488106230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa480009e80 tx=0x7fa48002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d783e5cdcabc451a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.372+0000 7fa4877fe640 1 -- 172.21.15.12:0/2795999869 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa480036070 con 0x7fa488105e30 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.372+0000 7fa4877fe640 1 -- 172.21.15.12:0/2795999869 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4800318c0 con 0x7fa488105e30 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.372+0000 7fa4877fe640 1 -- 172.21.15.12:0/2795999869 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa480007ab0 con 0x7fa488105e30 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.373+0000 7fa48ea8e640 1 -- 172.21.15.12:0/2795999869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 msgr2=0x7fa488106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.373+0000 7fa48ea8e640 1 --2- 172.21.15.12:0/2795999869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa488106230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa480009e80 tx=0x7fa48002a7a0 comp rx=0 tx=0).stop 2024-09-16T00:51:32.395 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.373+0000 7fa48ea8e640 1 -- 172.21.15.12:0/2795999869 shutdown_connections 2024-09-16T00:51:32.396 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.373+0000 7fa48ea8e640 1 --2- 172.21.15.12:0/2795999869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa488106230 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:32.396 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.373+0000 7fa48ea8e640 1 -- 172.21.15.12:0/2795999869 >> 172.21.15.12:0/2795999869 conn(0x7fa488101bc0 msgr2=0x7fa488104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:32.396 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.373+0000 7fa48ea8e640 1 -- 172.21.15.12:0/2795999869 shutdown_connections 2024-09-16T00:51:32.396 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.373+0000 7fa48ea8e640 1 -- 172.21.15.12:0/2795999869 wait complete. 2024-09-16T00:51:32.396 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.373+0000 7fa48ea8e640 1 Processor -- start 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.373+0000 7fa48ea8e640 1 -- start start 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa48ea8e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa48819d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa48ea8e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa488107870 con 0x7fa488105e30 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa48c82a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa48819d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa48c82a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa48819d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51270/0 (socket says 172.21.15.12:51270) 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa48c82a640 1 -- 172.21.15.12:0/776970438 learned_addr learned my addr 172.21.15.12:0/776970438 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa48c82a640 1 -- 172.21.15.12:0/776970438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48819dc70 con 0x7fa488105e30 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa48c82a640 1 --2- 172.21.15.12:0/776970438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa48819d730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa48002acc0 tx=0x7fa480031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa485ffb640 1 -- 172.21.15.12:0/776970438 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa480036050 con 0x7fa488105e30 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa485ffb640 1 -- 172.21.15.12:0/776970438 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa480037040 con 0x7fa488105e30 2024-09-16T00:51:32.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa48ea8e640 1 -- 172.21.15.12:0/776970438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48819df00 con 0x7fa488105e30 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.374+0000 7fa485ffb640 1 -- 172.21.15.12:0/776970438 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48003d850 con 0x7fa488105e30 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.375+0000 7fa48ea8e640 1 -- 172.21.15.12:0/776970438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4881a0bf0 con 0x7fa488105e30 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.375+0000 7fa485ffb640 1 -- 172.21.15.12:0/776970438 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa480044020 con 0x7fa488105e30 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.375+0000 7fa48ea8e640 1 -- 172.21.15.12:0/776970438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa488106230 con 0x7fa488105e30 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.376+0000 7fa485ffb640 1 --2- 172.21.15.12:0/776970438 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fa474039200 0x7fa47403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.376+0000 7fa485ffb640 1 -- 172.21.15.12:0/776970438 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa480042020 con 0x7fa488105e30 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.376+0000 7fa487fff640 1 --2- 172.21.15.12:0/776970438 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fa474039200 0x7fa47403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.376+0000 7fa487fff640 1 --2- 172.21.15.12:0/776970438 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fa474039200 0x7fa47403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa4780098c0 tx=0x7fa478006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.381+0000 7fa485ffb640 1 -- 172.21.15.12:0/776970438 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa48004b020 con 0x7fa488105e30 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.595+0000 7fa48ea8e640 1 -- 172.21.15.12:0/776970438 --> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fa488062630 con 0x7fa474039200 2024-09-16T00:51:32.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.600+0000 7fa485ffb640 1 -- 172.21.15.12:0/776970438 <== mgr.14118 v2:172.21.15.12:6800/1863535251 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa488062630 con 0x7fa474039200 2024-09-16T00:51:32.399 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.603+0000 7fa48ea8e640 1 -- 172.21.15.12:0/776970438 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fa474039200 msgr2=0x7fa47403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:32.399 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.603+0000 7fa48ea8e640 1 --2- 172.21.15.12:0/776970438 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fa474039200 0x7fa47403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa4780098c0 tx=0x7fa478006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:32.399 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.603+0000 7fa48ea8e640 1 -- 172.21.15.12:0/776970438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 msgr2=0x7fa48819d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:32.399 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.603+0000 7fa48ea8e640 1 --2- 172.21.15.12:0/776970438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa48819d730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa48002acc0 tx=0x7fa480031ca0 comp rx=0 tx=0).stop 2024-09-16T00:51:32.399 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.603+0000 7fa48ea8e640 1 -- 172.21.15.12:0/776970438 shutdown_connections 2024-09-16T00:51:32.399 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.603+0000 7fa48ea8e640 1 --2- 172.21.15.12:0/776970438 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fa474039200 0x7fa47403b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:32.399 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.603+0000 7fa48ea8e640 1 --2- 172.21.15.12:0/776970438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa488105e30 0x7fa48819d730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:32.399 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.603+0000 7fa48ea8e640 1 -- 172.21.15.12:0/776970438 >> 172.21.15.12:0/776970438 conn(0x7fa488101bc0 msgr2=0x7fa488191a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:32.400 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.603+0000 7fa48ea8e640 1 -- 172.21.15.12:0/776970438 shutdown_connections 2024-09-16T00:51:32.400 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:31.603+0000 7fa48ea8e640 1 -- 172.21.15.12:0/776970438 wait complete. 2024-09-16T00:51:32.400 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mgr service... 2024-09-16T00:51:32.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:32 smithi012 ceph-mon[31197]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:32.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:32 smithi012 ceph-mon[31197]: Saving service mon spec with placement count:5 2024-09-16T00:51:32.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:32 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:33.895 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-16T00:51:33.895 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.993+0000 7f070b0ba640 1 Processor -- start 2024-09-16T00:51:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.993+0000 7f070b0ba640 1 -- start start 2024-09-16T00:51:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.994+0000 7f070b0ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070410a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.994+0000 7f070b0ba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f070407bdd0 con 0x7f0704108020 2024-09-16T00:51:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.994+0000 7f0708e56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070410a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.994+0000 7f0708e56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070410a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51284/0 (socket says 172.21.15.12:51284) 2024-09-16T00:51:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.994+0000 7f0708e56640 1 -- 172.21.15.12:0/2218823297 learned_addr learned my addr 172.21.15.12:0/2218823297 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.994+0000 7f0708e56640 1 -- 172.21.15.12:0/2218823297 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070410a950 con 0x7f0704108020 2024-09-16T00:51:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.995+0000 7f0708e56640 1 --2- 172.21.15.12:0/2218823297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070410a410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009820 tx=0x7f06f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3986f3a52fb0dca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.995+0000 7f07037fe640 1 -- 172.21.15.12:0/2218823297 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4037070 con 0x7f0704108020 2024-09-16T00:51:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.995+0000 7f07037fe640 1 -- 172.21.15.12:0/2218823297 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06f4032900 con 0x7f0704108020 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.995+0000 7f07037fe640 1 -- 172.21.15.12:0/2218823297 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4030850 con 0x7f0704108020 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.995+0000 7f070b0ba640 1 -- 172.21.15.12:0/2218823297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 msgr2=0x7f070410a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.995+0000 7f070b0ba640 1 --2- 172.21.15.12:0/2218823297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070410a410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009820 tx=0x7f06f402a270 comp rx=0 tx=0).stop 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.996+0000 7f070b0ba640 1 -- 172.21.15.12:0/2218823297 shutdown_connections 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.996+0000 7f070b0ba640 1 --2- 172.21.15.12:0/2218823297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070410a410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.996+0000 7f070b0ba640 1 -- 172.21.15.12:0/2218823297 >> 172.21.15.12:0/2218823297 conn(0x7f0704101bc0 msgr2=0x7f0704104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.996+0000 7f070b0ba640 1 -- 172.21.15.12:0/2218823297 shutdown_connections 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.996+0000 7f070b0ba640 1 -- 172.21.15.12:0/2218823297 wait complete. 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.996+0000 7f070b0ba640 1 Processor -- start 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.996+0000 7f070b0ba640 1 -- start start 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f070b0ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:33.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f070b0ba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f070410b930 con 0x7f0704108020 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f0708e56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f0708e56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070419b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51300/0 (socket says 172.21.15.12:51300) 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f0708e56640 1 -- 172.21.15.12:0/3677179758 learned_addr learned my addr 172.21.15.12:0/3677179758 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f0708e56640 1 -- 172.21.15.12:0/3677179758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070419ba80 con 0x7f0704108020 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f0708e56640 1 --2- 172.21.15.12:0/3677179758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070419b540 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f06f4032ce0 tx=0x7f06f4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f0701ffb640 1 -- 172.21.15.12:0/3677179758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4042070 con 0x7f0704108020 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f0701ffb640 1 -- 172.21.15.12:0/3677179758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06f40308c0 con 0x7f0704108020 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f070b0ba640 1 -- 172.21.15.12:0/3677179758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070419bd10 con 0x7f0704108020 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.997+0000 7f0701ffb640 1 -- 172.21.15.12:0/3677179758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4037040 con 0x7f0704108020 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.998+0000 7f070b0ba640 1 -- 172.21.15.12:0/3677179758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070419ea00 con 0x7f0704108020 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.998+0000 7f0701ffb640 1 -- 172.21.15.12:0/3677179758 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f06f4045070 con 0x7f0704108020 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.999+0000 7f070b0ba640 1 -- 172.21.15.12:0/3677179758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0704108480 con 0x7f0704108020 2024-09-16T00:51:33.898 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.999+0000 7f0701ffb640 1 --2- 172.21.15.12:0/3677179758 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f06ec039200 0x7f06ec03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:33.899 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.999+0000 7f0701ffb640 1 -- 172.21.15.12:0/3677179758 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f06f406c2d0 con 0x7f0704108020 2024-09-16T00:51:33.899 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.999+0000 7f0703fff640 1 --2- 172.21.15.12:0/3677179758 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f06ec039200 0x7f06ec03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:33.899 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:32.999+0000 7f0703fff640 1 --2- 172.21.15.12:0/3677179758 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f06ec039200 0x7f06ec03b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f06f80098c0 tx=0x7f06f8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:33.899 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.004+0000 7f0701ffb640 1 -- 172.21.15.12:0/3677179758 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06f404b170 con 0x7f0704108020 2024-09-16T00:51:33.899 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.197+0000 7f070b0ba640 1 -- 172.21.15.12:0/3677179758 --> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f0704102e80 con 0x7f06ec039200 2024-09-16T00:51:33.899 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.201+0000 7f0701ffb640 1 -- 172.21.15.12:0/3677179758 <== mgr.14118 v2:172.21.15.12:6800/1863535251 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0704102e80 con 0x7f06ec039200 2024-09-16T00:51:33.899 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.204+0000 7f070b0ba640 1 -- 172.21.15.12:0/3677179758 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f06ec039200 msgr2=0x7f06ec03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:33.899 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.204+0000 7f070b0ba640 1 --2- 172.21.15.12:0/3677179758 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f06ec039200 0x7f06ec03b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f06f80098c0 tx=0x7f06f8006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:33.900 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.204+0000 7f070b0ba640 1 -- 172.21.15.12:0/3677179758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 msgr2=0x7f070419b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:33.900 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.204+0000 7f070b0ba640 1 --2- 172.21.15.12:0/3677179758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070419b540 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f06f4032ce0 tx=0x7f06f4032d10 comp rx=0 tx=0).stop 2024-09-16T00:51:33.900 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.204+0000 7f070b0ba640 1 -- 172.21.15.12:0/3677179758 shutdown_connections 2024-09-16T00:51:33.900 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.204+0000 7f070b0ba640 1 --2- 172.21.15.12:0/3677179758 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f06ec039200 0x7f06ec03b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:33.900 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.204+0000 7f070b0ba640 1 --2- 172.21.15.12:0/3677179758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0704108020 0x7f070419b540 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:33.900 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.204+0000 7f070b0ba640 1 -- 172.21.15.12:0/3677179758 >> 172.21.15.12:0/3677179758 conn(0x7f0704101bc0 msgr2=0x7f0704102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:33.900 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.204+0000 7f070b0ba640 1 -- 172.21.15.12:0/3677179758 shutdown_connections 2024-09-16T00:51:33.900 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:33.204+0000 7f070b0ba640 1 -- 172.21.15.12:0/3677179758 wait complete. 2024-09-16T00:51:34.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:34 smithi012 ceph-mon[31197]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:34.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:34 smithi012 ceph-mon[31197]: Saving service mgr spec with placement count:2 2024-09-16T00:51:34.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:34 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:35.172 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.262+0000 7fc81959c640 1 Processor -- start 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.262+0000 7fc81959c640 1 -- start start 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.262+0000 7fc81959c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc81410a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.262+0000 7fc81959c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc81407c630 con 0x7fc814108070 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.262+0000 7fc812ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc81410a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.262+0000 7fc812ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc81410a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51306/0 (socket says 172.21.15.12:51306) 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.262+0000 7fc812ffd640 1 -- 172.21.15.12:0/3027475491 learned_addr learned my addr 172.21.15.12:0/3027475491 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.262+0000 7fc812ffd640 1 -- 172.21.15.12:0/3027475491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81410a9a0 con 0x7fc814108070 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.263+0000 7fc812ffd640 1 --2- 172.21.15.12:0/3027475491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc81410a460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc804009820 tx=0x7fc80402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afbe74cb42ea72f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.263+0000 7fc8127fc640 1 -- 172.21.15.12:0/3027475491 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804037070 con 0x7fc814108070 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.263+0000 7fc8127fc640 1 -- 172.21.15.12:0/3027475491 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc804032900 con 0x7fc814108070 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.263+0000 7fc8127fc640 1 -- 172.21.15.12:0/3027475491 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804030850 con 0x7fc814108070 2024-09-16T00:51:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.264+0000 7fc81959c640 1 -- 172.21.15.12:0/3027475491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 msgr2=0x7fc81410a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.264+0000 7fc81959c640 1 --2- 172.21.15.12:0/3027475491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc81410a460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc804009820 tx=0x7fc80402a270 comp rx=0 tx=0).stop 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.264+0000 7fc81959c640 1 -- 172.21.15.12:0/3027475491 shutdown_connections 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.264+0000 7fc81959c640 1 --2- 172.21.15.12:0/3027475491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc81410a460 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.264+0000 7fc81959c640 1 -- 172.21.15.12:0/3027475491 >> 172.21.15.12:0/3027475491 conn(0x7fc814101c30 msgr2=0x7fc814104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.264+0000 7fc81959c640 1 -- 172.21.15.12:0/3027475491 shutdown_connections 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.264+0000 7fc81959c640 1 -- 172.21.15.12:0/3027475491 wait complete. 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.265+0000 7fc81959c640 1 Processor -- start 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.265+0000 7fc81959c640 1 -- start start 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.265+0000 7fc81959c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc8141078f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.265+0000 7fc81959c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc81410b970 con 0x7fc814108070 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.265+0000 7fc812ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc8141078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.265+0000 7fc812ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc8141078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51320/0 (socket says 172.21.15.12:51320) 2024-09-16T00:51:35.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.265+0000 7fc812ffd640 1 -- 172.21.15.12:0/17872552 learned_addr learned my addr 172.21.15.12:0/17872552 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.265+0000 7fc812ffd640 1 -- 172.21.15.12:0/17872552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc814107e30 con 0x7fc814108070 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.266+0000 7fc812ffd640 1 --2- 172.21.15.12:0/17872552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc8141078f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc804031000 tx=0x7fc8040326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.266+0000 7fc810ff9640 1 -- 172.21.15.12:0/17872552 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804042070 con 0x7fc814108070 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.266+0000 7fc810ff9640 1 -- 172.21.15.12:0/17872552 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc804032be0 con 0x7fc814108070 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.266+0000 7fc81959c640 1 -- 172.21.15.12:0/17872552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc814106020 con 0x7fc814108070 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.266+0000 7fc810ff9640 1 -- 172.21.15.12:0/17872552 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804037040 con 0x7fc814108070 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.266+0000 7fc81959c640 1 -- 172.21.15.12:0/17872552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc814106560 con 0x7fc814108070 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.267+0000 7fc810ff9640 1 -- 172.21.15.12:0/17872552 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc804045070 con 0x7fc814108070 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.267+0000 7fc810ff9640 1 --2- 172.21.15.12:0/17872552 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fc800039200 0x7fc80003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.267+0000 7fc810ff9640 1 -- 172.21.15.12:0/17872552 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc80406c220 con 0x7fc814108070 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.267+0000 7fc80bfff640 1 --2- 172.21.15.12:0/17872552 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fc800039200 0x7fc80003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.267+0000 7fc81959c640 1 -- 172.21.15.12:0/17872552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8141084d0 con 0x7fc814108070 2024-09-16T00:51:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.268+0000 7fc80bfff640 1 --2- 172.21.15.12:0/17872552 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fc800039200 0x7fc80003b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0098c0 tx=0x7fc7fc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:35.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.272+0000 7fc810ff9640 1 -- 172.21.15.12:0/17872552 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc80402f2a0 con 0x7fc814108070 2024-09-16T00:51:35.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.449+0000 7fc81959c640 1 -- 172.21.15.12:0/17872552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fc814106ba0 con 0x7fc814108070 2024-09-16T00:51:35.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.452+0000 7fc810ff9640 1 -- 172.21.15.12:0/17872552 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7fc804032d90 con 0x7fc814108070 2024-09-16T00:51:35.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.454+0000 7fc81959c640 1 -- 172.21.15.12:0/17872552 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fc800039200 msgr2=0x7fc80003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:35.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.454+0000 7fc81959c640 1 --2- 172.21.15.12:0/17872552 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fc800039200 0x7fc80003b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0098c0 tx=0x7fc7fc006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:35.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.454+0000 7fc81959c640 1 -- 172.21.15.12:0/17872552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 msgr2=0x7fc8141078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:35.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.454+0000 7fc81959c640 1 --2- 172.21.15.12:0/17872552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc8141078f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc804031000 tx=0x7fc8040326e0 comp rx=0 tx=0).stop 2024-09-16T00:51:35.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.454+0000 7fc81959c640 1 -- 172.21.15.12:0/17872552 shutdown_connections 2024-09-16T00:51:35.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.454+0000 7fc81959c640 1 --2- 172.21.15.12:0/17872552 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fc800039200 0x7fc80003b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:35.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.454+0000 7fc81959c640 1 --2- 172.21.15.12:0/17872552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc814108070 0x7fc8141078f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:35.177 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.454+0000 7fc81959c640 1 -- 172.21.15.12:0/17872552 >> 172.21.15.12:0/17872552 conn(0x7fc814101c30 msgr2=0x7fc8141028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:35.177 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.454+0000 7fc81959c640 1 -- 172.21.15.12:0/17872552 shutdown_connections 2024-09-16T00:51:35.177 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:34.454+0000 7fc81959c640 1 -- 172.21.15.12:0/17872552 wait complete. 2024-09-16T00:51:35.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:35 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/17872552' entity='client.admin' 2024-09-16T00:51:35.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:35 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:36.379 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.541+0000 7fd2f1bbc640 1 Processor -- start 2024-09-16T00:51:36.379 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.541+0000 7fd2f1bbc640 1 -- start start 2024-09-16T00:51:36.379 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.542+0000 7fd2f1bbc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec10a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:36.379 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.542+0000 7fd2f1bbc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec07be50 con 0x7fd2ec107fa0 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.542+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec10a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.542+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec10a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51322/0 (socket says 172.21.15.12:51322) 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.542+0000 7fd2eb7fe640 1 -- 172.21.15.12:0/2952901542 learned_addr learned my addr 172.21.15.12:0/2952901542 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.542+0000 7fd2eb7fe640 1 -- 172.21.15.12:0/2952901542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec10a8d0 con 0x7fd2ec107fa0 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.543+0000 7fd2eb7fe640 1 --2- 172.21.15.12:0/2952901542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec10a390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009820 tx=0x7fd2dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7661964aa81f945b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.543+0000 7fd2ea7fc640 1 -- 172.21.15.12:0/2952901542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc037070 con 0x7fd2ec107fa0 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.543+0000 7fd2ea7fc640 1 -- 172.21.15.12:0/2952901542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2dc032920 con 0x7fd2ec107fa0 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.543+0000 7fd2ea7fc640 1 -- 172.21.15.12:0/2952901542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc030810 con 0x7fd2ec107fa0 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.543+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/2952901542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 msgr2=0x7fd2ec10a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.543+0000 7fd2f1bbc640 1 --2- 172.21.15.12:0/2952901542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec10a390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009820 tx=0x7fd2dc02a270 comp rx=0 tx=0).stop 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.544+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/2952901542 shutdown_connections 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.544+0000 7fd2f1bbc640 1 --2- 172.21.15.12:0/2952901542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec10a390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:36.380 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.544+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/2952901542 >> 172.21.15.12:0/2952901542 conn(0x7fd2ec101bc0 msgr2=0x7fd2ec104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.544+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/2952901542 shutdown_connections 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.544+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/2952901542 wait complete. 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.544+0000 7fd2f1bbc640 1 Processor -- start 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.544+0000 7fd2f1bbc640 1 -- start start 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2f1bbc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2f1bbc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec10b9b0 con 0x7fd2ec107fa0 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec19b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51332/0 (socket says 172.21.15.12:51332) 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2eb7fe640 1 -- 172.21.15.12:0/608109114 learned_addr learned my addr 172.21.15.12:0/608109114 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2eb7fe640 1 -- 172.21.15.12:0/608109114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec19ba90 con 0x7fd2ec107fa0 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2eb7fe640 1 --2- 172.21.15.12:0/608109114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec19b550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc030380 tx=0x7fd2dc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2e8ff9640 1 -- 172.21.15.12:0/608109114 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc037040 con 0x7fd2ec107fa0 2024-09-16T00:51:36.381 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2e8ff9640 1 -- 172.21.15.12:0/608109114 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2dc040070 con 0x7fd2ec107fa0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/608109114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ec19bd20 con 0x7fd2ec107fa0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2e8ff9640 1 -- 172.21.15.12:0/608109114 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc03a7b0 con 0x7fd2ec107fa0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.545+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/608109114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ec19ea10 con 0x7fd2ec107fa0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.546+0000 7fd2e8ff9640 1 -- 172.21.15.12:0/608109114 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd2dc03b420 con 0x7fd2ec107fa0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.546+0000 7fd2e8ff9640 1 --2- 172.21.15.12:0/608109114 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fd2d4039200 0x7fd2d403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.546+0000 7fd2e8ff9640 1 -- 172.21.15.12:0/608109114 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd2dc06c8b0 con 0x7fd2ec107fa0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.546+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/608109114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ec108400 con 0x7fd2ec107fa0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.547+0000 7fd2eaffd640 1 --2- 172.21.15.12:0/608109114 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fd2d4039200 0x7fd2d403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.547+0000 7fd2eaffd640 1 --2- 172.21.15.12:0/608109114 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fd2d4039200 0x7fd2d403b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00098c0 tx=0x7fd2e0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.551+0000 7fd2e8ff9640 1 -- 172.21.15.12:0/608109114 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd2dc04a200 con 0x7fd2ec107fa0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.743+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/608109114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fd2ec19ebe0 con 0x7fd2ec107fa0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.745+0000 7fd2e8ff9640 1 -- 172.21.15.12:0/608109114 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fd2dc031e80 con 0x7fd2ec107fa0 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.748+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/608109114 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fd2d4039200 msgr2=0x7fd2d403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:36.382 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.748+0000 7fd2f1bbc640 1 --2- 172.21.15.12:0/608109114 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fd2d4039200 0x7fd2d403b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00098c0 tx=0x7fd2e0006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:36.383 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.748+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/608109114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 msgr2=0x7fd2ec19b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:36.383 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.748+0000 7fd2f1bbc640 1 --2- 172.21.15.12:0/608109114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec19b550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc030380 tx=0x7fd2dc032670 comp rx=0 tx=0).stop 2024-09-16T00:51:36.383 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.748+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/608109114 shutdown_connections 2024-09-16T00:51:36.383 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.748+0000 7fd2f1bbc640 1 --2- 172.21.15.12:0/608109114 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7fd2d4039200 0x7fd2d403b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:36.383 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.748+0000 7fd2f1bbc640 1 --2- 172.21.15.12:0/608109114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2ec107fa0 0x7fd2ec19b550 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:36.383 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.748+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/608109114 >> 172.21.15.12:0/608109114 conn(0x7fd2ec101bc0 msgr2=0x7fd2ec102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:36.383 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.748+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/608109114 shutdown_connections 2024-09-16T00:51:36.383 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:35.748+0000 7fd2f1bbc640 1 -- 172.21.15.12:0/608109114 wait complete. 2024-09-16T00:51:36.383 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling the dashboard module... 2024-09-16T00:51:36.740 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:36 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:36.740 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:36 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/608109114' entity='client.admin' 2024-09-16T00:51:38.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:37 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2827396951' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-16T00:51:38.041 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:37 smithi012 ceph-mon[31197]: from='mgr.14118 172.21.15.12:0/1202209695' entity='mgr.x' 2024-09-16T00:51:38.041 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:37 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: ignoring --setuser ceph since I am not root 2024-09-16T00:51:38.041 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:37 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: ignoring --setgroup ceph since I am not root 2024-09-16T00:51:38.041 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:37 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:37.873+0000 7f4d131c2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T00:51:38.041 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:37 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:37.936+0000 7f4d131c2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T00:51:38.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.739+0000 7f529bba2640 1 Processor -- start 2024-09-16T00:51:38.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.740+0000 7f529bba2640 1 -- start start 2024-09-16T00:51:38.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.740+0000 7f529bba2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f5294107950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:38.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.740+0000 7f529bba2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5294107f20 con 0x7f5294107550 2024-09-16T00:51:38.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.740+0000 7f529993e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f5294107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.740+0000 7f529993e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f5294107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56322/0 (socket says 172.21.15.12:56322) 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.740+0000 7f529993e640 1 -- 172.21.15.12:0/353970840 learned_addr learned my addr 172.21.15.12:0/353970840 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.740+0000 7f529993e640 1 -- 172.21.15.12:0/353970840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5294108750 con 0x7f5294107550 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.741+0000 7f529993e640 1 --2- 172.21.15.12:0/353970840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f5294107950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5290009820 tx=0x7f529002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a6ca490fbc2aca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.741+0000 7f529893c640 1 -- 172.21.15.12:0/353970840 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290037070 con 0x7f5294107550 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.741+0000 7f529893c640 1 -- 172.21.15.12:0/353970840 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5290032920 con 0x7f5294107550 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.741+0000 7f529893c640 1 -- 172.21.15.12:0/353970840 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290030810 con 0x7f5294107550 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.742+0000 7f529bba2640 1 -- 172.21.15.12:0/353970840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 msgr2=0x7f5294107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.742+0000 7f529bba2640 1 --2- 172.21.15.12:0/353970840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f5294107950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5290009820 tx=0x7f529002a270 comp rx=0 tx=0).stop 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.742+0000 7f529bba2640 1 -- 172.21.15.12:0/353970840 shutdown_connections 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.742+0000 7f529bba2640 1 --2- 172.21.15.12:0/353970840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f5294107950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.742+0000 7f529bba2640 1 -- 172.21.15.12:0/353970840 >> 172.21.15.12:0/353970840 conn(0x7f5294102ce0 msgr2=0x7f5294105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:38.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.742+0000 7f529bba2640 1 -- 172.21.15.12:0/353970840 shutdown_connections 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.742+0000 7f529bba2640 1 -- 172.21.15.12:0/353970840 wait complete. 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.742+0000 7f529bba2640 1 Processor -- start 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f529bba2640 1 -- start start 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f529bba2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f529419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f529bba2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f529410bb00 con 0x7f5294107550 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f529993e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f529419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f529993e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f529419b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56336/0 (socket says 172.21.15.12:56336) 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f529993e640 1 -- 172.21.15.12:0/2827396951 learned_addr learned my addr 172.21.15.12:0/2827396951 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f529993e640 1 -- 172.21.15.12:0/2827396951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529419bb30 con 0x7f5294107550 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f529993e640 1 --2- 172.21.15.12:0/2827396951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f529419b5f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5290030560 tx=0x7f5290032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f528affd640 1 -- 172.21.15.12:0/2827396951 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290037040 con 0x7f5294107550 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f528affd640 1 -- 172.21.15.12:0/2827396951 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5290040070 con 0x7f5294107550 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f529bba2640 1 -- 172.21.15.12:0/2827396951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529419bdc0 con 0x7f5294107550 2024-09-16T00:51:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.743+0000 7f528affd640 1 -- 172.21.15.12:0/2827396951 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f529003a740 con 0x7f5294107550 2024-09-16T00:51:38.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.744+0000 7f529bba2640 1 -- 172.21.15.12:0/2827396951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529419eab0 con 0x7f5294107550 2024-09-16T00:51:38.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.745+0000 7f528affd640 1 -- 172.21.15.12:0/2827396951 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f529003a9b0 con 0x7f5294107550 2024-09-16T00:51:38.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.745+0000 7f529bba2640 1 -- 172.21.15.12:0/2827396951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529410bc80 con 0x7f5294107550 2024-09-16T00:51:38.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.745+0000 7f528affd640 1 --2- 172.21.15.12:0/2827396951 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f52800391b0 0x7f528003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:38.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.745+0000 7f528affd640 1 -- 172.21.15.12:0/2827396951 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f529006c940 con 0x7f5294107550 2024-09-16T00:51:38.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.745+0000 7f529913d640 1 --2- 172.21.15.12:0/2827396951 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f52800391b0 0x7f528003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:38.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.745+0000 7f529913d640 1 --2- 172.21.15.12:0/2827396951 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f52800391b0 0x7f528003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52840098c0 tx=0x7f5284006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:38.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.750+0000 7f528affd640 1 -- 172.21.15.12:0/2827396951 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f529004a200 con 0x7f5294107550 2024-09-16T00:51:38.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:36.987+0000 7f529bba2640 1 -- 172.21.15.12:0/2827396951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f529419ec80 con 0x7f5294107550 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.716+0000 7f528affd640 1 -- 172.21.15.12:0/2827396951 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f5290031e80 con 0x7f5294107550 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.718+0000 7f528affd640 1 -- 172.21.15.12:0/2827396951 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f529003b420 con 0x7f5294107550 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.719+0000 7f529bba2640 1 -- 172.21.15.12:0/2827396951 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f52800391b0 msgr2=0x7f528003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.719+0000 7f529bba2640 1 --2- 172.21.15.12:0/2827396951 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f52800391b0 0x7f528003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52840098c0 tx=0x7f5284006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.719+0000 7f529bba2640 1 -- 172.21.15.12:0/2827396951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 msgr2=0x7f529419b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.719+0000 7f529bba2640 1 --2- 172.21.15.12:0/2827396951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f529419b5f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5290030560 tx=0x7f5290032670 comp rx=0 tx=0).stop 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.720+0000 7f529bba2640 1 -- 172.21.15.12:0/2827396951 shutdown_connections 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.720+0000 7f529bba2640 1 --2- 172.21.15.12:0/2827396951 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f52800391b0 0x7f528003b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.720+0000 7f529bba2640 1 --2- 172.21.15.12:0/2827396951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5294107550 0x7f529419b5f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.720+0000 7f529bba2640 1 -- 172.21.15.12:0/2827396951 >> 172.21.15.12:0/2827396951 conn(0x7f5294102ce0 msgr2=0x7f52941038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.720+0000 7f529bba2640 1 -- 172.21.15.12:0/2827396951 shutdown_connections 2024-09-16T00:51:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:37.720+0000 7f529bba2640 1 -- 172.21.15.12:0/2827396951 wait complete. 2024-09-16T00:51:38.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:38.101+0000 7f4d131c2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T00:51:38.331 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:38.170+0000 7f4d131c2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T00:51:38.331 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:38.330+0000 7f4d131c2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:51:38.606 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:38.478+0000 7f4d131c2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T00:51:38.883 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:38 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2827396951' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-16T00:51:38.883 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:38 smithi012 ceph-mon[31197]: mgrmap e9: x(active, since 18s) 2024-09-16T00:51:38.883 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:38.818+0000 7f4d131c2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T00:51:38.883 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:38.882+0000 7f4d131c2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T00:51:39.297 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:39 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:39.080+0000 7f4d131c2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T00:51:39.557 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:51:39.557 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-16T00:51:39.557 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T00:51:39.557 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-16T00:51:39.557 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T00:51:39.557 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:51:39.557 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.708+0000 7f0a2b2ea640 1 Processor -- start 2024-09-16T00:51:39.557 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.708+0000 7f0a2b2ea640 1 -- start start 2024-09-16T00:51:39.557 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.708+0000 7f0a2b2ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2410a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.708+0000 7f0a2b2ea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2407bdb0 con 0x7f0a24108040 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.708+0000 7f0a29086640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2410a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.709+0000 7f0a29086640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2410a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56356/0 (socket says 172.21.15.12:56356) 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.709+0000 7f0a29086640 1 -- 172.21.15.12:0/252248444 learned_addr learned my addr 172.21.15.12:0/252248444 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.709+0000 7f0a29086640 1 -- 172.21.15.12:0/252248444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2410a970 con 0x7f0a24108040 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.709+0000 7f0a29086640 1 --2- 172.21.15.12:0/252248444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2410a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009820 tx=0x7f0a2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72390d9d367703ca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.710+0000 7f0a1bfff640 1 -- 172.21.15.12:0/252248444 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20037070 con 0x7f0a24108040 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.710+0000 7f0a1bfff640 1 -- 172.21.15.12:0/252248444 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a20032920 con 0x7f0a24108040 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.710+0000 7f0a1bfff640 1 -- 172.21.15.12:0/252248444 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20030810 con 0x7f0a24108040 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.711+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/252248444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 msgr2=0x7f0a2410a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.711+0000 7f0a2b2ea640 1 --2- 172.21.15.12:0/252248444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2410a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009820 tx=0x7f0a2002a270 comp rx=0 tx=0).stop 2024-09-16T00:51:39.558 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.711+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/252248444 shutdown_connections 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.711+0000 7f0a2b2ea640 1 --2- 172.21.15.12:0/252248444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2410a430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.711+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/252248444 >> 172.21.15.12:0/252248444 conn(0x7f0a24101bc0 msgr2=0x7f0a24104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.711+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/252248444 shutdown_connections 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.711+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/252248444 wait complete. 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.711+0000 7f0a2b2ea640 1 Processor -- start 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.712+0000 7f0a2b2ea640 1 -- start start 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.712+0000 7f0a2b2ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.712+0000 7f0a2b2ea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2410b990 con 0x7f0a24108040 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.712+0000 7f0a29086640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.712+0000 7f0a29086640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2419b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56368/0 (socket says 172.21.15.12:56368) 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.712+0000 7f0a29086640 1 -- 172.21.15.12:0/2198570544 learned_addr learned my addr 172.21.15.12:0/2198570544 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.712+0000 7f0a29086640 1 -- 172.21.15.12:0/2198570544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2419ba80 con 0x7f0a24108040 2024-09-16T00:51:39.559 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.712+0000 7f0a29086640 1 --2- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2419b540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a20030380 tx=0x7f0a20032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.712+0000 7f0a1a7fc640 1 -- 172.21.15.12:0/2198570544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20037040 con 0x7f0a24108040 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.713+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/2198570544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2419bd10 con 0x7f0a24108040 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.713+0000 7f0a1a7fc640 1 -- 172.21.15.12:0/2198570544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a20040070 con 0x7f0a24108040 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.713+0000 7f0a1a7fc640 1 -- 172.21.15.12:0/2198570544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a2003a7b0 con 0x7f0a24108040 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.713+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/2198570544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2419ea00 con 0x7f0a24108040 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.714+0000 7f0a1a7fc640 1 -- 172.21.15.12:0/2198570544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f0a2003aa30 con 0x7f0a24108040 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.714+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/2198570544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a241084a0 con 0x7f0a24108040 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.714+0000 7f0a1a7fc640 1 --2- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f0a10039200 0x7f0a1003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.714+0000 7f0a1a7fc640 1 -- 172.21.15.12:0/2198570544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0a2006c950 con 0x7f0a24108040 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.714+0000 7f0a28885640 1 -- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f0a10039200 msgr2=0x7f0a1003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1863535251 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.714+0000 7f0a28885640 1 --2- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f0a10039200 0x7f0a1003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.723+0000 7f0a1a7fc640 1 -- 172.21.15.12:0/2198570544 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a20044c70 con 0x7f0a24108040 2024-09-16T00:51:39.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.915+0000 7f0a28885640 1 -- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f0a10039200 msgr2=0x7f0a1003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1863535251 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.915+0000 7f0a28885640 1 --2- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f0a10039200 0x7f0a1003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.948+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/2198570544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0a2419eff0 con 0x7f0a24108040 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.949+0000 7f0a1a7fc640 1 -- 172.21.15.12:0/2198570544 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f0a20041270 con 0x7f0a24108040 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.951+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f0a10039200 msgr2=0x7f0a1003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.951+0000 7f0a2b2ea640 1 --2- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f0a10039200 0x7f0a1003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.951+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 msgr2=0x7f0a2419b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.951+0000 7f0a2b2ea640 1 --2- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2419b540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a20030380 tx=0x7f0a20032670 comp rx=0 tx=0).stop 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.951+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/2198570544 shutdown_connections 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.951+0000 7f0a2b2ea640 1 --2- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7f0a10039200 0x7f0a1003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.951+0000 7f0a2b2ea640 1 --2- 172.21.15.12:0/2198570544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a24108040 0x7f0a2419b540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.951+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/2198570544 >> 172.21.15.12:0/2198570544 conn(0x7f0a24101bc0 msgr2=0x7f0a241027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.951+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/2198570544 shutdown_connections 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:38.951+0000 7f0a2b2ea640 1 -- 172.21.15.12:0/2198570544 wait complete. 2024-09-16T00:51:39.561 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2024-09-16T00:51:39.562 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 9... 2024-09-16T00:51:39.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:39 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2198570544' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T00:51:40.172 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:40.021+0000 7f4d131c2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T00:51:40.172 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:40.091+0000 7f4d131c2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T00:51:41.106 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:40.838+0000 7f4d131c2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T00:51:41.106 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:40.958+0000 7f4d131c2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T00:51:41.374 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.107+0000 7f4d131c2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:51:41.374 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.171+0000 7f4d131c2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T00:51:41.374 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.327+0000 7f4d131c2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T00:51:41.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.399+0000 7f4d131c2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T00:51:41.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.462+0000 7f4d131c2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T00:51:41.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.628+0000 7f4d131c2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T00:51:41.915 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.696+0000 7f4d131c2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T00:51:41.915 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.766+0000 7f4d131c2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T00:51:41.915 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.852+0000 7f4d131c2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T00:51:41.915 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.914+0000 7f4d131c2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T00:51:42.356 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:41.976+0000 7f4d131c2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T00:51:43.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:42.806+0000 7f4d131c2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T00:51:43.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: Active manager daemon x restarted 2024-09-16T00:51:43.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: Activating manager daemon x 2024-09-16T00:51:43.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: osdmap e3: 0 total, 0 up, 0 in 2024-09-16T00:51:43.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: mgrmap e10: x(active, starting, since 0.00342682s) 2024-09-16T00:51:43.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:51:43.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T00:51:43.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:51:43.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:51:43.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:51:43.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: Manager daemon x is now available 2024-09-16T00:51:43.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:43.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:51:43.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T00:51:44.650 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:51:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-16T00:51:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T00:51:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:51:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.965+0000 7efffc3fe640 1 Processor -- start 2024-09-16T00:51:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.965+0000 7efffc3fe640 1 -- start start 2024-09-16T00:51:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.965+0000 7efffc3fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff41079e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.965+0000 7efffc3fe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efff4107fb0 con 0x7efff41075e0 2024-09-16T00:51:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.966+0000 7efffa19a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff41079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.966+0000 7efffa19a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff41079e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56372/0 (socket says 172.21.15.12:56372) 2024-09-16T00:51:44.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.966+0000 7efffa19a640 1 -- 172.21.15.12:0/3670262762 learned_addr learned my addr 172.21.15.12:0/3670262762 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.966+0000 7efffa19a640 1 -- 172.21.15.12:0/3670262762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff4108790 con 0x7efff41075e0 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.967+0000 7efffa19a640 1 --2- 172.21.15.12:0/3670262762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff41079e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efff0009820 tx=0x7efff002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2107d1be9029f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.967+0000 7efff9198640 1 -- 172.21.15.12:0/3670262762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff0037070 con 0x7efff41075e0 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.967+0000 7efff9198640 1 -- 172.21.15.12:0/3670262762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efff0032920 con 0x7efff41075e0 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.967+0000 7efff9198640 1 -- 172.21.15.12:0/3670262762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff0030810 con 0x7efff41075e0 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.967+0000 7efffc3fe640 1 -- 172.21.15.12:0/3670262762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 msgr2=0x7efff41079e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.967+0000 7efffc3fe640 1 --2- 172.21.15.12:0/3670262762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff41079e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efff0009820 tx=0x7efff002a270 comp rx=0 tx=0).stop 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.967+0000 7efffc3fe640 1 -- 172.21.15.12:0/3670262762 shutdown_connections 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.967+0000 7efffc3fe640 1 --2- 172.21.15.12:0/3670262762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff41079e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.968+0000 7efffc3fe640 1 -- 172.21.15.12:0/3670262762 >> 172.21.15.12:0/3670262762 conn(0x7efff4102d30 msgr2=0x7efff41051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.968+0000 7efffc3fe640 1 -- 172.21.15.12:0/3670262762 shutdown_connections 2024-09-16T00:51:44.653 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.968+0000 7efffc3fe640 1 -- 172.21.15.12:0/3670262762 wait complete. 2024-09-16T00:51:44.653 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.968+0000 7efffc3fe640 1 Processor -- start 2024-09-16T00:51:44.653 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.968+0000 7efffc3fe640 1 -- start start 2024-09-16T00:51:44.653 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.968+0000 7efffc3fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:44.653 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.968+0000 7efffc3fe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efff410bb40 con 0x7efff41075e0 2024-09-16T00:51:44.653 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.968+0000 7efffa19a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:44.653 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.968+0000 7efffa19a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56380/0 (socket says 172.21.15.12:56380) 2024-09-16T00:51:44.653 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.968+0000 7efffa19a640 1 -- 172.21.15.12:0/1920475500 learned_addr learned my addr 172.21.15.12:0/1920475500 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.969+0000 7efffa19a640 1 -- 172.21.15.12:0/1920475500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff419bb20 con 0x7efff41075e0 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.969+0000 7efffa19a640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff419b5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efff0030560 tx=0x7efff0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.969+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff0037040 con 0x7efff41075e0 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.969+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efff0040070 con 0x7efff41075e0 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.969+0000 7efffc3fe640 1 -- 172.21.15.12:0/1920475500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff419bdb0 con 0x7efff41075e0 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.969+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff003a6d0 con 0x7efff41075e0 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.969+0000 7efffc3fe640 1 -- 172.21.15.12:0/1920475500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff419eaa0 con 0x7efff41075e0 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.970+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7efff003b420 con 0x7efff41075e0 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.971+0000 7effeb7fe640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 0x7effe003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.971+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 --> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7effe003bdd0 con 0x7effe0039200 2024-09-16T00:51:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.971+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efff006c860 con 0x7efff41075e0 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.971+0000 7efff9999640 1 -- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 msgr2=0x7effe003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1863535251 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:39.971+0000 7efff9999640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 0x7effe003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:40.172+0000 7efff9999640 1 -- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 msgr2=0x7effe003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1863535251 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:40.172+0000 7efff9999640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 0x7effe003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:40.573+0000 7efff9999640 1 -- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 msgr2=0x7effe003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1863535251 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:40.573+0000 7efff9999640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 0x7effe003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:41.374+0000 7efff9999640 1 -- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 msgr2=0x7effe003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1863535251 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:41.374+0000 7efff9999640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 0x7effe003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:42.810+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7efff006b310 con 0x7efff41075e0 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:42.810+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 msgr2=0x7effe003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:42.810+0000 7effeb7fe640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 0x7effe003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:44.655 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.812+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7efff003bb20 con 0x7efff41075e0 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.812+0000 7effeb7fe640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7effe003ccc0 0x7effe003f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.812+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efff003de70 con 0x7effe003ccc0 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.813+0000 7efff9999640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7effe003ccc0 0x7effe003f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.814+0000 7efff9999640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7effe003ccc0 0x7effe003f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7effe4003980 tx=0x7effe4006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.815+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7efff003de70 con 0x7effe003ccc0 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.823+0000 7efffc3fe640 1 -- 172.21.15.12:0/1920475500 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7efff410bcc0 con 0x7effe003ccc0 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.823+0000 7effeb7fe640 1 -- 172.21.15.12:0/1920475500 <== mgr.14150 v2:172.21.15.12:6800/2160939611 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7efff410bcc0 con 0x7effe003ccc0 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.823+0000 7efffc3fe640 1 -- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7effe003ccc0 msgr2=0x7effe003f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.823+0000 7efffc3fe640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7effe003ccc0 0x7effe003f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7effe4003980 tx=0x7effe4006e10 comp rx=0 tx=0).stop 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.823+0000 7efffc3fe640 1 -- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 msgr2=0x7efff419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.823+0000 7efffc3fe640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff419b5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efff0030560 tx=0x7efff0032670 comp rx=0 tx=0).stop 2024-09-16T00:51:44.657 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.823+0000 7efffc3fe640 1 -- 172.21.15.12:0/1920475500 shutdown_connections 2024-09-16T00:51:44.657 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.823+0000 7efffc3fe640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7effe003ccc0 0x7effe003f0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:44.657 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.823+0000 7efffc3fe640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:6800/1863535251,v1:172.21.15.12:6801/1863535251] conn(0x7effe0039200 0x7effe003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:44.657 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.823+0000 7efffc3fe640 1 --2- 172.21.15.12:0/1920475500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff41075e0 0x7efff419b5e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:44.657 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.824+0000 7efffc3fe640 1 -- 172.21.15.12:0/1920475500 >> 172.21.15.12:0/1920475500 conn(0x7efff4102d30 msgr2=0x7efff4103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:44.657 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.824+0000 7efffc3fe640 1 -- 172.21.15.12:0/1920475500 shutdown_connections 2024-09-16T00:51:44.657 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:43.824+0000 7efffc3fe640 1 -- 172.21.15.12:0/1920475500 wait complete. 2024-09-16T00:51:44.657 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 9 is available 2024-09-16T00:51:44.657 INFO:teuthology.orchestra.run.smithi012.stdout:Generating a dashboard self-signed certificate... 2024-09-16T00:51:44.891 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:44 smithi012 ceph-mon[31197]: mgrmap e11: x(active, since 1.00671s) 2024-09-16T00:51:44.891 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:44 smithi012 ceph-mon[31197]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T00:51:44.891 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:44 smithi012 ceph-mon[31197]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:45.060+0000 7f4c78c8b640 -1 log_channel(cephadm) log [ERR] : [16/Sep/2024:00:51:45] ENGINE Error in HTTPServer.serve 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: Traceback (most recent call last): 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: self._connections.run(self.expiration_interval) 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: self._run(expiration_interval) 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:51:45.237 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:51:45.238 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: s = self.context.wrap_socket( 2024-09-16T00:51:45.238 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:51:45.238 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: return self.sslsocket_class._create( 2024-09-16T00:51:45.238 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:51:45.238 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: self.do_handshake() 2024-09-16T00:51:45.238 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:51:45.238 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: self._sslobj.do_handshake() 2024-09-16T00:51:45.238 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:51:45.238 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:51:45.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.040+0000 7fcf31bab640 1 Processor -- start 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.040+0000 7fcf31bab640 1 -- start start 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.041+0000 7fcf31bab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c10a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.041+0000 7fcf31bab640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c07be10 con 0x7fcf2c107fe0 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.041+0000 7fcf2b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c10a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.041+0000 7fcf2b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c10a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56450/0 (socket says 172.21.15.12:56450) 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.041+0000 7fcf2b7fe640 1 -- 172.21.15.12:0/2367158346 learned_addr learned my addr 172.21.15.12:0/2367158346 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.041+0000 7fcf2b7fe640 1 -- 172.21.15.12:0/2367158346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c10a910 con 0x7fcf2c107fe0 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.042+0000 7fcf2b7fe640 1 --2- 172.21.15.12:0/2367158346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c10a3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009e80 tx=0x7fcf2402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c993f8a0fd257a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.042+0000 7fcf2a7fc640 1 -- 172.21.15.12:0/2367158346 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf24036070 con 0x7fcf2c107fe0 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.042+0000 7fcf2a7fc640 1 -- 172.21.15.12:0/2367158346 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf240318e0 con 0x7fcf2c107fe0 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.042+0000 7fcf2a7fc640 1 -- 172.21.15.12:0/2367158346 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf24007a00 con 0x7fcf2c107fe0 2024-09-16T00:51:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.042+0000 7fcf31bab640 1 -- 172.21.15.12:0/2367158346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 msgr2=0x7fcf2c10a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.042+0000 7fcf31bab640 1 --2- 172.21.15.12:0/2367158346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c10a3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009e80 tx=0x7fcf2402a7a0 comp rx=0 tx=0).stop 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.043+0000 7fcf31bab640 1 -- 172.21.15.12:0/2367158346 shutdown_connections 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.043+0000 7fcf31bab640 1 --2- 172.21.15.12:0/2367158346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c10a3d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.043+0000 7fcf31bab640 1 -- 172.21.15.12:0/2367158346 >> 172.21.15.12:0/2367158346 conn(0x7fcf2c101bc0 msgr2=0x7fcf2c104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.043+0000 7fcf31bab640 1 -- 172.21.15.12:0/2367158346 shutdown_connections 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.043+0000 7fcf31bab640 1 -- 172.21.15.12:0/2367158346 wait complete. 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.043+0000 7fcf31bab640 1 Processor -- start 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.043+0000 7fcf31bab640 1 -- start start 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf31bab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c19d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf31bab640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c10b990 con 0x7fcf2c107fe0 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf2b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c19d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf2b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c19d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56464/0 (socket says 172.21.15.12:56464) 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf2b7fe640 1 -- 172.21.15.12:0/3063932364 learned_addr learned my addr 172.21.15.12:0/3063932364 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:45.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf2b7fe640 1 -- 172.21.15.12:0/3063932364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c19dc80 con 0x7fcf2c107fe0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf2b7fe640 1 --2- 172.21.15.12:0/3063932364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c19d740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf24031cf0 tx=0x7fcf24031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf28ff9640 1 -- 172.21.15.12:0/3063932364 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf24036050 con 0x7fcf2c107fe0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf28ff9640 1 -- 172.21.15.12:0/3063932364 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf24042070 con 0x7fcf2c107fe0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf31bab640 1 -- 172.21.15.12:0/3063932364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf2c19df10 con 0x7fcf2c107fe0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf28ff9640 1 -- 172.21.15.12:0/3063932364 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf2403d9b0 con 0x7fcf2c107fe0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.044+0000 7fcf31bab640 1 -- 172.21.15.12:0/3063932364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf2c1a0c00 con 0x7fcf2c107fe0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.045+0000 7fcf28ff9640 1 -- 172.21.15.12:0/3063932364 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fcf2403db50 con 0x7fcf2c107fe0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.045+0000 7fcf31bab640 1 -- 172.21.15.12:0/3063932364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf2c108440 con 0x7fcf2c107fe0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.046+0000 7fcf28ff9640 1 --2- 172.21.15.12:0/3063932364 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf18039260 0x7fcf1803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.046+0000 7fcf28ff9640 1 -- 172.21.15.12:0/3063932364 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcf2406d710 con 0x7fcf2c107fe0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.046+0000 7fcf2affd640 1 --2- 172.21.15.12:0/3063932364 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf18039260 0x7fcf1803b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.046+0000 7fcf2affd640 1 --2- 172.21.15.12:0/3063932364 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf18039260 0x7fcf1803b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf140098c0 tx=0x7fcf14006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.050+0000 7fcf28ff9640 1 -- 172.21.15.12:0/3063932364 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf24044310 con 0x7fcf2c107fe0 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.235+0000 7fcf31bab640 1 -- 172.21.15.12:0/3063932364 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fcf2c102e60 con 0x7fcf18039260 2024-09-16T00:51:45.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.331+0000 7fcf28ff9640 1 -- 172.21.15.12:0/3063932364 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fcf2c102e60 con 0x7fcf18039260 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.333+0000 7fcf31bab640 1 -- 172.21.15.12:0/3063932364 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf18039260 msgr2=0x7fcf1803b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.333+0000 7fcf31bab640 1 --2- 172.21.15.12:0/3063932364 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf18039260 0x7fcf1803b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf140098c0 tx=0x7fcf14006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.333+0000 7fcf31bab640 1 -- 172.21.15.12:0/3063932364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 msgr2=0x7fcf2c19d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.333+0000 7fcf31bab640 1 --2- 172.21.15.12:0/3063932364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c19d740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf24031cf0 tx=0x7fcf24031d20 comp rx=0 tx=0).stop 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.333+0000 7fcf31bab640 1 -- 172.21.15.12:0/3063932364 shutdown_connections 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.333+0000 7fcf31bab640 1 --2- 172.21.15.12:0/3063932364 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf18039260 0x7fcf1803b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.333+0000 7fcf31bab640 1 --2- 172.21.15.12:0/3063932364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf2c107fe0 0x7fcf2c19d740 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.333+0000 7fcf31bab640 1 -- 172.21.15.12:0/3063932364 >> 172.21.15.12:0/3063932364 conn(0x7fcf2c101bc0 msgr2=0x7fcf2c102750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.333+0000 7fcf31bab640 1 -- 172.21.15.12:0/3063932364 shutdown_connections 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:45.333+0000 7fcf31bab640 1 -- 172.21.15.12:0/3063932364 wait complete. 2024-09-16T00:51:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial admin user... 2024-09-16T00:51:46.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-mon[31197]: mgrmap e12: x(active, since 2s) 2024-09-16T00:51:46.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-mon[31197]: [16/Sep/2024:00:51:44] ENGINE Bus STARTING 2024-09-16T00:51:46.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-mon[31197]: [16/Sep/2024:00:51:44] ENGINE Serving on http://172.21.15.12:8765 2024-09-16T00:51:46.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-mon[31197]: [16/Sep/2024:00:51:45] ENGINE Serving on https://172.21.15.12:7150 2024-09-16T00:51:46.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-mon[31197]: [16/Sep/2024:00:51:45] ENGINE Bus STARTED 2024-09-16T00:51:46.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-mon[31197]: [16/Sep/2024:00:51:45] ENGINE Error in HTTPServer.serve 2024-09-16T00:51:46.032 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-16T00:51:46.032 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:51:46.032 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-16T00:51:46.032 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:51:46.032 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:46.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-mon[31197]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:47.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:46 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:47.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:46 smithi012 ceph-mon[31197]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:47.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:46 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:47.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$3J.mc9qRgu41ppv00dIPW.qIs9vwvh6tt/yo2jGAShA2ykrACssLK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726447906, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-16T00:51:47.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.204+0000 7fcfc0384640 1 Processor -- start 2024-09-16T00:51:47.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.204+0000 7fcfc0384640 1 -- start start 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.205+0000 7fcfc0384640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb810a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.205+0000 7fcfc0384640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb807bdd0 con 0x7fcfb8108020 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.205+0000 7fcfbe120640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb810a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.205+0000 7fcfbe120640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb810a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53044/0 (socket says 172.21.15.12:53044) 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.205+0000 7fcfbe120640 1 -- 172.21.15.12:0/2015581328 learned_addr learned my addr 172.21.15.12:0/2015581328 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.205+0000 7fcfbe120640 1 -- 172.21.15.12:0/2015581328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb810a950 con 0x7fcfb8108020 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.206+0000 7fcfbe120640 1 --2- 172.21.15.12:0/2015581328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb810a410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009820 tx=0x7fcfb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa982b5a4e5bc66 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.206+0000 7fcfbd11e640 1 -- 172.21.15.12:0/2015581328 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfb4037070 con 0x7fcfb8108020 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.206+0000 7fcfbd11e640 1 -- 172.21.15.12:0/2015581328 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfb4032920 con 0x7fcfb8108020 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.206+0000 7fcfbd11e640 1 -- 172.21.15.12:0/2015581328 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfb4030810 con 0x7fcfb8108020 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.207+0000 7fcfc0384640 1 -- 172.21.15.12:0/2015581328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 msgr2=0x7fcfb810a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.207+0000 7fcfc0384640 1 --2- 172.21.15.12:0/2015581328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb810a410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009820 tx=0x7fcfb402a270 comp rx=0 tx=0).stop 2024-09-16T00:51:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.207+0000 7fcfc0384640 1 -- 172.21.15.12:0/2015581328 shutdown_connections 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.207+0000 7fcfc0384640 1 --2- 172.21.15.12:0/2015581328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb810a410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.207+0000 7fcfc0384640 1 -- 172.21.15.12:0/2015581328 >> 172.21.15.12:0/2015581328 conn(0x7fcfb8101bc0 msgr2=0x7fcfb8104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.207+0000 7fcfc0384640 1 -- 172.21.15.12:0/2015581328 shutdown_connections 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.207+0000 7fcfc0384640 1 -- 172.21.15.12:0/2015581328 wait complete. 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.207+0000 7fcfc0384640 1 Processor -- start 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfc0384640 1 -- start start 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfc0384640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb819b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfc0384640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb810b970 con 0x7fcfb8108020 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfbe120640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb819b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfbe120640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb819b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53046/0 (socket says 172.21.15.12:53046) 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfbe120640 1 -- 172.21.15.12:0/3144980561 learned_addr learned my addr 172.21.15.12:0/3144980561 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfbe120640 1 -- 172.21.15.12:0/3144980561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb819ba60 con 0x7fcfb8108020 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfbe120640 1 --2- 172.21.15.12:0/3144980561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb819b520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4030380 tx=0x7fcfb4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfaf7fe640 1 -- 172.21.15.12:0/3144980561 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfb4037040 con 0x7fcfb8108020 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfaf7fe640 1 -- 172.21.15.12:0/3144980561 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfb4040070 con 0x7fcfb8108020 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfaf7fe640 1 -- 172.21.15.12:0/3144980561 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfb403a7b0 con 0x7fcfb8108020 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.208+0000 7fcfc0384640 1 -- 172.21.15.12:0/3144980561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb819bcf0 con 0x7fcfb8108020 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.209+0000 7fcfc0384640 1 -- 172.21.15.12:0/3144980561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb819e9e0 con 0x7fcfb8108020 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.209+0000 7fcfaf7fe640 1 -- 172.21.15.12:0/3144980561 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fcfb403a9e0 con 0x7fcfb8108020 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.210+0000 7fcfaf7fe640 1 --2- 172.21.15.12:0/3144980561 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcfa4039260 0x7fcfa403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.210+0000 7fcfaf7fe640 1 -- 172.21.15.12:0/3144980561 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcfb406ca00 con 0x7fcfb8108020 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.210+0000 7fcfc0384640 1 -- 172.21.15.12:0/3144980561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb8108480 con 0x7fcfb8108020 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.210+0000 7fcfbd91f640 1 --2- 172.21.15.12:0/3144980561 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcfa4039260 0x7fcfa403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.210+0000 7fcfbd91f640 1 --2- 172.21.15.12:0/3144980561 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcfa4039260 0x7fcfa403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80098c0 tx=0x7fcfa8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.215+0000 7fcfaf7fe640 1 -- 172.21.15.12:0/3144980561 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcfb4044c70 con 0x7fcfb8108020 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.413+0000 7fcfc0384640 1 -- 172.21.15.12:0/3144980561 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fcfb8102ef0 con 0x7fcfa4039260 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.662+0000 7fcfaf7fe640 1 -- 172.21.15.12:0/3144980561 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fcfb8102ef0 con 0x7fcfa4039260 2024-09-16T00:51:47.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.664+0000 7fcfc0384640 1 -- 172.21.15.12:0/3144980561 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcfa4039260 msgr2=0x7fcfa403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.664+0000 7fcfc0384640 1 --2- 172.21.15.12:0/3144980561 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcfa4039260 0x7fcfa403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80098c0 tx=0x7fcfa8006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.664+0000 7fcfc0384640 1 -- 172.21.15.12:0/3144980561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 msgr2=0x7fcfb819b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.664+0000 7fcfc0384640 1 --2- 172.21.15.12:0/3144980561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb819b520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4030380 tx=0x7fcfb4032670 comp rx=0 tx=0).stop 2024-09-16T00:51:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.664+0000 7fcfc0384640 1 -- 172.21.15.12:0/3144980561 shutdown_connections 2024-09-16T00:51:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.664+0000 7fcfc0384640 1 --2- 172.21.15.12:0/3144980561 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcfa4039260 0x7fcfa403b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.664+0000 7fcfc0384640 1 --2- 172.21.15.12:0/3144980561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb8108020 0x7fcfb819b520 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.664+0000 7fcfc0384640 1 -- 172.21.15.12:0/3144980561 >> 172.21.15.12:0/3144980561 conn(0x7fcfb8101bc0 msgr2=0x7fcfb81027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.664+0000 7fcfc0384640 1 -- 172.21.15.12:0/3144980561 shutdown_connections 2024-09-16T00:51:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:46.665+0000 7fcfc0384640 1 -- 172.21.15.12:0/3144980561 wait complete. 2024-09-16T00:51:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:Fetching dashboard port number... 2024-09-16T00:51:48.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:47 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3415238885' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-16T00:51:48.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 8443 2024-09-16T00:51:48.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.694+0000 7f6c2a17e640 1 Processor -- start 2024-09-16T00:51:48.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.694+0000 7f6c2a17e640 1 -- start start 2024-09-16T00:51:48.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.694+0000 7f6c2a17e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c24109b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:48.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.694+0000 7f6c2a17e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2410a120 con 0x7f6c24109750 2024-09-16T00:51:48.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.695+0000 7f6c237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c24109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:48.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.695+0000 7f6c237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c24109b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53062/0 (socket says 172.21.15.12:53062) 2024-09-16T00:51:48.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.695+0000 7f6c237fe640 1 -- 172.21.15.12:0/804482511 learned_addr learned my addr 172.21.15.12:0/804482511 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:48.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.695+0000 7f6c237fe640 1 -- 172.21.15.12:0/804482511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2410a950 con 0x7f6c24109750 2024-09-16T00:51:48.928 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.696+0000 7f6c237fe640 1 --2- 172.21.15.12:0/804482511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c24109b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009820 tx=0x7f6c1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c120aee00cf28357 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:48.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.696+0000 7f6c227fc640 1 -- 172.21.15.12:0/804482511 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c14037070 con 0x7f6c24109750 2024-09-16T00:51:48.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.696+0000 7f6c227fc640 1 -- 172.21.15.12:0/804482511 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c14032920 con 0x7f6c24109750 2024-09-16T00:51:48.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.696+0000 7f6c227fc640 1 -- 172.21.15.12:0/804482511 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c14030810 con 0x7f6c24109750 2024-09-16T00:51:48.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.696+0000 7f6c2a17e640 1 -- 172.21.15.12:0/804482511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 msgr2=0x7f6c24109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:48.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.696+0000 7f6c2a17e640 1 --2- 172.21.15.12:0/804482511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c24109b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009820 tx=0x7f6c1402a270 comp rx=0 tx=0).stop 2024-09-16T00:51:48.929 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.697+0000 7f6c2a17e640 1 -- 172.21.15.12:0/804482511 shutdown_connections 2024-09-16T00:51:48.930 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.697+0000 7f6c2a17e640 1 --2- 172.21.15.12:0/804482511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c24109b50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:48.930 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.697+0000 7f6c2a17e640 1 -- 172.21.15.12:0/804482511 >> 172.21.15.12:0/804482511 conn(0x7f6c2407cd10 msgr2=0x7f6c2407d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:48.930 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.697+0000 7f6c2a17e640 1 -- 172.21.15.12:0/804482511 shutdown_connections 2024-09-16T00:51:48.930 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.697+0000 7f6c2a17e640 1 -- 172.21.15.12:0/804482511 wait complete. 2024-09-16T00:51:48.930 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.697+0000 7f6c2a17e640 1 Processor -- start 2024-09-16T00:51:48.930 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.697+0000 7f6c2a17e640 1 -- start start 2024-09-16T00:51:48.931 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c2a17e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c2419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:48.931 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c2a17e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2410dd00 con 0x7f6c24109750 2024-09-16T00:51:48.931 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c2419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:48.931 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c2419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53078/0 (socket says 172.21.15.12:53078) 2024-09-16T00:51:48.931 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c237fe640 1 -- 172.21.15.12:0/3415238885 learned_addr learned my addr 172.21.15.12:0/3415238885 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:48.931 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c237fe640 1 -- 172.21.15.12:0/3415238885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2419dd00 con 0x7f6c24109750 2024-09-16T00:51:48.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c237fe640 1 --2- 172.21.15.12:0/3415238885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c2419d7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c140097f0 tx=0x7f6c140327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:48.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c20ff9640 1 -- 172.21.15.12:0/3415238885 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c14037040 con 0x7f6c24109750 2024-09-16T00:51:48.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c20ff9640 1 -- 172.21.15.12:0/3415238885 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c14030cc0 con 0x7f6c24109750 2024-09-16T00:51:48.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c2a17e640 1 -- 172.21.15.12:0/3415238885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2419df90 con 0x7f6c24109750 2024-09-16T00:51:48.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c2a17e640 1 -- 172.21.15.12:0/3415238885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c241a0c80 con 0x7f6c24109750 2024-09-16T00:51:48.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.698+0000 7f6c20ff9640 1 -- 172.21.15.12:0/3415238885 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c1403a640 con 0x7f6c24109750 2024-09-16T00:51:48.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.699+0000 7f6c20ff9640 1 -- 172.21.15.12:0/3415238885 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f6c1403a8f0 con 0x7f6c24109750 2024-09-16T00:51:48.933 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.700+0000 7f6c2a17e640 1 -- 172.21.15.12:0/3415238885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2410de80 con 0x7f6c24109750 2024-09-16T00:51:48.933 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.700+0000 7f6c20ff9640 1 --2- 172.21.15.12:0/3415238885 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c0c039260 0x7f6c0c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:48.933 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.700+0000 7f6c20ff9640 1 -- 172.21.15.12:0/3415238885 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6c1406ca30 con 0x7f6c24109750 2024-09-16T00:51:48.933 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.700+0000 7f6c22ffd640 1 --2- 172.21.15.12:0/3415238885 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c0c039260 0x7f6c0c03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:48.933 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.700+0000 7f6c22ffd640 1 --2- 172.21.15.12:0/3415238885 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c0c039260 0x7f6c0c03b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c180098c0 tx=0x7f6c18006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:48.933 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.705+0000 7f6c20ff9640 1 -- 172.21.15.12:0/3415238885 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c1403ba40 con 0x7f6c24109750 2024-09-16T00:51:48.934 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.889+0000 7f6c2a17e640 1 -- 172.21.15.12:0/3415238885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f6c241a0e50 con 0x7f6c24109750 2024-09-16T00:51:48.934 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.889+0000 7f6c20ff9640 1 -- 172.21.15.12:0/3415238885 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f6c14044980 con 0x7f6c24109750 2024-09-16T00:51:48.934 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.892+0000 7f6c2a17e640 1 -- 172.21.15.12:0/3415238885 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c0c039260 msgr2=0x7f6c0c03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:48.934 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.892+0000 7f6c2a17e640 1 --2- 172.21.15.12:0/3415238885 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c0c039260 0x7f6c0c03b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c180098c0 tx=0x7f6c18006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:48.934 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.892+0000 7f6c2a17e640 1 -- 172.21.15.12:0/3415238885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 msgr2=0x7f6c2419d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:48.934 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.892+0000 7f6c2a17e640 1 --2- 172.21.15.12:0/3415238885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c2419d7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c140097f0 tx=0x7f6c140327b0 comp rx=0 tx=0).stop 2024-09-16T00:51:48.935 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.892+0000 7f6c2a17e640 1 -- 172.21.15.12:0/3415238885 shutdown_connections 2024-09-16T00:51:48.935 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.892+0000 7f6c2a17e640 1 --2- 172.21.15.12:0/3415238885 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c0c039260 0x7f6c0c03b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:48.935 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.892+0000 7f6c2a17e640 1 --2- 172.21.15.12:0/3415238885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c24109750 0x7f6c2419d7c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:48.935 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.892+0000 7f6c2a17e640 1 -- 172.21.15.12:0/3415238885 >> 172.21.15.12:0/3415238885 conn(0x7f6c2407cd10 msgr2=0x7f6c2410bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:48.935 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.892+0000 7f6c2a17e640 1 -- 172.21.15.12:0/3415238885 shutdown_connections 2024-09-16T00:51:48.936 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:47.892+0000 7f6c2a17e640 1 -- 172.21.15.12:0/3415238885 wait complete. 2024-09-16T00:51:48.936 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:51:48.937 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-16T00:51:48.944 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:51:48.944 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-16T00:51:48.944 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-16T00:51:48.944 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-16T00:51:48.946 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph Dashboard is now available at: 2024-09-16T00:51:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:51:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: URL: https://smithi012.front.sepia.ceph.com:8443/ 2024-09-16T00:51:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: User: admin 2024-09-16T00:51:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: Password: o1whz1cwsq 2024-09-16T00:51:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:51:48.946 INFO:teuthology.orchestra.run.smithi012.stdout:Saving cluster configuration to /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config directory 2024-09-16T00:51:50.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.324+0000 7f4223fca640 1 Processor -- start 2024-09-16T00:51:50.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.324+0000 7f4223fca640 1 -- start start 2024-09-16T00:51:50.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.325+0000 7f4223fca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c10a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:50.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.325+0000 7f4223fca640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f421c07be50 con 0x7f421c107fa0 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.325+0000 7f4221d66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c10a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.325+0000 7f4221d66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c10a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53094/0 (socket says 172.21.15.12:53094) 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.325+0000 7f4221d66640 1 -- 172.21.15.12:0/2787478054 learned_addr learned my addr 172.21.15.12:0/2787478054 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.325+0000 7f4221d66640 1 -- 172.21.15.12:0/2787478054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c10a8d0 con 0x7f421c107fa0 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.326+0000 7f4221d66640 1 --2- 172.21.15.12:0/2787478054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c10a390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4218009e80 tx=0x7f421802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746137b7e39f02cf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.326+0000 7f4220d64640 1 -- 172.21.15.12:0/2787478054 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4218036070 con 0x7f421c107fa0 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.326+0000 7f4220d64640 1 -- 172.21.15.12:0/2787478054 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42180318e0 con 0x7f421c107fa0 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.326+0000 7f4220d64640 1 -- 172.21.15.12:0/2787478054 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4218007a00 con 0x7f421c107fa0 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.327+0000 7f4223fca640 1 -- 172.21.15.12:0/2787478054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 msgr2=0x7f421c10a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.327+0000 7f4223fca640 1 --2- 172.21.15.12:0/2787478054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c10a390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4218009e80 tx=0x7f421802a7a0 comp rx=0 tx=0).stop 2024-09-16T00:51:50.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.327+0000 7f4223fca640 1 -- 172.21.15.12:0/2787478054 shutdown_connections 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.327+0000 7f4223fca640 1 --2- 172.21.15.12:0/2787478054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c10a390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.327+0000 7f4223fca640 1 -- 172.21.15.12:0/2787478054 >> 172.21.15.12:0/2787478054 conn(0x7f421c101bc0 msgr2=0x7f421c104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.327+0000 7f4223fca640 1 -- 172.21.15.12:0/2787478054 shutdown_connections 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.327+0000 7f4223fca640 1 -- 172.21.15.12:0/2787478054 wait complete. 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.328+0000 7f4223fca640 1 Processor -- start 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.328+0000 7f4223fca640 1 -- start start 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.328+0000 7f4223fca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.328+0000 7f4223fca640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f421c10b9b0 con 0x7f421c107fa0 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.328+0000 7f4221d66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.328+0000 7f4221d66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c19b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53100/0 (socket says 172.21.15.12:53100) 2024-09-16T00:51:50.143 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.328+0000 7f4221d66640 1 -- 172.21.15.12:0/2545027754 learned_addr learned my addr 172.21.15.12:0/2545027754 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.328+0000 7f4221d66640 1 -- 172.21.15.12:0/2545027754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c19ba90 con 0x7f421c107fa0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.329+0000 7f4221d66640 1 --2- 172.21.15.12:0/2545027754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c19b550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4218031cf0 tx=0x7f4218031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.329+0000 7f4212ffd640 1 -- 172.21.15.12:0/2545027754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4218036050 con 0x7f421c107fa0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.329+0000 7f4212ffd640 1 -- 172.21.15.12:0/2545027754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4218042070 con 0x7f421c107fa0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.329+0000 7f4223fca640 1 -- 172.21.15.12:0/2545027754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421c19bd20 con 0x7f421c107fa0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.329+0000 7f4212ffd640 1 -- 172.21.15.12:0/2545027754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f421803d9b0 con 0x7f421c107fa0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.329+0000 7f4223fca640 1 -- 172.21.15.12:0/2545027754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f421c19ea10 con 0x7f421c107fa0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.330+0000 7f4212ffd640 1 -- 172.21.15.12:0/2545027754 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f421803dc60 con 0x7f421c107fa0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.330+0000 7f4212ffd640 1 --2- 172.21.15.12:0/2545027754 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42080392a0 0x7f420803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.330+0000 7f4212ffd640 1 -- 172.21.15.12:0/2545027754 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f421806da80 con 0x7f421c107fa0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.330+0000 7f4221565640 1 --2- 172.21.15.12:0/2545027754 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42080392a0 0x7f420803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.330+0000 7f4223fca640 1 -- 172.21.15.12:0/2545027754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421c108400 con 0x7f421c107fa0 2024-09-16T00:51:50.144 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.331+0000 7f4221565640 1 --2- 172.21.15.12:0/2545027754 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42080392a0 0x7f420803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f420c0098c0 tx=0x7f420c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.335+0000 7f4212ffd640 1 -- 172.21.15.12:0/2545027754 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4218044310 con 0x7f421c107fa0 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.600+0000 7f4223fca640 1 -- 172.21.15.12:0/2545027754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f421c19eed0 con 0x7f421c107fa0 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.602+0000 7f4212ffd640 1 -- 172.21.15.12:0/2545027754 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f421803bcf0 con 0x7f421c107fa0 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.604+0000 7f4223fca640 1 -- 172.21.15.12:0/2545027754 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42080392a0 msgr2=0x7f420803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.604+0000 7f4223fca640 1 --2- 172.21.15.12:0/2545027754 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42080392a0 0x7f420803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f420c0098c0 tx=0x7f420c006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.604+0000 7f4223fca640 1 -- 172.21.15.12:0/2545027754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 msgr2=0x7f421c19b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.604+0000 7f4223fca640 1 --2- 172.21.15.12:0/2545027754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c19b550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4218031cf0 tx=0x7f4218031d20 comp rx=0 tx=0).stop 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.605+0000 7f4223fca640 1 -- 172.21.15.12:0/2545027754 shutdown_connections 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.605+0000 7f4223fca640 1 --2- 172.21.15.12:0/2545027754 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42080392a0 0x7f420803b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:50.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.605+0000 7f4223fca640 1 --2- 172.21.15.12:0/2545027754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f421c107fa0 0x7f421c19b550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.605+0000 7f4223fca640 1 -- 172.21.15.12:0/2545027754 >> 172.21.15.12:0/2545027754 conn(0x7f421c101bc0 msgr2=0x7f421c102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.605+0000 7f4223fca640 1 -- 172.21.15.12:0/2545027754 shutdown_connections 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-16T00:51:49.605+0000 7f4223fca640 1 -- 172.21.15.12:0/2545027754 wait complete. 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout:Or, if you are only running a single cluster on this host: 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout: ceph telemetry on 2024-09-16T00:51:50.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:51:50.147 INFO:teuthology.orchestra.run.smithi012.stdout:For more information see: 2024-09-16T00:51:50.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:51:50.147 INFO:teuthology.orchestra.run.smithi012.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-16T00:51:50.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:51:50.147 INFO:teuthology.orchestra.run.smithi012.stdout:Bootstrap complete. 2024-09-16T00:51:50.165 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:49 smithi012 ceph-mon[31197]: mgrmap e13: x(active, since 6s) 2024-09-16T00:51:50.166 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:49 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2545027754' entity='client.admin' 2024-09-16T00:51:50.181 INFO:tasks.cephadm:Fetching config... 2024-09-16T00:51:50.182 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:51:50.182 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-16T00:51:50.199 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-16T00:51:50.199 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:51:50.199 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-16T00:51:50.255 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-16T00:51:50.255 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:51:50.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-16T00:51:50.321 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-16T00:51:50.321 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:51:50.321 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-16T00:51:50.377 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-16T00:51:50.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNdN/C9ljIKLbDexWMvxq3xi7GUi5CMitMLEKvHj7/BYhaTFPE9vKvJKxhAoIZ9Eo17Fgvl0Kf/Mx1ToLIxlrPVXUOQGIiIVV2L/CVq6R5I8hHB6x7lDZbOQnMVnUbgIeJ1xArubCCea5a/11YIe6LbhaMTUc7XnWKF85TCxQjBHS2mZ8q2zckwcCs/SpPFeitukRUb3ZvMGMgnwzsAggdgI+wKZJfQ7XlKbRCz8W84O8HrQmn9QuYVTCDCexIM6kkui7r3R3nT7ArdGSFfxFlVtX9Mz5aMFNFp4E0kJzUyP6X1qszAPm4QAEA+WlH9GtP3OoQ6WH7S9i2Vz7MvbMrB7OLExFeh2fi5YUeGGLggE2grmuUWRjFnxRwc+N7PTq6n1SIl8G1Ve8PJqe2jB28NV3f69Ol8OggSjhlAroJWKXncq7pLZo5tKxuF9WG/yNT4lZf3L3vnf7AtQflYQR+E7HwYEH3VbpmhgQFBLV0krXsfJ3NLPhFxJxxLrOFttM= ceph-9a476aac-73c5-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T00:51:50.452 INFO:teuthology.orchestra.run.smithi012.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNdN/C9ljIKLbDexWMvxq3xi7GUi5CMitMLEKvHj7/BYhaTFPE9vKvJKxhAoIZ9Eo17Fgvl0Kf/Mx1ToLIxlrPVXUOQGIiIVV2L/CVq6R5I8hHB6x7lDZbOQnMVnUbgIeJ1xArubCCea5a/11YIe6LbhaMTUc7XnWKF85TCxQjBHS2mZ8q2zckwcCs/SpPFeitukRUb3ZvMGMgnwzsAggdgI+wKZJfQ7XlKbRCz8W84O8HrQmn9QuYVTCDCexIM6kkui7r3R3nT7ArdGSFfxFlVtX9Mz5aMFNFp4E0kJzUyP6X1qszAPm4QAEA+WlH9GtP3OoQ6WH7S9i2Vz7MvbMrB7OLExFeh2fi5YUeGGLggE2grmuUWRjFnxRwc+N7PTq6n1SIl8G1Ve8PJqe2jB28NV3f69Ol8OggSjhlAroJWKXncq7pLZo5tKxuF9WG/yNT4lZf3L3vnf7AtQflYQR+E7HwYEH3VbpmhgQFBLV0krXsfJ3NLPhFxJxxLrOFttM= ceph-9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:51:50.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNdN/C9ljIKLbDexWMvxq3xi7GUi5CMitMLEKvHj7/BYhaTFPE9vKvJKxhAoIZ9Eo17Fgvl0Kf/Mx1ToLIxlrPVXUOQGIiIVV2L/CVq6R5I8hHB6x7lDZbOQnMVnUbgIeJ1xArubCCea5a/11YIe6LbhaMTUc7XnWKF85TCxQjBHS2mZ8q2zckwcCs/SpPFeitukRUb3ZvMGMgnwzsAggdgI+wKZJfQ7XlKbRCz8W84O8HrQmn9QuYVTCDCexIM6kkui7r3R3nT7ArdGSFfxFlVtX9Mz5aMFNFp4E0kJzUyP6X1qszAPm4QAEA+WlH9GtP3OoQ6WH7S9i2Vz7MvbMrB7OLExFeh2fi5YUeGGLggE2grmuUWRjFnxRwc+N7PTq6n1SIl8G1Ve8PJqe2jB28NV3f69Ol8OggSjhlAroJWKXncq7pLZo5tKxuF9WG/yNT4lZf3L3vnf7AtQflYQR+E7HwYEH3VbpmhgQFBLV0krXsfJ3NLPhFxJxxLrOFttM= ceph-9a476aac-73c5-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T00:51:50.506 INFO:teuthology.orchestra.run.smithi098.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNdN/C9ljIKLbDexWMvxq3xi7GUi5CMitMLEKvHj7/BYhaTFPE9vKvJKxhAoIZ9Eo17Fgvl0Kf/Mx1ToLIxlrPVXUOQGIiIVV2L/CVq6R5I8hHB6x7lDZbOQnMVnUbgIeJ1xArubCCea5a/11YIe6LbhaMTUc7XnWKF85TCxQjBHS2mZ8q2zckwcCs/SpPFeitukRUb3ZvMGMgnwzsAggdgI+wKZJfQ7XlKbRCz8W84O8HrQmn9QuYVTCDCexIM6kkui7r3R3nT7ArdGSFfxFlVtX9Mz5aMFNFp4E0kJzUyP6X1qszAPm4QAEA+WlH9GtP3OoQ6WH7S9i2Vz7MvbMrB7OLExFeh2fi5YUeGGLggE2grmuUWRjFnxRwc+N7PTq6n1SIl8G1Ve8PJqe2jB28NV3f69Ol8OggSjhlAroJWKXncq7pLZo5tKxuF9WG/yNT4lZf3L3vnf7AtQflYQR+E7HwYEH3VbpmhgQFBLV0krXsfJ3NLPhFxJxxLrOFttM= ceph-9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:51:50.520 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNdN/C9ljIKLbDexWMvxq3xi7GUi5CMitMLEKvHj7/BYhaTFPE9vKvJKxhAoIZ9Eo17Fgvl0Kf/Mx1ToLIxlrPVXUOQGIiIVV2L/CVq6R5I8hHB6x7lDZbOQnMVnUbgIeJ1xArubCCea5a/11YIe6LbhaMTUc7XnWKF85TCxQjBHS2mZ8q2zckwcCs/SpPFeitukRUb3ZvMGMgnwzsAggdgI+wKZJfQ7XlKbRCz8W84O8HrQmn9QuYVTCDCexIM6kkui7r3R3nT7ArdGSFfxFlVtX9Mz5aMFNFp4E0kJzUyP6X1qszAPm4QAEA+WlH9GtP3OoQ6WH7S9i2Vz7MvbMrB7OLExFeh2fi5YUeGGLggE2grmuUWRjFnxRwc+N7PTq6n1SIl8G1Ve8PJqe2jB28NV3f69Ol8OggSjhlAroJWKXncq7pLZo5tKxuF9WG/yNT4lZf3L3vnf7AtQflYQR+E7HwYEH3VbpmhgQFBLV0krXsfJ3NLPhFxJxxLrOFttM= ceph-9a476aac-73c5-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T00:51:50.561 INFO:teuthology.orchestra.run.smithi119.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNdN/C9ljIKLbDexWMvxq3xi7GUi5CMitMLEKvHj7/BYhaTFPE9vKvJKxhAoIZ9Eo17Fgvl0Kf/Mx1ToLIxlrPVXUOQGIiIVV2L/CVq6R5I8hHB6x7lDZbOQnMVnUbgIeJ1xArubCCea5a/11YIe6LbhaMTUc7XnWKF85TCxQjBHS2mZ8q2zckwcCs/SpPFeitukRUb3ZvMGMgnwzsAggdgI+wKZJfQ7XlKbRCz8W84O8HrQmn9QuYVTCDCexIM6kkui7r3R3nT7ArdGSFfxFlVtX9Mz5aMFNFp4E0kJzUyP6X1qszAPm4QAEA+WlH9GtP3OoQ6WH7S9i2Vz7MvbMrB7OLExFeh2fi5YUeGGLggE2grmuUWRjFnxRwc+N7PTq6n1SIl8G1Ve8PJqe2jB28NV3f69Ol8OggSjhlAroJWKXncq7pLZo5tKxuF9WG/yNT4lZf3L3vnf7AtQflYQR+E7HwYEH3VbpmhgQFBLV0krXsfJ3NLPhFxJxxLrOFttM= ceph-9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:51:50.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-16T00:51:50.831 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:51:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.302+0000 7f2adcf52640 1 -- 172.21.15.12:0/1326756437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ad81020d0 msgr2=0x7f2ad81044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:51.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.302+0000 7f2adcf52640 1 --2- 172.21.15.12:0/1326756437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ad81020d0 0x7f2ad81044c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009880 tx=0x7f2ac802a5d0 comp rx=0 tx=0).stop 2024-09-16T00:51:51.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.302+0000 7f2adcf52640 1 -- 172.21.15.12:0/1326756437 shutdown_connections 2024-09-16T00:51:51.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.302+0000 7f2adcf52640 1 --2- 172.21.15.12:0/1326756437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ad81020d0 0x7f2ad81044c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:51.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.302+0000 7f2adcf52640 1 -- 172.21.15.12:0/1326756437 >> 172.21.15.12:0/1326756437 conn(0x7f2ad80fbcd0 msgr2=0x7f2ad80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:51.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.302+0000 7f2adcf52640 1 -- 172.21.15.12:0/1326756437 shutdown_connections 2024-09-16T00:51:51.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.302+0000 7f2adcf52640 1 -- 172.21.15.12:0/1326756437 wait complete. 2024-09-16T00:51:51.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.303+0000 7f2adcf52640 1 Processor -- start 2024-09-16T00:51:51.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.303+0000 7f2adcf52640 1 -- start start 2024-09-16T00:51:51.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.303+0000 7f2adcf52640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ad81020d0 0x7f2ad8101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:51.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.303+0000 7f2adcf52640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad8107670 con 0x7f2ad81020d0 2024-09-16T00:51:51.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.303+0000 7f2ad659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ad81020d0 0x7f2ad8101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:51.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.303+0000 7f2ad659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ad81020d0 0x7f2ad8101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53126/0 (socket says 172.21.15.12:53126) 2024-09-16T00:51:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.303+0000 7f2ad659c640 1 -- 172.21.15.12:0/1545414009 learned_addr learned my addr 172.21.15.12:0/1545414009 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.304+0000 7f2ad659c640 1 -- 172.21.15.12:0/1545414009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad8101e90 con 0x7f2ad81020d0 2024-09-16T00:51:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.304+0000 7f2ad659c640 1 --2- 172.21.15.12:0/1545414009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ad81020d0 0x7f2ad8101950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8004f60 tx=0x7f2ac80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.304+0000 7f2ac77fe640 1 -- 172.21.15.12:0/1545414009 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac803f070 con 0x7f2ad81020d0 2024-09-16T00:51:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.304+0000 7f2ac77fe640 1 -- 172.21.15.12:0/1545414009 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ac8003ad0 con 0x7f2ad81020d0 2024-09-16T00:51:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.304+0000 7f2adcf52640 1 -- 172.21.15.12:0/1545414009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad8100080 con 0x7f2ad81020d0 2024-09-16T00:51:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.304+0000 7f2ac77fe640 1 -- 172.21.15.12:0/1545414009 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac8035030 con 0x7f2ad81020d0 2024-09-16T00:51:51.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.304+0000 7f2adcf52640 1 -- 172.21.15.12:0/1545414009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad81005c0 con 0x7f2ad81020d0 2024-09-16T00:51:51.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.305+0000 7f2adcf52640 1 -- 172.21.15.12:0/1545414009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad8107df0 con 0x7f2ad81020d0 2024-09-16T00:51:51.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.305+0000 7f2ac77fe640 1 -- 172.21.15.12:0/1545414009 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2ac8042070 con 0x7f2ad81020d0 2024-09-16T00:51:51.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.305+0000 7f2ac77fe640 1 --2- 172.21.15.12:0/1545414009 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2ac00392a0 0x7f2ac003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:51.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.305+0000 7f2ac77fe640 1 -- 172.21.15.12:0/1545414009 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2ac806d140 con 0x7f2ad81020d0 2024-09-16T00:51:51.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.306+0000 7f2ad5d9b640 1 --2- 172.21.15.12:0/1545414009 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2ac00392a0 0x7f2ac003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:51.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.306+0000 7f2ad5d9b640 1 --2- 172.21.15.12:0/1545414009 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2ac00392a0 0x7f2ac003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0098c0 tx=0x7f2acc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:51.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.310+0000 7f2ac77fe640 1 -- 172.21.15.12:0/1545414009 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ac80433b0 con 0x7f2ad81020d0 2024-09-16T00:51:51.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.489+0000 7f2adcf52640 1 -- 172.21.15.12:0/1545414009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f2ad8190350 con 0x7f2ad81020d0 2024-09-16T00:51:51.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.492+0000 7f2ac77fe640 1 -- 172.21.15.12:0/1545414009 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f2ac802f300 con 0x7f2ad81020d0 2024-09-16T00:51:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.494+0000 7f2adcf52640 1 -- 172.21.15.12:0/1545414009 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2ac00392a0 msgr2=0x7f2ac003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.494+0000 7f2adcf52640 1 --2- 172.21.15.12:0/1545414009 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2ac00392a0 0x7f2ac003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0098c0 tx=0x7f2acc006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.494+0000 7f2adcf52640 1 -- 172.21.15.12:0/1545414009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ad81020d0 msgr2=0x7f2ad8101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.494+0000 7f2adcf52640 1 --2- 172.21.15.12:0/1545414009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ad81020d0 0x7f2ad8101950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8004f60 tx=0x7f2ac80048f0 comp rx=0 tx=0).stop 2024-09-16T00:51:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.494+0000 7f2adcf52640 1 -- 172.21.15.12:0/1545414009 shutdown_connections 2024-09-16T00:51:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.494+0000 7f2adcf52640 1 --2- 172.21.15.12:0/1545414009 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2ac00392a0 0x7f2ac003b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.494+0000 7f2adcf52640 1 --2- 172.21.15.12:0/1545414009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ad81020d0 0x7f2ad8101950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.494+0000 7f2adcf52640 1 -- 172.21.15.12:0/1545414009 >> 172.21.15.12:0/1545414009 conn(0x7f2ad80fbcd0 msgr2=0x7f2ad80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:51.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.495+0000 7f2adcf52640 1 -- 172.21.15.12:0/1545414009 shutdown_connections 2024-09-16T00:51:51.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:51.495+0000 7f2adcf52640 1 -- 172.21.15.12:0/1545414009 wait complete. 2024-09-16T00:51:52.126 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-16T00:51:52.127 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-16T00:51:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:51:52.829 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:52 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1545414009' entity='client.admin' 2024-09-16T00:51:53.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.045+0000 7fc5db972640 1 -- 172.21.15.12:0/28090829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5d4100540 msgr2=0x7fc5d4100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:53.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.045+0000 7fc5db972640 1 --2- 172.21.15.12:0/28090829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5d4100540 0x7fc5d4100940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009880 tx=0x7fc5d002a5d0 comp rx=0 tx=0).stop 2024-09-16T00:51:53.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.046+0000 7fc5db972640 1 -- 172.21.15.12:0/28090829 shutdown_connections 2024-09-16T00:51:53.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.046+0000 7fc5db972640 1 --2- 172.21.15.12:0/28090829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5d4100540 0x7fc5d4100940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:53.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.046+0000 7fc5db972640 1 -- 172.21.15.12:0/28090829 >> 172.21.15.12:0/28090829 conn(0x7fc5d40fbcd0 msgr2=0x7fc5d40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:53.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.046+0000 7fc5db972640 1 -- 172.21.15.12:0/28090829 shutdown_connections 2024-09-16T00:51:53.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.046+0000 7fc5db972640 1 -- 172.21.15.12:0/28090829 wait complete. 2024-09-16T00:51:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.046+0000 7fc5db972640 1 Processor -- start 2024-09-16T00:51:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.046+0000 7fc5db972640 1 -- start start 2024-09-16T00:51:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5db972640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5d4100540 0x7fc5d4196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5db972640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d41065f0 con 0x7fc5d4100540 2024-09-16T00:51:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5d970e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5d4100540 0x7fc5d4196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5d970e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5d4100540 0x7fc5d4196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53154/0 (socket says 172.21.15.12:53154) 2024-09-16T00:51:53.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5d970e640 1 -- 172.21.15.12:0/829057414 learned_addr learned my addr 172.21.15.12:0/829057414 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:53.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5d970e640 1 -- 172.21.15.12:0/829057414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d41972f0 con 0x7fc5d4100540 2024-09-16T00:51:53.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5d970e640 1 --2- 172.21.15.12:0/829057414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5d4100540 0x7fc5d4196db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0004f60 tx=0x7fc5d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:53.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5ca7fc640 1 -- 172.21.15.12:0/829057414 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5d003f070 con 0x7fc5d4100540 2024-09-16T00:51:53.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5db972640 1 -- 172.21.15.12:0/829057414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d4197580 con 0x7fc5d4100540 2024-09-16T00:51:53.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5ca7fc640 1 -- 172.21.15.12:0/829057414 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5d0004d40 con 0x7fc5d4100540 2024-09-16T00:51:53.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5ca7fc640 1 -- 172.21.15.12:0/829057414 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5d0035030 con 0x7fc5d4100540 2024-09-16T00:51:53.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.047+0000 7fc5db972640 1 -- 172.21.15.12:0/829057414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d419a230 con 0x7fc5d4100540 2024-09-16T00:51:53.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.048+0000 7fc5ca7fc640 1 -- 172.21.15.12:0/829057414 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc5d0042070 con 0x7fc5d4100540 2024-09-16T00:51:53.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.048+0000 7fc5db972640 1 -- 172.21.15.12:0/829057414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5d4106d70 con 0x7fc5d4100540 2024-09-16T00:51:53.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.049+0000 7fc5ca7fc640 1 --2- 172.21.15.12:0/829057414 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc5c00392a0 0x7fc5c003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:53.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.049+0000 7fc5ca7fc640 1 -- 172.21.15.12:0/829057414 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc5d006d140 con 0x7fc5d4100540 2024-09-16T00:51:53.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.049+0000 7fc5d8f0d640 1 --2- 172.21.15.12:0/829057414 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc5c00392a0 0x7fc5c003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:53.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.049+0000 7fc5d8f0d640 1 --2- 172.21.15.12:0/829057414 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc5c00392a0 0x7fc5c003b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40098c0 tx=0x7fc5c4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:53.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.053+0000 7fc5ca7fc640 1 -- 172.21.15.12:0/829057414 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5d0039350 con 0x7fc5d4100540 2024-09-16T00:51:53.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.236+0000 7fc5db972640 1 -- 172.21.15.12:0/829057414 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fc5d402d8a0 con 0x7fc5c00392a0 2024-09-16T00:51:53.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.239+0000 7fc5ca7fc640 1 -- 172.21.15.12:0/829057414 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc5d402d8a0 con 0x7fc5c00392a0 2024-09-16T00:51:53.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.241+0000 7fc5db972640 1 -- 172.21.15.12:0/829057414 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc5c00392a0 msgr2=0x7fc5c003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:53.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.241+0000 7fc5db972640 1 --2- 172.21.15.12:0/829057414 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc5c00392a0 0x7fc5c003b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40098c0 tx=0x7fc5c4006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:53.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.241+0000 7fc5db972640 1 -- 172.21.15.12:0/829057414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5d4100540 msgr2=0x7fc5d4196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:53.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.241+0000 7fc5db972640 1 --2- 172.21.15.12:0/829057414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5d4100540 0x7fc5d4196db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0004f60 tx=0x7fc5d00048f0 comp rx=0 tx=0).stop 2024-09-16T00:51:53.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.241+0000 7fc5db972640 1 -- 172.21.15.12:0/829057414 shutdown_connections 2024-09-16T00:51:53.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.241+0000 7fc5db972640 1 --2- 172.21.15.12:0/829057414 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc5c00392a0 0x7fc5c003b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:53.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.241+0000 7fc5db972640 1 --2- 172.21.15.12:0/829057414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5d4100540 0x7fc5d4196db0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:53.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.241+0000 7fc5db972640 1 -- 172.21.15.12:0/829057414 >> 172.21.15.12:0/829057414 conn(0x7fc5d40fbcd0 msgr2=0x7fc5d4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:53.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.241+0000 7fc5db972640 1 -- 172.21.15.12:0/829057414 shutdown_connections 2024-09-16T00:51:53.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:53.241+0000 7fc5db972640 1 -- 172.21.15.12:0/829057414 wait complete. 2024-09-16T00:51:53.832 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:53.832 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:53.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi012", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:51:53.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:53.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:53.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:53.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:53.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:53.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:51:53.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:51:53.997 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi098 2024-09-16T00:51:53.997 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:51:53.997 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.conf 2024-09-16T00:51:54.017 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:51:54.017 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:51:54.075 INFO:tasks.cephadm:Adding host smithi098 to orchestrator... 2024-09-16T00:51:54.076 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch host add smithi098 2024-09-16T00:51:54.334 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:51:54.694 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:54 smithi012 ceph-mon[31197]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:54.694 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:54 smithi012 ceph-mon[31197]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-16T00:51:54.694 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:54 smithi012 ceph-mon[31197]: Updating smithi012:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:51:54.694 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:54 smithi012 ceph-mon[31197]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:51:54.694 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:54 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:54.694 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:54 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:54.695 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:54 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.777+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/2666055392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e88106560 msgr2=0x7f7e88106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.777+0000 7f7e8fb8d640 1 --2- 172.21.15.12:0/2666055392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e88106560 0x7f7e88106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009880 tx=0x7f7e8402a5d0 comp rx=0 tx=0).stop 2024-09-16T00:51:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.777+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/2666055392 shutdown_connections 2024-09-16T00:51:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.777+0000 7f7e8fb8d640 1 --2- 172.21.15.12:0/2666055392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e88106560 0x7f7e88106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.777+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/2666055392 >> 172.21.15.12:0/2666055392 conn(0x7f7e880fc1b0 msgr2=0x7f7e880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.777+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/2666055392 shutdown_connections 2024-09-16T00:51:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.777+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/2666055392 wait complete. 2024-09-16T00:51:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.778+0000 7f7e8fb8d640 1 Processor -- start 2024-09-16T00:51:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.778+0000 7f7e8fb8d640 1 -- start start 2024-09-16T00:51:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.778+0000 7f7e8fb8d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e88106560 0x7f7e88195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.778+0000 7f7e8fb8d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8810ab90 con 0x7f7e88106560 2024-09-16T00:51:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.778+0000 7f7e8d929640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e88106560 0x7f7e88195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.778+0000 7f7e8d929640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e88106560 0x7f7e88195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53178/0 (socket says 172.21.15.12:53178) 2024-09-16T00:51:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.778+0000 7f7e8d929640 1 -- 172.21.15.12:0/1993581403 learned_addr learned my addr 172.21.15.12:0/1993581403 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:51:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.778+0000 7f7e8d929640 1 -- 172.21.15.12:0/1993581403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8806acd0 con 0x7f7e88106560 2024-09-16T00:51:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.779+0000 7f7e8d929640 1 --2- 172.21.15.12:0/1993581403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e88106560 0x7f7e88195db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009230 tx=0x7f7e84003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.779+0000 7f7e7effd640 1 -- 172.21.15.12:0/1993581403 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e8403f070 con 0x7f7e88106560 2024-09-16T00:51:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.779+0000 7f7e7effd640 1 -- 172.21.15.12:0/1993581403 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e8403bc80 con 0x7f7e88106560 2024-09-16T00:51:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.779+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/1993581403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e881962f0 con 0x7f7e88106560 2024-09-16T00:51:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.779+0000 7f7e7effd640 1 -- 172.21.15.12:0/1993581403 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e84035030 con 0x7f7e88106560 2024-09-16T00:51:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.779+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/1993581403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e88196750 con 0x7f7e88106560 2024-09-16T00:51:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.780+0000 7f7e7effd640 1 -- 172.21.15.12:0/1993581403 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7e84042070 con 0x7f7e88106560 2024-09-16T00:51:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.780+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/1993581403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e88101bd0 con 0x7f7e88106560 2024-09-16T00:51:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.780+0000 7f7e7effd640 1 --2- 172.21.15.12:0/1993581403 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7e74039300 0x7f7e7403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.780+0000 7f7e7effd640 1 -- 172.21.15.12:0/1993581403 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7e8406d1b0 con 0x7f7e88106560 2024-09-16T00:51:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.780+0000 7f7e8d128640 1 --2- 172.21.15.12:0/1993581403 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7e74039300 0x7f7e7403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.780+0000 7f7e8d128640 1 --2- 172.21.15.12:0/1993581403 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7e74039300 0x7f7e7403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7e780098c0 tx=0x7f7e78006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:54.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.785+0000 7f7e7effd640 1 -- 172.21.15.12:0/1993581403 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e840314c0 con 0x7f7e88106560 2024-09-16T00:51:54.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:54.966+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/1993581403 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}) -- 0x7f7e8806a4c0 con 0x7f7e74039300 2024-09-16T00:51:55.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:55 smithi012 ceph-mon[31197]: Updating smithi012:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:51:56.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:56 smithi012 ceph-mon[31197]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:57.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:57 smithi012 ceph-mon[31197]: Deploying cephadm binary to smithi098 2024-09-16T00:51:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.828+0000 7f7e7effd640 1 -- 172.21.15.12:0/1993581403 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f7e8806a4c0 con 0x7f7e74039300 2024-09-16T00:51:58.830 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi098' with addr '172.21.15.98' 2024-09-16T00:51:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.831+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/1993581403 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7e74039300 msgr2=0x7f7e7403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.831+0000 7f7e8fb8d640 1 --2- 172.21.15.12:0/1993581403 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7e74039300 0x7f7e7403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7e780098c0 tx=0x7f7e78006db0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.831+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/1993581403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e88106560 msgr2=0x7f7e88195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.831+0000 7f7e8fb8d640 1 --2- 172.21.15.12:0/1993581403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e88106560 0x7f7e88195db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009230 tx=0x7f7e84003d40 comp rx=0 tx=0).stop 2024-09-16T00:51:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.831+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/1993581403 shutdown_connections 2024-09-16T00:51:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.831+0000 7f7e8fb8d640 1 --2- 172.21.15.12:0/1993581403 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7e74039300 0x7f7e7403b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.831+0000 7f7e8fb8d640 1 --2- 172.21.15.12:0/1993581403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e88106560 0x7f7e88195db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.831+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/1993581403 >> 172.21.15.12:0/1993581403 conn(0x7f7e880fc1b0 msgr2=0x7f7e880fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.831+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/1993581403 shutdown_connections 2024-09-16T00:51:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:58.831+0000 7f7e8fb8d640 1 -- 172.21.15.12:0/1993581403 wait complete. 2024-09-16T00:51:59.320 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T00:51:59.582 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:51:59.992 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:59 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:59.993 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:59 smithi012 ceph-mon[31197]: Added host smithi098 2024-09-16T00:51:59.993 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:59 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:59.993 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:59 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:51:59.993 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:51:59 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.998+0000 7fe46e026640 1 -- 172.21.15.12:0/2470229867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe468107660 msgr2=0x7fe468107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.998+0000 7fe46e026640 1 --2- 172.21.15.12:0/2470229867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe468107660 0x7fe468107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe458009880 tx=0x7fe45802a5d0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.998+0000 7fe46e026640 1 -- 172.21.15.12:0/2470229867 shutdown_connections 2024-09-16T00:52:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.998+0000 7fe46e026640 1 --2- 172.21.15.12:0/2470229867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe468107660 0x7fe468107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.998+0000 7fe46e026640 1 -- 172.21.15.12:0/2470229867 >> 172.21.15.12:0/2470229867 conn(0x7fe4680fd290 msgr2=0x7fe4680ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.998+0000 7fe46e026640 1 -- 172.21.15.12:0/2470229867 shutdown_connections 2024-09-16T00:52:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.998+0000 7fe46e026640 1 -- 172.21.15.12:0/2470229867 wait complete. 2024-09-16T00:52:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.999+0000 7fe46e026640 1 Processor -- start 2024-09-16T00:52:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.999+0000 7fe46e026640 1 -- start start 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.999+0000 7fe46e026640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe468107660 0x7fe4680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.999+0000 7fe46e026640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe46810bc90 con 0x7fe468107660 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.999+0000 7fe4677fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe468107660 0x7fe4680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.999+0000 7fe4677fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe468107660 0x7fe4680744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49400/0 (socket says 172.21.15.12:49400) 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.999+0000 7fe4677fe640 1 -- 172.21.15.12:0/4234525446 learned_addr learned my addr 172.21.15.12:0/4234525446 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:51:59.999+0000 7fe4677fe640 1 -- 172.21.15.12:0/4234525446 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4680763e0 con 0x7fe468107660 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.000+0000 7fe4677fe640 1 --2- 172.21.15.12:0/4234525446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe468107660 0x7fe4680744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe458009230 tx=0x7fe458003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.000+0000 7fe464ff9640 1 -- 172.21.15.12:0/4234525446 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45803f070 con 0x7fe468107660 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.000+0000 7fe464ff9640 1 -- 172.21.15.12:0/4234525446 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe45803bd40 con 0x7fe468107660 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.000+0000 7fe46e026640 1 -- 172.21.15.12:0/4234525446 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe468074a30 con 0x7fe468107660 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.000+0000 7fe464ff9640 1 -- 172.21.15.12:0/4234525446 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe458035030 con 0x7fe468107660 2024-09-16T00:52:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.000+0000 7fe46e026640 1 -- 172.21.15.12:0/4234525446 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe468074ef0 con 0x7fe468107660 2024-09-16T00:52:00.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.001+0000 7fe464ff9640 1 -- 172.21.15.12:0/4234525446 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe458042070 con 0x7fe468107660 2024-09-16T00:52:00.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.001+0000 7fe46e026640 1 -- 172.21.15.12:0/4234525446 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe468102cd0 con 0x7fe468107660 2024-09-16T00:52:00.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.001+0000 7fe464ff9640 1 --2- 172.21.15.12:0/4234525446 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4500392a0 0x7fe45003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:00.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.001+0000 7fe464ff9640 1 -- 172.21.15.12:0/4234525446 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe45806cf50 con 0x7fe468107660 2024-09-16T00:52:00.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.001+0000 7fe466ffd640 1 --2- 172.21.15.12:0/4234525446 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4500392a0 0x7fe45003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:00.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.002+0000 7fe466ffd640 1 --2- 172.21.15.12:0/4234525446 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4500392a0 0x7fe45003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0098c0 tx=0x7fe45c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:00.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.006+0000 7fe464ff9640 1 -- 172.21.15.12:0/4234525446 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe458030d60 con 0x7fe468107660 2024-09-16T00:52:00.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.188+0000 7fe46e026640 1 -- 172.21.15.12:0/4234525446 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe468075a20 con 0x7fe4500392a0 2024-09-16T00:52:00.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.189+0000 7fe464ff9640 1 -- 172.21.15.12:0/4234525446 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fe468075a20 con 0x7fe4500392a0 2024-09-16T00:52:00.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:52:00.191 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}] 2024-09-16T00:52:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.192+0000 7fe46e026640 1 -- 172.21.15.12:0/4234525446 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4500392a0 msgr2=0x7fe45003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.192+0000 7fe46e026640 1 --2- 172.21.15.12:0/4234525446 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4500392a0 0x7fe45003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0098c0 tx=0x7fe45c006db0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.192+0000 7fe46e026640 1 -- 172.21.15.12:0/4234525446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe468107660 msgr2=0x7fe4680744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.192+0000 7fe46e026640 1 --2- 172.21.15.12:0/4234525446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe468107660 0x7fe4680744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe458009230 tx=0x7fe458003d80 comp rx=0 tx=0).stop 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.192+0000 7fe46e026640 1 -- 172.21.15.12:0/4234525446 shutdown_connections 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.192+0000 7fe46e026640 1 --2- 172.21.15.12:0/4234525446 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4500392a0 0x7fe45003b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.192+0000 7fe46e026640 1 --2- 172.21.15.12:0/4234525446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe468107660 0x7fe4680744f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.192+0000 7fe46e026640 1 -- 172.21.15.12:0/4234525446 >> 172.21.15.12:0/4234525446 conn(0x7fe4680fd290 msgr2=0x7fe4680febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.192+0000 7fe46e026640 1 -- 172.21.15.12:0/4234525446 shutdown_connections 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:00.192+0000 7fe46e026640 1 -- 172.21.15.12:0/4234525446 wait complete. 2024-09-16T00:52:00.853 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi119 2024-09-16T00:52:00.854 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:52:00.854 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.conf 2024-09-16T00:52:00.874 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:52:00.874 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:00.933 INFO:tasks.cephadm:Adding host smithi119 to orchestrator... 2024-09-16T00:52:00.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch host add smithi119 2024-09-16T00:52:01.198 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:52:01.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:01.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:01 smithi012 ceph-mon[31197]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:52:01.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.757+0000 7fadd76cf640 1 -- 172.21.15.12:0/692623839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadd0106540 msgr2=0x7fadd0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:01.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.757+0000 7fadd76cf640 1 --2- 172.21.15.12:0/692623839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadd0106540 0x7fadd0106920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009810 tx=0x7fadcc02a540 comp rx=0 tx=0).stop 2024-09-16T00:52:01.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.757+0000 7fadd76cf640 1 -- 172.21.15.12:0/692623839 shutdown_connections 2024-09-16T00:52:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.757+0000 7fadd76cf640 1 --2- 172.21.15.12:0/692623839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadd0106540 0x7fadd0106920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.757+0000 7fadd76cf640 1 -- 172.21.15.12:0/692623839 >> 172.21.15.12:0/692623839 conn(0x7fadd0077310 msgr2=0x7fadd00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.757+0000 7fadd76cf640 1 -- 172.21.15.12:0/692623839 shutdown_connections 2024-09-16T00:52:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.757+0000 7fadd76cf640 1 -- 172.21.15.12:0/692623839 wait complete. 2024-09-16T00:52:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.757+0000 7fadd76cf640 1 Processor -- start 2024-09-16T00:52:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.757+0000 7fadd76cf640 1 -- start start 2024-09-16T00:52:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadd76cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadd0106540 0x7fadd0197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadd76cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fadd010ab70 con 0x7fadd0106540 2024-09-16T00:52:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadd546b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadd0106540 0x7fadd0197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadd546b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadd0106540 0x7fadd0197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49422/0 (socket says 172.21.15.12:49422) 2024-09-16T00:52:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadd546b640 1 -- 172.21.15.12:0/1012544130 learned_addr learned my addr 172.21.15.12:0/1012544130 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:52:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadd546b640 1 -- 172.21.15.12:0/1012544130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd0197690 con 0x7fadd0106540 2024-09-16T00:52:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadd546b640 1 --2- 172.21.15.12:0/1012544130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadd0106540 0x7fadd0197150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009930 tx=0x7fadcc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadc67fc640 1 -- 172.21.15.12:0/1012544130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadcc031400 con 0x7fadd0106540 2024-09-16T00:52:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadc67fc640 1 -- 172.21.15.12:0/1012544130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadcc0035f0 con 0x7fadd0106540 2024-09-16T00:52:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadd76cf640 1 -- 172.21.15.12:0/1012544130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd0197920 con 0x7fadd0106540 2024-09-16T00:52:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.758+0000 7fadc67fc640 1 -- 172.21.15.12:0/1012544130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadcc03c440 con 0x7fadd0106540 2024-09-16T00:52:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.759+0000 7fadd76cf640 1 -- 172.21.15.12:0/1012544130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd019ba20 con 0x7fadd0106540 2024-09-16T00:52:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.759+0000 7fadc67fc640 1 -- 172.21.15.12:0/1012544130 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fadcc039040 con 0x7fadd0106540 2024-09-16T00:52:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.759+0000 7fadd76cf640 1 -- 172.21.15.12:0/1012544130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd0101bb0 con 0x7fadd0106540 2024-09-16T00:52:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.760+0000 7fadc67fc640 1 --2- 172.21.15.12:0/1012544130 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fadbc039300 0x7fadbc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.760+0000 7fadc67fc640 1 -- 172.21.15.12:0/1012544130 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fadcc06d860 con 0x7fadd0106540 2024-09-16T00:52:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.760+0000 7fadd4c6a640 1 --2- 172.21.15.12:0/1012544130 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fadbc039300 0x7fadbc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.760+0000 7fadd4c6a640 1 --2- 172.21.15.12:0/1012544130 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fadbc039300 0x7fadbc03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fadc00098c0 tx=0x7fadc0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:01.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.764+0000 7fadc67fc640 1 -- 172.21.15.12:0/1012544130 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadcc040030 con 0x7fadd0106540 2024-09-16T00:52:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:01.944+0000 7fadd76cf640 1 -- 172.21.15.12:0/1012544130 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}) -- 0x7fadd01069a0 con 0x7fadbc039300 2024-09-16T00:52:03.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:02 smithi012 ceph-mon[31197]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:04.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: Deploying cephadm binary to smithi119 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: Updating smithi098:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: Updating smithi098:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:04.358 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.771+0000 7fadc67fc640 1 -- 172.21.15.12:0/1012544130 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fadd01069a0 con 0x7fadbc039300 2024-09-16T00:52:05.773 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi119' with addr '172.21.15.119' 2024-09-16T00:52:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.774+0000 7fadd76cf640 1 -- 172.21.15.12:0/1012544130 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fadbc039300 msgr2=0x7fadbc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.774+0000 7fadd76cf640 1 --2- 172.21.15.12:0/1012544130 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fadbc039300 0x7fadbc03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fadc00098c0 tx=0x7fadc0006db0 comp rx=0 tx=0).stop 2024-09-16T00:52:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.774+0000 7fadd76cf640 1 -- 172.21.15.12:0/1012544130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadd0106540 msgr2=0x7fadd0197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.774+0000 7fadd76cf640 1 --2- 172.21.15.12:0/1012544130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadd0106540 0x7fadd0197150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009930 tx=0x7fadcc004570 comp rx=0 tx=0).stop 2024-09-16T00:52:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.774+0000 7fadd76cf640 1 -- 172.21.15.12:0/1012544130 shutdown_connections 2024-09-16T00:52:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.774+0000 7fadd76cf640 1 --2- 172.21.15.12:0/1012544130 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fadbc039300 0x7fadbc03b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.774+0000 7fadd76cf640 1 --2- 172.21.15.12:0/1012544130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadd0106540 0x7fadd0197150 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.774+0000 7fadd76cf640 1 -- 172.21.15.12:0/1012544130 >> 172.21.15.12:0/1012544130 conn(0x7fadd0077310 msgr2=0x7fadd00696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.774+0000 7fadd76cf640 1 -- 172.21.15.12:0/1012544130 shutdown_connections 2024-09-16T00:52:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:05.774+0000 7fadd76cf640 1 -- 172.21.15.12:0/1012544130 wait complete. 2024-09-16T00:52:06.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T00:52:06.540 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:52:06.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:06 smithi012 ceph-mon[31197]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:06.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:06.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:06 smithi012 ceph-mon[31197]: Added host smithi119 2024-09-16T00:52:06.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:06.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:06.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:06.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.953+0000 7fd40ffaa640 1 -- 172.21.15.12:0/962478867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd408100540 msgr2=0x7fd408100920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:06.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.953+0000 7fd40ffaa640 1 --2- 172.21.15.12:0/962478867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd408100540 0x7fd408100920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd400009880 tx=0x7fd40002a670 comp rx=0 tx=0).stop 2024-09-16T00:52:06.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.953+0000 7fd40ffaa640 1 -- 172.21.15.12:0/962478867 shutdown_connections 2024-09-16T00:52:06.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.953+0000 7fd40ffaa640 1 --2- 172.21.15.12:0/962478867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd408100540 0x7fd408100920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.953+0000 7fd40ffaa640 1 -- 172.21.15.12:0/962478867 >> 172.21.15.12:0/962478867 conn(0x7fd4080fc1b0 msgr2=0x7fd4080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.953+0000 7fd40ffaa640 1 -- 172.21.15.12:0/962478867 shutdown_connections 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.953+0000 7fd40ffaa640 1 -- 172.21.15.12:0/962478867 wait complete. 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.954+0000 7fd40ffaa640 1 Processor -- start 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.954+0000 7fd40ffaa640 1 -- start start 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.954+0000 7fd40ffaa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd408100540 0x7fd4081a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.954+0000 7fd40ffaa640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4081122d0 con 0x7fd408100540 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.954+0000 7fd40dd46640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd408100540 0x7fd4081a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.954+0000 7fd40dd46640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd408100540 0x7fd4081a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48150/0 (socket says 172.21.15.12:48150) 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.954+0000 7fd40dd46640 1 -- 172.21.15.12:0/3494855534 learned_addr learned my addr 172.21.15.12:0/3494855534 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.954+0000 7fd40dd46640 1 -- 172.21.15.12:0/3494855534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4081a3980 con 0x7fd408100540 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.955+0000 7fd40dd46640 1 --2- 172.21.15.12:0/3494855534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd408100540 0x7fd4081a3440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd400009230 tx=0x7fd400003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.955+0000 7fd406ffd640 1 -- 172.21.15.12:0/3494855534 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd40003f070 con 0x7fd408100540 2024-09-16T00:52:06.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.955+0000 7fd406ffd640 1 -- 172.21.15.12:0/3494855534 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd40003bd40 con 0x7fd408100540 2024-09-16T00:52:06.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.955+0000 7fd406ffd640 1 -- 172.21.15.12:0/3494855534 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd400035030 con 0x7fd408100540 2024-09-16T00:52:06.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.955+0000 7fd40ffaa640 1 -- 172.21.15.12:0/3494855534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4081a3c10 con 0x7fd408100540 2024-09-16T00:52:06.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.955+0000 7fd40ffaa640 1 -- 172.21.15.12:0/3494855534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40819d600 con 0x7fd408100540 2024-09-16T00:52:06.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.956+0000 7fd406ffd640 1 -- 172.21.15.12:0/3494855534 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fd400042070 con 0x7fd408100540 2024-09-16T00:52:06.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.956+0000 7fd406ffd640 1 --2- 172.21.15.12:0/3494855534 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd3f0039300 0x7fd3f003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:06.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.956+0000 7fd40ffaa640 1 -- 172.21.15.12:0/3494855534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40806a7b0 con 0x7fd408100540 2024-09-16T00:52:06.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.956+0000 7fd406ffd640 1 -- 172.21.15.12:0/3494855534 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd40006cf00 con 0x7fd408100540 2024-09-16T00:52:06.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.956+0000 7fd40d545640 1 --2- 172.21.15.12:0/3494855534 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd3f0039300 0x7fd3f003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:06.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.957+0000 7fd40d545640 1 --2- 172.21.15.12:0/3494855534 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd3f0039300 0x7fd3f003b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0098c0 tx=0x7fd3fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:06.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:06.961+0000 7fd406ffd640 1 -- 172.21.15.12:0/3494855534 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4000412c0 con 0x7fd408100540 2024-09-16T00:52:07.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.142+0000 7fd40ffaa640 1 -- 172.21.15.12:0/3494855534 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4081009a0 con 0x7fd3f0039300 2024-09-16T00:52:07.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.143+0000 7fd406ffd640 1 -- 172.21.15.12:0/3494855534 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fd4081009a0 con 0x7fd3f0039300 2024-09-16T00:52:07.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:52:07.145 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}] 2024-09-16T00:52:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.145+0000 7fd40ffaa640 1 -- 172.21.15.12:0/3494855534 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd3f0039300 msgr2=0x7fd3f003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.145+0000 7fd40ffaa640 1 --2- 172.21.15.12:0/3494855534 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd3f0039300 0x7fd3f003b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0098c0 tx=0x7fd3fc006db0 comp rx=0 tx=0).stop 2024-09-16T00:52:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.145+0000 7fd40ffaa640 1 -- 172.21.15.12:0/3494855534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd408100540 msgr2=0x7fd4081a3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.145+0000 7fd40ffaa640 1 --2- 172.21.15.12:0/3494855534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd408100540 0x7fd4081a3440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd400009230 tx=0x7fd400003d80 comp rx=0 tx=0).stop 2024-09-16T00:52:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.145+0000 7fd40ffaa640 1 -- 172.21.15.12:0/3494855534 shutdown_connections 2024-09-16T00:52:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.145+0000 7fd40ffaa640 1 --2- 172.21.15.12:0/3494855534 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd3f0039300 0x7fd3f003b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.145+0000 7fd40ffaa640 1 --2- 172.21.15.12:0/3494855534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd408100540 0x7fd4081a3440 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.145+0000 7fd40ffaa640 1 -- 172.21.15.12:0/3494855534 >> 172.21.15.12:0/3494855534 conn(0x7fd4080fc1b0 msgr2=0x7fd4080fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.145+0000 7fd40ffaa640 1 -- 172.21.15.12:0/3494855534 shutdown_connections 2024-09-16T00:52:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:07.145+0000 7fd40ffaa640 1 -- 172.21.15.12:0/3494855534 wait complete. 2024-09-16T00:52:07.704 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-16T00:52:07.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-16T00:52:07.955 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:52:08.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:08 smithi012 ceph-mon[31197]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:08.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:08.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:08 smithi012 ceph-mon[31197]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:52:08.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.490+0000 7f4ff2369640 1 -- 172.21.15.12:0/3652724345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fec102730 msgr2=0x7f4fec102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:08.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.490+0000 7f4ff2369640 1 --2- 172.21.15.12:0/3652724345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fec102730 0x7f4fec102b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009880 tx=0x7f4fdc02a670 comp rx=0 tx=0).stop 2024-09-16T00:52:08.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.491+0000 7f4ff2369640 1 -- 172.21.15.12:0/3652724345 shutdown_connections 2024-09-16T00:52:08.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.491+0000 7f4ff2369640 1 --2- 172.21.15.12:0/3652724345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fec102730 0x7f4fec102b10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:08.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.491+0000 7f4ff2369640 1 -- 172.21.15.12:0/3652724345 >> 172.21.15.12:0/3652724345 conn(0x7f4fec0fc150 msgr2=0x7f4fec0fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:08.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.491+0000 7f4ff2369640 1 -- 172.21.15.12:0/3652724345 shutdown_connections 2024-09-16T00:52:08.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.491+0000 7f4ff2369640 1 -- 172.21.15.12:0/3652724345 wait complete. 2024-09-16T00:52:08.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.491+0000 7f4ff2369640 1 Processor -- start 2024-09-16T00:52:08.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.491+0000 7f4ff2369640 1 -- start start 2024-09-16T00:52:08.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4ff2369640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fec102730 0x7f4fec100390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:08.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4ff2369640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec10bca0 con 0x7f4fec102730 2024-09-16T00:52:08.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4febfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fec102730 0x7f4fec100390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:08.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4febfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fec102730 0x7f4fec100390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48172/0 (socket says 172.21.15.12:48172) 2024-09-16T00:52:08.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4febfff640 1 -- 172.21.15.12:0/1226095959 learned_addr learned my addr 172.21.15.12:0/1226095959 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:52:08.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4febfff640 1 -- 172.21.15.12:0/1226095959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec102280 con 0x7f4fec102730 2024-09-16T00:52:08.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4febfff640 1 --2- 172.21.15.12:0/1226095959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fec102730 0x7f4fec100390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009230 tx=0x7f4fdc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:08.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4fe9ffb640 1 -- 172.21.15.12:0/1226095959 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fdc03f070 con 0x7f4fec102730 2024-09-16T00:52:08.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4ff2369640 1 -- 172.21.15.12:0/1226095959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fec1008d0 con 0x7f4fec102730 2024-09-16T00:52:08.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4fe9ffb640 1 -- 172.21.15.12:0/1226095959 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fdc03bc80 con 0x7f4fec102730 2024-09-16T00:52:08.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.492+0000 7f4fe9ffb640 1 -- 172.21.15.12:0/1226095959 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fdc035030 con 0x7f4fec102730 2024-09-16T00:52:08.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.493+0000 7f4ff2369640 1 -- 172.21.15.12:0/1226095959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fec100d90 con 0x7f4fec102730 2024-09-16T00:52:08.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.493+0000 7f4fe9ffb640 1 -- 172.21.15.12:0/1226095959 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4fdc042070 con 0x7f4fec102730 2024-09-16T00:52:08.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.493+0000 7f4ff2369640 1 -- 172.21.15.12:0/1226095959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fec06a7b0 con 0x7f4fec102730 2024-09-16T00:52:08.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.494+0000 7f4fe9ffb640 1 --2- 172.21.15.12:0/1226095959 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4fd80392a0 0x7f4fd803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:08.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.494+0000 7f4fe9ffb640 1 -- 172.21.15.12:0/1226095959 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4fdc06d0f0 con 0x7f4fec102730 2024-09-16T00:52:08.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.494+0000 7f4fe3fff640 1 --2- 172.21.15.12:0/1226095959 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4fd80392a0 0x7f4fd803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:08.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.494+0000 7f4fe3fff640 1 --2- 172.21.15.12:0/1226095959 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4fd80392a0 0x7f4fd803b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40098c0 tx=0x7f4fd4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:08.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.498+0000 7f4fe9ffb640 1 -- 172.21.15.12:0/1226095959 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fdc04c350 con 0x7f4fec102730 2024-09-16T00:52:08.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:08.679+0000 7f4ff2369640 1 -- 172.21.15.12:0/1226095959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f4fec1018c0 con 0x7f4fec102730 2024-09-16T00:52:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.128+0000 7f4fe9ffb640 1 -- 172.21.15.12:0/1226095959 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f4fdc0314c0 con 0x7f4fec102730 2024-09-16T00:52:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-09-16T00:52:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.130+0000 7f4ff2369640 1 -- 172.21.15.12:0/1226095959 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4fd80392a0 msgr2=0x7f4fd803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.130+0000 7f4ff2369640 1 --2- 172.21.15.12:0/1226095959 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4fd80392a0 0x7f4fd803b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40098c0 tx=0x7f4fd4006db0 comp rx=0 tx=0).stop 2024-09-16T00:52:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.130+0000 7f4ff2369640 1 -- 172.21.15.12:0/1226095959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fec102730 msgr2=0x7f4fec100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.130+0000 7f4ff2369640 1 --2- 172.21.15.12:0/1226095959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fec102730 0x7f4fec100390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009230 tx=0x7f4fdc003d40 comp rx=0 tx=0).stop 2024-09-16T00:52:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.130+0000 7f4ff2369640 1 -- 172.21.15.12:0/1226095959 shutdown_connections 2024-09-16T00:52:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.130+0000 7f4ff2369640 1 --2- 172.21.15.12:0/1226095959 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4fd80392a0 0x7f4fd803b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.130+0000 7f4ff2369640 1 --2- 172.21.15.12:0/1226095959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fec102730 0x7f4fec100390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.131+0000 7f4ff2369640 1 -- 172.21.15.12:0/1226095959 >> 172.21.15.12:0/1226095959 conn(0x7f4fec0fc150 msgr2=0x7f4fec1054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.131+0000 7f4ff2369640 1 -- 172.21.15.12:0/1226095959 shutdown_connections 2024-09-16T00:52:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:09.131+0000 7f4ff2369640 1 -- 172.21.15.12:0/1226095959 wait complete. 2024-09-16T00:52:09.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:09 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1226095959' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T00:52:09.724 INFO:tasks.cephadm:Adding mon.a on smithi012 2024-09-16T00:52:09.724 INFO:tasks.cephadm:Adding mon.b on smithi098 2024-09-16T00:52:09.724 INFO:tasks.cephadm:Adding mon.c on smithi119 2024-09-16T00:52:09.724 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi012:172.21.15.12=a;smithi098:172.21.15.98=b;smithi119:172.21.15.119=c' 2024-09-16T00:52:09.977 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:52:10.023 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:52:10.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.525+0000 7f227d097640 1 -- 172.21.15.119:0/1911171658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2278100540 msgr2=0x7f2278100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:10.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.525+0000 7f227d097640 1 --2- 172.21.15.119:0/1911171658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2278100540 0x7f2278100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2268009880 tx=0x7f226802a5d0 comp rx=0 tx=0).stop 2024-09-16T00:52:10.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.526+0000 7f227d097640 1 -- 172.21.15.119:0/1911171658 shutdown_connections 2024-09-16T00:52:10.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.526+0000 7f227d097640 1 --2- 172.21.15.119:0/1911171658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2278100540 0x7f2278100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:10.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.526+0000 7f227d097640 1 -- 172.21.15.119:0/1911171658 >> 172.21.15.119:0/1911171658 conn(0x7f22780fbcd0 msgr2=0x7f22780fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:10.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.526+0000 7f227d097640 1 -- 172.21.15.119:0/1911171658 shutdown_connections 2024-09-16T00:52:10.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.526+0000 7f227d097640 1 -- 172.21.15.119:0/1911171658 wait complete. 2024-09-16T00:52:10.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.526+0000 7f227d097640 1 Processor -- start 2024-09-16T00:52:10.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.527+0000 7f227d097640 1 -- start start 2024-09-16T00:52:10.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.527+0000 7f227d097640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2278100540 0x7f227806a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:10.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.527+0000 7f227d097640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f22781065f0 con 0x7f2278100540 2024-09-16T00:52:10.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.527+0000 7f2276d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2278100540 0x7f227806a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:10.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.527+0000 7f2276d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2278100540 0x7f227806a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.119:37178/0 (socket says 172.21.15.119:37178) 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.527+0000 7f2276d9d640 1 -- 172.21.15.119:0/1888655868 learned_addr learned my addr 172.21.15.119:0/1888655868 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.527+0000 7f2276d9d640 1 -- 172.21.15.119:0/1888655868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2278199ab0 con 0x7f2278100540 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.527+0000 7f2276d9d640 1 --2- 172.21.15.119:0/1888655868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2278100540 0x7f227806a130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2268004f60 tx=0x7f22680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.528+0000 7f225ffff640 1 -- 172.21.15.119:0/1888655868 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f226803f070 con 0x7f2278100540 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.528+0000 7f225ffff640 1 -- 172.21.15.119:0/1888655868 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2268004cc0 con 0x7f2278100540 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.528+0000 7f227d097640 1 -- 172.21.15.119:0/1888655868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2278199c80 con 0x7f2278100540 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.528+0000 7f225ffff640 1 -- 172.21.15.119:0/1888655868 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2268035030 con 0x7f2278100540 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.528+0000 7f227d097640 1 -- 172.21.15.119:0/1888655868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227819a020 con 0x7f2278100540 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.529+0000 7f225ffff640 1 -- 172.21.15.119:0/1888655868 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2268042070 con 0x7f2278100540 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.529+0000 7f227d097640 1 -- 172.21.15.119:0/1888655868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2278106d70 con 0x7f2278100540 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.529+0000 7f225ffff640 1 --2- 172.21.15.119:0/1888655868 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2260039300 0x7f226003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.529+0000 7f225ffff640 1 -- 172.21.15.119:0/1888655868 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f226806d060 con 0x7f2278100540 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.529+0000 7f227659c640 1 --2- 172.21.15.119:0/1888655868 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2260039300 0x7f226003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:10.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.530+0000 7f227659c640 1 --2- 172.21.15.119:0/1888655868 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2260039300 0x7f226003b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f226c0098c0 tx=0x7f226c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:10.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.534+0000 7f225ffff640 1 -- 172.21.15.119:0/1888655868 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f22680433b0 con 0x7f2278100540 2024-09-16T00:52:10.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:10 smithi012 ceph-mon[31197]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:10.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:10 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1226095959' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T00:52:10.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:10 smithi012 ceph-mon[31197]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:52:10.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:10.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:10.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:10.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:10.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:52:10.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:10.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:10.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.725+0000 7f227d097640 1 -- 172.21.15.119:0/1888655868 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi098:172.21.15.98=b;smithi119:172.21.15.119=c", "target": ["mon-mgr", ""]}) -- 0x7f227802db40 con 0x7f2260039300 2024-09-16T00:52:10.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.731+0000 7f225ffff640 1 -- 172.21.15.119:0/1888655868 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f227802db40 con 0x7f2260039300 2024-09-16T00:52:10.731 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mon update... 2024-09-16T00:52:10.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.734+0000 7f227d097640 1 -- 172.21.15.119:0/1888655868 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2260039300 msgr2=0x7f226003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:10.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.734+0000 7f227d097640 1 --2- 172.21.15.119:0/1888655868 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2260039300 0x7f226003b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f226c0098c0 tx=0x7f226c006db0 comp rx=0 tx=0).stop 2024-09-16T00:52:10.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.734+0000 7f227d097640 1 -- 172.21.15.119:0/1888655868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2278100540 msgr2=0x7f227806a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:10.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.734+0000 7f227d097640 1 --2- 172.21.15.119:0/1888655868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2278100540 0x7f227806a130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2268004f60 tx=0x7f22680048f0 comp rx=0 tx=0).stop 2024-09-16T00:52:10.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.734+0000 7f227d097640 1 -- 172.21.15.119:0/1888655868 shutdown_connections 2024-09-16T00:52:10.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.734+0000 7f227d097640 1 --2- 172.21.15.119:0/1888655868 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2260039300 0x7f226003b7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:10.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.734+0000 7f227d097640 1 --2- 172.21.15.119:0/1888655868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2278100540 0x7f227806a130 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:10.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.734+0000 7f227d097640 1 -- 172.21.15.119:0/1888655868 >> 172.21.15.119:0/1888655868 conn(0x7f22780fbcd0 msgr2=0x7f22780fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:10.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.734+0000 7f227d097640 1 -- 172.21.15.119:0/1888655868 shutdown_connections 2024-09-16T00:52:10.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:10.734+0000 7f227d097640 1 -- 172.21.15.119:0/1888655868 wait complete. 2024-09-16T00:52:11.341 DEBUG:teuthology.orchestra.run.smithi098:mon.b> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.b.service 2024-09-16T00:52:11.344 DEBUG:teuthology.orchestra.run.smithi119:mon.c> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.c.service 2024-09-16T00:52:11.346 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T00:52:11.346 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:52:12.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-16T00:52:12.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: Updating smithi119:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:12.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:12.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: Updating smithi119:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:52:12.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi098:172.21.15.98=b;smithi119:172.21.15.119=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:12.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi098:172.21.15.98=b;smithi119:172.21.15.119=c;count:3 2024-09-16T00:52:12.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:12.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:12.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:12.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:12.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:12.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:12.399 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:13.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:12 smithi012 ceph-mon[31197]: Deploying daemon mon.c on smithi119 2024-09-16T00:52:13.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:12 smithi012 ceph-mon[31197]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:13.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.462+0000 7fa47ebe0640 1 -- 172.21.15.119:0/2266870656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa478106540 msgr2=0x7fa478106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:13.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.462+0000 7fa47ebe0640 1 --2- 172.21.15.119:0/2266870656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa478106540 0x7fa478106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009810 tx=0x7fa46c02a540 comp rx=0 tx=0).stop 2024-09-16T00:52:13.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.462+0000 7fa47ebe0640 1 -- 172.21.15.119:0/2266870656 shutdown_connections 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.462+0000 7fa47ebe0640 1 --2- 172.21.15.119:0/2266870656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa478106540 0x7fa478106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.462+0000 7fa47ebe0640 1 -- 172.21.15.119:0/2266870656 >> 172.21.15.119:0/2266870656 conn(0x7fa478077310 msgr2=0x7fa4780fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.462+0000 7fa47ebe0640 1 -- 172.21.15.119:0/2266870656 shutdown_connections 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.462+0000 7fa47ebe0640 1 -- 172.21.15.119:0/2266870656 wait complete. 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.463+0000 7fa47ebe0640 1 Processor -- start 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.463+0000 7fa47ebe0640 1 -- start start 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.463+0000 7fa47ebe0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa478106540 0x7fa478197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.463+0000 7fa47ebe0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa47810ab70 con 0x7fa478106540 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.464+0000 7fa47c97c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa478106540 0x7fa478197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.464+0000 7fa47c97c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa478106540 0x7fa478197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.119:52196/0 (socket says 172.21.15.119:52196) 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.464+0000 7fa47c97c640 1 -- 172.21.15.119:0/3240747087 learned_addr learned my addr 172.21.15.119:0/3240747087 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.464+0000 7fa47c97c640 1 -- 172.21.15.119:0/3240747087 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa478198510 con 0x7fa478106540 2024-09-16T00:52:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.464+0000 7fa47c97c640 1 --2- 172.21.15.119:0/3240747087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa478106540 0x7fa478197fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0045e0 tx=0x7fa46c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.464+0000 7fa475ffb640 1 -- 172.21.15.119:0/3240747087 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa46c030e70 con 0x7fa478106540 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.464+0000 7fa475ffb640 1 -- 172.21.15.119:0/3240747087 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa46c0318e0 con 0x7fa478106540 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.464+0000 7fa47ebe0640 1 -- 172.21.15.119:0/3240747087 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4781987a0 con 0x7fa478106540 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.464+0000 7fa475ffb640 1 -- 172.21.15.119:0/3240747087 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa46c0049c0 con 0x7fa478106540 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.465+0000 7fa47ebe0640 1 -- 172.21.15.119:0/3240747087 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa478198c00 con 0x7fa478106540 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.465+0000 7fa475ffb640 1 -- 172.21.15.119:0/3240747087 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa46c039040 con 0x7fa478106540 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.466+0000 7fa47ebe0640 1 -- 172.21.15.119:0/3240747087 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa478101bb0 con 0x7fa478106540 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.466+0000 7fa475ffb640 1 --2- 172.21.15.119:0/3240747087 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa468039300 0x7fa46803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.466+0000 7fa475ffb640 1 -- 172.21.15.119:0/3240747087 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa46c06d640 con 0x7fa478106540 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.466+0000 7fa477fff640 1 --2- 172.21.15.119:0/3240747087 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa468039300 0x7fa46803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.466+0000 7fa477fff640 1 --2- 172.21.15.119:0/3240747087 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa468039300 0x7fa46803b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa4640098c0 tx=0x7fa464006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:13.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.471+0000 7fa475ffb640 1 -- 172.21.15.119:0/3240747087 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa46c040030 con 0x7fa478106540 2024-09-16T00:52:13.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.709+0000 7fa47ebe0640 1 -- 172.21.15.119:0/3240747087 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa4781069a0 con 0x7fa478106540 2024-09-16T00:52:13.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.709+0000 7fa475ffb640 1 -- 172.21.15.119:0/3240747087 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fa46c043a00 con 0x7fa478106540 2024-09-16T00:52:13.710 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:52:13.710 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","modified":"2024-09-16T00:50:42.130126Z","created":"2024-09-16T00:50:42.130126Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:52:13.710 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2024-09-16T00:52:13.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.712+0000 7fa47ebe0640 1 -- 172.21.15.119:0/3240747087 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa468039300 msgr2=0x7fa46803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:13.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.712+0000 7fa47ebe0640 1 --2- 172.21.15.119:0/3240747087 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa468039300 0x7fa46803b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa4640098c0 tx=0x7fa464006db0 comp rx=0 tx=0).stop 2024-09-16T00:52:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.712+0000 7fa47ebe0640 1 -- 172.21.15.119:0/3240747087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa478106540 msgr2=0x7fa478197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.712+0000 7fa47ebe0640 1 --2- 172.21.15.119:0/3240747087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa478106540 0x7fa478197fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0045e0 tx=0x7fa46c004610 comp rx=0 tx=0).stop 2024-09-16T00:52:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.712+0000 7fa47ebe0640 1 -- 172.21.15.119:0/3240747087 shutdown_connections 2024-09-16T00:52:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.712+0000 7fa47ebe0640 1 --2- 172.21.15.119:0/3240747087 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa468039300 0x7fa46803b7c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.712+0000 7fa47ebe0640 1 --2- 172.21.15.119:0/3240747087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa478106540 0x7fa478197fd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.712+0000 7fa47ebe0640 1 -- 172.21.15.119:0/3240747087 >> 172.21.15.119:0/3240747087 conn(0x7fa478077310 msgr2=0x7fa4780fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.712+0000 7fa47ebe0640 1 -- 172.21.15.119:0/3240747087 shutdown_connections 2024-09-16T00:52:13.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:13.712+0000 7fa47ebe0640 1 -- 172.21.15.119:0/3240747087 wait complete. 2024-09-16T00:52:14.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:13 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/3240747087' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:14 smithi012 ceph-mon[31197]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:15.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 podman[35031]: 2024-09-16 00:52:15.194912026 +0000 UTC m=+0.024920424 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:52:15.738 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T00:52:15.739 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:52:15.763 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 podman[35031]: 2024-09-16 00:52:15.504458777 +0000 UTC m=+0.334467172 container init 5ba633bd207ff2dfc72e06d7c1b74aa79fb06c2a43d7cd6994e2421a22e50365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-16T00:52:15.763 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 podman[35031]: 2024-09-16 00:52:15.50754987 +0000 UTC m=+0.337558250 container start 5ba633bd207ff2dfc72e06d7c1b74aa79fb06c2a43d7cd6994e2421a22e50365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-16T00:52:15.763 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: pidfile_write: ignore empty --pid-file 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: load: jerasure load: lrc 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: RocksDB version: 7.9.2 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Git sha 0 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: DB SUMMARY 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: DB Session ID: 3GOJECYZGF3OR9K3D45G 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: CURRENT file: CURRENT 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T00:52:15.764 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.error_if_exists: 0 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.create_if_missing: 0 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.paranoid_checks: 1 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.env: 0x556c10b33940 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.info_log: 0x556c12f196e0 2024-09-16T00:52:15.765 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T00:52:15.767 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.statistics: (nil) 2024-09-16T00:52:15.767 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.use_fsync: 0 2024-09-16T00:52:15.767 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_log_file_size: 0 2024-09-16T00:52:15.767 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T00:52:15.767 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T00:52:15.767 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T00:52:15.768 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T00:52:15.768 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.allow_fallocate: 1 2024-09-16T00:52:15.768 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T00:52:15.768 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T00:52:15.768 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.use_direct_reads: 0 2024-09-16T00:52:15.768 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T00:52:15.768 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T00:52:15.768 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.db_log_dir: 2024-09-16T00:52:15.768 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.wal_dir: 2024-09-16T00:52:15.768 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.write_buffer_manager: 0x556c12f28dc0 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T00:52:15.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.unordered_write: 0 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.row_cache: None 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.wal_filter: None 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.two_write_queues: 0 2024-09-16T00:52:15.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.wal_compression: 0 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.atomic_flush: 0 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.log_readahead_size: 0 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T00:52:15.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_background_jobs: 2 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_background_compactions: -1 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_subcompactions: 1 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_open_files: -1 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T00:52:15.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T00:52:15.773 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T00:52:15.773 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_background_flushes: -1 2024-09-16T00:52:15.773 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Compression algorithms supported: 2024-09-16T00:52:15.773 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: kZSTD supported: 0 2024-09-16T00:52:15.773 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: kXpressCompression supported: 0 2024-09-16T00:52:15.773 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: kBZip2Compression supported: 0 2024-09-16T00:52:15.773 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T00:52:15.773 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: kLZ4Compression supported: 1 2024-09-16T00:52:15.773 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: kZlibCompression supported: 1 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: kSnappyCompression supported: 1 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.merge_operator: 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_filter: None 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T00:52:15.774 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556c12f19320) 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout: cache_index_and_filter_blocks: 1 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout: pin_top_level_index_and_filter: 1 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout: index_type: 0 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout: data_block_index_type: 0 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout: index_shortening: 1 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout: checksum: 4 2024-09-16T00:52:15.775 INFO:journalctl@ceph.mon.c.smithi119.stdout: no_block_cache: 0 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_cache: 0x556c12f0d1f0 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_cache_name: BinnedLRUCache 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_cache_options: 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: capacity : 536870912 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: num_shard_bits : 4 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: strict_capacity_limit : 0 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: high_pri_pool_ratio: 0.000 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_cache_compressed: (nil) 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: persistent_cache: (nil) 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_size: 4096 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_size_deviation: 10 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_restart_interval: 16 2024-09-16T00:52:15.776 INFO:journalctl@ceph.mon.c.smithi119.stdout: index_block_restart_interval: 1 2024-09-16T00:52:15.777 INFO:journalctl@ceph.mon.c.smithi119.stdout: metadata_block_size: 4096 2024-09-16T00:52:15.777 INFO:journalctl@ceph.mon.c.smithi119.stdout: partition_filters: 0 2024-09-16T00:52:15.777 INFO:journalctl@ceph.mon.c.smithi119.stdout: use_delta_encoding: 1 2024-09-16T00:52:15.777 INFO:journalctl@ceph.mon.c.smithi119.stdout: filter_policy: bloomfilter 2024-09-16T00:52:15.777 INFO:journalctl@ceph.mon.c.smithi119.stdout: whole_key_filtering: 1 2024-09-16T00:52:15.777 INFO:journalctl@ceph.mon.c.smithi119.stdout: verify_compression: 0 2024-09-16T00:52:15.777 INFO:journalctl@ceph.mon.c.smithi119.stdout: read_amp_bytes_per_bit: 0 2024-09-16T00:52:15.777 INFO:journalctl@ceph.mon.c.smithi119.stdout: format_version: 5 2024-09-16T00:52:15.777 INFO:journalctl@ceph.mon.c.smithi119.stdout: enable_index_compression: 1 2024-09-16T00:52:15.778 INFO:journalctl@ceph.mon.c.smithi119.stdout: block_align: 0 2024-09-16T00:52:15.778 INFO:journalctl@ceph.mon.c.smithi119.stdout: max_auto_readahead_size: 262144 2024-09-16T00:52:15.778 INFO:journalctl@ceph.mon.c.smithi119.stdout: prepopulate_block_cache: 0 2024-09-16T00:52:15.778 INFO:journalctl@ceph.mon.c.smithi119.stdout: initial_auto_readahead_size: 8192 2024-09-16T00:52:15.778 INFO:journalctl@ceph.mon.c.smithi119.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T00:52:15.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T00:52:15.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T00:52:15.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compression: NoCompression 2024-09-16T00:52:15.778 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T00:52:15.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T00:52:15.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T00:52:15.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.num_levels: 7 2024-09-16T00:52:15.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T00:52:15.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T00:52:15.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T00:52:15.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T00:52:15.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T00:52:15.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T00:52:15.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T00:52:15.781 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:52:15.782 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T00:52:15.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T00:52:15.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T00:52:15.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T00:52:15.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T00:52:15.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T00:52:15.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T00:52:15.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T00:52:15.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T00:52:15.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T00:52:15.785 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.inplace_update_support: 0 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.bloom_locality: 0 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.max_successive_merges: 0 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T00:52:15.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.ttl: 2592000 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.enable_blob_files: false 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.min_blob_size: 0 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T00:52:15.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cb24db27-bb3d-493d-9121-dda6372afbdf 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447935534692, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447935535096, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726447935, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cb24db27-bb3d-493d-9121-dda6372afbdf", "db_session_id": "3GOJECYZGF3OR9K3D45G", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447935535191, "job": 1, "event": "recovery_finished"} 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-16T00:52:15.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556c12f3ae00 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: DB pointer 0x556c13036000 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout: ** DB Stats ** 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:52:15.789 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: ** Compaction Stats [default] ** 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: ** Compaction Stats [default] ** 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2024-09-16T00:52:15.790 INFO:journalctl@ceph.mon.c.smithi119.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: Block cache BinnedLRUCache@0x556c12f0d1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-16T00:52:15.791 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: using public_addr v2:172.21.15.119:0/0 -> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: starting mon.c rank -1 at public addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] at bind addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(???) e0 preinit fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).mds e1 new map 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout: e1 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout: btime 2024-09-16T00:50:45:145115+0000 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:52:15.792 INFO:journalctl@ceph.mon.c.smithi119.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T00:52:15.793 INFO:journalctl@ceph.mon.c.smithi119.stdout: legacy client fscid: -1 2024-09-16T00:52:15.793 INFO:journalctl@ceph.mon.c.smithi119.stdout: 2024-09-16T00:52:15.793 INFO:journalctl@ceph.mon.c.smithi119.stdout: No filesystems configured 2024-09-16T00:52:15.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-16T00:52:15.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-16T00:52:15.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-16T00:52:15.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-16T00:52:15.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-16T00:52:15.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-16T00:52:15.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1226095959' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1226095959' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:15.794 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: Updating smithi119:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: Updating smithi119:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi098:172.21.15.98=b;smithi119:172.21.15.119=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi098:172.21.15.98=b;smithi119:172.21.15.119=c;count:3 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:15.795 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:15.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:15.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:15.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:15.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: Deploying daemon mon.c on smithi119 2024-09-16T00:52:15.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:15.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/3240747087' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:52:15.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:15.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 ceph-mon[35049]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-16T00:52:15.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 bash[35031]: 5ba633bd207ff2dfc72e06d7c1b74aa79fb06c2a43d7cd6994e2421a22e50365 2024-09-16T00:52:15.796 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:15 smithi119 systemd[1]: Started Ceph mon.c for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:52:15.994 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:52:20.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.841+0000 7f2fff8f3640 1 -- 172.21.15.119:0/2018798365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe4003530 msgr2=0x7f2fe40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:20.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.841+0000 7f2fff8f3640 1 --2- 172.21.15.119:0/2018798365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe4003530 0x7f2fe40059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ff81016c0 tx=0x7f2fe802c490 comp rx=0 tx=0).stop 2024-09-16T00:52:20.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.841+0000 7f2fff8f3640 1 -- 172.21.15.119:0/2018798365 shutdown_connections 2024-09-16T00:52:20.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.841+0000 7f2fff8f3640 1 --2- 172.21.15.119:0/2018798365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe4003530 0x7f2fe40059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:20.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.841+0000 7f2fff8f3640 1 -- 172.21.15.119:0/2018798365 >> 172.21.15.119:0/2018798365 conn(0x7f2ff80fc280 msgr2=0x7f2ff80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:20.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.841+0000 7f2fff8f3640 1 -- 172.21.15.119:0/2018798365 shutdown_connections 2024-09-16T00:52:20.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.841+0000 7f2fff8f3640 1 -- 172.21.15.119:0/2018798365 wait complete. 2024-09-16T00:52:20.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.842+0000 7f2fff8f3640 1 Processor -- start 2024-09-16T00:52:20.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.842+0000 7f2fff8f3640 1 -- start start 2024-09-16T00:52:20.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.842+0000 7f2fff8f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe4003530 0x7f2ff8102210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.842+0000 7f2fff8f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff8102750 0x7f2ff8102bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.842+0000 7f2fff8f3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8108690 con 0x7f2fe4003530 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.842+0000 7f2fff8f3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8108510 con 0x7f2ff8102750 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffce8e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff8102750 0x7f2ff8102bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffce8e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff8102750 0x7f2ff8102bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58034/0 (socket says 172.21.15.119:58034) 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffce8e640 1 -- 172.21.15.119:0/1596426544 learned_addr learned my addr 172.21.15.119:0/1596426544 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffd68f640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe4003530 0x7f2ff8102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffce8e640 1 -- 172.21.15.119:0/1596426544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff8102750 msgr2=0x7f2ff8102bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffce8e640 1 -- 172.21.15.119:0/1596426544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff8102750 msgr2=0x7f2ff8102bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffce8e640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff8102750 0x7f2ff8102bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffce8e640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff8102750 0x7f2ff8102bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffd68f640 1 -- 172.21.15.119:0/1596426544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff8102750 msgr2=0x7f2ff8102bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:52:20.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffd68f640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff8102750 0x7f2ff8102bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:20.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffd68f640 1 -- 172.21.15.119:0/1596426544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff81040b0 con 0x7f2fe4003530 2024-09-16T00:52:20.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.843+0000 7f2ffd68f640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe4003530 0x7f2ff8102210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8036040 tx=0x7f2fe8032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:20.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.844+0000 7f2fee7fc640 1 -- 172.21.15.119:0/1596426544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2fe8033400 con 0x7f2fe4003530 2024-09-16T00:52:20.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.844+0000 7f2fee7fc640 1 -- 172.21.15.119:0/1596426544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe8041070 con 0x7f2fe4003530 2024-09-16T00:52:20.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.844+0000 7f2fff8f3640 1 -- 172.21.15.119:0/1596426544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff81a3560 con 0x7f2fe4003530 2024-09-16T00:52:20.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.844+0000 7f2fee7fc640 1 -- 172.21.15.119:0/1596426544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2fe8004a00 con 0x7f2fe4003530 2024-09-16T00:52:20.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.844+0000 7f2fff8f3640 1 -- 172.21.15.119:0/1596426544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff81a3af0 con 0x7f2fe4003530 2024-09-16T00:52:20.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.845+0000 7f2fee7fc640 1 -- 172.21.15.119:0/1596426544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2fe8004cb0 con 0x7f2fe4003530 2024-09-16T00:52:20.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.845+0000 7f2fee7fc640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2fdc039040 0x7f2fdc03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:20.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.845+0000 7f2fff8f3640 1 -- 172.21.15.119:0/1596426544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff8101cc0 con 0x7f2fe4003530 2024-09-16T00:52:20.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.845+0000 7f2fee7fc640 1 -- 172.21.15.119:0/1596426544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2fe806e710 con 0x7f2fe4003530 2024-09-16T00:52:20.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.845+0000 7f2ffce8e640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2fdc039040 0x7f2fdc03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:20.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.846+0000 7f2ffce8e640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2fdc039040 0x7f2fdc03b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009100 tx=0x7f2ff4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:20.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:20.850+0000 7f2fee7fc640 1 -- 172.21.15.119:0/1596426544 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2fe803a550 con 0x7f2fe4003530 2024-09-16T00:52:21.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.082+0000 7f2fff8f3640 1 -- 172.21.15.119:0/1596426544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2ff81a3da0 con 0x7f2fe4003530 2024-09-16T00:52:21.084 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:21.084 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.084 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:52:21.084 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: mon.a calling monitor election 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: mon.c calling monitor election 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: monmap epoch 2 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: last_changed 2024-09-16T00:52:15.560207+0000 2024-09-16T00:52:21.085 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: created 2024-09-16T00:50:42.130126+0000 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: min_mon_release 19 (squid) 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: election_strategy: 1 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: fsmap 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: mgrmap e13: x(active, since 37s) 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: overall HEALTH_OK 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:21.086 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:21.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.083+0000 7f2fee7fc640 1 -- 172.21.15.119:0/1596426544 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f2fe803a2f0 con 0x7f2fe4003530 2024-09-16T00:52:21.087 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:52:21.087 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","modified":"2024-09-16T00:52:15.560207Z","created":"2024-09-16T00:50:42.130126Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 2 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 -- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2fdc039040 msgr2=0x7f2fdc03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2fdc039040 0x7f2fdc03b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009100 tx=0x7f2ff4008040 comp rx=0 tx=0).stop 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 -- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe4003530 msgr2=0x7f2ff8102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe4003530 0x7f2ff8102210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8036040 tx=0x7f2fe8032bc0 comp rx=0 tx=0).stop 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 -- 172.21.15.119:0/1596426544 shutdown_connections 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2fdc039040 0x7f2fdc03b500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ff8102750 0x7f2ff8102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 --2- 172.21.15.119:0/1596426544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fe4003530 0x7f2ff8102210 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 -- 172.21.15.119:0/1596426544 >> 172.21.15.119:0/1596426544 conn(0x7f2ff80fc280 msgr2=0x7f2ff806a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:21.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 -- 172.21.15.119:0/1596426544 shutdown_connections 2024-09-16T00:52:21.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:21.085+0000 7f2fff8f3640 1 -- 172.21.15.119:0/1596426544 wait complete. 2024-09-16T00:52:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:52:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: mon.a calling monitor election 2024-09-16T00:52:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: mon.c calling monitor election 2024-09-16T00:52:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: monmap epoch 2 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: last_changed 2024-09-16T00:52:15.560207+0000 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: created 2024-09-16T00:50:42.130126+0000 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: min_mon_release 19 (squid) 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: election_strategy: 1 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: fsmap 2024-09-16T00:52:21.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:52:21.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: mgrmap e13: x(active, since 37s) 2024-09-16T00:52:21.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: overall HEALTH_OK 2024-09-16T00:52:21.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:21.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:21.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:21.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:21.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:21.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:21 smithi119 ceph-mon[35049]: Deploying daemon mon.b on smithi098 2024-09-16T00:52:21.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:21 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/1596426544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:52:21.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:22.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:21 smithi012 ceph-mon[31197]: Deploying daemon mon.b on smithi098 2024-09-16T00:52:22.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:21 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/1596426544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:52:22.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:22.663 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T00:52:22.663 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:52:22.892 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:22 smithi012 ceph-mon[31197]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:22.914 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:52:23.034 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:22 smithi119 ceph-mon[35049]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:23.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.350+0000 7f30d924c640 1 -- 172.21.15.119:0/3089044159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30d41028a0 msgr2=0x7f30d4102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:23.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.350+0000 7f30d924c640 1 --2- 172.21.15.119:0/3089044159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30d41028a0 0x7f30d4102c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009c20 tx=0x7f30c402ab20 comp rx=0 tx=0).stop 2024-09-16T00:52:23.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.350+0000 7f30d924c640 1 -- 172.21.15.119:0/3089044159 shutdown_connections 2024-09-16T00:52:23.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.350+0000 7f30d924c640 1 --2- 172.21.15.119:0/3089044159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30d41028a0 0x7f30d4102c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:23.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.350+0000 7f30d924c640 1 -- 172.21.15.119:0/3089044159 >> 172.21.15.119:0/3089044159 conn(0x7f30d40fc280 msgr2=0x7f30d40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:23.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.350+0000 7f30d924c640 1 -- 172.21.15.119:0/3089044159 shutdown_connections 2024-09-16T00:52:23.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.350+0000 7f30d924c640 1 -- 172.21.15.119:0/3089044159 wait complete. 2024-09-16T00:52:23.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d924c640 1 Processor -- start 2024-09-16T00:52:23.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d924c640 1 -- start start 2024-09-16T00:52:23.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d924c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30d41028a0 0x7f30d41973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d924c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d41978f0 0x7f30d419bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d924c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f30d410bda0 con 0x7f30d41028a0 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d924c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30d410bc20 con 0x7f30d41978f0 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d41978f0 0x7f30d419bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d41978f0 0x7f30d419bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41208/0 (socket says 172.21.15.119:41208) 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d259c640 1 -- 172.21.15.119:0/2031938935 learned_addr learned my addr 172.21.15.119:0/2031938935 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d2d9d640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30d41028a0 0x7f30d41973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d259c640 1 -- 172.21.15.119:0/2031938935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d41978f0 msgr2=0x7f30d419bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d259c640 1 -- 172.21.15.119:0/2031938935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d41978f0 msgr2=0x7f30d419bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d259c640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d41978f0 0x7f30d419bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d259c640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d41978f0 0x7f30d419bc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.351+0000 7f30d2d9d640 1 -- 172.21.15.119:0/2031938935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d41978f0 msgr2=0x7f30d419bc80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:52:23.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.352+0000 7f30d2d9d640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d41978f0 0x7f30d419bc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.352+0000 7f30d2d9d640 1 -- 172.21.15.119:0/2031938935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d4197f10 con 0x7f30d41028a0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.352+0000 7f30d2d9d640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30d41028a0 0x7f30d41973b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f30c4006010 tx=0x7f30c402ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.352+0000 7f30bbfff640 1 -- 172.21.15.119:0/2031938935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f30c402ce80 con 0x7f30d41028a0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.352+0000 7f30bbfff640 1 -- 172.21.15.119:0/2031938935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30c402eb40 con 0x7f30d41028a0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.352+0000 7f30d924c640 1 -- 172.21.15.119:0/2031938935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d419c1c0 con 0x7f30d41028a0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.352+0000 7f30bbfff640 1 -- 172.21.15.119:0/2031938935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f30c4036d10 con 0x7f30d41028a0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.352+0000 7f30d924c640 1 -- 172.21.15.119:0/2031938935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d419c640 con 0x7f30d41028a0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.353+0000 7f30d924c640 1 -- 172.21.15.119:0/2031938935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d406a490 con 0x7f30d41028a0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.353+0000 7f30bbfff640 1 -- 172.21.15.119:0/2031938935 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f30c402c040 con 0x7f30d41028a0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.353+0000 7f30bbfff640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f30bc038ff0 0x7f30bc03b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.353+0000 7f30bbfff640 1 -- 172.21.15.119:0/2031938935 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f30c406cfe0 con 0x7f30d41028a0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.353+0000 7f30d259c640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f30bc038ff0 0x7f30bc03b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.354+0000 7f30d259c640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f30bc038ff0 0x7f30bc03b4b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f30c8009100 tx=0x7f30c8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:23.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.358+0000 7f30bbfff640 1 -- 172.21.15.119:0/2031938935 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30c4032030 con 0x7f30d41028a0 2024-09-16T00:52:23.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.586+0000 7f30d924c640 1 -- 172.21.15.119:0/2031938935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f30d419c960 con 0x7f30d41028a0 2024-09-16T00:52:23.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.587+0000 7f30bbfff640 1 -- 172.21.15.119:0/2031938935 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f30c402d3d0 con 0x7f30d41028a0 2024-09-16T00:52:23.588 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:52:23.588 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","modified":"2024-09-16T00:52:15.560207Z","created":"2024-09-16T00:50:42.130126Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T00:52:23.588 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 2 2024-09-16T00:52:23.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 -- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f30bc038ff0 msgr2=0x7f30bc03b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:23.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f30bc038ff0 0x7f30bc03b4b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f30c8009100 tx=0x7f30c8008040 comp rx=0 tx=0).stop 2024-09-16T00:52:23.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 -- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30d41028a0 msgr2=0x7f30d41973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:23.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30d41028a0 0x7f30d41973b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f30c4006010 tx=0x7f30c402ca80 comp rx=0 tx=0).stop 2024-09-16T00:52:23.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 -- 172.21.15.119:0/2031938935 shutdown_connections 2024-09-16T00:52:23.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f30bc038ff0 0x7f30bc03b4b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:23.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d41978f0 0x7f30d419bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:23.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 --2- 172.21.15.119:0/2031938935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30d41028a0 0x7f30d41973b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:23.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 -- 172.21.15.119:0/2031938935 >> 172.21.15.119:0/2031938935 conn(0x7f30d40fc280 msgr2=0x7f30d4105660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:23.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 -- 172.21.15.119:0/2031938935 shutdown_connections 2024-09-16T00:52:23.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:23.589+0000 7f30d924c640 1 -- 172.21.15.119:0/2031938935 wait complete. 2024-09-16T00:52:23.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:23 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/2031938935' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:52:24.039 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:23 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/2031938935' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:52:24.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:24 smithi098 systemd[1]: Started Ceph mon.b for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:52:25.119 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T00:52:25.120 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:52:25.370 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:52:29.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:52:29.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: mon.a calling monitor election 2024-09-16T00:52:29.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: mon.c calling monitor election 2024-09-16T00:52:29.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:29.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: monmap epoch 3 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: last_changed 2024-09-16T00:52:24.459858+0000 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: created 2024-09-16T00:50:42.130126+0000 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: min_mon_release 19 (squid) 2024-09-16T00:52:29.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: election_strategy: 1 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: fsmap 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: mgrmap e13: x(active, since 46s) 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: overall HEALTH_OK 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:29.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:29.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: mon.a calling monitor election 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: mon.c calling monitor election 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T00:52:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: monmap epoch 3 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: last_changed 2024-09-16T00:52:24.459858+0000 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: created 2024-09-16T00:50:42.130126+0000 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: min_mon_release 19 (squid) 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: election_strategy: 1 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: fsmap 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: mgrmap e13: x(active, since 46s) 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: overall HEALTH_OK 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:29.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:29.859 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.209+0000 7fcf8edef640 1 -- 172.21.15.119:0/67098628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf70005740 msgr2=0x7fcf70007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.209+0000 7fcf8edef640 1 --2- 172.21.15.119:0/67098628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf70005740 0x7fcf70007bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcf881016c0 tx=0x7fcf8402c490 comp rx=0 tx=0).stop 2024-09-16T00:52:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.209+0000 7fcf8edef640 1 -- 172.21.15.119:0/67098628 shutdown_connections 2024-09-16T00:52:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.209+0000 7fcf8edef640 1 --2- 172.21.15.119:0/67098628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf70005740 0x7fcf70007bd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.209+0000 7fcf8edef640 1 -- 172.21.15.119:0/67098628 >> 172.21.15.119:0/67098628 conn(0x7fcf880fc280 msgr2=0x7fcf880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.209+0000 7fcf8edef640 1 -- 172.21.15.119:0/67098628 shutdown_connections 2024-09-16T00:52:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.209+0000 7fcf8edef640 1 -- 172.21.15.119:0/67098628 wait complete. 2024-09-16T00:52:30.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.210+0000 7fcf8edef640 1 Processor -- start 2024-09-16T00:52:30.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.210+0000 7fcf8edef640 1 -- start start 2024-09-16T00:52:30.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.210+0000 7fcf8edef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf70005740 0x7fcf88195150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:30.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.210+0000 7fcf8edef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf88195690 0x7fcf88199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:30.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.210+0000 7fcf8edef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf88199f60 0x7fcf8819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.210+0000 7fcf8edef640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf881075c0 con 0x7fcf70005740 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.210+0000 7fcf8edef640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88107440 con 0x7fcf88199f60 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.210+0000 7fcf8edef640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88107740 con 0x7fcf88195690 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf7ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf88195690 0x7fcf88199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8d38c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf88199f60 0x7fcf8819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf7ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf88195690 0x7fcf88199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41216/0 (socket says 172.21.15.119:41216) 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf7ffff640 1 -- 172.21.15.119:0/1301193620 learned_addr learned my addr 172.21.15.119:0/1301193620 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8cb8b640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf70005740 0x7fcf88195150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf7ffff640 1 -- 172.21.15.119:0/1301193620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf88195690 msgr2=0x7fcf88199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8d38c640 1 -- 172.21.15.119:0/1301193620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf88199f60 msgr2=0x7fcf8819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf7ffff640 1 -- 172.21.15.119:0/1301193620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf88195690 msgr2=0x7fcf88199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8d38c640 1 -- 172.21.15.119:0/1301193620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf88199f60 msgr2=0x7fcf8819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf7ffff640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf88195690 0x7fcf88199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:52:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8d38c640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf88199f60 0x7fcf8819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8d38c640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf88199f60 0x7fcf8819a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf7ffff640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf88195690 0x7fcf88199a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8cb8b640 1 -- 172.21.15.119:0/1301193620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf88195690 msgr2=0x7fcf88199a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8cb8b640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf88195690 0x7fcf88199a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8cb8b640 1 -- 172.21.15.119:0/1301193620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf88199f60 msgr2=0x7fcf8819a410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8cb8b640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf88199f60 0x7fcf8819a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8cb8b640 1 -- 172.21.15.119:0/1301193620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf881a1cd0 con 0x7fcf70005740 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.211+0000 7fcf8cb8b640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf70005740 0x7fcf88195150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf84005f30 tx=0x7fcf840339a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.212+0000 7fcf7dffb640 1 -- 172.21.15.119:0/1301193620 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf84038040 con 0x7fcf70005740 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.212+0000 7fcf8edef640 1 -- 172.21.15.119:0/1301193620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf881a1ea0 con 0x7fcf70005740 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.212+0000 7fcf7dffb640 1 -- 172.21.15.119:0/1301193620 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf84041070 con 0x7fcf70005740 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.212+0000 7fcf7dffb640 1 -- 172.21.15.119:0/1301193620 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8403b390 con 0x7fcf70005740 2024-09-16T00:52:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.212+0000 7fcf8edef640 1 -- 172.21.15.119:0/1301193620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf881a2380 con 0x7fcf70005740 2024-09-16T00:52:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.213+0000 7fcf8edef640 1 -- 172.21.15.119:0/1301193620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf881086d0 con 0x7fcf70005740 2024-09-16T00:52:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.213+0000 7fcf7dffb640 1 -- 172.21.15.119:0/1301193620 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fcf8403b530 con 0x7fcf70005740 2024-09-16T00:52:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.213+0000 7fcf7dffb640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf74039730 0x7fcf7403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.213+0000 7fcf7dffb640 1 -- 172.21.15.119:0/1301193620 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcf8406ed20 con 0x7fcf70005740 2024-09-16T00:52:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.214+0000 7fcf7ffff640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf74039730 0x7fcf7403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:30.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.214+0000 7fcf7ffff640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf74039730 0x7fcf7403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009100 tx=0x7fcf78008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:30.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.218+0000 7fcf7dffb640 1 -- 172.21.15.119:0/1301193620 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf84032be0 con 0x7fcf70005740 2024-09-16T00:52:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.459+0000 7fcf8edef640 1 -- 172.21.15.119:0/1301193620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fcf881a2670 con 0x7fcf70005740 2024-09-16T00:52:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.459+0000 7fcf7dffb640 1 -- 172.21.15.119:0/1301193620 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7fcf84032e00 con 0x7fcf70005740 2024-09-16T00:52:30.460 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:52:30.460 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":3,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","modified":"2024-09-16T00:52:24.459858Z","created":"2024-09-16T00:50:42.130126Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T00:52:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 3 2024-09-16T00:52:30.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 -- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf74039730 msgr2=0x7fcf7403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:30.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf74039730 0x7fcf7403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009100 tx=0x7fcf78008040 comp rx=0 tx=0).stop 2024-09-16T00:52:30.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 -- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf70005740 msgr2=0x7fcf88195150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:30.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf70005740 0x7fcf88195150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf84005f30 tx=0x7fcf840339a0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 -- 172.21.15.119:0/1301193620 shutdown_connections 2024-09-16T00:52:30.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf74039730 0x7fcf7403bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf88199f60 0x7fcf8819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf88195690 0x7fcf88199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 --2- 172.21.15.119:0/1301193620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf70005740 0x7fcf88195150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 -- 172.21.15.119:0/1301193620 >> 172.21.15.119:0/1301193620 conn(0x7fcf880fc280 msgr2=0x7fcf880fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:30.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 -- 172.21.15.119:0/1301193620 shutdown_connections 2024-09-16T00:52:30.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:30.462+0000 7fcf8edef640 1 -- 172.21.15.119:0/1301193620 wait complete. 2024-09-16T00:52:30.809 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:30 smithi119 ceph-mon[35049]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:30.809 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:30.809 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:30 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/1301193620' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:52:30.809 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:30.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:30 smithi012 ceph-mon[31197]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:30.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:30.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:30 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/1301193620' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:52:30.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:31.201 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-16T00:52:31.202 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-16T00:52:31.463 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:52:31.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:52:31.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:31.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: mon.a calling monitor election 2024-09-16T00:52:31.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: mon.c calling monitor election 2024-09-16T00:52:31.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: monmap epoch 3 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: last_changed 2024-09-16T00:52:24.459858+0000 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: created 2024-09-16T00:50:42.130126+0000 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: min_mon_release 19 (squid) 2024-09-16T00:52:31.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: election_strategy: 1 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: fsmap 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: mgrmap e13: x(active, since 46s) 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: overall HEALTH_OK 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:31.865 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:31.866 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='client.? 172.21.15.119:0/1301193620' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:52:31.866 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.867+0000 7f8080f7e640 1 -- 172.21.15.12:0/3945633742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f807c107660 msgr2=0x7f807c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.867+0000 7f8080f7e640 1 --2- 172.21.15.12:0/3945633742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f807c107660 0x7f807c107a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f806c009880 tx=0x7f806c02a5d0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.867+0000 7f8080f7e640 1 -- 172.21.15.12:0/3945633742 shutdown_connections 2024-09-16T00:52:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.867+0000 7f8080f7e640 1 --2- 172.21.15.12:0/3945633742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f807c107660 0x7f807c107a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.867+0000 7f8080f7e640 1 -- 172.21.15.12:0/3945633742 >> 172.21.15.12:0/3945633742 conn(0x7f807c0fd290 msgr2=0x7f807c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.867+0000 7f8080f7e640 1 -- 172.21.15.12:0/3945633742 shutdown_connections 2024-09-16T00:52:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.867+0000 7f8080f7e640 1 -- 172.21.15.12:0/3945633742 wait complete. 2024-09-16T00:52:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.868+0000 7f8080f7e640 1 Processor -- start 2024-09-16T00:52:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.868+0000 7f8080f7e640 1 -- start start 2024-09-16T00:52:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.868+0000 7f8080f7e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f807c107660 0x7f807c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.868+0000 7f8080f7e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c074a30 0x7f807c074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.868+0000 7f8080f7e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c1a3550 0x7f807c1a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.868+0000 7f8080f7e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f807c10bc40 con 0x7f807c107660 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.868+0000 7f8080f7e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f807c10bac0 con 0x7f807c1a3550 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.868+0000 7f8080f7e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f807c10bdc0 con 0x7f807c074a30 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f807a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f807c107660 0x7f807c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f807a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f807c107660 0x7f807c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59488/0 (socket says 172.21.15.12:59488) 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f807a59c640 1 -- 172.21.15.12:0/3661760326 learned_addr learned my addr 172.21.15.12:0/3661760326 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f807ad9d640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c1a3550 0x7f807c1a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f8079d9b640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c074a30 0x7f807c074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f807a59c640 1 -- 172.21.15.12:0/3661760326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c074a30 msgr2=0x7f807c074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f807a59c640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c074a30 0x7f807c074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f807a59c640 1 -- 172.21.15.12:0/3661760326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c1a3550 msgr2=0x7f807c1a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f807a59c640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c1a3550 0x7f807c1a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f807a59c640 1 -- 172.21.15.12:0/3661760326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807c1a6010 con 0x7f807c107660 2024-09-16T00:52:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.869+0000 7f807a59c640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f807c107660 0x7f807c0744f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f806c031550 tx=0x7f806c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.870+0000 7f806b7fe640 1 -- 172.21.15.12:0/3661760326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c03f030 con 0x7f807c107660 2024-09-16T00:52:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.870+0000 7f806b7fe640 1 -- 172.21.15.12:0/3661760326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f806c003ce0 con 0x7f807c107660 2024-09-16T00:52:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.870+0000 7f8080f7e640 1 -- 172.21.15.12:0/3661760326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807c1a62a0 con 0x7f807c107660 2024-09-16T00:52:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.870+0000 7f806b7fe640 1 -- 172.21.15.12:0/3661760326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c035070 con 0x7f807c107660 2024-09-16T00:52:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.870+0000 7f8080f7e640 1 -- 172.21.15.12:0/3661760326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807c1a67d0 con 0x7f807c107660 2024-09-16T00:52:31.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.871+0000 7f806b7fe640 1 -- 172.21.15.12:0/3661760326 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f806c042030 con 0x7f807c107660 2024-09-16T00:52:31.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.871+0000 7f806b7fe640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8064039730 0x7f806403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:31.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.871+0000 7f8080f7e640 1 -- 172.21.15.12:0/3661760326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807c107ac0 con 0x7f807c107660 2024-09-16T00:52:31.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.871+0000 7f806b7fe640 1 -- 172.21.15.12:0/3661760326 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f806c06cfb0 con 0x7f807c107660 2024-09-16T00:52:31.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.871+0000 7f8079d9b640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8064039730 0x7f806403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:31.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.872+0000 7f8079d9b640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8064039730 0x7f806403bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8070009a30 tx=0x7f8070009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:31.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:31.877+0000 7f806b7fe640 1 -- 172.21.15.12:0/3661760326 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f806c04d9f0 con 0x7f807c107660 2024-09-16T00:52:32.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.062+0000 7f8080f7e640 1 -- 172.21.15.12:0/3661760326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f807c1a6a80 con 0x7f807c107660 2024-09-16T00:52:32.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.063+0000 7f806b7fe640 1 -- 172.21.15.12:0/3661760326 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f806c06e130 con 0x7f807c107660 2024-09-16T00:52:32.063 INFO:teuthology.orchestra.run.smithi012.stdout:# minimal ceph.conf for 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:32.064 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-09-16T00:52:32.064 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:32.064 INFO:teuthology.orchestra.run.smithi012.stdout: mon_host = [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-16T00:52:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 -- 172.21.15.12:0/3661760326 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8064039730 msgr2=0x7f806403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8064039730 0x7f806403bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8070009a30 tx=0x7f8070009190 comp rx=0 tx=0).stop 2024-09-16T00:52:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 -- 172.21.15.12:0/3661760326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f807c107660 msgr2=0x7f807c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f807c107660 0x7f807c0744f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f806c031550 tx=0x7f806c0042f0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 -- 172.21.15.12:0/3661760326 shutdown_connections 2024-09-16T00:52:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8064039730 0x7f806403bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807c1a3550 0x7f807c1a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c074a30 0x7f807c074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 --2- 172.21.15.12:0/3661760326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f807c107660 0x7f807c0744f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 -- 172.21.15.12:0/3661760326 >> 172.21.15.12:0/3661760326 conn(0x7f807c0fd290 msgr2=0x7f807c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 -- 172.21.15.12:0/3661760326 shutdown_connections 2024-09-16T00:52:32.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:32.065+0000 7f8080f7e640 1 -- 172.21.15.12:0/3661760326 wait complete. 2024-09-16T00:52:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: mon.b calling monitor election 2024-09-16T00:52:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: Updating smithi119:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: Updating smithi098:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: Updating smithi012:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: Reconfiguring mon.a (unknown last config time)... 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: Reconfiguring daemon mon.a on smithi012 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: mon.b calling monitor election 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: mon.c calling monitor election 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: mon.a calling monitor election 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: monmap epoch 3 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: last_changed 2024-09-16T00:52:24.459858+0000 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: created 2024-09-16T00:50:42.130126+0000 2024-09-16T00:52:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: min_mon_release 19 (squid) 2024-09-16T00:52:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: election_strategy: 1 2024-09-16T00:52:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-16T00:52:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-16T00:52:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-16T00:52:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: fsmap 2024-09-16T00:52:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:52:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: mgrmap e13: x(active, since 48s) 2024-09-16T00:52:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: overall HEALTH_OK 2024-09-16T00:52:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:32 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3661760326' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:32.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: mon.b calling monitor election 2024-09-16T00:52:32.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:32.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: Updating smithi119:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:32.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: Updating smithi098:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: Updating smithi012:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: Reconfiguring mon.a (unknown last config time)... 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: Reconfiguring daemon mon.a on smithi012 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: mon.b calling monitor election 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: mon.c calling monitor election 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: mon.a calling monitor election 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: monmap epoch 3 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: last_changed 2024-09-16T00:52:24.459858+0000 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: created 2024-09-16T00:50:42.130126+0000 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: min_mon_release 19 (squid) 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: election_strategy: 1 2024-09-16T00:52:32.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-16T00:52:32.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-16T00:52:32.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-16T00:52:32.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: fsmap 2024-09-16T00:52:32.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:52:32.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: mgrmap e13: x(active, since 48s) 2024-09-16T00:52:32.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: overall HEALTH_OK 2024-09-16T00:52:32.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:32 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3661760326' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: mon.b calling monitor election 2024-09-16T00:52:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: Updating smithi119:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: Updating smithi098:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: Updating smithi012:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: Reconfiguring mon.a (unknown last config time)... 2024-09-16T00:52:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: Reconfiguring daemon mon.a on smithi012 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: mon.b calling monitor election 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: mon.c calling monitor election 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: mon.a calling monitor election 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: monmap epoch 3 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: last_changed 2024-09-16T00:52:24.459858+0000 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: created 2024-09-16T00:50:42.130126+0000 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: min_mon_release 19 (squid) 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: election_strategy: 1 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: fsmap 2024-09-16T00:52:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:52:32.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: mgrmap e13: x(active, since 48s) 2024-09-16T00:52:32.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: overall HEALTH_OK 2024-09-16T00:52:32.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:32 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3661760326' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:33.419 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:33.419 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:33.419 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:33.419 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:33.419 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:33.419 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:33.419 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:33.446 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-16T00:52:33.447 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:52:33.447 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T00:52:33.475 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:52:33.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:33.541 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:52:33.541 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T00:52:33.571 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:33.571 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:33.571 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:33.571 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:33.571 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:33.571 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:33.572 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:33.575 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:52:33.575 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:33.595 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:52:33.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:33.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:33.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:33.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:33.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:33.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:33.640 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:52:33.640 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T00:52:33.671 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:52:33.671 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:33.740 INFO:tasks.cephadm:Adding mgr.x on smithi012 2024-09-16T00:52:33.741 INFO:tasks.cephadm:Adding mgr.y on smithi098 2024-09-16T00:52:33.741 INFO:tasks.cephadm:Adding mgr.z on smithi119 2024-09-16T00:52:33.741 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi012=x;smithi098=y;smithi119=z' 2024-09-16T00:52:34.023 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:52:34.448 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:34 smithi119 ceph-mon[35049]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:34.448 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:34 smithi119 ceph-mon[35049]: Reconfiguring mon.b (monmap changed)... 2024-09-16T00:52:34.448 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:34 smithi119 ceph-mon[35049]: Reconfiguring daemon mon.b on smithi098 2024-09-16T00:52:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.454+0000 7f55e3111640 1 -- 172.21.15.119:0/3083552409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55dc1005e0 msgr2=0x7f55dc1009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.454+0000 7f55e3111640 1 --2- 172.21.15.119:0/3083552409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55dc1005e0 0x7f55dc1009e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009880 tx=0x7f55d002a5d0 comp rx=0 tx=0).stop 2024-09-16T00:52:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.454+0000 7f55e3111640 1 -- 172.21.15.119:0/3083552409 shutdown_connections 2024-09-16T00:52:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.454+0000 7f55e3111640 1 --2- 172.21.15.119:0/3083552409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55dc1005e0 0x7f55dc1009e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.454+0000 7f55e3111640 1 -- 172.21.15.119:0/3083552409 >> 172.21.15.119:0/3083552409 conn(0x7f55dc0fbdb0 msgr2=0x7f55dc0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.454+0000 7f55e3111640 1 -- 172.21.15.119:0/3083552409 shutdown_connections 2024-09-16T00:52:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.454+0000 7f55e3111640 1 -- 172.21.15.119:0/3083552409 wait complete. 2024-09-16T00:52:34.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e3111640 1 Processor -- start 2024-09-16T00:52:34.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e3111640 1 -- start start 2024-09-16T00:52:34.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e3111640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55dc1005e0 0x7f55dc06a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:34.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e3111640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55dc199d20 0x7f55dc19c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:34.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e3111640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55dc19c650 0x7f55dc19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:34.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e3111640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc1066d0 con 0x7f55dc199d20 2024-09-16T00:52:34.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e3111640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc106550 con 0x7f55dc1005e0 2024-09-16T00:52:34.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e3111640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc106850 con 0x7f55dc19c650 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e16ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55dc19c650 0x7f55dc19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e16ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55dc19c650 0x7f55dc19eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40220/0 (socket says 172.21.15.119:40220) 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.455+0000 7f55e16ae640 1 -- 172.21.15.119:0/2568513575 learned_addr learned my addr 172.21.15.119:0/2568513575 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55e0ead640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55dc1005e0 0x7f55dc06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55dbfff640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55dc199d20 0x7f55dc19c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55e16ae640 1 -- 172.21.15.119:0/2568513575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55dc1005e0 msgr2=0x7f55dc06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55e16ae640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55dc1005e0 0x7f55dc06a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55e16ae640 1 -- 172.21.15.119:0/2568513575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55dc199d20 msgr2=0x7f55dc19c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55e16ae640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55dc199d20 0x7f55dc19c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55e16ae640 1 -- 172.21.15.119:0/2568513575 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc19f420 con 0x7f55dc19c650 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55e16ae640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55dc19c650 0x7f55dc19eb10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55d400ba50 tx=0x7f55d400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2568513575 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4019070 con 0x7f55dc19c650 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2568513575 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55d400cbe0 con 0x7f55dc19c650 2024-09-16T00:52:34.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55e3111640 1 -- 172.21.15.119:0/2568513575 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55dc19f6b0 con 0x7f55dc19c650 2024-09-16T00:52:34.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2568513575 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d40076a0 con 0x7f55dc19c650 2024-09-16T00:52:34.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.456+0000 7f55e3111640 1 -- 172.21.15.119:0/2568513575 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55dc19fc20 con 0x7f55dc19c650 2024-09-16T00:52:34.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.457+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2568513575 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f55d401c070 con 0x7f55dc19c650 2024-09-16T00:52:34.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.457+0000 7f55d9ffb640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55cc039730 0x7f55cc03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:34.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.457+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2568513575 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f55d404be70 con 0x7f55dc19c650 2024-09-16T00:52:34.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.457+0000 7f55e3111640 1 -- 172.21.15.119:0/2568513575 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55dc18f490 con 0x7f55dc19c650 2024-09-16T00:52:34.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.458+0000 7f55e0ead640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55cc039730 0x7f55cc03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:34.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.458+0000 7f55e0ead640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55cc039730 0x7f55cc03bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009230 tx=0x7f55d00315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:34.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.462+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2568513575 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55d4012980 con 0x7f55dc19c650 2024-09-16T00:52:34.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:34 smithi012 ceph-mon[31197]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:34.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:34 smithi012 ceph-mon[31197]: Reconfiguring mon.b (monmap changed)... 2024-09-16T00:52:34.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:34 smithi012 ceph-mon[31197]: Reconfiguring daemon mon.b on smithi098 2024-09-16T00:52:34.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.650+0000 7f55e3111640 1 -- 172.21.15.119:0/2568513575 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi098=y;smithi119=z", "target": ["mon-mgr", ""]}) -- 0x7f55dc062630 con 0x7f55cc039730 2024-09-16T00:52:34.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.656+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2568513575 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f55dc062630 con 0x7f55cc039730 2024-09-16T00:52:34.657 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mgr update... 2024-09-16T00:52:34.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 -- 172.21.15.119:0/2568513575 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55cc039730 msgr2=0x7f55cc03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:34.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55cc039730 0x7f55cc03bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009230 tx=0x7f55d00315d0 comp rx=0 tx=0).stop 2024-09-16T00:52:34.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 -- 172.21.15.119:0/2568513575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55dc19c650 msgr2=0x7f55dc19eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:34.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55dc19c650 0x7f55dc19eb10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55d400ba50 tx=0x7f55d400bf10 comp rx=0 tx=0).stop 2024-09-16T00:52:34.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 -- 172.21.15.119:0/2568513575 shutdown_connections 2024-09-16T00:52:34.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55cc039730 0x7f55cc03bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:34.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55dc19c650 0x7f55dc19eb10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:34.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55dc199d20 0x7f55dc19c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:34.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 --2- 172.21.15.119:0/2568513575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55dc1005e0 0x7f55dc06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:34.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 -- 172.21.15.119:0/2568513575 >> 172.21.15.119:0/2568513575 conn(0x7f55dc0fbdb0 msgr2=0x7f55dc0fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:34.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 -- 172.21.15.119:0/2568513575 shutdown_connections 2024-09-16T00:52:34.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:52:34.658+0000 7f55e3111640 1 -- 172.21.15.119:0/2568513575 wait complete. 2024-09-16T00:52:34.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:34 smithi098 ceph-mon[35346]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:34.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:34 smithi098 ceph-mon[35346]: Reconfiguring mon.b (monmap changed)... 2024-09-16T00:52:34.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:34 smithi098 ceph-mon[35346]: Reconfiguring daemon mon.b on smithi098 2024-09-16T00:52:35.256 DEBUG:teuthology.orchestra.run.smithi098:mgr.y> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.y.service 2024-09-16T00:52:35.259 DEBUG:teuthology.orchestra.run.smithi119:mgr.z> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.z.service 2024-09-16T00:52:35.261 INFO:tasks.cephadm:Deploying OSDs... 2024-09-16T00:52:35.261 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:52:35.261 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T00:52:35.282 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T00:52:35.282 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-09-16T00:52:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T00:52:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:35.343 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-16T00:52:35.343 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:35.343 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:35.343 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-16 00:51:51.082046734 +0000 2024-09-16T00:52:35.343 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-16 00:47:55.181834838 +0000 2024-09-16T00:52:35.343 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-16 00:47:55.181834838 +0000 2024-09-16T00:52:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-16 00:47:55.181834838 +0000 2024-09-16T00:52:35.344 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T00:52:35.412 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-16T00:52:35.412 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-16T00:52:35.412 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000235226 s, 2.2 MB/s 2024-09-16T00:52:35.413 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T00:52:35.473 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-09-16T00:52:35.532 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T00:52:35.532 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:35.532 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-16T00:52:35.532 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:35.532 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:35.533 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-16 00:51:51.123046386 +0000 2024-09-16T00:52:35.533 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-16 00:47:55.513832149 +0000 2024-09-16T00:52:35.533 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-16 00:47:55.513832149 +0000 2024-09-16T00:52:35.533 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-16 00:47:55.513832149 +0000 2024-09-16T00:52:35.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T00:52:35.600 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-16T00:52:35.600 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-16T00:52:35.600 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000225959 s, 2.3 MB/s 2024-09-16T00:52:35.602 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T00:52:35.662 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-09-16T00:52:35.703 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:35 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:35.704 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:35 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:35.704 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:35 smithi119 ceph-mon[35049]: Reconfiguring mon.c (monmap changed)... 2024-09-16T00:52:35.704 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:35 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:35.704 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:35 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:35.704 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:35 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:35.704 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:35 smithi119 ceph-mon[35049]: Reconfiguring daemon mon.c on smithi119 2024-09-16T00:52:35.704 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:35 smithi119 ceph-mon[35049]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi098=y;smithi119=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:35.704 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:35 smithi119 ceph-mon[35049]: Saving service mgr spec with placement smithi012=x;smithi098=y;smithi119=z;count:3 2024-09-16T00:52:35.704 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:35 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:35.711 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:35 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:35 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:35 smithi098 ceph-mon[35346]: Reconfiguring mon.c (monmap changed)... 2024-09-16T00:52:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:35 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:35 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:35 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:35 smithi098 ceph-mon[35346]: Reconfiguring daemon mon.c on smithi119 2024-09-16T00:52:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:35 smithi098 ceph-mon[35346]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi098=y;smithi119=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:35 smithi098 ceph-mon[35346]: Saving service mgr spec with placement smithi012=x;smithi098=y;smithi119=z;count:3 2024-09-16T00:52:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:35 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:35.720 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T00:52:35.720 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:35.720 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-16T00:52:35.720 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:35.720 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:35.720 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-16 00:51:51.159046080 +0000 2024-09-16T00:52:35.720 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-16 00:47:55.836829532 +0000 2024-09-16T00:52:35.721 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-16 00:47:55.836829532 +0000 2024-09-16T00:52:35.721 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-16 00:47:55.836829532 +0000 2024-09-16T00:52:35.721 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T00:52:35.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:35 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:35.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:35 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:35.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:35 smithi012 ceph-mon[31197]: Reconfiguring mon.c (monmap changed)... 2024-09-16T00:52:35.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:35 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:35.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:35 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:35.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:35 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:35.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:35 smithi012 ceph-mon[31197]: Reconfiguring daemon mon.c on smithi119 2024-09-16T00:52:35.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:35 smithi012 ceph-mon[31197]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi098=y;smithi119=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:35.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:35 smithi012 ceph-mon[31197]: Saving service mgr spec with placement smithi012=x;smithi098=y;smithi119=z;count:3 2024-09-16T00:52:35.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:35 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:35.787 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-16T00:52:35.788 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-16T00:52:35.788 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00021955 s, 2.3 MB/s 2024-09-16T00:52:35.789 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T00:52:35.847 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-09-16T00:52:35.904 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T00:52:35.904 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:35.904 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-16T00:52:35.904 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:35.905 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:35.905 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-16 00:51:51.193045791 +0000 2024-09-16T00:52:35.905 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-16 00:47:56.183826721 +0000 2024-09-16T00:52:35.905 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-16 00:47:56.183826721 +0000 2024-09-16T00:52:35.905 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-16 00:47:56.183826721 +0000 2024-09-16T00:52:35.905 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T00:52:35.970 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-16T00:52:35.970 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-16T00:52:35.970 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000211325 s, 2.4 MB/s 2024-09-16T00:52:35.971 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T00:52:36.029 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T00:52:36.029 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T00:52:36.049 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T00:52:36.049 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-16T00:52:36.108 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T00:52:36.108 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:36.108 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-16T00:52:36.108 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:36.108 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:36.108 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-16 00:52:23.901962139 +0000 2024-09-16T00:52:36.108 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-16 00:48:00.688026828 +0000 2024-09-16T00:52:36.108 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-16 00:48:00.688026828 +0000 2024-09-16T00:52:36.108 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-16 00:48:00.688026828 +0000 2024-09-16T00:52:36.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T00:52:36.176 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-16T00:52:36.177 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-16T00:52:36.177 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000261958 s, 2.0 MB/s 2024-09-16T00:52:36.178 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T00:52:36.237 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-16T00:52:36.295 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T00:52:36.295 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:36.295 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T00:52:36.295 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:36.295 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:36.295 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-16 00:52:23.901962139 +0000 2024-09-16T00:52:36.295 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-16 00:48:01.013022230 +0000 2024-09-16T00:52:36.295 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-16 00:48:01.013022230 +0000 2024-09-16T00:52:36.295 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-16 00:48:01.013022230 +0000 2024-09-16T00:52:36.295 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T00:52:36.360 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-16T00:52:36.360 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-16T00:52:36.360 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000232726 s, 2.2 MB/s 2024-09-16T00:52:36.361 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T00:52:36.419 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-16T00:52:36.477 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T00:52:36.477 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:36.477 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T00:52:36.477 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:36.477 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:36.478 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-16 00:52:23.902962125 +0000 2024-09-16T00:52:36.478 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-16 00:48:01.338017632 +0000 2024-09-16T00:52:36.478 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-16 00:48:01.338017632 +0000 2024-09-16T00:52:36.478 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-16 00:48:01.338017632 +0000 2024-09-16T00:52:36.478 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T00:52:36.541 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-16T00:52:36.541 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-16T00:52:36.542 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000245501 s, 2.1 MB/s 2024-09-16T00:52:36.543 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T00:52:36.600 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-16T00:52:36.656 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T00:52:36.656 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:36.656 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T00:52:36.656 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:36.656 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:36.656 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-16 00:52:23.902962125 +0000 2024-09-16T00:52:36.656 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-16 00:48:01.671012921 +0000 2024-09-16T00:52:36.657 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-16 00:48:01.671012921 +0000 2024-09-16T00:52:36.657 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-16 00:48:01.671012921 +0000 2024-09-16T00:52:36.657 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T00:52:36.720 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-16T00:52:36.720 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-16T00:52:36.720 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000205199 s, 2.5 MB/s 2024-09-16T00:52:36.721 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T00:52:36.777 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-16T00:52:36.777 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T00:52:36.793 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T00:52:36.793 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-09-16T00:52:36.848 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T00:52:36.848 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:36.848 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-16T00:52:36.848 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:36.848 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:36.848 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-16 00:52:14.986120357 +0000 2024-09-16T00:52:36.848 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-16 00:48:03.214254556 +0000 2024-09-16T00:52:36.849 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-16 00:48:03.214254556 +0000 2024-09-16T00:52:36.849 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-16 00:48:03.214254556 +0000 2024-09-16T00:52:36.849 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T00:52:36.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:36.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:36.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:36.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:36.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:36.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:36.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:36.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:36.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:52:36.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:36.912 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:36.913 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-16T00:52:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-16T00:52:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000262922 s, 1.9 MB/s 2024-09-16T00:52:36.915 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T00:52:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:52:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:36.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:36.971 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-09-16T00:52:37.026 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T00:52:37.026 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:37.026 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T00:52:37.026 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:37.026 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:37.027 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-16 00:52:14.986120357 +0000 2024-09-16T00:52:37.027 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-16 00:48:03.538246100 +0000 2024-09-16T00:52:37.027 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-16 00:48:03.538246100 +0000 2024-09-16T00:52:37.027 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-16 00:48:03.538246100 +0000 2024-09-16T00:52:37.027 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T00:52:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-16T00:52:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-16T00:52:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000216135 s, 2.4 MB/s 2024-09-16T00:52:37.091 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T00:52:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:52:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:37.147 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-09-16T00:52:37.202 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T00:52:37.202 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:37.202 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T00:52:37.202 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:37.202 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:37.202 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-16 00:52:14.986120357 +0000 2024-09-16T00:52:37.203 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-16 00:48:03.862237645 +0000 2024-09-16T00:52:37.203 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-16 00:48:03.862237645 +0000 2024-09-16T00:52:37.203 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-16 00:48:03.862237645 +0000 2024-09-16T00:52:37.203 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T00:52:37.265 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-16T00:52:37.265 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-16T00:52:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000347166 s, 1.5 MB/s 2024-09-16T00:52:37.267 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T00:52:37.323 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-09-16T00:52:37.379 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T00:52:37.379 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:52:37.379 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T00:52:37.379 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:52:37.379 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:52:37.380 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-16 00:52:14.986120357 +0000 2024-09-16T00:52:37.380 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-16 00:48:04.191229059 +0000 2024-09-16T00:52:37.380 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-16 00:48:04.191229059 +0000 2024-09-16T00:52:37.380 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-16 00:48:04.191229059 +0000 2024-09-16T00:52:37.380 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T00:52:37.442 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-16T00:52:37.442 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-16T00:52:37.442 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000206044 s, 2.5 MB/s 2024-09-16T00:52:37.443 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T00:52:37.500 INFO:tasks.cephadm:Deploying osd.0 on smithi012 with /dev/vg_nvme/lv_4... 2024-09-16T00:52:37.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T00:52:37.764 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:52:37.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:37 smithi119 ceph-mon[35049]: Deploying daemon mgr.z on smithi119 2024-09-16T00:52:37.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:37 smithi012 ceph-mon[31197]: Deploying daemon mgr.z on smithi119 2024-09-16T00:52:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:37 smithi098 ceph-mon[35346]: Deploying daemon mgr.z on smithi119 2024-09-16T00:52:38.231 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 systemd[1]: Starting Ceph mgr.z for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:52:38.518 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 podman[36846]: 2024-09-16 00:52:38.134021868 +0000 UTC m=+0.016017837 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:52:38.518 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 podman[36846]: 2024-09-16 00:52:38.240892028 +0000 UTC m=+0.122887998 container create 55522edc958417be3bdac613e2dc7af7aec831c074d54684d63b9a6a38f8feb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T00:52:38.518 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 podman[36846]: 2024-09-16 00:52:38.434841623 +0000 UTC m=+0.316837594 container init 55522edc958417be3bdac613e2dc7af7aec831c074d54684d63b9a6a38f8feb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-16T00:52:38.518 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 podman[36846]: 2024-09-16 00:52:38.437730861 +0000 UTC m=+0.319726831 container start 55522edc958417be3bdac613e2dc7af7aec831c074d54684d63b9a6a38f8feb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:52:38.518 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-mgr[36865]: -- 172.21.15.119:0/1749756669 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f592bbd0e0 con 0x55f592b9b400 2024-09-16T00:52:38.518 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 bash[36846]: 55522edc958417be3bdac613e2dc7af7aec831c074d54684d63b9a6a38f8feb8 2024-09-16T00:52:38.769 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 systemd[1]: Started Ceph mgr.z for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:52:38.769 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:38.558+0000 7fabaaf29040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T00:52:38.769 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:38.620+0000 7fabaaf29040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T00:52:38.770 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:38.769+0000 7fabaaf29040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T00:52:38.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-mon[35049]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:38.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:38.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:38.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:38.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:38.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:52:38.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:38.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:38 smithi098 ceph-mon[35346]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:52:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:39.067 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:38 smithi012 ceph-mon[31197]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:39.067 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:39.067 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:39.067 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:39.067 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:39.067 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:52:39.068 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:39.068 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:39.095 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:38.834+0000 7fabaaf29040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T00:52:39.096 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:38 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:38.978+0000 7fabaaf29040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:52:39.429 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:39.118+0000 7fabaaf29040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T00:52:39.823 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:39 smithi012 ceph-mon[31197]: Deploying daemon mgr.y on smithi098 2024-09-16T00:52:39.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:39 smithi119 ceph-mon[35049]: Deploying daemon mgr.y on smithi098 2024-09-16T00:52:39.846 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:39.428+0000 7fabaaf29040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T00:52:39.846 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:39.488+0000 7fabaaf29040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T00:52:39.846 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:39.671+0000 7fabaaf29040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T00:52:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:39 smithi098 ceph-mon[35346]: Deploying daemon mgr.y on smithi098 2024-09-16T00:52:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:52:40.113 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_4 2024-09-16T00:52:40.361 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:40 smithi098 systemd[1]: Starting Ceph mgr.y for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:52:40.366 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:52:40.676 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:40 smithi098 podman[36693]: 2024-09-16 00:52:40.483850359 +0000 UTC m=+0.015868843 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:52:40.676 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:40 smithi098 podman[36693]: 2024-09-16 00:52:40.60375302 +0000 UTC m=+0.135771550 container create a9ff6b958502d456a729d95236e7da2a0a552613d67e14380e5d6655ae68635c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-16T00:52:40.777 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:40 smithi012 ceph-mon[31197]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:40.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 -- 172.21.15.12:0/3440835337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0041078c0 msgr2=0x7fc004109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:40.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 --2- 172.21.15.12:0/3440835337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0041078c0 0x7fc004109d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009ca0 tx=0x7fbffc02a8c0 comp rx=0 tx=0).stop 2024-09-16T00:52:40.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 -- 172.21.15.12:0/3440835337 shutdown_connections 2024-09-16T00:52:40.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 --2- 172.21.15.12:0/3440835337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0041078c0 0x7fc004109d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:40.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 --2- 172.21.15.12:0/3440835337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc004104f90 0x7fc004107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:40.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 --2- 172.21.15.12:0/3440835337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc004102660 0x7fc004104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:40.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 -- 172.21.15.12:0/3440835337 >> 172.21.15.12:0/3440835337 conn(0x7fc0040fc280 msgr2=0x7fc0040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:40.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 -- 172.21.15.12:0/3440835337 shutdown_connections 2024-09-16T00:52:40.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 -- 172.21.15.12:0/3440835337 wait complete. 2024-09-16T00:52:40.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 Processor -- start 2024-09-16T00:52:40.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 -- start start 2024-09-16T00:52:40.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc004102660 0x7fc00419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:40.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.780+0000 7fc00bc61640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc004104f90 0x7fc00419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:40.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc00bc61640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0041078c0 0x7fc0041a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc00bc61640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc00410d8b0 con 0x7fc004102660 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc00bc61640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc00410d730 con 0x7fc004104f90 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc00bc61640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc00410da30 con 0x7fc0041078c0 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0099fd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc004102660 0x7fc00419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0091fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc004104f90 0x7fc00419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0099fd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc004102660 0x7fc00419a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43292/0 (socket says 172.21.15.12:43292) 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0099fd640 1 -- 172.21.15.12:0/1837099736 learned_addr learned my addr 172.21.15.12:0/1837099736 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc00a1fe640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0041078c0 0x7fc0041a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0091fc640 1 -- 172.21.15.12:0/1837099736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0041078c0 msgr2=0x7fc0041a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0091fc640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0041078c0 0x7fc0041a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0091fc640 1 -- 172.21.15.12:0/1837099736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc004102660 msgr2=0x7fc00419a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:40.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0091fc640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc004102660 0x7fc00419a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0091fc640 1 -- 172.21.15.12:0/1837099736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0041a1d10 con 0x7fc004104f90 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc00a1fe640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0041078c0 0x7fc0041a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0099fd640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc004102660 0x7fc00419a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc0091fc640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc004104f90 0x7fc00419a620 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbff400e9c0 tx=0x7fbff400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fbffaffd640 1 -- 172.21.15.12:0/1837099736 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff400ccc0 con 0x7fc004104f90 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fc00bc61640 1 -- 172.21.15.12:0/1837099736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0041a1fa0 con 0x7fc004104f90 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fbffaffd640 1 -- 172.21.15.12:0/1837099736 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbff4010910 con 0x7fc004104f90 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.781+0000 7fbffaffd640 1 -- 172.21.15.12:0/1837099736 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4018880 con 0x7fc004104f90 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.782+0000 7fc00bc61640 1 -- 172.21.15.12:0/1837099736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0041a24b0 con 0x7fc004104f90 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.782+0000 7fbffaffd640 1 -- 172.21.15.12:0/1837099736 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fbff4018a20 con 0x7fc004104f90 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.782+0000 7fc00bc61640 1 -- 172.21.15.12:0/1837099736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0041093b0 con 0x7fc004104f90 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.783+0000 7fbffaffd640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbff0039500 0x7fbff003b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.783+0000 7fbffaffd640 1 -- 172.21.15.12:0/1837099736 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbff404cbc0 con 0x7fc004104f90 2024-09-16T00:52:40.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.783+0000 7fc0099fd640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbff0039500 0x7fbff003b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:40.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.783+0000 7fc0099fd640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbff0039500 0x7fbff003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc000005fd0 tx=0x7fc00000b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:40.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.788+0000 7fbffaffd640 1 -- 172.21.15.12:0/1837099736 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbff401d210 con 0x7fc004104f90 2024-09-16T00:52:40.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:40 smithi119 ceph-mon[35049]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:40.846 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:40.546+0000 7fabaaf29040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T00:52:40.846 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:40.613+0000 7fabaaf29040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T00:52:40.936 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:40 smithi098 ceph-mon[35346]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:40.936 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:40 smithi098 podman[36693]: 2024-09-16 00:52:40.810479828 +0000 UTC m=+0.342498312 container init a9ff6b958502d456a729d95236e7da2a0a552613d67e14380e5d6655ae68635c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-16T00:52:40.936 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:40 smithi098 podman[36693]: 2024-09-16 00:52:40.813739301 +0000 UTC m=+0.345757786 container start a9ff6b958502d456a729d95236e7da2a0a552613d67e14380e5d6655ae68635c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-16T00:52:40.936 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:40 smithi098 ceph-mgr[36712]: -- 172.21.15.98:0/2012328115 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559d696c30e0 con 0x559d696a0800 2024-09-16T00:52:40.936 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:40 smithi098 bash[36693]: a9ff6b958502d456a729d95236e7da2a0a552613d67e14380e5d6655ae68635c 2024-09-16T00:52:40.936 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:40 smithi098 systemd[1]: Started Ceph mgr.y for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:52:40.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:40.973+0000 7fc00bc61640 1 -- 172.21.15.12:0/1837099736 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc004062630 con 0x7fbff0039500 2024-09-16T00:52:41.212 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:40.934+0000 7fa563bc4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T00:52:41.212 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:40.993+0000 7fa563bc4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T00:52:41.212 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:41.149+0000 7fa563bc4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T00:52:41.540 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:41.219+0000 7fa563bc4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T00:52:41.540 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:41.376+0000 7fa563bc4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:52:41.540 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:41.538+0000 7fa563bc4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T00:52:41.628 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:41.356+0000 7fabaaf29040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T00:52:41.628 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:41.485+0000 7fabaaf29040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T00:52:41.628 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:41.627+0000 7fabaaf29040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:52:41.887 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:41.691+0000 7fabaaf29040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T00:52:41.887 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:41.848+0000 7fabaaf29040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T00:52:42.122 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:41.869+0000 7fa563bc4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T00:52:42.122 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:41.931+0000 7fa563bc4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T00:52:42.122 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-mon[35346]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:42.122 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.122 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.122 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.122 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-mon[35346]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:42.122 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.123 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:52:42.123 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:52:42.123 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:42.123 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:42.148 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:41.917+0000 7fabaaf29040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T00:52:42.148 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:41.979+0000 7fabaaf29040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T00:52:42.148 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:42.147+0000 7fabaaf29040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T00:52:42.149 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-mon[35049]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:42.149 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.149 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.149 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.149 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-mon[35049]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:42.149 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.149 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:52:42.149 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:52:42.149 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:42.149 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:42.297 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:41 smithi012 ceph-mon[31197]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:42.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:41 smithi012 ceph-mon[31197]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:42.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:42.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:52:42.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:52:42.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:42.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:42.429 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:42.219+0000 7fabaaf29040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T00:52:42.429 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:42.288+0000 7fabaaf29040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T00:52:42.429 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:42.370+0000 7fabaaf29040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T00:52:42.430 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:42.429+0000 7fabaaf29040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T00:52:42.462 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:42 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:42.120+0000 7fa563bc4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T00:52:42.846 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:42.487+0000 7fabaaf29040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T00:52:43.461 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:43.011+0000 7fa563bc4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T00:52:43.462 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:43.077+0000 7fa563bc4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T00:52:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: Reconfiguring mgr.x (unknown last config time)... 2024-09-16T00:52:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:43.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:43.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:43.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: Reconfiguring daemon mgr.x on smithi012 2024-09-16T00:52:43.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: Reconfiguring mgr.x (unknown last config time)... 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: Reconfiguring daemon mgr.x on smithi012 2024-09-16T00:52:43.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.596 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z[36861]: 2024-09-16T00:52:43.268+0000 7fabaaf29040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T00:52:43.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:43.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:43.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:43.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: Reconfiguring mgr.x (unknown last config time)... 2024-09-16T00:52:43.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:43.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:43.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:43.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: Reconfiguring daemon mgr.x on smithi012 2024-09-16T00:52:43.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:44.049 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:43.792+0000 7fa563bc4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T00:52:44.049 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:43 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:43.906+0000 7fa563bc4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T00:52:44.049 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.049+0000 7fa563bc4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:52:44.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:44.188+0000 7fbffaffd640 1 -- 172.21.15.12:0/1837099736 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7fbff4010430 con 0x7fc004104f90 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.109+0000 7fa563bc4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.258+0000 7fa563bc4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.326+0000 7fa563bc4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2966327802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23b4eba0-9c04-4fa9-b8fb-73e21c94d03e"}]: dispatch 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2966327802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23b4eba0-9c04-4fa9-b8fb-73e21c94d03e"}]': finished 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: osdmap e5: 1 total, 0 up, 1 in 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: Standby manager daemon z started 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T00:52:44.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:52:44.328 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T00:52:44.328 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:52:44.328 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1422979842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:52:44.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:44.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2966327802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23b4eba0-9c04-4fa9-b8fb-73e21c94d03e"}]: dispatch 2024-09-16T00:52:44.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2966327802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23b4eba0-9c04-4fa9-b8fb-73e21c94d03e"}]': finished 2024-09-16T00:52:44.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: osdmap e5: 1 total, 0 up, 1 in 2024-09-16T00:52:44.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:52:44.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: Standby manager daemon z started 2024-09-16T00:52:44.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T00:52:44.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:52:44.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T00:52:44.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:52:44.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:44 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1422979842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2966327802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23b4eba0-9c04-4fa9-b8fb-73e21c94d03e"}]: dispatch 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2966327802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23b4eba0-9c04-4fa9-b8fb-73e21c94d03e"}]': finished 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: osdmap e5: 1 total, 0 up, 1 in 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: Standby manager daemon z started 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: from='mgr.? 172.21.15.119:0/185971845' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:52:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:44 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1422979842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:52:44.606 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.385+0000 7fa563bc4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T00:52:44.606 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.541+0000 7fa563bc4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T00:52:44.606 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.606+0000 7fa563bc4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T00:52:44.875 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.673+0000 7fa563bc4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T00:52:44.875 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.755+0000 7fa563bc4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T00:52:44.875 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.815+0000 7fa563bc4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T00:52:44.875 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:44.874+0000 7fa563bc4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T00:52:45.461 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:45 smithi098 ceph-mon[35346]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-16T00:52:45.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T00:52:45.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:45 smithi119 ceph-mon[35049]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-16T00:52:45.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T00:52:45.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:45 smithi012 ceph-mon[31197]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-16T00:52:45.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T00:52:45.962 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 00:52:45 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y[36708]: 2024-09-16T00:52:45.652+0000 7fa563bc4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T00:52:46.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:52:46.201+0000 7fbffaffd640 1 -- 172.21.15.12:0/1837099736 <== mon.2 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fbff4014230 con 0x7fc004104f90 2024-09-16T00:52:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:46 smithi098 ceph-mon[35346]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:46 smithi098 ceph-mon[35346]: Standby manager daemon y started 2024-09-16T00:52:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:46 smithi098 ceph-mon[35346]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T00:52:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:46 smithi098 ceph-mon[35346]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:52:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:46 smithi098 ceph-mon[35346]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T00:52:46.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:46 smithi098 ceph-mon[35346]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:52:46.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:46 smithi119 ceph-mon[35049]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:46.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:46 smithi119 ceph-mon[35049]: Standby manager daemon y started 2024-09-16T00:52:46.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:46 smithi119 ceph-mon[35049]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T00:52:46.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:46 smithi119 ceph-mon[35049]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:52:46.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:46 smithi119 ceph-mon[35049]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T00:52:46.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:46 smithi119 ceph-mon[35049]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:52:46.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:46 smithi012 ceph-mon[31197]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:46.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:46 smithi012 ceph-mon[31197]: Standby manager daemon y started 2024-09-16T00:52:46.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:46 smithi012 ceph-mon[31197]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T00:52:46.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:46 smithi012 ceph-mon[31197]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:52:46.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:46 smithi012 ceph-mon[31197]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T00:52:46.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:46 smithi012 ceph-mon[31197]: from='mgr.? 172.21.15.98:0/2440930090' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:52:47.461 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:47 smithi098 ceph-mon[35346]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-16T00:52:47.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:47 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T00:52:47.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:47 smithi119 ceph-mon[35049]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-16T00:52:47.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:47 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T00:52:47.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:47 smithi012 ceph-mon[31197]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-16T00:52:47.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:47 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T00:52:48.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:48 smithi012 ceph-mon[31197]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:48 smithi098 ceph-mon[35346]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:48.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:48 smithi119 ceph-mon[35049]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:50.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:50 smithi098 ceph-mon[35346]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:50.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:50 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:50.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:50 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:50.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:50 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:50.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:50 smithi119 ceph-mon[35049]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:50.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:50 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:50.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:50 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:50.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:50 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:50.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:50 smithi012 ceph-mon[31197]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:50.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:50 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:50.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:50 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:50.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:50 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:51 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:51 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:51 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:51.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:51 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:51.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:51 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:51.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:51 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:51.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:51 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:51.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:51 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:51.497 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:51 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:52.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:52 smithi098 ceph-mon[35346]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:52.636 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:52:52.636 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:52.652 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:52 smithi012 ceph-mon[31197]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:52.652 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:52:52.652 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:52.703 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:52 smithi119 ceph-mon[35049]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:52.703 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:52:52.703 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:53.674 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:53 smithi012 ceph-mon[31197]: Deploying daemon osd.0 on smithi012 2024-09-16T00:52:53.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:53 smithi098 ceph-mon[35346]: Deploying daemon osd.0 on smithi012 2024-09-16T00:52:53.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:53 smithi119 ceph-mon[35049]: Deploying daemon osd.0 on smithi012 2024-09-16T00:52:54.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:54 smithi098 ceph-mon[35346]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:54.745 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:54 smithi012 ceph-mon[31197]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:54.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:54 smithi119 ceph-mon[35049]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:56.711 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:56 smithi098 ceph-mon[35346]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:56.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:56 smithi012 ceph-mon[31197]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:56.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:56 smithi119 ceph-mon[35049]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:58.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:58 smithi012 ceph-mon[31197]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:58.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:58.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:58.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:52:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:58.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:58 smithi098 ceph-mon[35346]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:58.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:58.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:58.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:52:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:58.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:58 smithi119 ceph-mon[35049]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:52:58.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:58.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:52:58.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:52:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:00.639 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:00 smithi012 ceph-mon[31197]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:00.711 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:00 smithi098 ceph-mon[35346]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:00.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:00 smithi119 ceph-mon[35049]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:02.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:02.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:02.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:02.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:02.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:02.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:02.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:02.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:02.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:02.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.433+0000 7fbffaffd640 1 -- 172.21.15.12:0/1837099736 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc004062630 con 0x7fbff0039500 2024-09-16T00:53:02.434 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 0 on host 'smithi012' 2024-09-16T00:53:02.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 -- 172.21.15.12:0/1837099736 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbff0039500 msgr2=0x7fbff003b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:02.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbff0039500 0x7fbff003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc000005fd0 tx=0x7fc00000b480 comp rx=0 tx=0).stop 2024-09-16T00:53:02.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 -- 172.21.15.12:0/1837099736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc004104f90 msgr2=0x7fc00419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:02.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc004104f90 0x7fc00419a620 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbff400e9c0 tx=0x7fbff400ee80 comp rx=0 tx=0).stop 2024-09-16T00:53:02.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 -- 172.21.15.12:0/1837099736 shutdown_connections 2024-09-16T00:53:02.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbff0039500 0x7fbff003b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:02.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0041078c0 0x7fc0041a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:02.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc004104f90 0x7fc00419a620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:02.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 --2- 172.21.15.12:0/1837099736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc004102660 0x7fc00419a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:02.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 -- 172.21.15.12:0/1837099736 >> 172.21.15.12:0/1837099736 conn(0x7fc0040fc280 msgr2=0x7fc004101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:02.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 -- 172.21.15.12:0/1837099736 shutdown_connections 2024-09-16T00:53:02.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:02.436+0000 7fc00bc61640 1 -- 172.21.15.12:0/1837099736 wait complete. 2024-09-16T00:53:02.741 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:02 smithi012 ceph-mon[31197]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:02.741 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:02.741 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:02.741 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:02 smithi098 ceph-mon[35346]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:03.021 DEBUG:teuthology.orchestra.run.smithi012:osd.0> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.0.service 2024-09-16T00:53:03.023 INFO:tasks.cephadm:Deploying osd.1 on smithi098 with /dev/vg_nvme/lv_4... 2024-09-16T00:53:03.023 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T00:53:03.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:02 smithi119 ceph-mon[35049]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:03.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:03.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:03.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:03.289 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:53:04.356 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0[42817]: 2024-09-16T00:53:04.156+0000 7f55d1cdb640 -1 osd.0 0 log_to_monitors true 2024-09-16T00:53:04.954 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:04 smithi098 ceph-mon[35346]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:04.954 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:04 smithi098 ceph-mon[35346]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T00:53:05.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:04 smithi119 ceph-mon[35049]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:05.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:04 smithi119 ceph-mon[35049]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T00:53:05.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:04 smithi012 ceph-mon[31197]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:05.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:04 smithi012 ceph-mon[31197]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T00:53:05.498 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:53:05.524 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_4 2024-09-16T00:53:05.780 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:53:05.832 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:05 smithi012 ceph-mon[31197]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T00:53:05.832 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:05 smithi012 ceph-mon[31197]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T00:53:05.832 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:05 smithi012 ceph-mon[31197]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:53:05.832 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:05.832 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:05 smithi012 ceph-mon[31197]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:53:05.901 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:05 smithi098 ceph-mon[35346]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T00:53:05.902 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:05 smithi098 ceph-mon[35346]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T00:53:05.902 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:05 smithi098 ceph-mon[35346]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:53:05.902 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:05.902 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:05 smithi098 ceph-mon[35346]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:53:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:05 smithi119 ceph-mon[35049]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T00:53:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:05 smithi119 ceph-mon[35049]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T00:53:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:05 smithi119 ceph-mon[35049]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:53:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:05 smithi119 ceph-mon[35049]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:53:06.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.207+0000 7f1e3593b640 1 -- 172.21.15.98:0/4058234412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e30102690 msgr2=0x7f1e30108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:06.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.207+0000 7f1e3593b640 1 --2- 172.21.15.98:0/4058234412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e30102690 0x7f1e30108f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009ca0 tx=0x7f1e2802a8c0 comp rx=0 tx=0).stop 2024-09-16T00:53:06.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.207+0000 7f1e3593b640 1 -- 172.21.15.98:0/4058234412 shutdown_connections 2024-09-16T00:53:06.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.207+0000 7f1e3593b640 1 --2- 172.21.15.98:0/4058234412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e30102690 0x7f1e30108f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:06.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.207+0000 7f1e3593b640 1 --2- 172.21.15.98:0/4058234412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e30101cd0 0x7f1e30102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:06.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.207+0000 7f1e3593b640 1 --2- 172.21.15.98:0/4058234412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30100ad0 0x7f1e30100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:06.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.207+0000 7f1e3593b640 1 -- 172.21.15.98:0/4058234412 >> 172.21.15.98:0/4058234412 conn(0x7f1e300fc280 msgr2=0x7f1e300fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:06.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.207+0000 7f1e3593b640 1 -- 172.21.15.98:0/4058234412 shutdown_connections 2024-09-16T00:53:06.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.207+0000 7f1e3593b640 1 -- 172.21.15.98:0/4058234412 wait complete. 2024-09-16T00:53:06.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.207+0000 7f1e3593b640 1 Processor -- start 2024-09-16T00:53:06.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e3593b640 1 -- start start 2024-09-16T00:53:06.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e3593b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30100ad0 0x7f1e30197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:06.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e3593b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e30101cd0 0x7f1e30198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e3593b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e30102690 0x7f1e3019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e3593b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3010c730 con 0x7f1e30100ad0 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e3593b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3010c5b0 con 0x7f1e30102690 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e3593b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3010c8b0 con 0x7f1e30101cd0 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e30102690 0x7f1e3019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e30102690 0x7f1e3019f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47580/0 (socket says 172.21.15.98:47580) 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2f7fe640 1 -- 172.21.15.98:0/3959437382 learned_addr learned my addr 172.21.15.98:0/3959437382 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2effd640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30100ad0 0x7f1e30197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2e7fc640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e30101cd0 0x7f1e30198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2f7fe640 1 -- 172.21.15.98:0/3959437382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e30101cd0 msgr2=0x7f1e30198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2f7fe640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e30101cd0 0x7f1e30198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:06.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2f7fe640 1 -- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30100ad0 msgr2=0x7f1e30197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2f7fe640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30100ad0 0x7f1e30197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2f7fe640 1 -- 172.21.15.98:0/3959437382 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3019fa80 con 0x7f1e30102690 2024-09-16T00:53:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.208+0000 7f1e2effd640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30100ad0 0x7f1e30197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:53:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.209+0000 7f1e2f7fe640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e30102690 0x7f1e3019f410 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e28031ae0 tx=0x7f1e28031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.209+0000 7f1e34939640 1 -- 172.21.15.98:0/3959437382 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e28003c30 con 0x7f1e30102690 2024-09-16T00:53:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.209+0000 7f1e34939640 1 -- 172.21.15.98:0/3959437382 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e28003dd0 con 0x7f1e30102690 2024-09-16T00:53:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.209+0000 7f1e3593b640 1 -- 172.21.15.98:0/3959437382 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3019fd10 con 0x7f1e30102690 2024-09-16T00:53:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.209+0000 7f1e34939640 1 -- 172.21.15.98:0/3959437382 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2802fcb0 con 0x7f1e30102690 2024-09-16T00:53:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.209+0000 7f1e3593b640 1 -- 172.21.15.98:0/3959437382 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e301a01f0 con 0x7f1e30102690 2024-09-16T00:53:06.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.210+0000 7f1e3593b640 1 -- 172.21.15.98:0/3959437382 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e301a04e0 con 0x7f1e30102690 2024-09-16T00:53:06.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.211+0000 7f1e34939640 1 -- 172.21.15.98:0/3959437382 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f1e28004050 con 0x7f1e30102690 2024-09-16T00:53:06.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.212+0000 7f1e34939640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1e180a31e0 0x7f1e180a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:06.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.212+0000 7f1e34939640 1 -- 172.21.15.98:0/3959437382 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f1e280eef00 con 0x7f1e30102690 2024-09-16T00:53:06.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.212+0000 7f1e2effd640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1e180a31e0 0x7f1e180a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:06.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.213+0000 7f1e2effd640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1e180a31e0 0x7f1e180a56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e30101b30 tx=0x7f1e20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:06.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.216+0000 7f1e34939640 1 -- 172.21.15.98:0/3959437382 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e280bd8d0 con 0x7f1e30102690 2024-09-16T00:53:06.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:06.392+0000 7f1e3593b640 1 -- 172.21.15.98:0/3959437382 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1e301a06b0 con 0x7f1e180a31e0 2024-09-16T00:53:06.549 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0[42817]: 2024-09-16T00:53:06.120+0000 7f55cdc5e640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T00:53:06.549 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0[42817]: 2024-09-16T00:53:06.125+0000 7f55c5a7e640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:53:06.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:06.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T00:53:06.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:53:06.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:06 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T00:53:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' 2024-09-16T00:53:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:53:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:53:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:06 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T00:53:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:07.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:07.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:07.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:07.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:07.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419]' entity='osd.0' 2024-09-16T00:53:07.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:53:07.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:53:07.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:06 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:07.922 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:07 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:53:07.923 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:07 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:53:07.923 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:07 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi012 2024-09-16T00:53:07.923 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:07 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi012 to 17092M 2024-09-16T00:53:07.923 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:07 smithi098 ceph-mon[35346]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:07.923 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:07 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:07.923 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:07 smithi098 ceph-mon[35346]: osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] boot 2024-09-16T00:53:07.923 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:07 smithi098 ceph-mon[35346]: osdmap e8: 1 total, 1 up, 1 in 2024-09-16T00:53:07.923 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:07 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:08.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:07 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:53:08.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:07 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:53:08.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:07 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi012 2024-09-16T00:53:08.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:07 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi012 to 17092M 2024-09-16T00:53:08.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:07 smithi119 ceph-mon[35049]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:08.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:07 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:08.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:07 smithi119 ceph-mon[35049]: osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] boot 2024-09-16T00:53:08.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:07 smithi119 ceph-mon[35049]: osdmap e8: 1 total, 1 up, 1 in 2024-09-16T00:53:08.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:07 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:08.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:07 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:53:08.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:07 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:53:08.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:07 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi012 2024-09-16T00:53:08.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:07 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi012 to 17092M 2024-09-16T00:53:08.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:07 smithi012 ceph-mon[31197]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:08.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:07 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:08.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:07 smithi012 ceph-mon[31197]: osd.0 [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] boot 2024-09-16T00:53:08.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:07 smithi012 ceph-mon[31197]: osdmap e8: 1 total, 1 up, 1 in 2024-09-16T00:53:08.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:07 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:08.929 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:08 smithi098 ceph-mon[35346]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:08.929 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:08 smithi098 ceph-mon[35346]: from='client.? 172.21.15.98:0/2605899129' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc043dbf-d80e-4a37-b9c1-f54359868df5"}]: dispatch 2024-09-16T00:53:08.929 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:08 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc043dbf-d80e-4a37-b9c1-f54359868df5"}]: dispatch 2024-09-16T00:53:08.929 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:08 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc043dbf-d80e-4a37-b9c1-f54359868df5"}]': finished 2024-09-16T00:53:08.929 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:08 smithi098 ceph-mon[35346]: osdmap e9: 2 total, 1 up, 2 in 2024-09-16T00:53:08.929 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:08 smithi119 ceph-mon[35049]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:08 smithi119 ceph-mon[35049]: from='client.? 172.21.15.98:0/2605899129' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc043dbf-d80e-4a37-b9c1-f54359868df5"}]: dispatch 2024-09-16T00:53:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:08 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc043dbf-d80e-4a37-b9c1-f54359868df5"}]: dispatch 2024-09-16T00:53:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:08 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc043dbf-d80e-4a37-b9c1-f54359868df5"}]': finished 2024-09-16T00:53:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:08 smithi119 ceph-mon[35049]: osdmap e9: 2 total, 1 up, 2 in 2024-09-16T00:53:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:09.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:08 smithi012 ceph-mon[31197]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:09.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:08 smithi012 ceph-mon[31197]: from='client.? 172.21.15.98:0/2605899129' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc043dbf-d80e-4a37-b9c1-f54359868df5"}]: dispatch 2024-09-16T00:53:09.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:08 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc043dbf-d80e-4a37-b9c1-f54359868df5"}]: dispatch 2024-09-16T00:53:09.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:08 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc043dbf-d80e-4a37-b9c1-f54359868df5"}]': finished 2024-09-16T00:53:09.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:08 smithi012 ceph-mon[31197]: osdmap e9: 2 total, 1 up, 2 in 2024-09-16T00:53:09.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:09.961 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:09 smithi098 ceph-mon[35346]: from='client.? 172.21.15.98:0/3155331656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:53:10.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:09 smithi119 ceph-mon[35049]: from='client.? 172.21.15.98:0/3155331656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:53:10.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:09 smithi012 ceph-mon[31197]: from='client.? 172.21.15.98:0/3155331656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:53:10.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:10 smithi098 ceph-mon[35346]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:11.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:10 smithi119 ceph-mon[35049]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:11.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:10 smithi012 ceph-mon[31197]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:12.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:12 smithi098 ceph-mon[35346]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:13.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:12 smithi119 ceph-mon[35049]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:13.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:12 smithi012 ceph-mon[31197]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:14.930 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:14 smithi098 ceph-mon[35346]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:15.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:14 smithi119 ceph-mon[35049]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:15.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:14 smithi012 ceph-mon[31197]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:16.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:16 smithi098 ceph-mon[35346]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:16.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:53:16.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:17.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:16 smithi119 ceph-mon[35049]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:17.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:53:17.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:17.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:16 smithi012 ceph-mon[31197]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:17.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:53:17.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:17.961 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:17 smithi098 ceph-mon[35346]: Deploying daemon osd.1 on smithi098 2024-09-16T00:53:18.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:17 smithi119 ceph-mon[35049]: Deploying daemon osd.1 on smithi098 2024-09-16T00:53:18.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:17 smithi012 ceph-mon[31197]: Deploying daemon osd.1 on smithi098 2024-09-16T00:53:18.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:18 smithi098 ceph-mon[35346]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:19.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:18 smithi119 ceph-mon[35049]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:19.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:18 smithi012 ceph-mon[31197]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:20 smithi098 ceph-mon[35346]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:20 smithi119 ceph-mon[35049]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:21.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:20 smithi012 ceph-mon[31197]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:22.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:22 smithi098 ceph-mon[35346]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:22 smithi119 ceph-mon[35049]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:23.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:22 smithi012 ceph-mon[31197]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:23 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:23 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:23 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:23.970 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:23 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:23.971 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:23 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:23.971 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:23 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:24.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:23 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:24.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:23 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:24.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:23 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:24.905 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:24 smithi098 ceph-mon[35346]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:24 smithi119 ceph-mon[35049]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:25.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:24 smithi012 ceph-mon[31197]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:26.562 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:26 smithi098 ceph-mon[35346]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:26.562 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:26.562 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:26.562 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:26.562 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:26.562 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:26.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.599+0000 7f1e34939640 1 -- 172.21.15.98:0/3959437382 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1e301a06b0 con 0x7f1e180a31e0 2024-09-16T00:53:26.600 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 1 on host 'smithi098' 2024-09-16T00:53:26.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 -- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1e180a31e0 msgr2=0x7f1e180a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:26.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1e180a31e0 0x7f1e180a56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e30101b30 tx=0x7f1e20005f90 comp rx=0 tx=0).stop 2024-09-16T00:53:26.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 -- 172.21.15.98:0/3959437382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e30102690 msgr2=0x7f1e3019f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:26.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e30102690 0x7f1e3019f410 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e28031ae0 tx=0x7f1e28031ee0 comp rx=0 tx=0).stop 2024-09-16T00:53:26.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 -- 172.21.15.98:0/3959437382 shutdown_connections 2024-09-16T00:53:26.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1e180a31e0 0x7f1e180a56a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:26.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e30102690 0x7f1e3019f410 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:26.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e30101cd0 0x7f1e30198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:26.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 --2- 172.21.15.98:0/3959437382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30100ad0 0x7f1e30197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:26.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 -- 172.21.15.98:0/3959437382 >> 172.21.15.98:0/3959437382 conn(0x7f1e300fc280 msgr2=0x7f1e300fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:26.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 -- 172.21.15.98:0/3959437382 shutdown_connections 2024-09-16T00:53:26.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:53:26.602+0000 7f1e3593b640 1 -- 172.21.15.98:0/3959437382 wait complete. 2024-09-16T00:53:26.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:26 smithi119 ceph-mon[35049]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:26.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:26.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:26.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:26.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:26.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:26.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:26 smithi012 ceph-mon[31197]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:26.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:26.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:26.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:26.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:26.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:27.183 DEBUG:teuthology.orchestra.run.smithi098:osd.1> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.1.service 2024-09-16T00:53:27.185 INFO:tasks.cephadm:Deploying osd.2 on smithi119 with /dev/vg_nvme/lv_4... 2024-09-16T00:53:27.186 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T00:53:27.437 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:53:27.694 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:27.694 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:27.694 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:27.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:27.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:27.787 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:27.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:27.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:27.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:28.637 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:28 smithi098 ceph-mon[35346]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:28.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:28 smithi119 ceph-mon[35049]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:28.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:28 smithi012 ceph-mon[31197]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:29.343 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:29 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-16T00:53:28.999+0000 7fef4f5b4640 -1 osd.1 0 log_to_monitors true 2024-09-16T00:53:29.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:29 smithi012 ceph-mon[31197]: from='osd.1 [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:53:29.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:29 smithi012 ceph-mon[31197]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:53:29.908 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:29 smithi119 ceph-mon[35049]: from='osd.1 [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:53:29.908 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:29 smithi119 ceph-mon[35049]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:53:29.911 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:53:29.929 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:29 smithi098 ceph-mon[35346]: from='osd.1 [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:53:29.929 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:29 smithi098 ceph-mon[35346]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:53:29.937 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_4 2024-09-16T00:53:30.190 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:53:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.576+0000 7f34413fc640 1 -- 172.21.15.119:0/2064024979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f343c1026d0 msgr2=0x7f343c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.576+0000 7f34413fc640 1 --2- 172.21.15.119:0/2064024979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f343c1026d0 0x7f343c108f60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3434009ca0 tx=0x7f343402a8c0 comp rx=0 tx=0).stop 2024-09-16T00:53:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.576+0000 7f34413fc640 1 -- 172.21.15.119:0/2064024979 shutdown_connections 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.576+0000 7f34413fc640 1 --2- 172.21.15.119:0/2064024979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f343c1026d0 0x7f343c108f60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.576+0000 7f34413fc640 1 --2- 172.21.15.119:0/2064024979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f343c101d10 0x7f343c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.576+0000 7f34413fc640 1 --2- 172.21.15.119:0/2064024979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f343c100b10 0x7f343c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.576+0000 7f34413fc640 1 -- 172.21.15.119:0/2064024979 >> 172.21.15.119:0/2064024979 conn(0x7f343c0fc2a0 msgr2=0x7f343c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.576+0000 7f34413fc640 1 -- 172.21.15.119:0/2064024979 shutdown_connections 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.576+0000 7f34413fc640 1 -- 172.21.15.119:0/2064024979 wait complete. 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.576+0000 7f34413fc640 1 Processor -- start 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f34413fc640 1 -- start start 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f34413fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f343c100b10 0x7f343c196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f34413fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f343c101d10 0x7f343c197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f34413fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f343c1026d0 0x7f343c19e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f34413fc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f343c10c810 con 0x7f343c1026d0 2024-09-16T00:53:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f34413fc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f343c10c690 con 0x7f343c100b10 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f34413fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f343c10c990 con 0x7f343c101d10 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f343c101d10 0x7f343c197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f343c101d10 0x7f343c197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58154/0 (socket says 172.21.15.119:58154) 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343a7fc640 1 -- 172.21.15.119:0/2070674925 learned_addr learned my addr 172.21.15.119:0/2070674925 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343affd640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f343c100b10 0x7f343c196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343b7fe640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f343c1026d0 0x7f343c19e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343a7fc640 1 -- 172.21.15.119:0/2070674925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f343c100b10 msgr2=0x7f343c196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343a7fc640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f343c100b10 0x7f343c196e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343a7fc640 1 -- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f343c1026d0 msgr2=0x7f343c19e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343a7fc640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f343c1026d0 0x7f343c19e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343a7fc640 1 -- 172.21.15.119:0/2070674925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c19ea60 con 0x7f343c101d10 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343b7fe640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f343c1026d0 0x7f343c19e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:53:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.577+0000 7f343a7fc640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f343c101d10 0x7f343c197370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f342400b4a0 tx=0x7f342400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.578+0000 7f3433fff640 1 -- 172.21.15.119:0/2070674925 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3424014070 con 0x7f343c101d10 2024-09-16T00:53:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.578+0000 7f34413fc640 1 -- 172.21.15.119:0/2070674925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c19ed50 con 0x7f343c101d10 2024-09-16T00:53:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.578+0000 7f3433fff640 1 -- 172.21.15.119:0/2070674925 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3424010af0 con 0x7f343c101d10 2024-09-16T00:53:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.578+0000 7f3433fff640 1 -- 172.21.15.119:0/2070674925 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3424017d10 con 0x7f343c101d10 2024-09-16T00:53:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.578+0000 7f34413fc640 1 -- 172.21.15.119:0/2070674925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c19f2b0 con 0x7f343c101d10 2024-09-16T00:53:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.579+0000 7f34413fc640 1 -- 172.21.15.119:0/2070674925 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343c107f10 con 0x7f343c101d10 2024-09-16T00:53:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.580+0000 7f3433fff640 1 -- 172.21.15.119:0/2070674925 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f3424017070 con 0x7f343c101d10 2024-09-16T00:53:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.580+0000 7f3433fff640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f34280a31e0 0x7f34280a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.580+0000 7f3433fff640 1 -- 172.21.15.119:0/2070674925 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1903+0+0 (secure 0 0 0) 0x7f34240cd240 con 0x7f343c101d10 2024-09-16T00:53:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.580+0000 7f343affd640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f34280a31e0 0x7f34280a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.581+0000 7f343affd640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f34280a31e0 0x7f34280a56a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f342c005fd0 tx=0x7f342c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:30.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.585+0000 7f3433fff640 1 -- 172.21.15.119:0/2070674925 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f342409b950 con 0x7f343c101d10 2024-09-16T00:53:30.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:30.759+0000 7f34413fc640 1 -- 172.21.15.119:0/2070674925 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f343c062630 con 0x7f34280a31e0 2024-09-16T00:53:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T00:53:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='osd.1 [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:53:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: osdmap e10: 2 total, 1 up, 2 in 2024-09-16T00:53:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:53:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:30.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:30.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:30.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:30.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:30.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='osd.1 [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: osdmap e10: 2 total, 1 up, 2 in 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:30.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:30.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:31.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='osd.1 [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: osdmap e10: 2 total, 1 up, 2 in 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:31.462 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-16T00:53:30.987+0000 7fef4b537640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T00:53:31.462 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:30 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-16T00:53:30.990+0000 7fef43357640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:53:31.833 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi098 2024-09-16T00:53:31.833 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-16T00:53:31.833 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:53:31.833 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T00:53:31.833 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:31.833 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:31.833 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:31.834 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:53:31.834 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:53:31.834 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:31.834 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:31 smithi119 ceph-mon[35049]: from='osd.1 ' entity='osd.1' 2024-09-16T00:53:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi098 2024-09-16T00:53:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-16T00:53:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:53:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T00:53:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:31.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:31.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:53:31.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:53:31.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:31.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:31 smithi098 ceph-mon[35346]: from='osd.1 ' entity='osd.1' 2024-09-16T00:53:32.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi098 2024-09-16T00:53:32.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-16T00:53:32.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:53:32.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T00:53:32.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:32.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:32.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:32.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:53:32.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:53:32.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:32.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:31 smithi012 ceph-mon[31197]: from='osd.1 ' entity='osd.1' 2024-09-16T00:53:32.741 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:32 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:53:32.741 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:32 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:53:32.741 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:32 smithi119 ceph-mon[35049]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:32.741 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:32.742 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:32 smithi119 ceph-mon[35049]: osd.1 [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] boot 2024-09-16T00:53:32.742 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:32 smithi119 ceph-mon[35049]: osdmap e12: 2 total, 2 up, 2 in 2024-09-16T00:53:32.742 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:32.961 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:32 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:53:32.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:32 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:53:32.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:32 smithi098 ceph-mon[35346]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:32.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:32.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:32 smithi098 ceph-mon[35346]: osd.1 [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] boot 2024-09-16T00:53:32.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:32 smithi098 ceph-mon[35346]: osdmap e12: 2 total, 2 up, 2 in 2024-09-16T00:53:32.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:33.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:32 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:53:33.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:32 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:53:33.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:32 smithi012 ceph-mon[31197]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:53:33.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:33.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:32 smithi012 ceph-mon[31197]: osd.1 [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] boot 2024-09-16T00:53:33.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:32 smithi012 ceph-mon[31197]: osdmap e12: 2 total, 2 up, 2 in 2024-09-16T00:53:33.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:53:34.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:33 smithi119 ceph-mon[35049]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:34.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:33 smithi119 ceph-mon[35049]: osdmap e13: 2 total, 2 up, 2 in 2024-09-16T00:53:34.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:33 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/1287574254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e24aa9f-c324-40d0-9cef-1bdc211e0eb6"}]: dispatch 2024-09-16T00:53:34.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:33 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e24aa9f-c324-40d0-9cef-1bdc211e0eb6"}]: dispatch 2024-09-16T00:53:34.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:33 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e24aa9f-c324-40d0-9cef-1bdc211e0eb6"}]': finished 2024-09-16T00:53:34.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:33 smithi119 ceph-mon[35049]: osdmap e14: 3 total, 2 up, 3 in 2024-09-16T00:53:34.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:34.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:33 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/1932874961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:53:34.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:33 smithi012 ceph-mon[31197]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:34.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:33 smithi012 ceph-mon[31197]: osdmap e13: 2 total, 2 up, 2 in 2024-09-16T00:53:34.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:33 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/1287574254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e24aa9f-c324-40d0-9cef-1bdc211e0eb6"}]: dispatch 2024-09-16T00:53:34.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:33 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e24aa9f-c324-40d0-9cef-1bdc211e0eb6"}]: dispatch 2024-09-16T00:53:34.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:33 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e24aa9f-c324-40d0-9cef-1bdc211e0eb6"}]': finished 2024-09-16T00:53:34.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:33 smithi012 ceph-mon[31197]: osdmap e14: 3 total, 2 up, 3 in 2024-09-16T00:53:34.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:34.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:33 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/1932874961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:53:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:33 smithi098 ceph-mon[35346]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:33 smithi098 ceph-mon[35346]: osdmap e13: 2 total, 2 up, 2 in 2024-09-16T00:53:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:33 smithi098 ceph-mon[35346]: from='client.? 172.21.15.119:0/1287574254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e24aa9f-c324-40d0-9cef-1bdc211e0eb6"}]: dispatch 2024-09-16T00:53:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:33 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e24aa9f-c324-40d0-9cef-1bdc211e0eb6"}]: dispatch 2024-09-16T00:53:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:33 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e24aa9f-c324-40d0-9cef-1bdc211e0eb6"}]': finished 2024-09-16T00:53:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:33 smithi098 ceph-mon[35346]: osdmap e14: 3 total, 2 up, 3 in 2024-09-16T00:53:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:33 smithi098 ceph-mon[35346]: from='client.? 172.21.15.119:0/1932874961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:53:36.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:36 smithi119 ceph-mon[35049]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:36.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:36 smithi012 ceph-mon[31197]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:36 smithi098 ceph-mon[35346]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:38.066 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:38 smithi119 ceph-mon[35049]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:38.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:38 smithi012 ceph-mon[31197]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:38.461 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:38 smithi098 ceph-mon[35346]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:40.328 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:40 smithi119 ceph-mon[35049]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:40.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:40 smithi012 ceph-mon[31197]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:40 smithi098 ceph-mon[35346]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:41.298 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:53:41.298 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:41.298 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:41 smithi119 ceph-mon[35049]: Deploying daemon osd.2 on smithi119 2024-09-16T00:53:41.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:53:41.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:41.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:41 smithi012 ceph-mon[31197]: Deploying daemon osd.2 on smithi119 2024-09-16T00:53:41.461 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:53:41.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:41.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:41 smithi098 ceph-mon[35346]: Deploying daemon osd.2 on smithi119 2024-09-16T00:53:42.013 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:42 smithi119 ceph-mon[35049]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:42.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:42 smithi012 ceph-mon[31197]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:42.461 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:42 smithi098 ceph-mon[35346]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:44 smithi119 ceph-mon[35049]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:44.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:44 smithi012 ceph-mon[31197]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:44 smithi098 ceph-mon[35346]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:46.273 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:46 smithi119 ceph-mon[35049]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:46.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:46 smithi012 ceph-mon[31197]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:46 smithi098 ceph-mon[35346]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:48.300 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:48 smithi119 ceph-mon[35049]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:48.301 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:48 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:48.301 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:48 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:48.301 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:48 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:48.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:48 smithi012 ceph-mon[31197]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:48.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:48 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:48.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:48 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:48.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:48 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:48 smithi098 ceph-mon[35346]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:48 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:48 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:48 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:50.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:50 smithi119 ceph-mon[35049]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:50.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:50 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:50.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:50 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:50.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:50 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:50.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:50 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:50.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:50 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:50 smithi098 ceph-mon[35346]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:50 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:50 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:50 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:50 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:50 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:51.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:50 smithi012 ceph-mon[31197]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:51.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:50 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:51.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:50 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:51.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:50 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:51.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:50 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:51.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:50 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:51.228 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 2 on host 'smithi119' 2024-09-16T00:53:51.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.227+0000 7f3433fff640 1 -- 172.21.15.119:0/2070674925 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f343c062630 con 0x7f34280a31e0 2024-09-16T00:53:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.229+0000 7f34413fc640 1 -- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f34280a31e0 msgr2=0x7f34280a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.229+0000 7f34413fc640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f34280a31e0 0x7f34280a56a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f342c005fd0 tx=0x7f342c00b390 comp rx=0 tx=0).stop 2024-09-16T00:53:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.229+0000 7f34413fc640 1 -- 172.21.15.119:0/2070674925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f343c101d10 msgr2=0x7f343c197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.229+0000 7f34413fc640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f343c101d10 0x7f343c197370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f342400b4a0 tx=0x7f342400b960 comp rx=0 tx=0).stop 2024-09-16T00:53:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.229+0000 7f34413fc640 1 -- 172.21.15.119:0/2070674925 shutdown_connections 2024-09-16T00:53:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.229+0000 7f34413fc640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f34280a31e0 0x7f34280a56a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.229+0000 7f34413fc640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f343c1026d0 0x7f343c19e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.229+0000 7f34413fc640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f343c101d10 0x7f343c197370 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:51.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.229+0000 7f34413fc640 1 --2- 172.21.15.119:0/2070674925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f343c100b10 0x7f343c196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:51.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.229+0000 7f34413fc640 1 -- 172.21.15.119:0/2070674925 >> 172.21.15.119:0/2070674925 conn(0x7f343c0fc2a0 msgr2=0x7f343c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:51.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.230+0000 7f34413fc640 1 -- 172.21.15.119:0/2070674925 shutdown_connections 2024-09-16T00:53:51.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:53:51.230+0000 7f34413fc640 1 -- 172.21.15.119:0/2070674925 wait complete. 2024-09-16T00:53:51.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:51 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:51.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:51 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:51.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:51 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:51.918 DEBUG:teuthology.orchestra.run.smithi119:osd.2> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.2.service 2024-09-16T00:53:51.920 INFO:tasks.cephadm:Deploying osd.3 on smithi012 with /dev/vg_nvme/lv_3... 2024-09-16T00:53:51.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T00:53:51.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:51 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:51.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:51 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:51.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:51 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:51.961 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:51 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:51.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:51 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:51.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:51 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:52.174 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:53:52.911 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:52 smithi119 ceph-mon[35049]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:52.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:52 smithi098 ceph-mon[35346]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:53.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:52 smithi012 ceph-mon[31197]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:53.834 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:53 smithi012 ceph-mon[31197]: from='osd.2 [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:53:53.834 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:53 smithi012 ceph-mon[31197]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:53:53.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:53 smithi119 ceph-mon[35049]: from='osd.2 [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:53:53.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:53 smithi119 ceph-mon[35049]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:53:53.846 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:53:53 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2[40007]: 2024-09-16T00:53:53.490+0000 7fca13c2f640 -1 osd.2 0 log_to_monitors true 2024-09-16T00:53:53.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:53 smithi098 ceph-mon[35346]: from='osd.2 [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:53:53.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:53 smithi098 ceph-mon[35346]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:53:54.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:54 smithi012 ceph-mon[31197]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:54.733 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:54 smithi012 ceph-mon[31197]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T00:53:54.733 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:54 smithi012 ceph-mon[31197]: osdmap e15: 3 total, 2 up, 3 in 2024-09-16T00:53:54.733 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:54 smithi012 ceph-mon[31197]: from='osd.2 [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:53:54.733 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:54 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:54.733 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:54 smithi012 ceph-mon[31197]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:53:54.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:53:54.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_3 2024-09-16T00:53:54.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:54 smithi098 ceph-mon[35346]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:54.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:54 smithi098 ceph-mon[35346]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T00:53:54.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:54 smithi098 ceph-mon[35346]: osdmap e15: 3 total, 2 up, 3 in 2024-09-16T00:53:54.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:54 smithi098 ceph-mon[35346]: from='osd.2 [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:53:54.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:54 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:54.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:54 smithi098 ceph-mon[35346]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:53:55.053 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:54 smithi119 ceph-mon[35049]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:55.053 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:54 smithi119 ceph-mon[35049]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T00:53:55.053 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:54 smithi119 ceph-mon[35049]: osdmap e15: 3 total, 2 up, 3 in 2024-09-16T00:53:55.053 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:54 smithi119 ceph-mon[35049]: from='osd.2 [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:53:55.053 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:54 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:55.053 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:54 smithi119 ceph-mon[35049]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:53:55.081 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:53:55.346 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2[40007]: 2024-09-16T00:53:55.051+0000 7fca0fbb2640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T00:53:55.346 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2[40007]: 2024-09-16T00:53:55.056+0000 7fca079d2640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:53:55.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.547+0000 7f31d6d52640 1 -- 172.21.15.12:0/75364437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31d0102690 msgr2=0x7f31d0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:55.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.547+0000 7f31d6d52640 1 --2- 172.21.15.12:0/75364437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31d0102690 0x7f31d0108f20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009ca0 tx=0x7f31c802a8c0 comp rx=0 tx=0).stop 2024-09-16T00:53:55.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.547+0000 7f31d6d52640 1 -- 172.21.15.12:0/75364437 shutdown_connections 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.547+0000 7f31d6d52640 1 --2- 172.21.15.12:0/75364437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31d0102690 0x7f31d0108f20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.547+0000 7f31d6d52640 1 --2- 172.21.15.12:0/75364437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d0101cd0 0x7f31d0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.547+0000 7f31d6d52640 1 --2- 172.21.15.12:0/75364437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d0100ad0 0x7f31d0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.547+0000 7f31d6d52640 1 -- 172.21.15.12:0/75364437 >> 172.21.15.12:0/75364437 conn(0x7f31d00fc280 msgr2=0x7f31d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.547+0000 7f31d6d52640 1 -- 172.21.15.12:0/75364437 shutdown_connections 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.547+0000 7f31d6d52640 1 -- 172.21.15.12:0/75364437 wait complete. 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d6d52640 1 Processor -- start 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d6d52640 1 -- start start 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d6d52640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d0100ad0 0x7f31d006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d6d52640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31d0101cd0 0x7f31d019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d6d52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d0102690 0x7f31d019f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d6d52640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f31d010c780 con 0x7f31d0101cd0 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d6d52640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f31d010c600 con 0x7f31d0102690 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d6d52640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f31d010c900 con 0x7f31d0100ad0 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31cffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31d0101cd0 0x7f31d019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31cffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31d0101cd0 0x7f31d019cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53564/0 (socket says 172.21.15.12:53564) 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31cffff640 1 -- 172.21.15.12:0/2031147942 learned_addr learned my addr 172.21.15.12:0/2031147942 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d52ef640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d0102690 0x7f31d019f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d4aee640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d0100ad0 0x7f31d006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31cffff640 1 -- 172.21.15.12:0/2031147942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d0100ad0 msgr2=0x7f31d006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31cffff640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d0100ad0 0x7f31d006ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31cffff640 1 -- 172.21.15.12:0/2031147942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d0102690 msgr2=0x7f31d019f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31cffff640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d0102690 0x7f31d019f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31cffff640 1 -- 172.21.15.12:0/2031147942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d019fa70 con 0x7f31d0101cd0 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.548+0000 7f31d4aee640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d0100ad0 0x7f31d006ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.549+0000 7f31cffff640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31d0101cd0 0x7f31d019cb60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c920 tx=0x7f31bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.549+0000 7f31cdffb640 1 -- 172.21.15.12:0/2031147942 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc007c70 con 0x7f31d0101cd0 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.549+0000 7f31d6d52640 1 -- 172.21.15.12:0/2031147942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d019fd60 con 0x7f31d0101cd0 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.549+0000 7f31cdffb640 1 -- 172.21.15.12:0/2031147942 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31bc007e10 con 0x7f31d0101cd0 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.549+0000 7f31cdffb640 1 -- 172.21.15.12:0/2031147942 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc018890 con 0x7f31d0101cd0 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.549+0000 7f31d6d52640 1 -- 172.21.15.12:0/2031147942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d01a0240 con 0x7f31d0101cd0 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.550+0000 7f31d6d52640 1 -- 172.21.15.12:0/2031147942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d0107da0 con 0x7f31d0101cd0 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.551+0000 7f31cdffb640 1 -- 172.21.15.12:0/2031147942 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f31bc018b30 con 0x7f31d0101cd0 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.552+0000 7f31cdffb640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31c00a31b0 0x7f31c00a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.552+0000 7f31d4aee640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31c00a31b0 0x7f31c00a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.552+0000 7f31cdffb640 1 -- 172.21.15.12:0/2031147942 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f31bc0ce2d0 con 0x7f31d0101cd0 2024-09-16T00:53:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.552+0000 7f31d4aee640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31c00a31b0 0x7f31c00a5670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31d006b050 tx=0x7f31c4005e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.556+0000 7f31cdffb640 1 -- 172.21.15.12:0/2031147942 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31bc014030 con 0x7f31d0101cd0 2024-09-16T00:53:55.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:55.748+0000 7f31d6d52640 1 -- 172.21.15.12:0/2031147942 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f31d0062630 con 0x7f31c00a31b0 2024-09-16T00:53:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:53:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T00:53:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi119 2024-09-16T00:53:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-16T00:53:55.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:55.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:55.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:55.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:55.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:55 smithi098 ceph-mon[35346]: from='osd.2 ' entity='osd.2' 2024-09-16T00:53:56.096 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:53:56.096 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T00:53:56.096 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:56.096 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:56.096 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi119 2024-09-16T00:53:56.096 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:56.096 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:56.096 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:56.097 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-16T00:53:56.097 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:56.097 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:56.097 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:56.097 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:56.097 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:55 smithi012 ceph-mon[31197]: from='osd.2 ' entity='osd.2' 2024-09-16T00:53:56.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:53:56.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T00:53:56.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi119 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:56.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:55 smithi119 ceph-mon[35049]: from='osd.2 ' entity='osd.2' 2024-09-16T00:53:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:53:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:53:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:56.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:53:56.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:53:56.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:56.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: osd.2 [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] boot 2024-09-16T00:53:56.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: osdmap e17: 3 total, 3 up, 3 in 2024-09-16T00:53:56.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:53:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:53:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:57.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:57.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:53:57.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:53:57.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:57.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: osd.2 [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] boot 2024-09-16T00:53:57.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: osdmap e17: 3 total, 3 up, 3 in 2024-09-16T00:53:57.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:53:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:53:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:53:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:53:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:53:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: osd.2 [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] boot 2024-09-16T00:53:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: osdmap e17: 3 total, 3 up, 3 in 2024-09-16T00:53:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:53:57.838 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:57 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:53:57.838 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:57 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T00:53:57.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:57 smithi012 ceph-mon[31197]: osdmap e18: 3 total, 3 up, 3 in 2024-09-16T00:53:57.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:57 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:53:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:57 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:53:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:57 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T00:53:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:57 smithi098 ceph-mon[35346]: osdmap e18: 3 total, 3 up, 3 in 2024-09-16T00:53:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:57 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:53:58.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:57 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:53:58.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:57 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T00:53:58.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:57 smithi119 ceph-mon[35049]: osdmap e18: 3 total, 3 up, 3 in 2024-09-16T00:53:58.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:57 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:53:58.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:58 smithi012 ceph-mon[31197]: pgmap v74: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:53:58.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:58 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/961305248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e860e2c0-5765-406a-837e-cccb8b2ef8a0"}]: dispatch 2024-09-16T00:53:58.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T00:53:58.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:58 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/961305248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e860e2c0-5765-406a-837e-cccb8b2ef8a0"}]': finished 2024-09-16T00:53:58.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:58 smithi012 ceph-mon[31197]: osdmap e19: 4 total, 3 up, 4 in 2024-09-16T00:53:58.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:53:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:58 smithi098 ceph-mon[35346]: pgmap v74: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:53:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:58 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/961305248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e860e2c0-5765-406a-837e-cccb8b2ef8a0"}]: dispatch 2024-09-16T00:53:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T00:53:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:58 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/961305248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e860e2c0-5765-406a-837e-cccb8b2ef8a0"}]': finished 2024-09-16T00:53:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:58 smithi098 ceph-mon[35346]: osdmap e19: 4 total, 3 up, 4 in 2024-09-16T00:53:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:53:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:58 smithi119 ceph-mon[35049]: pgmap v74: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:53:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:58 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/961305248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e860e2c0-5765-406a-837e-cccb8b2ef8a0"}]: dispatch 2024-09-16T00:53:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T00:53:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:58 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/961305248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e860e2c0-5765-406a-837e-cccb8b2ef8a0"}]': finished 2024-09-16T00:53:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:58 smithi119 ceph-mon[35049]: osdmap e19: 4 total, 3 up, 4 in 2024-09-16T00:53:59.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:53:59.335 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:58 smithi012 sudo[47524]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:53:59.335 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:58 smithi012 sudo[47524]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:53:59.335 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:58 smithi012 sudo[47524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:53:59.335 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:58 smithi012 sudo[47524]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:53:59.606 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:59 smithi012 sudo[47573]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:53:59.606 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:59 smithi012 sudo[47573]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:53:59.606 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:59 smithi012 sudo[47573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:53:59.606 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 00:53:59 smithi012 sudo[47573]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:53:59.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:53:59.678+0000 7f31cdffb640 1 -- 172.21.15.12:0/2031147942 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f31bc0986b0 con 0x7f31d0101cd0 2024-09-16T00:53:59.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:59 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/637016961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:53:59.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:59 smithi098 ceph-mon[35346]: osdmap e20: 4 total, 3 up, 4 in 2024-09-16T00:53:59.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:59 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:53:59.864 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:53:59 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:53:59.864 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:59 smithi098 sudo[43664]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:53:59.864 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:59 smithi098 sudo[43664]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:53:59.864 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:59 smithi098 sudo[43664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:53:59.864 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:59 smithi098 sudo[43664]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:54:00.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:59 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/637016961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:00.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:59 smithi119 ceph-mon[35049]: osdmap e20: 4 total, 3 up, 4 in 2024-09-16T00:54:00.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:59 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:00.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:53:59 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:00.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:59 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/637016961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:00.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:59 smithi012 ceph-mon[31197]: osdmap e20: 4 total, 3 up, 4 in 2024-09-16T00:54:00.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:59 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:00.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:53:59 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:00.212 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:59 smithi098 sudo[43667]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:54:00.212 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:59 smithi098 sudo[43667]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:54:00.212 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:59 smithi098 sudo[43667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:54:00.212 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 00:53:59 smithi098 sudo[43667]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:54:00.389 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:54:00 smithi119 sudo[44085]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:54:00.389 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:54:00 smithi119 sudo[44085]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:54:00.389 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:54:00 smithi119 sudo[44085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:54:00.389 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:54:00 smithi119 sudo[44085]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:54:00.846 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:54:00 smithi119 sudo[44088]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:54:00.846 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:54:00 smithi119 sudo[44088]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:54:00.846 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:54:00 smithi119 sudo[44088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:54:00.846 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 00:54:00 smithi119 sudo[44088]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:54:01.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:00 smithi012 sudo[47948]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:54:01.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:00 smithi012 sudo[47948]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:54:01.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:00 smithi012 sudo[47948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:54:01.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:00 smithi012 sudo[47948]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:54:01.577 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 ceph-mon[35049]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:01.577 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 ceph-mon[35049]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-16T00:54:01.577 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:01.577 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:01.577 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 ceph-mon[35049]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:54:01.577 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 sudo[44091]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:54:01.577 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 sudo[44091]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:54:01.577 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 sudo[44091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:54:01.578 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 sudo[44091]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:54:01.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:01 smithi012 sudo[48136]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:54:01.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:01 smithi012 sudo[48136]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:54:01.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:01 smithi012 sudo[48136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:54:01.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:01 smithi012 sudo[48136]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:54:01.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:01 smithi012 ceph-mon[31197]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:01.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:01 smithi012 ceph-mon[31197]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-16T00:54:01.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:01.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:01.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:01 smithi012 ceph-mon[31197]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:54:01.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:01 smithi098 ceph-mon[35346]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:01.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:01 smithi098 ceph-mon[35346]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-16T00:54:01.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:01.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:01.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:01 smithi098 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:54:01.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 sudo[44094]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:54:01.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 sudo[44094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:54:01.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 sudo[44094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:54:01.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:01 smithi119 sudo[44094]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:54:02.313 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 sudo[43670]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:54:02.313 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 sudo[43670]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:54:02.313 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 sudo[43670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:54:02.313 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 sudo[43670]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:54:02.590 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 sudo[43673]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:54:02.590 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 sudo[43673]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 sudo[43673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 sudo[43673]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:54:02.591 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:02.592 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:02.592 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:02.592 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:02 smithi098 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:54:02.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:02.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:54:02.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:02.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:02.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:02.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:54:02.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:02.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:02.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:02.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:54:02.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:54:02.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:02.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:02.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:02.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:02 smithi119 ceph-mon[35049]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:54:02.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:02.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:02.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:02 smithi012 ceph-mon[31197]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:54:04.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:04 smithi119 ceph-mon[35049]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:04.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:04 smithi012 ceph-mon[31197]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:04.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:04 smithi098 ceph-mon[35346]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:06.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:06 smithi119 ceph-mon[35049]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:06.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:06 smithi012 ceph-mon[31197]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:06.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:06 smithi098 ceph-mon[35346]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:07.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:07 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:54:07.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:07 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:07.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:07 smithi119 ceph-mon[35049]: Deploying daemon osd.3 on smithi012 2024-09-16T00:54:07.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:07 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:54:07.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:07 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:07.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:07 smithi012 ceph-mon[31197]: Deploying daemon osd.3 on smithi012 2024-09-16T00:54:07.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:07 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:54:07.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:07 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:07.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:07 smithi098 ceph-mon[35346]: Deploying daemon osd.3 on smithi012 2024-09-16T00:54:08.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:08 smithi119 ceph-mon[35049]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:08.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:08 smithi012 ceph-mon[31197]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:08 smithi098 ceph-mon[35346]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:10.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:10 smithi119 ceph-mon[35049]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:10.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:10 smithi012 ceph-mon[31197]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:10 smithi098 ceph-mon[35346]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:12.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:12 smithi012 ceph-mon[31197]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:12.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:12 smithi119 ceph-mon[35049]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:12.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:12 smithi098 ceph-mon[35346]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:13.488 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:13.488 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:13.488 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:13.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:13.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:13.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:15.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:14 smithi119 ceph-mon[35049]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:15.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:14 smithi012 ceph-mon[31197]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:15.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:14 smithi098 ceph-mon[35346]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:16.685 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:16 smithi012 ceph-mon[31197]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:16.685 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:16.685 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:16.686 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:16.686 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:16.686 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:16 smithi098 ceph-mon[35346]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:16.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.725+0000 7f31cdffb640 1 -- 172.21.15.12:0/2031147942 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f31d0062630 con 0x7f31c00a31b0 2024-09-16T00:54:16.727 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 3 on host 'smithi012' 2024-09-16T00:54:16.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 -- 172.21.15.12:0/2031147942 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31c00a31b0 msgr2=0x7f31c00a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:16.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31c00a31b0 0x7f31c00a5670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31d006b050 tx=0x7f31c4005e90 comp rx=0 tx=0).stop 2024-09-16T00:54:16.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 -- 172.21.15.12:0/2031147942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31d0101cd0 msgr2=0x7f31d019cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:16.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31d0101cd0 0x7f31d019cb60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c920 tx=0x7f31bc00cde0 comp rx=0 tx=0).stop 2024-09-16T00:54:16.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 -- 172.21.15.12:0/2031147942 shutdown_connections 2024-09-16T00:54:16.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31c00a31b0 0x7f31c00a5670 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:16.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d0102690 0x7f31d019f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:16.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31d0101cd0 0x7f31d019cb60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:16.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 --2- 172.21.15.12:0/2031147942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31d0100ad0 0x7f31d006ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:16.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 -- 172.21.15.12:0/2031147942 >> 172.21.15.12:0/2031147942 conn(0x7f31d00fc280 msgr2=0x7f31d0104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:16.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 -- 172.21.15.12:0/2031147942 shutdown_connections 2024-09-16T00:54:16.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:54:16.728+0000 7f31d6d52640 1 -- 172.21.15.12:0/2031147942 wait complete. 2024-09-16T00:54:16.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:16 smithi119 ceph-mon[35049]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:16.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:16.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:16.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:16.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:16.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:17.273 DEBUG:teuthology.orchestra.run.smithi012:osd.3> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.3.service 2024-09-16T00:54:17.276 INFO:tasks.cephadm:Deploying osd.4 on smithi098 with /dev/vg_nvme/lv_3... 2024-09-16T00:54:17.276 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T00:54:17.530 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:54:17.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:17 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:17.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:17 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:17.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:17 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:17.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:17 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:17.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:17 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:17.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:17 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:17.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:17 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:17.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:17 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:17.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:17 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:18.606 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 00:54:18 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3[49543]: 2024-09-16T00:54:18.540+0000 7fb9842a0640 -1 osd.3 0 log_to_monitors true 2024-09-16T00:54:18.876 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:18 smithi098 ceph-mon[35346]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:18.877 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:18 smithi098 ceph-mon[35346]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:54:19.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:18 smithi119 ceph-mon[35049]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:19.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:18 smithi119 ceph-mon[35049]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:54:19.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:18 smithi012 ceph-mon[31197]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:19.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:18 smithi012 ceph-mon[31197]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:54:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:19 smithi098 ceph-mon[35346]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T00:54:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:19 smithi098 ceph-mon[35346]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T00:54:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:19 smithi098 ceph-mon[35346]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:54:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:19 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:19.973 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:19 smithi012 ceph-mon[31197]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T00:54:19.973 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:19 smithi012 ceph-mon[31197]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T00:54:19.973 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:19 smithi012 ceph-mon[31197]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:54:19.973 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:19 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:19.973 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 00:54:19 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3[49543]: 2024-09-16T00:54:19.737+0000 7fb980223640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T00:54:19.973 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 00:54:19 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3[49543]: 2024-09-16T00:54:19.744+0000 7fb97c04b640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:54:20.045 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:54:20.070 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_3 2024-09-16T00:54:20.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:19 smithi119 ceph-mon[35049]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T00:54:20.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:19 smithi119 ceph-mon[35049]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T00:54:20.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:19 smithi119 ceph-mon[35049]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:54:20.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:19 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:20.317 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:54:20.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.817+0000 7f637ff55640 1 -- 172.21.15.98:0/470635963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6378104fd0 msgr2=0x7f63781073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.817+0000 7f637ff55640 1 --2- 172.21.15.98:0/470635963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6378104fd0 0x7f63781073c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6374009900 tx=0x7f637402a410 comp rx=0 tx=0).stop 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.817+0000 7f637ff55640 1 -- 172.21.15.98:0/470635963 shutdown_connections 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.817+0000 7f637ff55640 1 --2- 172.21.15.98:0/470635963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6378107900 0x7f6378109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.817+0000 7f637ff55640 1 --2- 172.21.15.98:0/470635963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6378104fd0 0x7f63781073c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.817+0000 7f637ff55640 1 --2- 172.21.15.98:0/470635963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63781026a0 0x7f6378104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.817+0000 7f637ff55640 1 -- 172.21.15.98:0/470635963 >> 172.21.15.98:0/470635963 conn(0x7f63780fc2a0 msgr2=0x7f63780fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.817+0000 7f637ff55640 1 -- 172.21.15.98:0/470635963 shutdown_connections 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.817+0000 7f637ff55640 1 -- 172.21.15.98:0/470635963 wait complete. 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637ff55640 1 Processor -- start 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637ff55640 1 -- start start 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637ff55640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63781026a0 0x7f63781980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637ff55640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6378104fd0 0x7f6378198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:20.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637ff55640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6378107900 0x7f637819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637ff55640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f637810d970 con 0x7f6378107900 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637ff55640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f637810d7f0 con 0x7f6378104fd0 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637ff55640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f637810daf0 con 0x7f63781026a0 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637d4f0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6378104fd0 0x7f6378198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637d4f0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6378104fd0 0x7f6378198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51248/0 (socket says 172.21.15.98:51248) 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.818+0000 7f637d4f0640 1 -- 172.21.15.98:0/4183242519 learned_addr learned my addr 172.21.15.98:0/4183242519 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637e4f2640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6378107900 0x7f637819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637dcf1640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63781026a0 0x7f63781980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637d4f0640 1 -- 172.21.15.98:0/4183242519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63781026a0 msgr2=0x7f63781980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637d4f0640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63781026a0 0x7f63781980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637d4f0640 1 -- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6378107900 msgr2=0x7f637819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:20.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637d4f0640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6378107900 0x7f637819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637d4f0640 1 -- 172.21.15.98:0/4183242519 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637819fcf0 con 0x7f6378104fd0 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637dcf1640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63781026a0 0x7f63781980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637e4f2640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6378107900 0x7f637819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637d4f0640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6378104fd0 0x7f6378198600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6374031610 tx=0x7f63740043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f636effd640 1 -- 172.21.15.98:0/4183242519 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637403f030 con 0x7f6378104fd0 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f636effd640 1 -- 172.21.15.98:0/4183242519 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6374003ce0 con 0x7f6378104fd0 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637ff55640 1 -- 172.21.15.98:0/4183242519 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637819ff80 con 0x7f6378104fd0 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f636effd640 1 -- 172.21.15.98:0/4183242519 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374035070 con 0x7f6378104fd0 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.819+0000 7f637ff55640 1 -- 172.21.15.98:0/4183242519 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63781a0450 con 0x7f6378104fd0 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.820+0000 7f637ff55640 1 -- 172.21.15.98:0/4183242519 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63780fdd90 con 0x7f6378104fd0 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.821+0000 7f636effd640 1 -- 172.21.15.98:0/4183242519 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6374042030 con 0x7f6378104fd0 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.821+0000 7f636effd640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63640a3270 0x7f63640a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.822+0000 7f636effd640 1 -- 172.21.15.98:0/4183242519 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3702+0+0 (secure 0 0 0) 0x7f63740eee00 con 0x7f6378104fd0 2024-09-16T00:54:20.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.822+0000 7f637dcf1640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63640a3270 0x7f63640a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:20.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.822+0000 7f637dcf1640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63640a3270 0x7f63640a5730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6368006fd0 tx=0x7f6368008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:20.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:20.826+0000 7f636effd640 1 -- 172.21.15.98:0/4183242519 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63740bcd20 con 0x7f6378104fd0 2024-09-16T00:54:21.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:21.002+0000 7f637ff55640 1 -- 172.21.15.98:0/4183242519 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6378062630 con 0x7f63640a3270 2024-09-16T00:54:21.002 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:21.003 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:54:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T00:54:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:21.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:54:21.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T00:54:21.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:21.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:54:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:54:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi012 2024-09-16T00:54:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi012 to 8546M 2024-09-16T00:54:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] boot 2024-09-16T00:54:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: osdmap e23: 4 total, 4 up, 4 in 2024-09-16T00:54:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:21.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:54:21.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:54:21.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:21.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:21 smithi098 ceph-mon[35346]: osdmap e24: 4 total, 4 up, 4 in 2024-09-16T00:54:22.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:54:22.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:54:22.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi012 2024-09-16T00:54:22.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi012 to 8546M 2024-09-16T00:54:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] boot 2024-09-16T00:54:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: osdmap e23: 4 total, 4 up, 4 in 2024-09-16T00:54:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:54:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:54:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:21 smithi119 ceph-mon[35049]: osdmap e24: 4 total, 4 up, 4 in 2024-09-16T00:54:22.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:54:22.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:54:22.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi012 2024-09-16T00:54:22.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi012 to 8546M 2024-09-16T00:54:22.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:22.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: osd.3 [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] boot 2024-09-16T00:54:22.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: osdmap e23: 4 total, 4 up, 4 in 2024-09-16T00:54:22.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:54:22.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:54:22.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:54:22.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:22.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:21 smithi012 ceph-mon[31197]: osdmap e24: 4 total, 4 up, 4 in 2024-09-16T00:54:22.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:22 smithi098 ceph-mon[35346]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:22.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:22 smithi098 ceph-mon[35346]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:22.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:22 smithi098 ceph-mon[35346]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T00:54:23.009 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:22 smithi119 ceph-mon[35049]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:23.009 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:22 smithi119 ceph-mon[35049]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:23.009 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:22 smithi119 ceph-mon[35049]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T00:54:23.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:22 smithi012 ceph-mon[31197]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:54:23.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:22 smithi012 ceph-mon[31197]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:23.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:22 smithi012 ceph-mon[31197]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T00:54:23.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:23 smithi098 ceph-mon[35346]: from='client.? 172.21.15.98:0/1027614049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95ab617c-cff5-4bf9-9429-cba8e3da1d97"}]: dispatch 2024-09-16T00:54:23.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:23 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95ab617c-cff5-4bf9-9429-cba8e3da1d97"}]: dispatch 2024-09-16T00:54:23.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:23 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95ab617c-cff5-4bf9-9429-cba8e3da1d97"}]': finished 2024-09-16T00:54:23.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:23 smithi098 ceph-mon[35346]: osdmap e26: 5 total, 4 up, 5 in 2024-09-16T00:54:23.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:23 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:24.088 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:23 smithi012 ceph-mon[31197]: from='client.? 172.21.15.98:0/1027614049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95ab617c-cff5-4bf9-9429-cba8e3da1d97"}]: dispatch 2024-09-16T00:54:24.088 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:23 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95ab617c-cff5-4bf9-9429-cba8e3da1d97"}]: dispatch 2024-09-16T00:54:24.088 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:23 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95ab617c-cff5-4bf9-9429-cba8e3da1d97"}]': finished 2024-09-16T00:54:24.088 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:23 smithi012 ceph-mon[31197]: osdmap e26: 5 total, 4 up, 5 in 2024-09-16T00:54:24.089 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:23 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:24.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:23 smithi119 ceph-mon[35049]: from='client.? 172.21.15.98:0/1027614049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95ab617c-cff5-4bf9-9429-cba8e3da1d97"}]: dispatch 2024-09-16T00:54:24.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:23 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95ab617c-cff5-4bf9-9429-cba8e3da1d97"}]: dispatch 2024-09-16T00:54:24.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:23 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95ab617c-cff5-4bf9-9429-cba8e3da1d97"}]': finished 2024-09-16T00:54:24.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:23 smithi119 ceph-mon[35049]: osdmap e26: 5 total, 4 up, 5 in 2024-09-16T00:54:24.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:23 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:24 smithi119 ceph-mon[35049]: pgmap v95: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T00:54:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:24 smithi119 ceph-mon[35049]: from='client.? 172.21.15.98:0/2355404559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:24 smithi119 ceph-mon[35049]: osdmap e27: 5 total, 4 up, 5 in 2024-09-16T00:54:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:24 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:25.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:24 smithi012 ceph-mon[31197]: pgmap v95: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T00:54:25.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:24 smithi012 ceph-mon[31197]: from='client.? 172.21.15.98:0/2355404559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:25.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:24 smithi012 ceph-mon[31197]: osdmap e27: 5 total, 4 up, 5 in 2024-09-16T00:54:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:24 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:24 smithi098 ceph-mon[35346]: pgmap v95: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T00:54:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:24 smithi098 ceph-mon[35346]: from='client.? 172.21.15.98:0/2355404559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:24 smithi098 ceph-mon[35346]: osdmap e27: 5 total, 4 up, 5 in 2024-09-16T00:54:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:24 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:26 smithi119 ceph-mon[35049]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T00:54:27.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:26 smithi012 ceph-mon[31197]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T00:54:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:26 smithi098 ceph-mon[35346]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T00:54:29.088 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:28 smithi098 ceph-mon[35346]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-16T00:54:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:28 smithi119 ceph-mon[35049]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-16T00:54:29.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:28 smithi012 ceph-mon[31197]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-16T00:54:30.873 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:30 smithi098 ceph-mon[35346]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-16T00:54:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:30 smithi119 ceph-mon[35049]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-16T00:54:31.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:30 smithi012 ceph-mon[31197]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-16T00:54:32.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:31 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:54:32.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:31 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:32.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:31 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:54:32.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:31 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:32.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:54:32.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:32 smithi119 ceph-mon[35049]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:32 smithi119 ceph-mon[35049]: Deploying daemon osd.4 on smithi098 2024-09-16T00:54:33.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:32 smithi012 ceph-mon[31197]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:33.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:32 smithi012 ceph-mon[31197]: Deploying daemon osd.4 on smithi098 2024-09-16T00:54:33.108 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:32 smithi098 ceph-mon[35346]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:33.108 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:32 smithi098 ceph-mon[35346]: Deploying daemon osd.4 on smithi098 2024-09-16T00:54:35.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:34 smithi119 ceph-mon[35049]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:35.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:34 smithi012 ceph-mon[31197]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:35.137 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:34 smithi098 ceph-mon[35346]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:36 smithi098 ceph-mon[35346]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:36 smithi119 ceph-mon[35049]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:36 smithi012 ceph-mon[31197]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:38 smithi098 ceph-mon[35346]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:38 smithi119 ceph-mon[35049]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:39.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:38 smithi012 ceph-mon[31197]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:39.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:39.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:39.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:40 smithi119 ceph-mon[35049]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:40 smithi012 ceph-mon[31197]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:40 smithi098 ceph-mon[35346]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:41.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.562+0000 7f636effd640 1 -- 172.21.15.98:0/4183242519 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6378062630 con 0x7f63640a3270 2024-09-16T00:54:41.564 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 4 on host 'smithi098' 2024-09-16T00:54:41.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.565+0000 7f637ff55640 1 -- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63640a3270 msgr2=0x7f63640a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:41.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.565+0000 7f637ff55640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63640a3270 0x7f63640a5730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6368006fd0 tx=0x7f6368008040 comp rx=0 tx=0).stop 2024-09-16T00:54:41.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.565+0000 7f637ff55640 1 -- 172.21.15.98:0/4183242519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6378104fd0 msgr2=0x7f6378198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:41.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.565+0000 7f637ff55640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6378104fd0 0x7f6378198600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6374031610 tx=0x7f63740043b0 comp rx=0 tx=0).stop 2024-09-16T00:54:41.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.565+0000 7f637ff55640 1 -- 172.21.15.98:0/4183242519 shutdown_connections 2024-09-16T00:54:41.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.565+0000 7f637ff55640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63640a3270 0x7f63640a5730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:41.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.565+0000 7f637ff55640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6378107900 0x7f637819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:41.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.565+0000 7f637ff55640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6378104fd0 0x7f6378198600 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:41.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.565+0000 7f637ff55640 1 --2- 172.21.15.98:0/4183242519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63781026a0 0x7f63781980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:41.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.565+0000 7f637ff55640 1 -- 172.21.15.98:0/4183242519 >> 172.21.15.98:0/4183242519 conn(0x7f63780fc2a0 msgr2=0x7f6378103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:41.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.566+0000 7f637ff55640 1 -- 172.21.15.98:0/4183242519 shutdown_connections 2024-09-16T00:54:41.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:54:41.566+0000 7f637ff55640 1 -- 172.21.15.98:0/4183242519 wait complete. 2024-09-16T00:54:42.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:42.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:42.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:42.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:42.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:42.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:42.134 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:42.134 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:42.135 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:42.164 DEBUG:teuthology.orchestra.run.smithi098:osd.4> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.4.service 2024-09-16T00:54:42.166 INFO:tasks.cephadm:Deploying osd.5 on smithi119 with /dev/vg_nvme/lv_3... 2024-09-16T00:54:42.166 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T00:54:42.419 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:54:42.793 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:42 smithi119 ceph-mon[35049]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:43.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:42 smithi012 ceph-mon[31197]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:43.211 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:42 smithi098 ceph-mon[35346]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:44.212 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 00:54:43 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4[46430]: 2024-09-16T00:54:43.967+0000 7f39a0d6a640 -1 osd.4 0 log_to_monitors true 2024-09-16T00:54:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:44 smithi119 ceph-mon[35049]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:44 smithi119 ceph-mon[35049]: from='osd.4 [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:54:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:44 smithi119 ceph-mon[35049]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:54:45.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:44 smithi012 ceph-mon[31197]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:45.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:44 smithi012 ceph-mon[31197]: from='osd.4 [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:54:45.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:44 smithi012 ceph-mon[31197]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:54:45.124 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:54:45.151 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_3 2024-09-16T00:54:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:44 smithi098 ceph-mon[35346]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:44 smithi098 ceph-mon[35346]: from='osd.4 [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:54:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:44 smithi098 ceph-mon[35346]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:54:45.405 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:54:45.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.868+0000 7f3e6deb9640 1 -- 172.21.15.119:0/3689316315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e68100b10 msgr2=0x7f3e68100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:45.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.868+0000 7f3e6deb9640 1 --2- 172.21.15.119:0/3689316315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e68100b10 0x7f3e68100f10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009900 tx=0x7f3e5802a410 comp rx=0 tx=0).stop 2024-09-16T00:54:45.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.868+0000 7f3e6deb9640 1 -- 172.21.15.119:0/3689316315 shutdown_connections 2024-09-16T00:54:45.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.868+0000 7f3e6deb9640 1 --2- 172.21.15.119:0/3689316315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e681026d0 0x7f3e68108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:45.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.868+0000 7f3e6deb9640 1 --2- 172.21.15.119:0/3689316315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e68101d10 0x7f3e68102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:45.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.868+0000 7f3e6deb9640 1 --2- 172.21.15.119:0/3689316315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e68100b10 0x7f3e68100f10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:45.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.868+0000 7f3e6deb9640 1 -- 172.21.15.119:0/3689316315 >> 172.21.15.119:0/3689316315 conn(0x7f3e680fc2a0 msgr2=0x7f3e680fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:45.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.868+0000 7f3e6deb9640 1 -- 172.21.15.119:0/3689316315 shutdown_connections 2024-09-16T00:54:45.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.868+0000 7f3e6deb9640 1 -- 172.21.15.119:0/3689316315 wait complete. 2024-09-16T00:54:45.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e6deb9640 1 Processor -- start 2024-09-16T00:54:45.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e6deb9640 1 -- start start 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e6deb9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e68100b10 0x7f3e68196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e6deb9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e68101d10 0x7f3e68197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e6deb9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e681026d0 0x7f3e6819e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e6deb9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6810c790 con 0x7f3e68100b10 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e6deb9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6810c610 con 0x7f3e68101d10 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e6deb9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6810c910 con 0x7f3e681026d0 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e67fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e681026d0 0x7f3e6819e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e67fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e681026d0 0x7f3e6819e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33426/0 (socket says 172.21.15.119:33426) 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.869+0000 7f3e67fff640 1 -- 172.21.15.119:0/1305995906 learned_addr learned my addr 172.21.15.119:0/1305995906 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e66ffd640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e68101d10 0x7f3e68197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e677fe640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e68100b10 0x7f3e68196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:45.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e67fff640 1 -- 172.21.15.119:0/1305995906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e68101d10 msgr2=0x7f3e68197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e67fff640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e68101d10 0x7f3e68197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e67fff640 1 -- 172.21.15.119:0/1305995906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e68100b10 msgr2=0x7f3e68196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e67fff640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e68100b10 0x7f3e68196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e67fff640 1 -- 172.21.15.119:0/1305995906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6819ea20 con 0x7f3e681026d0 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e67fff640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e681026d0 0x7f3e6819e3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000eb10 tx=0x7f3e6000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e64ff9640 1 -- 172.21.15.119:0/1305995906 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60004b20 con 0x7f3e681026d0 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e6deb9640 1 -- 172.21.15.119:0/1305995906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6819ed10 con 0x7f3e681026d0 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e64ff9640 1 -- 172.21.15.119:0/1305995906 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e60004cc0 con 0x7f3e681026d0 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e64ff9640 1 -- 172.21.15.119:0/1305995906 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60010760 con 0x7f3e681026d0 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.870+0000 7f3e6deb9640 1 -- 172.21.15.119:0/1305995906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6819f1a0 con 0x7f3e681026d0 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.871+0000 7f3e6deb9640 1 -- 172.21.15.119:0/1305995906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e68107f50 con 0x7f3e681026d0 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.872+0000 7f3e64ff9640 1 -- 172.21.15.119:0/1305995906 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3e60010900 con 0x7f3e681026d0 2024-09-16T00:54:45.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.873+0000 7f3e64ff9640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3e500a3270 0x7f3e500a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:45.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.873+0000 7f3e64ff9640 1 -- 172.21.15.119:0/1305995906 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f3e600ceeb0 con 0x7f3e681026d0 2024-09-16T00:54:45.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.873+0000 7f3e677fe640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3e500a3270 0x7f3e500a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:45.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.874+0000 7f3e677fe640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3e500a3270 0x7f3e500a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e58005ab0 tx=0x7f3e58000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:45.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:45.876+0000 7f3e64ff9640 1 -- 172.21.15.119:0/1305995906 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e600541b0 con 0x7f3e681026d0 2024-09-16T00:54:46.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:54:46.052+0000 7f3e6deb9640 1 -- 172.21.15.119:0/1305995906 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3e68062630 con 0x7f3e500a3270 2024-09-16T00:54:46.053 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: osdmap e28: 5 total, 4 up, 5 in 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='osd.4 [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:46.054 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: osdmap e28: 5 total, 4 up, 5 in 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='osd.4 [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.212 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4[46430]: 2024-09-16T00:54:45.803+0000 7f399cced640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T00:54:46.212 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4[46430]: 2024-09-16T00:54:45.810+0000 7f3998b15640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:54:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T00:54:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: osdmap e28: 5 total, 4 up, 5 in 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='osd.4 [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:54:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi098 2024-09-16T00:54:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-16T00:54:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:54:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T00:54:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:54:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:54:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:47.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:46 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:47.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:47.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi098 2024-09-16T00:54:47.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-16T00:54:47.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:54:47.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T00:54:47.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:47.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:47.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:54:47.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:54:47.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:47.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:46 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi098 2024-09-16T00:54:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-16T00:54:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:54:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T00:54:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:54:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:54:47.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:47.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:46 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:48.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:47 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:54:48.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:47 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:54:48.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:47 smithi119 ceph-mon[35049]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:48.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:47 smithi119 ceph-mon[35049]: osd.4 [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] boot 2024-09-16T00:54:48.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:47 smithi119 ceph-mon[35049]: osdmap e30: 5 total, 5 up, 5 in 2024-09-16T00:54:48.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:47 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:48.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:47 smithi119 ceph-mon[35049]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:48.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:47 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:54:48.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:47 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:54:48.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:47 smithi012 ceph-mon[31197]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:48.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:47 smithi012 ceph-mon[31197]: osd.4 [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] boot 2024-09-16T00:54:48.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:47 smithi012 ceph-mon[31197]: osdmap e30: 5 total, 5 up, 5 in 2024-09-16T00:54:48.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:47 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:48.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:47 smithi012 ceph-mon[31197]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:47 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:54:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:47 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:54:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:47 smithi098 ceph-mon[35346]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:47 smithi098 ceph-mon[35346]: osd.4 [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] boot 2024-09-16T00:54:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:47 smithi098 ceph-mon[35346]: osdmap e30: 5 total, 5 up, 5 in 2024-09-16T00:54:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:47 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:54:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:47 smithi098 ceph-mon[35346]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:54:49.046 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:48 smithi119 ceph-mon[35049]: osdmap e31: 5 total, 5 up, 5 in 2024-09-16T00:54:49.046 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:48 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/1713315599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6524ca6c-c07a-497c-a034-8ad6055ca487"}]: dispatch 2024-09-16T00:54:49.046 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:48 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6524ca6c-c07a-497c-a034-8ad6055ca487"}]: dispatch 2024-09-16T00:54:49.047 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:48 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6524ca6c-c07a-497c-a034-8ad6055ca487"}]': finished 2024-09-16T00:54:49.047 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:48 smithi119 ceph-mon[35049]: osdmap e32: 6 total, 5 up, 6 in 2024-09-16T00:54:49.047 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:48 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:54:49.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:48 smithi012 ceph-mon[31197]: osdmap e31: 5 total, 5 up, 5 in 2024-09-16T00:54:49.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:48 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/1713315599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6524ca6c-c07a-497c-a034-8ad6055ca487"}]: dispatch 2024-09-16T00:54:49.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:48 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6524ca6c-c07a-497c-a034-8ad6055ca487"}]: dispatch 2024-09-16T00:54:49.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:48 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6524ca6c-c07a-497c-a034-8ad6055ca487"}]': finished 2024-09-16T00:54:49.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:48 smithi012 ceph-mon[31197]: osdmap e32: 6 total, 5 up, 6 in 2024-09-16T00:54:49.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:48 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:54:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:48 smithi098 ceph-mon[35346]: osdmap e31: 5 total, 5 up, 5 in 2024-09-16T00:54:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:48 smithi098 ceph-mon[35346]: from='client.? 172.21.15.119:0/1713315599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6524ca6c-c07a-497c-a034-8ad6055ca487"}]: dispatch 2024-09-16T00:54:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:48 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6524ca6c-c07a-497c-a034-8ad6055ca487"}]: dispatch 2024-09-16T00:54:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:48 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6524ca6c-c07a-497c-a034-8ad6055ca487"}]': finished 2024-09-16T00:54:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:48 smithi098 ceph-mon[35346]: osdmap e32: 6 total, 5 up, 6 in 2024-09-16T00:54:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:48 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:54:50.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:49 smithi119 ceph-mon[35049]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:50.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:49 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/2244011827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:50.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:49 smithi012 ceph-mon[31197]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:50.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:49 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/2244011827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:49 smithi098 ceph-mon[35346]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:49 smithi098 ceph-mon[35346]: from='client.? 172.21.15.119:0/2244011827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:51 smithi098 ceph-mon[35346]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:52.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:51 smithi119 ceph-mon[35049]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:52.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:51 smithi012 ceph-mon[31197]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:53 smithi098 ceph-mon[35346]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:54.241 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:53 smithi119 ceph-mon[35049]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:54.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:53 smithi012 ceph-mon[31197]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:55.979 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:55 smithi119 ceph-mon[35049]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:56.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:55 smithi098 ceph-mon[35346]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:56.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:55 smithi012 ceph-mon[31197]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:58.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:57 smithi119 ceph-mon[35049]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:58.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:57 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:54:58.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:57 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:58.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:57 smithi119 ceph-mon[35049]: Deploying daemon osd.5 on smithi119 2024-09-16T00:54:58.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:57 smithi098 ceph-mon[35346]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:58.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:57 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:54:58.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:57 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:58.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:57 smithi098 ceph-mon[35346]: Deploying daemon osd.5 on smithi119 2024-09-16T00:54:58.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:57 smithi012 ceph-mon[31197]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:54:58.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:57 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:54:58.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:57 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:58.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:57 smithi012 ceph-mon[31197]: Deploying daemon osd.5 on smithi119 2024-09-16T00:55:00.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:54:59 smithi098 ceph-mon[35346]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:00.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:54:59 smithi119 ceph-mon[35049]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:00.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:54:59 smithi012 ceph-mon[31197]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:02.063 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:01 smithi119 ceph-mon[35049]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:01 smithi098 ceph-mon[35346]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:02.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:01 smithi012 ceph-mon[31197]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:04.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:03 smithi119 ceph-mon[35049]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:04.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:03 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:04.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:03 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:04.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:03 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:03 smithi098 ceph-mon[35346]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:03 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:03 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:03 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:04.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:03 smithi012 ceph-mon[31197]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:04.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:03 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:05 smithi119 ceph-mon[35049]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:05 smithi098 ceph-mon[35346]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:06.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:05 smithi012 ceph-mon[31197]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:07.265 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:07 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:07.265 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:07 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:07.265 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:07 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:07.265 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:07 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:07.265 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:07 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:07.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.305+0000 7f3e64ff9640 1 -- 172.21.15.119:0/1305995906 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3e68062630 con 0x7f3e500a3270 2024-09-16T00:55:07.306 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 5 on host 'smithi119' 2024-09-16T00:55:07.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.307+0000 7f3e6deb9640 1 -- 172.21.15.119:0/1305995906 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3e500a3270 msgr2=0x7f3e500a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:07.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.307+0000 7f3e6deb9640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3e500a3270 0x7f3e500a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e58005ab0 tx=0x7f3e58000bc0 comp rx=0 tx=0).stop 2024-09-16T00:55:07.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.307+0000 7f3e6deb9640 1 -- 172.21.15.119:0/1305995906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e681026d0 msgr2=0x7f3e6819e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:07.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.307+0000 7f3e6deb9640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e681026d0 0x7f3e6819e3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000eb10 tx=0x7f3e6000c2d0 comp rx=0 tx=0).stop 2024-09-16T00:55:07.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.307+0000 7f3e6deb9640 1 -- 172.21.15.119:0/1305995906 shutdown_connections 2024-09-16T00:55:07.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.307+0000 7f3e6deb9640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3e500a3270 0x7f3e500a5730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:07.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.307+0000 7f3e6deb9640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e681026d0 0x7f3e6819e3b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:07.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.307+0000 7f3e6deb9640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e68101d10 0x7f3e68197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:07.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.307+0000 7f3e6deb9640 1 --2- 172.21.15.119:0/1305995906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e68100b10 0x7f3e68196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:07.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.307+0000 7f3e6deb9640 1 -- 172.21.15.119:0/1305995906 >> 172.21.15.119:0/1305995906 conn(0x7f3e680fc2a0 msgr2=0x7f3e68105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:07.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.308+0000 7f3e6deb9640 1 -- 172.21.15.119:0/1305995906 shutdown_connections 2024-09-16T00:55:07.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:55:07.308+0000 7f3e6deb9640 1 -- 172.21.15.119:0/1305995906 wait complete. 2024-09-16T00:55:07.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:07 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:07.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:07 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:07.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:07 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:07.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:07 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:07.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:07 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:07 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:07 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:07 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:07 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:07 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:08.004 DEBUG:teuthology.orchestra.run.smithi119:osd.5> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.5.service 2024-09-16T00:55:08.007 INFO:tasks.cephadm:Deploying osd.6 on smithi012 with /dev/vg_nvme/lv_2... 2024-09-16T00:55:08.007 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T00:55:08.276 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:55:08.292 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:08 smithi119 ceph-mon[35049]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:08.293 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:08.293 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:08.293 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:08.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:08 smithi012 ceph-mon[31197]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:08.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:08.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:08.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:08 smithi098 ceph-mon[35346]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:09.822 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 00:55:09 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T00:55:09.659+0000 7f93b5236640 -1 osd.5 0 log_to_monitors true 2024-09-16T00:55:10.395 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:10 smithi012 ceph-mon[31197]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:10.395 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:10 smithi012 ceph-mon[31197]: from='osd.5 [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:55:10.395 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:10 smithi012 ceph-mon[31197]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:55:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:10 smithi098 ceph-mon[35346]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:10 smithi098 ceph-mon[35346]: from='osd.5 [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:55:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:10 smithi098 ceph-mon[35346]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:55:10.465 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:10 smithi119 ceph-mon[35049]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:10.466 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:10 smithi119 ceph-mon[35049]: from='osd.5 [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:55:10.466 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:10 smithi119 ceph-mon[35049]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:55:11.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T00:55:11.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: osdmap e33: 6 total, 5 up, 6 in 2024-09-16T00:55:11.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:11.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='osd.5 [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:55:11.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:55:11.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.208 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:11.208 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:11.208 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.208 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:11.208 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:11.208 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:55:11.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_2 2024-09-16T00:55:11.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T00:55:11.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: osdmap e33: 6 total, 5 up, 6 in 2024-09-16T00:55:11.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:11.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='osd.5 [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:55:11.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:55:11.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:11 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.492 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:55:11.596 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T00:55:11.138+0000 7f93b11b9640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T00:55:11.596 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T00:55:11.145+0000 7f93acfe1640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:55:11.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T00:55:11.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: osdmap e33: 6 total, 5 up, 6 in 2024-09-16T00:55:11.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='osd.5 [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:55:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:55:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:11.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:11 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:11.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.947+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/2727168286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0100490 msgr2=0x7fc9b0100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.947+0000 7fc9b7e4e640 1 --2- 172.21.15.12:0/2727168286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0100490 0x7fc9b0100890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009900 tx=0x7fc9ac02a410 comp rx=0 tx=0).stop 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.947+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/2727168286 shutdown_connections 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.947+0000 7fc9b7e4e640 1 --2- 172.21.15.12:0/2727168286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b0101770 0x7fc9b0101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.947+0000 7fc9b7e4e640 1 --2- 172.21.15.12:0/2727168286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b0100dd0 0x7fc9b0101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.947+0000 7fc9b7e4e640 1 --2- 172.21.15.12:0/2727168286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0100490 0x7fc9b0100890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.947+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/2727168286 >> 172.21.15.12:0/2727168286 conn(0x7fc9b00fc2a0 msgr2=0x7fc9b00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.947+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/2727168286 shutdown_connections 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.947+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/2727168286 wait complete. 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.947+0000 7fc9b7e4e640 1 Processor -- start 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b7e4e640 1 -- start start 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b7e4e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b0100490 0x7fc9b019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:11.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b7e4e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b0100dd0 0x7fc9b019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b7e4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0101770 0x7fc9b01a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b7e4e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b010fa80 con 0x7fc9b0101770 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b7e4e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b010f900 con 0x7fc9b0100dd0 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b7e4e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b010fc00 con 0x7fc9b0100490 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b63eb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0101770 0x7fc9b01a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b63eb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0101770 0x7fc9b01a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57300/0 (socket says 172.21.15.12:57300) 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b63eb640 1 -- 172.21.15.12:0/3348424505 learned_addr learned my addr 172.21.15.12:0/3348424505 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b5bea640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b0100490 0x7fc9b019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b53e9640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b0100dd0 0x7fc9b019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b63eb640 1 -- 172.21.15.12:0/3348424505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b0100490 msgr2=0x7fc9b019a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b63eb640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b0100490 0x7fc9b019a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:11.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b63eb640 1 -- 172.21.15.12:0/3348424505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b0100dd0 msgr2=0x7fc9b019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b63eb640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b0100dd0 0x7fc9b019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b63eb640 1 -- 172.21.15.12:0/3348424505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b01a1d00 con 0x7fc9b0101770 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b53e9640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b0100dd0 0x7fc9b019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b63eb640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0101770 0x7fc9b01a1690 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800eb10 tx=0x7fc9a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9a6ffd640 1 -- 172.21.15.12:0/3348424505 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8004b20 con 0x7fc9b0101770 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9a6ffd640 1 -- 172.21.15.12:0/3348424505 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a8004cc0 con 0x7fc9b0101770 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.948+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/3348424505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b01a1ff0 con 0x7fc9b0101770 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.949+0000 7fc9a6ffd640 1 -- 172.21.15.12:0/3348424505 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8010760 con 0x7fc9b0101770 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.949+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/3348424505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b01a24f0 con 0x7fc9b0101770 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.950+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/3348424505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b010b1e0 con 0x7fc9b0101770 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.951+0000 7fc9a6ffd640 1 -- 172.21.15.12:0/3348424505 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc9a8005020 con 0x7fc9b0101770 2024-09-16T00:55:11.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.952+0000 7fc9a6ffd640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc99c0a32f0 0x7fc99c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:11.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.952+0000 7fc9b5bea640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc99c0a32f0 0x7fc99c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:11.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.952+0000 7fc9a6ffd640 1 -- 172.21.15.12:0/3348424505 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4566+0+0 (secure 0 0 0) 0x7fc9a80cef20 con 0x7fc9b0101770 2024-09-16T00:55:11.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.952+0000 7fc9b5bea640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc99c0a32f0 0x7fc99c0a57b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0314e0 tx=0x7fc9ac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:11.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:11.956+0000 7fc9a6ffd640 1 -- 172.21.15.12:0/3348424505 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9a809cae0 con 0x7fc9b0101770 2024-09-16T00:55:12.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:12.141+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/3348424505 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc9b0062630 con 0x7fc99c0a32f0 2024-09-16T00:55:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:12 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi119 2024-09-16T00:55:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:12 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-16T00:55:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:12 smithi098 ceph-mon[35346]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:12 smithi098 ceph-mon[35346]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:55:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:12 smithi098 ceph-mon[35346]: osdmap e34: 6 total, 5 up, 6 in 2024-09-16T00:55:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:12 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:12 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:12.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:12 smithi098 ceph-mon[35346]: osd.5 [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] boot 2024-09-16T00:55:12.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:12 smithi098 ceph-mon[35346]: osdmap e35: 6 total, 6 up, 6 in 2024-09-16T00:55:12.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:12 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:12.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:12 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi119 2024-09-16T00:55:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:12 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-16T00:55:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:12 smithi012 ceph-mon[31197]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:12 smithi012 ceph-mon[31197]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:55:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:12 smithi012 ceph-mon[31197]: osdmap e34: 6 total, 5 up, 6 in 2024-09-16T00:55:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:12 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:12 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:12 smithi012 ceph-mon[31197]: osd.5 [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] boot 2024-09-16T00:55:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:12 smithi012 ceph-mon[31197]: osdmap e35: 6 total, 6 up, 6 in 2024-09-16T00:55:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:12 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:12.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:12 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi119 2024-09-16T00:55:12.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:12 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-16T00:55:12.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:12 smithi119 ceph-mon[35049]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:55:12.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:12 smithi119 ceph-mon[35049]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:55:12.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:12 smithi119 ceph-mon[35049]: osdmap e34: 6 total, 5 up, 6 in 2024-09-16T00:55:12.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:12 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:12.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:12 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:12.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:12 smithi119 ceph-mon[35049]: osd.5 [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] boot 2024-09-16T00:55:12.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:12 smithi119 ceph-mon[35049]: osdmap e35: 6 total, 6 up, 6 in 2024-09-16T00:55:12.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:12 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:55:13.252 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:13 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:55:13.252 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:13 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:55:13.252 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:13 smithi012 ceph-mon[31197]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:13.252 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:13.252 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:13.252 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:13.252 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:13 smithi012 ceph-mon[31197]: osdmap e36: 6 total, 6 up, 6 in 2024-09-16T00:55:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:13 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:55:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:13 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:55:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:13 smithi098 ceph-mon[35346]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:13 smithi098 ceph-mon[35346]: osdmap e36: 6 total, 6 up, 6 in 2024-09-16T00:55:13.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:13 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:55:13.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:13 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:55:13.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:13 smithi119 ceph-mon[35049]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:13.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:13.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:13.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:13.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:13 smithi119 ceph-mon[35049]: osdmap e36: 6 total, 6 up, 6 in 2024-09-16T00:55:14.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:14 smithi119 ceph-mon[35049]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:14.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:14 smithi119 ceph-mon[35049]: osdmap e37: 6 total, 6 up, 6 in 2024-09-16T00:55:14.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:14 smithi012 ceph-mon[31197]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:14.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:14 smithi012 ceph-mon[31197]: osdmap e37: 6 total, 6 up, 6 in 2024-09-16T00:55:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:14 smithi098 ceph-mon[35346]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:14 smithi098 ceph-mon[35346]: osdmap e37: 6 total, 6 up, 6 in 2024-09-16T00:55:15.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:15 smithi012 ceph-mon[31197]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T00:55:15.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:15 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1049068998' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "575ceec2-6940-445f-87c3-1986e9efaf50"}]: dispatch 2024-09-16T00:55:15.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:15 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1049068998' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "575ceec2-6940-445f-87c3-1986e9efaf50"}]': finished 2024-09-16T00:55:15.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:15 smithi012 ceph-mon[31197]: osdmap e39: 7 total, 6 up, 7 in 2024-09-16T00:55:15.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:15 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:15.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:15 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/526989726' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:15.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:15 smithi119 ceph-mon[35049]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T00:55:15.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:15 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1049068998' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "575ceec2-6940-445f-87c3-1986e9efaf50"}]: dispatch 2024-09-16T00:55:15.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:15 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1049068998' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "575ceec2-6940-445f-87c3-1986e9efaf50"}]': finished 2024-09-16T00:55:15.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:15 smithi119 ceph-mon[35049]: osdmap e39: 7 total, 6 up, 7 in 2024-09-16T00:55:15.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:15 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:15.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:15 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/526989726' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:15 smithi098 ceph-mon[35346]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T00:55:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:15 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1049068998' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "575ceec2-6940-445f-87c3-1986e9efaf50"}]: dispatch 2024-09-16T00:55:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:15 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1049068998' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "575ceec2-6940-445f-87c3-1986e9efaf50"}]': finished 2024-09-16T00:55:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:15 smithi098 ceph-mon[35346]: osdmap e39: 7 total, 6 up, 7 in 2024-09-16T00:55:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:15 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:15 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/526989726' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:16.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:16 smithi098 ceph-mon[35346]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:17.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:16 smithi119 ceph-mon[35049]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:17.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:16 smithi012 ceph-mon[31197]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:18.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:18 smithi098 ceph-mon[35346]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:19.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:18 smithi119 ceph-mon[35049]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:19.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:18 smithi012 ceph-mon[31197]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:21.048 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:20 smithi012 ceph-mon[31197]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:55:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:20 smithi119 ceph-mon[35049]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:55:21.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:20 smithi098 ceph-mon[35346]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:55:23.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:22 smithi098 ceph-mon[35346]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-16T00:55:23.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:22 smithi012 ceph-mon[31197]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-16T00:55:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:22 smithi119 ceph-mon[35049]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-16T00:55:23.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:23 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-16T00:55:23.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:23 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:23.997 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:23 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-16T00:55:23.997 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:23 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:23 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-16T00:55:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:23 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:24.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:24 smithi012 ceph-mon[31197]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-16T00:55:24.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:24 smithi012 ceph-mon[31197]: Deploying daemon osd.6 on smithi012 2024-09-16T00:55:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:24 smithi119 ceph-mon[35049]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-16T00:55:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:24 smithi119 ceph-mon[35049]: Deploying daemon osd.6 on smithi012 2024-09-16T00:55:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:24 smithi098 ceph-mon[35346]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-16T00:55:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:24 smithi098 ceph-mon[35346]: Deploying daemon osd.6 on smithi012 2024-09-16T00:55:26.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:26 smithi012 ceph-mon[31197]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-16T00:55:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:26 smithi119 ceph-mon[35049]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-16T00:55:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:26 smithi098 ceph-mon[35346]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-16T00:55:28.970 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:28 smithi012 ceph-mon[31197]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:55:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:28 smithi119 ceph-mon[35049]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:55:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:28 smithi098 ceph-mon[35346]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:55:29.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:29.970 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:29.970 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:29 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:30.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:30.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:30.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:29 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:29 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:29 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:29 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:30.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:30 smithi012 ceph-mon[31197]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:55:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:30 smithi119 ceph-mon[35049]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:55:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:30 smithi098 ceph-mon[35346]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:55:32.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.634+0000 7fc9a6ffd640 1 -- 172.21.15.12:0/3348424505 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9b0062630 con 0x7fc99c0a32f0 2024-09-16T00:55:32.636 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 6 on host 'smithi012' 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/3348424505 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc99c0a32f0 msgr2=0x7fc99c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc99c0a32f0 0x7fc99c0a57b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0314e0 tx=0x7fc9ac000bc0 comp rx=0 tx=0).stop 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/3348424505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0101770 msgr2=0x7fc9b01a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0101770 0x7fc9b01a1690 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800eb10 tx=0x7fc9a800c2d0 comp rx=0 tx=0).stop 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/3348424505 shutdown_connections 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc99c0a32f0 0x7fc99c0a57b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9b0101770 0x7fc9b01a1690 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9b0100dd0 0x7fc9b019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 --2- 172.21.15.12:0/3348424505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9b0100490 0x7fc9b019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/3348424505 >> 172.21.15.12:0/3348424505 conn(0x7fc9b00fc2a0 msgr2=0x7fc9b00fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/3348424505 shutdown_connections 2024-09-16T00:55:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:55:32.637+0000 7fc9b7e4e640 1 -- 172.21.15.12:0/3348424505 wait complete. 2024-09-16T00:55:32.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:32 smithi012 ceph-mon[31197]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:32.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:32.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:32.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:32.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:32.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:32.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:32.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:32.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:32 smithi119 ceph-mon[35049]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:33.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.187 DEBUG:teuthology.orchestra.run.smithi012:osd.6> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.6.service 2024-09-16T00:55:33.190 INFO:tasks.cephadm:Deploying osd.7 on smithi098 with /dev/vg_nvme/lv_2... 2024-09-16T00:55:33.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T00:55:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:32 smithi098 ceph-mon[35346]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:33.452 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:55:35.038 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:34 smithi098 ceph-mon[35346]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:35.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:34 smithi119 ceph-mon[35049]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:35.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:34 smithi012 ceph-mon[31197]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:35.107 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 00:55:34 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T00:55:34.796+0000 7f197a8b5640 -1 osd.6 0 log_to_monitors true 2024-09-16T00:55:36.033 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:35 smithi098 ceph-mon[35346]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-16T00:55:36.084 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:35 smithi012 ceph-mon[31197]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-16T00:55:36.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:35 smithi119 ceph-mon[35049]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-16T00:55:36.136 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:55:36.163 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_2 2024-09-16T00:55:36.456 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:55:36.833 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: osdmap e40: 7 total, 6 up, 7 in 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:36.834 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:36.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.872+0000 7fa787db5640 1 -- 172.21.15.98:0/3926590219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa780102f70 msgr2=0x7fa7801033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:36.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.872+0000 7fa787db5640 1 --2- 172.21.15.98:0/3926590219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa780102f70 0x7fa7801033f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa770009930 tx=0x7fa77002a420 comp rx=0 tx=0).stop 2024-09-16T00:55:36.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.872+0000 7fa787db5640 1 -- 172.21.15.98:0/3926590219 shutdown_connections 2024-09-16T00:55:36.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.872+0000 7fa787db5640 1 --2- 172.21.15.98:0/3926590219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780103930 0x7fa78010a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:36.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.872+0000 7fa787db5640 1 --2- 172.21.15.98:0/3926590219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa780102f70 0x7fa7801033f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:36.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.872+0000 7fa787db5640 1 --2- 172.21.15.98:0/3926590219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7800ffef0 0x7fa7801002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:36.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.872+0000 7fa787db5640 1 -- 172.21.15.98:0/3926590219 >> 172.21.15.98:0/3926590219 conn(0x7fa7800fba40 msgr2=0x7fa7800fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.872+0000 7fa787db5640 1 -- 172.21.15.98:0/3926590219 shutdown_connections 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.872+0000 7fa787db5640 1 -- 172.21.15.98:0/3926590219 wait complete. 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa787db5640 1 Processor -- start 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa787db5640 1 -- start start 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa787db5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7800ffef0 0x7fa7801028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa787db5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780102f70 0x7fa780100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa787db5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa780103930 0x7fa780101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa787db5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa78010d890 con 0x7fa780102f70 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa787db5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa78010d710 con 0x7fa780103930 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa787db5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa78010da10 con 0x7fa7800ffef0 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa786352640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa780103930 0x7fa780101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:36.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa786352640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa780103930 0x7fa780101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47618/0 (socket says 172.21.15.98:47618) 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa786352640 1 -- 172.21.15.98:0/3291963141 learned_addr learned my addr 172.21.15.98:0/3291963141 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa785b51640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7800ffef0 0x7fa7801028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa786352640 1 -- 172.21.15.98:0/3291963141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7800ffef0 msgr2=0x7fa7801028d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa785350640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780102f70 0x7fa780100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa786352640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7800ffef0 0x7fa7801028d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa786352640 1 -- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780102f70 msgr2=0x7fa780100f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa786352640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780102f70 0x7fa780100f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa786352640 1 -- 172.21.15.98:0/3291963141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa780101d20 con 0x7fa780103930 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa785b51640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7800ffef0 0x7fa7801028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.873+0000 7fa785350640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780102f70 0x7fa780100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.874+0000 7fa786352640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa780103930 0x7fa780101460 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa77800cce0 tx=0x7fa77800a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.874+0000 7fa776ffd640 1 -- 172.21.15.98:0/3291963141 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77800f450 con 0x7fa780103930 2024-09-16T00:55:36.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.874+0000 7fa776ffd640 1 -- 172.21.15.98:0/3291963141 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa77800fad0 con 0x7fa780103930 2024-09-16T00:55:36.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.874+0000 7fa787db5640 1 -- 172.21.15.98:0/3291963141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7801a20a0 con 0x7fa780103930 2024-09-16T00:55:36.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.874+0000 7fa776ffd640 1 -- 172.21.15.98:0/3291963141 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778018c10 con 0x7fa780103930 2024-09-16T00:55:36.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.874+0000 7fa787db5640 1 -- 172.21.15.98:0/3291963141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7801a2560 con 0x7fa780103930 2024-09-16T00:55:36.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.875+0000 7fa787db5640 1 -- 172.21.15.98:0/3291963141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa780109190 con 0x7fa780103930 2024-09-16T00:55:36.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.876+0000 7fa776ffd640 1 -- 172.21.15.98:0/3291963141 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa77800f5f0 con 0x7fa780103930 2024-09-16T00:55:36.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.876+0000 7fa776ffd640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa76c0a3240 0x7fa76c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:36.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.877+0000 7fa776ffd640 1 -- 172.21.15.98:0/3291963141 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7fa7780cf1e0 con 0x7fa780103930 2024-09-16T00:55:36.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.877+0000 7fa785b51640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa76c0a3240 0x7fa76c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:36.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.877+0000 7fa785b51640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa76c0a3240 0x7fa76c0a5700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa77c005d00 tx=0x7fa77c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:36.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:36.880+0000 7fa776ffd640 1 -- 172.21.15.98:0/3291963141 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa778014030 con 0x7fa780103930 2024-09-16T00:55:37.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:37.056+0000 7fa787db5640 1 -- 172.21.15.98:0/3291963141 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa780062630 con 0x7fa76c0a3240 2024-09-16T00:55:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-16T00:55:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: osdmap e40: 7 total, 6 up, 7 in 2024-09-16T00:55:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:55:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:37.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:37.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:37.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:37.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:37.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:37.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:37.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:37.106 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T00:55:36.754+0000 7f1976838640 -1 osd.6 0 waiting for initial osdmap 2024-09-16T00:55:37.106 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T00:55:36.768+0000 7f1972660640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:55:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: osdmap e40: 7 total, 6 up, 7 in 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:38.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:37 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi012 2024-09-16T00:55:38.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:37 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi012 to 5697M 2024-09-16T00:55:38.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:37 smithi119 ceph-mon[35049]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:55:38.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:37 smithi119 ceph-mon[35049]: osdmap e41: 7 total, 6 up, 7 in 2024-09-16T00:55:38.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:37 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:38.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:37 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:38.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:37 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:38.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:37 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:38.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:37 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:38.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:37 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi012 2024-09-16T00:55:38.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:37 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi012 to 5697M 2024-09-16T00:55:38.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:37 smithi012 ceph-mon[31197]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:55:38.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:37 smithi012 ceph-mon[31197]: osdmap e41: 7 total, 6 up, 7 in 2024-09-16T00:55:38.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:37 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:38.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:37 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:38.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:37 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:38.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:37 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:38.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:37 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:38.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:37 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi012 2024-09-16T00:55:38.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:37 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi012 to 5697M 2024-09-16T00:55:38.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:37 smithi098 ceph-mon[35346]: from='osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:55:38.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:37 smithi098 ceph-mon[35346]: osdmap e41: 7 total, 6 up, 7 in 2024-09-16T00:55:38.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:37 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:38.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:37 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:38.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:37 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:38.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:37 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:38.153 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:37 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:38 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:55:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:38 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:55:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:38 smithi119 ceph-mon[35049]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:38 smithi119 ceph-mon[35049]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:38 smithi119 ceph-mon[35049]: osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] boot 2024-09-16T00:55:39.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:38 smithi119 ceph-mon[35049]: osdmap e42: 7 total, 7 up, 7 in 2024-09-16T00:55:39.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:39.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:38 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:55:39.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:38 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:55:39.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:38 smithi012 ceph-mon[31197]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:39.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:38 smithi012 ceph-mon[31197]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:39.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:39.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:38 smithi012 ceph-mon[31197]: osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] boot 2024-09-16T00:55:39.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:38 smithi012 ceph-mon[31197]: osdmap e42: 7 total, 7 up, 7 in 2024-09-16T00:55:39.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:39.125 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:38 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:55:39.125 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:38 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:55:39.125 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:38 smithi098 ceph-mon[35346]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:55:39.125 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:38 smithi098 ceph-mon[35346]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:39.125 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:39.125 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:38 smithi098 ceph-mon[35346]: osd.6 [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] boot 2024-09-16T00:55:39.125 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:38 smithi098 ceph-mon[35346]: osdmap e42: 7 total, 7 up, 7 in 2024-09-16T00:55:39.125 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:55:39.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:39 smithi098 ceph-mon[35346]: osdmap e43: 7 total, 7 up, 7 in 2024-09-16T00:55:39.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:39 smithi098 ceph-mon[35346]: from='client.? 172.21.15.98:0/3480068531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bbbdc0e-928f-4288-b7c3-c11d797dafc7"}]: dispatch 2024-09-16T00:55:39.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:39 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bbbdc0e-928f-4288-b7c3-c11d797dafc7"}]: dispatch 2024-09-16T00:55:39.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:39 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bbbdc0e-928f-4288-b7c3-c11d797dafc7"}]': finished 2024-09-16T00:55:39.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:39 smithi098 ceph-mon[35346]: osdmap e44: 8 total, 7 up, 8 in 2024-09-16T00:55:39.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:39 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:55:40.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:39 smithi119 ceph-mon[35049]: osdmap e43: 7 total, 7 up, 7 in 2024-09-16T00:55:40.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:39 smithi119 ceph-mon[35049]: from='client.? 172.21.15.98:0/3480068531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bbbdc0e-928f-4288-b7c3-c11d797dafc7"}]: dispatch 2024-09-16T00:55:40.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:39 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bbbdc0e-928f-4288-b7c3-c11d797dafc7"}]: dispatch 2024-09-16T00:55:40.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:39 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bbbdc0e-928f-4288-b7c3-c11d797dafc7"}]': finished 2024-09-16T00:55:40.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:39 smithi119 ceph-mon[35049]: osdmap e44: 8 total, 7 up, 8 in 2024-09-16T00:55:40.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:39 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:55:40.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:39 smithi012 ceph-mon[31197]: osdmap e43: 7 total, 7 up, 7 in 2024-09-16T00:55:40.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:39 smithi012 ceph-mon[31197]: from='client.? 172.21.15.98:0/3480068531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bbbdc0e-928f-4288-b7c3-c11d797dafc7"}]: dispatch 2024-09-16T00:55:40.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:39 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bbbdc0e-928f-4288-b7c3-c11d797dafc7"}]: dispatch 2024-09-16T00:55:40.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:39 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bbbdc0e-928f-4288-b7c3-c11d797dafc7"}]': finished 2024-09-16T00:55:40.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:39 smithi012 ceph-mon[31197]: osdmap e44: 8 total, 7 up, 8 in 2024-09-16T00:55:40.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:39 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:55:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:40 smithi119 ceph-mon[35049]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:40 smithi119 ceph-mon[35049]: from='client.? 172.21.15.98:0/3065662804' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:40 smithi012 ceph-mon[31197]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:40 smithi012 ceph-mon[31197]: from='client.? 172.21.15.98:0/3065662804' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:40 smithi098 ceph-mon[35346]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:40 smithi098 ceph-mon[35346]: from='client.? 172.21.15.98:0/3065662804' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:43.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:42 smithi119 ceph-mon[35049]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:43.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:42 smithi012 ceph-mon[31197]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:42 smithi098 ceph-mon[35346]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:44 smithi098 ceph-mon[35346]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:45.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:44 smithi119 ceph-mon[35049]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:45.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:44 smithi012 ceph-mon[31197]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:46 smithi098 ceph-mon[35346]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:46 smithi119 ceph-mon[35049]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:47.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:46 smithi012 ceph-mon[31197]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:47 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-16T00:55:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:47 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:48.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:47 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-16T00:55:48.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:47 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:48.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:47 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-16T00:55:48.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:47 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:49.074 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:48 smithi098 ceph-mon[35346]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:49.074 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:48 smithi098 ceph-mon[35346]: Deploying daemon osd.7 on smithi098 2024-09-16T00:55:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:48 smithi119 ceph-mon[35049]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:48 smithi119 ceph-mon[35049]: Deploying daemon osd.7 on smithi098 2024-09-16T00:55:49.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:48 smithi012 ceph-mon[31197]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:49.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:48 smithi012 ceph-mon[31197]: Deploying daemon osd.7 on smithi098 2024-09-16T00:55:51.084 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:50 smithi098 ceph-mon[35346]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:51.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:50 smithi119 ceph-mon[35049]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:51.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:50 smithi012 ceph-mon[31197]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:52.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:52 smithi098 ceph-mon[35346]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:53.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:52 smithi119 ceph-mon[35049]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:53.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:52 smithi012 ceph-mon[31197]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:54.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:54.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:54.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:54.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:54.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:54.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:54.150 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:54.150 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:54.151 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:55.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:54 smithi119 ceph-mon[35049]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:55.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:54 smithi012 ceph-mon[31197]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:55.201 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:54 smithi098 ceph-mon[35346]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:57.062 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:56 smithi098 ceph-mon[35346]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:57.062 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:57.062 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:57.062 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:57.062 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:57.062 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:56 smithi119 ceph-mon[35049]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:56 smithi012 ceph-mon[31197]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:57.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.396+0000 7fa776ffd640 1 -- 172.21.15.98:0/3291963141 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa780062630 con 0x7fa76c0a3240 2024-09-16T00:55:57.398 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 7 on host 'smithi098' 2024-09-16T00:55:57.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 -- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa76c0a3240 msgr2=0x7fa76c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:57.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa76c0a3240 0x7fa76c0a5700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa77c005d00 tx=0x7fa77c005ef0 comp rx=0 tx=0).stop 2024-09-16T00:55:57.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 -- 172.21.15.98:0/3291963141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa780103930 msgr2=0x7fa780101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:57.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa780103930 0x7fa780101460 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa77800cce0 tx=0x7fa77800a620 comp rx=0 tx=0).stop 2024-09-16T00:55:57.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 -- 172.21.15.98:0/3291963141 shutdown_connections 2024-09-16T00:55:57.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa76c0a3240 0x7fa76c0a5700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:57.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa780103930 0x7fa780101460 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:57.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780102f70 0x7fa780100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:57.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 --2- 172.21.15.98:0/3291963141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7800ffef0 0x7fa7801028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:57.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 -- 172.21.15.98:0/3291963141 >> 172.21.15.98:0/3291963141 conn(0x7fa7800fba40 msgr2=0x7fa780106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:57.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 -- 172.21.15.98:0/3291963141 shutdown_connections 2024-09-16T00:55:57.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:55:57.399+0000 7fa787db5640 1 -- 172.21.15.98:0/3291963141 wait complete. 2024-09-16T00:55:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:57 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:57 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:57 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:58.029 DEBUG:teuthology.orchestra.run.smithi098:osd.7> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.7.service 2024-09-16T00:55:58.032 INFO:tasks.cephadm:Deploying osd.8 on smithi119 with /dev/vg_nvme/lv_2... 2024-09-16T00:55:58.032 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T00:55:58.062 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:57 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:58.063 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:57 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:58.063 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:57 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:58.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:57 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:58.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:57 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:58.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:57 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:55:58.283 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:55:58.933 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:58 smithi098 ceph-mon[35346]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:58 smithi119 ceph-mon[35049]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:59.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:58 smithi012 ceph-mon[31197]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:55:59.822 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 00:55:59 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T00:55:59.649+0000 7f567122e640 -1 osd.7 0 log_to_monitors true 2024-09-16T00:56:00.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:59 smithi119 ceph-mon[35049]: from='osd.7 [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:56:00.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:55:59 smithi119 ceph-mon[35049]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:56:00.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:59 smithi012 ceph-mon[31197]: from='osd.7 [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:56:00.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:55:59 smithi012 ceph-mon[31197]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:56:00.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:59 smithi098 ceph-mon[35346]: from='osd.7 [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:56:00.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:55:59 smithi098 ceph-mon[35346]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:56:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:00 smithi119 ceph-mon[35049]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:56:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:00 smithi119 ceph-mon[35049]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-16T00:56:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:00 smithi119 ceph-mon[35049]: from='osd.7 [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:56:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:00 smithi119 ceph-mon[35049]: osdmap e45: 8 total, 7 up, 8 in 2024-09-16T00:56:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:00 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:00 smithi119 ceph-mon[35049]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:56:01.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:00 smithi012 ceph-mon[31197]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:56:01.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:00 smithi012 ceph-mon[31197]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-16T00:56:01.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:00 smithi012 ceph-mon[31197]: from='osd.7 [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:56:01.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:00 smithi012 ceph-mon[31197]: osdmap e45: 8 total, 7 up, 8 in 2024-09-16T00:56:01.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:00 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:01.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:00 smithi012 ceph-mon[31197]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:56:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:56:01.212 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 00:56:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T00:56:00.827+0000 7f566d1b1640 -1 osd.7 0 waiting for initial osdmap 2024-09-16T00:56:01.212 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 00:56:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T00:56:00.835+0000 7f5668fd9640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:56:01.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:00 smithi098 ceph-mon[35346]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:56:01.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:00 smithi098 ceph-mon[35346]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-16T00:56:01.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:00 smithi098 ceph-mon[35346]: from='osd.7 [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:56:01.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:00 smithi098 ceph-mon[35346]: osdmap e45: 8 total, 7 up, 8 in 2024-09-16T00:56:01.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:00 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:01.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:00 smithi098 ceph-mon[35346]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:56:01.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_2 2024-09-16T00:56:01.519 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:56:01.967 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:56:01.967 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: osdmap e46: 8 total, 7 up, 8 in 2024-09-16T00:56:01.967 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:01.967 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:01.967 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi098 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: osd.7 [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] boot 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: osdmap e47: 8 total, 8 up, 8 in 2024-09-16T00:56:01.968 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.049+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/3566028558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c1026d0 msgr2=0x7fa59c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.049+0000 7fa5a0c1b640 1 --2- 172.21.15.119:0/3566028558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c1026d0 0x7fa59c108f60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa594009ca0 tx=0x7fa59402a8c0 comp rx=0 tx=0).stop 2024-09-16T00:56:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.050+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/3566028558 shutdown_connections 2024-09-16T00:56:02.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.050+0000 7fa5a0c1b640 1 --2- 172.21.15.119:0/3566028558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c1026d0 0x7fa59c108f60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.050+0000 7fa5a0c1b640 1 --2- 172.21.15.119:0/3566028558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa59c101d10 0x7fa59c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.050+0000 7fa5a0c1b640 1 --2- 172.21.15.119:0/3566028558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa59c100b10 0x7fa59c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.050+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/3566028558 >> 172.21.15.119:0/3566028558 conn(0x7fa59c0fc2a0 msgr2=0x7fa59c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.050+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/3566028558 shutdown_connections 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.050+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/3566028558 wait complete. 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.050+0000 7fa5a0c1b640 1 Processor -- start 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.050+0000 7fa5a0c1b640 1 -- start start 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.050+0000 7fa5a0c1b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa59c100b10 0x7fa59c197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa5a0c1b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa59c101d10 0x7fa59c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa5a0c1b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c1026d0 0x7fa59c19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa5a0c1b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c10d920 con 0x7fa59c100b10 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa5a0c1b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c10d7a0 con 0x7fa59c101d10 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa5a0c1b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c10daa0 con 0x7fa59c1026d0 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa59ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c1026d0 0x7fa59c19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa59ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c1026d0 0x7fa59c19f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35726/0 (socket says 172.21.15.119:35726) 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa59ad9d640 1 -- 172.21.15.119:0/2604084189 learned_addr learned my addr 172.21.15.119:0/2604084189 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa599d9b640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa59c101d10 0x7fa59c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa59a59c640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa59c100b10 0x7fa59c197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa59ad9d640 1 -- 172.21.15.119:0/2604084189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa59c101d10 msgr2=0x7fa59c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa59ad9d640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa59c101d10 0x7fa59c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa59ad9d640 1 -- 172.21.15.119:0/2604084189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa59c100b10 msgr2=0x7fa59c197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:02.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa59ad9d640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa59c100b10 0x7fa59c197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa59ad9d640 1 -- 172.21.15.119:0/2604084189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c19fae0 con 0x7fa59c1026d0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa59ad9d640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c1026d0 0x7fa59c19f470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa5940098d0 tx=0x7fa59402f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa58b7fe640 1 -- 172.21.15.119:0/2604084189 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59402fc30 con 0x7fa59c1026d0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa58b7fe640 1 -- 172.21.15.119:0/2604084189 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa594003e50 con 0x7fa59c1026d0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa58b7fe640 1 -- 172.21.15.119:0/2604084189 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594004810 con 0x7fa59c1026d0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/2604084189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59c19fd70 con 0x7fa59c1026d0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.051+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/2604084189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59c1a02d0 con 0x7fa59c1026d0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.052+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/2604084189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa59c107e40 con 0x7fa59c1026d0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.053+0000 7fa58b7fe640 1 -- 172.21.15.119:0/2604084189 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa594003970 con 0x7fa59c1026d0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.054+0000 7fa58b7fe640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa5840a32f0 0x7fa5840a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.054+0000 7fa58b7fe640 1 -- 172.21.15.119:0/2604084189 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5430+0+0 (secure 0 0 0) 0x7fa5940f00f0 con 0x7fa59c1026d0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.054+0000 7fa59a59c640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa5840a32f0 0x7fa5840a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.055+0000 7fa59a59c640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa5840a32f0 0x7fa5840a57b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa59c101b70 tx=0x7fa58c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:02.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.058+0000 7fa58b7fe640 1 -- 172.21.15.119:0/2604084189 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5940bda70 con 0x7fa59c1026d0 2024-09-16T00:56:02.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: osdmap e46: 8 total, 7 up, 8 in 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi098 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-16T00:56:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:02.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:02.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:02.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:02.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: osd.7 [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] boot 2024-09-16T00:56:02.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: osdmap e47: 8 total, 8 up, 8 in 2024-09-16T00:56:02.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:56:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: osdmap e46: 8 total, 7 up, 8 in 2024-09-16T00:56:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:56:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi098 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: osd.7 [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] boot 2024-09-16T00:56:02.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: osdmap e47: 8 total, 8 up, 8 in 2024-09-16T00:56:02.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:56:02.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:02.233+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/2604084189 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa59c062630 con 0x7fa5840a32f0 2024-09-16T00:56:02.944 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:02 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:56:02.945 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:02 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:56:02.945 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:02 smithi119 ceph-mon[35049]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:02.945 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:02.945 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:02.945 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:02 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:02.945 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:02 smithi119 ceph-mon[35049]: osdmap e48: 8 total, 8 up, 8 in 2024-09-16T00:56:03.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:02 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:56:03.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:02 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:56:03.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:02 smithi012 ceph-mon[31197]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:03.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:03.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:03.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:02 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:03.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:02 smithi012 ceph-mon[31197]: osdmap e48: 8 total, 8 up, 8 in 2024-09-16T00:56:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:02 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:56:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:02 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:56:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:02 smithi098 ceph-mon[35346]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:03.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:03.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:03.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:02 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:03.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:02 smithi098 ceph-mon[35346]: osdmap e48: 8 total, 8 up, 8 in 2024-09-16T00:56:04.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:04 smithi119 ceph-mon[35049]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:04.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:04 smithi119 ceph-mon[35049]: osdmap e49: 8 total, 8 up, 8 in 2024-09-16T00:56:04.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:04 smithi012 ceph-mon[31197]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:04.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:04 smithi012 ceph-mon[31197]: osdmap e49: 8 total, 8 up, 8 in 2024-09-16T00:56:04.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:04 smithi098 ceph-mon[35346]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:04.906 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:04 smithi098 ceph-mon[35346]: osdmap e49: 8 total, 8 up, 8 in 2024-09-16T00:56:05.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:05 smithi119 ceph-mon[35049]: osdmap e50: 8 total, 8 up, 8 in 2024-09-16T00:56:05.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:05 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/1909507922' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bf5d5ca-7917-4956-bca7-20126befb69f"}]: dispatch 2024-09-16T00:56:05.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:05 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bf5d5ca-7917-4956-bca7-20126befb69f"}]: dispatch 2024-09-16T00:56:05.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:05 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bf5d5ca-7917-4956-bca7-20126befb69f"}]': finished 2024-09-16T00:56:05.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:05 smithi119 ceph-mon[35049]: osdmap e51: 9 total, 8 up, 9 in 2024-09-16T00:56:05.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:05.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:05 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/3010431969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:05.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:05 smithi012 ceph-mon[31197]: osdmap e50: 8 total, 8 up, 8 in 2024-09-16T00:56:05.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/1909507922' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bf5d5ca-7917-4956-bca7-20126befb69f"}]: dispatch 2024-09-16T00:56:05.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:05 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bf5d5ca-7917-4956-bca7-20126befb69f"}]: dispatch 2024-09-16T00:56:05.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:05 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bf5d5ca-7917-4956-bca7-20126befb69f"}]': finished 2024-09-16T00:56:05.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:05 smithi012 ceph-mon[31197]: osdmap e51: 9 total, 8 up, 9 in 2024-09-16T00:56:05.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:05.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/3010431969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:05 smithi098 ceph-mon[35346]: osdmap e50: 8 total, 8 up, 8 in 2024-09-16T00:56:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:05 smithi098 ceph-mon[35346]: from='client.? 172.21.15.119:0/1909507922' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bf5d5ca-7917-4956-bca7-20126befb69f"}]: dispatch 2024-09-16T00:56:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:05 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bf5d5ca-7917-4956-bca7-20126befb69f"}]: dispatch 2024-09-16T00:56:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:05 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bf5d5ca-7917-4956-bca7-20126befb69f"}]': finished 2024-09-16T00:56:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:05 smithi098 ceph-mon[35346]: osdmap e51: 9 total, 8 up, 9 in 2024-09-16T00:56:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:05 smithi098 ceph-mon[35346]: from='client.? 172.21.15.119:0/3010431969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:06 smithi119 ceph-mon[35049]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:07.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:06 smithi012 ceph-mon[31197]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:07.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:06 smithi098 ceph-mon[35346]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:08 smithi119 ceph-mon[35049]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:09.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:08 smithi012 ceph-mon[31197]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:09.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:08 smithi098 ceph-mon[35346]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:11.051 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:10 smithi119 ceph-mon[35049]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:11.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:10 smithi012 ceph-mon[31197]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:11.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:10 smithi098 ceph-mon[35346]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:13.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:12 smithi119 ceph-mon[35049]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:13.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:12 smithi012 ceph-mon[31197]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:13.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:12 smithi098 ceph-mon[35346]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:14.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-16T00:56:14.027 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:14.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-16T00:56:14.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:14.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-16T00:56:14.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:14.823 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:14 smithi119 ceph-mon[35049]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:14.823 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:14 smithi119 ceph-mon[35049]: Deploying daemon osd.8 on smithi119 2024-09-16T00:56:15.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:14 smithi012 ceph-mon[31197]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:15.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:14 smithi012 ceph-mon[31197]: Deploying daemon osd.8 on smithi119 2024-09-16T00:56:15.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:14 smithi098 ceph-mon[35346]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:15.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:14 smithi098 ceph-mon[35346]: Deploying daemon osd.8 on smithi119 2024-09-16T00:56:16.998 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:16 smithi119 ceph-mon[35049]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:17.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:16 smithi012 ceph-mon[31197]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:17.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:16 smithi098 ceph-mon[35346]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:18.999 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:18 smithi119 ceph-mon[35049]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:19.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:18 smithi012 ceph-mon[31197]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:19.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:18 smithi098 ceph-mon[35346]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:20.074 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:19 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:20.129 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:19 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:20.129 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:19 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:20.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:19 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:20.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:19 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:20.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:19 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:19 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:19 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:19 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:21.063 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:20 smithi119 ceph-mon[35049]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:21.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:20 smithi012 ceph-mon[31197]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:21.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:20 smithi098 ceph-mon[35346]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:23.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:22 smithi098 ceph-mon[35346]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:23.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:22 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:23.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:22 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:23.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:22 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:23.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:22 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:23.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:22 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:22 smithi119 ceph-mon[35049]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:22 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:22 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:22 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:22 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:22 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:23.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:22 smithi012 ceph-mon[31197]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:23.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:22 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:23.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:22 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:23.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:22 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:23.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:22 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:23.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:22 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:23.573 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 8 on host 'smithi119' 2024-09-16T00:56:23.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.572+0000 7fa58b7fe640 1 -- 172.21.15.119:0/2604084189 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa59c062630 con 0x7fa5840a32f0 2024-09-16T00:56:23.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.574+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/2604084189 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa5840a32f0 msgr2=0x7fa5840a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.574+0000 7fa5a0c1b640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa5840a32f0 0x7fa5840a57b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa59c101b70 tx=0x7fa58c008040 comp rx=0 tx=0).stop 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.575+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/2604084189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c1026d0 msgr2=0x7fa59c19f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.575+0000 7fa5a0c1b640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c1026d0 0x7fa59c19f470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa5940098d0 tx=0x7fa59402f840 comp rx=0 tx=0).stop 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.575+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/2604084189 shutdown_connections 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.575+0000 7fa5a0c1b640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa5840a32f0 0x7fa5840a57b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.575+0000 7fa5a0c1b640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c1026d0 0x7fa59c19f470 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.575+0000 7fa5a0c1b640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa59c101d10 0x7fa59c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.575+0000 7fa5a0c1b640 1 --2- 172.21.15.119:0/2604084189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa59c100b10 0x7fa59c197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.575+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/2604084189 >> 172.21.15.119:0/2604084189 conn(0x7fa59c0fc2a0 msgr2=0x7fa59c105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.575+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/2604084189 shutdown_connections 2024-09-16T00:56:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:56:23.575+0000 7fa5a0c1b640 1 -- 172.21.15.119:0/2604084189 wait complete. 2024-09-16T00:56:23.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:23 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:23.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:23 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:23.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:23 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:24.026 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:23 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:24.026 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:23 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:24.026 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:23 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:24.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:23 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:24.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:23 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:24.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:23 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:24.301 DEBUG:teuthology.orchestra.run.smithi119:osd.8> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.8.service 2024-09-16T00:56:24.304 INFO:tasks.cephadm:Deploying osd.9 on smithi012 with /dev/vg_nvme/lv_1... 2024-09-16T00:56:24.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-16T00:56:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:56:24.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:24 smithi119 ceph-mon[35049]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:25.023 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:24 smithi012 ceph-mon[31197]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:24 smithi098 ceph-mon[35346]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:25.463 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 00:56:25 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T00:56:25.211+0000 7fc7bc509640 -1 osd.8 0 log_to_monitors true 2024-09-16T00:56:25.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:25 smithi012 ceph-mon[31197]: from='osd.8 [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:56:25.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:25 smithi012 ceph-mon[31197]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:56:26.046 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:25 smithi119 ceph-mon[35049]: from='osd.8 [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:56:26.046 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:25 smithi119 ceph-mon[35049]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:56:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:25 smithi098 ceph-mon[35346]: from='osd.8 [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:56:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:25 smithi098 ceph-mon[35346]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:56:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:26 smithi119 ceph-mon[35049]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:26 smithi119 ceph-mon[35049]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-16T00:56:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:26 smithi119 ceph-mon[35049]: from='osd.8 [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:56:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:26 smithi119 ceph-mon[35049]: osdmap e52: 9 total, 8 up, 9 in 2024-09-16T00:56:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:27.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:26 smithi119 ceph-mon[35049]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:56:27.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:26 smithi012 ceph-mon[31197]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:26 smithi012 ceph-mon[31197]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-16T00:56:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:26 smithi012 ceph-mon[31197]: from='osd.8 [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:56:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:26 smithi012 ceph-mon[31197]: osdmap e52: 9 total, 8 up, 9 in 2024-09-16T00:56:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:26 smithi012 ceph-mon[31197]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:56:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:26 smithi098 ceph-mon[35346]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:26 smithi098 ceph-mon[35346]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-16T00:56:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:26 smithi098 ceph-mon[35346]: from='osd.8 [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:56:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:26 smithi098 ceph-mon[35346]: osdmap e52: 9 total, 8 up, 9 in 2024-09-16T00:56:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:26 smithi098 ceph-mon[35346]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:56:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:56:27.242 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_1 2024-09-16T00:56:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:56:27.596 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T00:56:27.152+0000 7fc7b8ca0640 -1 osd.8 0 waiting for initial osdmap 2024-09-16T00:56:27.596 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T00:56:27.163+0000 7fc7b02ac640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:56:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.980+0000 7f7680b36640 1 -- 172.21.15.12:0/804554967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f767c101c00 msgr2=0x7f767c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.980+0000 7f7680b36640 1 --2- 172.21.15.12:0/804554967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f767c101c00 0x7f767c102000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f766c009900 tx=0x7f766c02a410 comp rx=0 tx=0).stop 2024-09-16T00:56:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.980+0000 7f7680b36640 1 -- 172.21.15.12:0/804554967 shutdown_connections 2024-09-16T00:56:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.980+0000 7f7680b36640 1 --2- 172.21.15.12:0/804554967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f767c1037c0 0x7f767c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.980+0000 7f7680b36640 1 --2- 172.21.15.12:0/804554967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767c102e00 0x7f767c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.980+0000 7f7680b36640 1 --2- 172.21.15.12:0/804554967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f767c101c00 0x7f767c102000 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.980+0000 7f7680b36640 1 -- 172.21.15.12:0/804554967 >> 172.21.15.12:0/804554967 conn(0x7f767c0fd390 msgr2=0x7f767c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.980+0000 7f7680b36640 1 -- 172.21.15.12:0/804554967 shutdown_connections 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.980+0000 7f7680b36640 1 -- 172.21.15.12:0/804554967 wait complete. 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7680b36640 1 Processor -- start 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7680b36640 1 -- start start 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7680b36640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f767c101c00 0x7f767c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7680b36640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f767c102e00 0x7f767c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7680b36640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767c1037c0 0x7f767c19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7680b36640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f767c10d860 con 0x7f767c102e00 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7680b36640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f767c10d6e0 con 0x7f767c101c00 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7680b36640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f767c10d9e0 con 0x7f767c1037c0 2024-09-16T00:56:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7679d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f767c102e00 0x7f767c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7679d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f767c102e00 0x7f767c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55344/0 (socket says 172.21.15.12:55344) 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7679d9b640 1 -- 172.21.15.12:0/1186353041 learned_addr learned my addr 172.21.15.12:0/1186353041 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f767a59c640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f767c101c00 0x7f767c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f767ad9d640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767c1037c0 0x7f767c19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7679d9b640 1 -- 172.21.15.12:0/1186353041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767c1037c0 msgr2=0x7f767c19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7679d9b640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767c1037c0 0x7f767c19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7679d9b640 1 -- 172.21.15.12:0/1186353041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f767c101c00 msgr2=0x7f767c197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7679d9b640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f767c101c00 0x7f767c197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.981+0000 7f7679d9b640 1 -- 172.21.15.12:0/1186353041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c19fb80 con 0x7f767c102e00 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.982+0000 7f7679d9b640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f767c102e00 0x7f767c198490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f767000d950 tx=0x7f767000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.982+0000 7f766b7fe640 1 -- 172.21.15.12:0/1186353041 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670017070 con 0x7f767c102e00 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.982+0000 7f766b7fe640 1 -- 172.21.15.12:0/1186353041 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7670009c30 con 0x7f767c102e00 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.982+0000 7f7680b36640 1 -- 172.21.15.12:0/1186353041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c19fe70 con 0x7f767c102e00 2024-09-16T00:56:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.982+0000 7f766b7fe640 1 -- 172.21.15.12:0/1186353041 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767000f6b0 con 0x7f767c102e00 2024-09-16T00:56:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.982+0000 7f7680b36640 1 -- 172.21.15.12:0/1186353041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c1a0320 con 0x7f767c102e00 2024-09-16T00:56:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.983+0000 7f7680b36640 1 -- 172.21.15.12:0/1186353041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767c1090f0 con 0x7f767c102e00 2024-09-16T00:56:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.984+0000 7f766b7fe640 1 -- 172.21.15.12:0/1186353041 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f76700109d0 con 0x7f767c102e00 2024-09-16T00:56:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.985+0000 7f766b7fe640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f76640a3270 0x7f76640a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.985+0000 7f767a59c640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f76640a3270 0x7f76640a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.985+0000 7f766b7fe640 1 -- 172.21.15.12:0/1186353041 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5862+0+0 (secure 0 0 0) 0x7f76700cea80 con 0x7f767c102e00 2024-09-16T00:56:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.986+0000 7f767a59c640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f76640a3270 0x7f76640a5730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f766c005ab0 tx=0x7f766c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:27.990+0000 7f766b7fe640 1 -- 172.21.15.12:0/1186353041 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f767009bae0 con 0x7f767c102e00 2024-09-16T00:56:28.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:56:28.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: osdmap e53: 9 total, 8 up, 9 in 2024-09-16T00:56:28.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:28.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:28.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='osd.8 ' entity='osd.8' 2024-09-16T00:56:28.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:28.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:28.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:28.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:28.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:28.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:56:28.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: osdmap e53: 9 total, 8 up, 9 in 2024-09-16T00:56:28.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='osd.8 ' entity='osd.8' 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:28.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:28.176+0000 7f7680b36640 1 -- 172.21.15.12:0/1186353041 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f767c062630 con 0x7f76640a3270 2024-09-16T00:56:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:56:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: osdmap e53: 9 total, 8 up, 9 in 2024-09-16T00:56:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='osd.8 ' entity='osd.8' 2024-09-16T00:56:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:28.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:28.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:28.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:28.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:28.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:28.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi119 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: osd.8 [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] boot 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: osdmap e54: 9 total, 9 up, 9 in 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:28.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:28 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:56:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:56:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi119 2024-09-16T00:56:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-16T00:56:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: osd.8 [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] boot 2024-09-16T00:56:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: osdmap e54: 9 total, 9 up, 9 in 2024-09-16T00:56:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:28 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:56:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:56:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:56:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi119 2024-09-16T00:56:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-16T00:56:29.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:29.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: osd.8 [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] boot 2024-09-16T00:56:29.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: osdmap e54: 9 total, 9 up, 9 in 2024-09-16T00:56:29.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:56:29.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:29.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:29.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:28 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:30.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:29 smithi119 ceph-mon[35049]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:30.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:29 smithi119 ceph-mon[35049]: osdmap e55: 9 total, 9 up, 9 in 2024-09-16T00:56:30.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:29 smithi012 ceph-mon[31197]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:30.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:29 smithi012 ceph-mon[31197]: osdmap e55: 9 total, 9 up, 9 in 2024-09-16T00:56:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:29 smithi098 ceph-mon[35346]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:29 smithi098 ceph-mon[35346]: osdmap e55: 9 total, 9 up, 9 in 2024-09-16T00:56:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:30 smithi119 ceph-mon[35049]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:30 smithi119 ceph-mon[35049]: osdmap e56: 9 total, 9 up, 9 in 2024-09-16T00:56:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:30 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/373488830' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13e32644-63a4-4a41-8eb7-36955407891c"}]: dispatch 2024-09-16T00:56:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:30 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/373488830' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13e32644-63a4-4a41-8eb7-36955407891c"}]': finished 2024-09-16T00:56:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:30 smithi119 ceph-mon[35049]: osdmap e57: 10 total, 9 up, 10 in 2024-09-16T00:56:31.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:31.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:30 smithi012 ceph-mon[31197]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:31.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:30 smithi012 ceph-mon[31197]: osdmap e56: 9 total, 9 up, 9 in 2024-09-16T00:56:31.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:30 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/373488830' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13e32644-63a4-4a41-8eb7-36955407891c"}]: dispatch 2024-09-16T00:56:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:30 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/373488830' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13e32644-63a4-4a41-8eb7-36955407891c"}]': finished 2024-09-16T00:56:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:30 smithi012 ceph-mon[31197]: osdmap e57: 10 total, 9 up, 10 in 2024-09-16T00:56:31.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:30 smithi098 ceph-mon[35346]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:30 smithi098 ceph-mon[35346]: osdmap e56: 9 total, 9 up, 9 in 2024-09-16T00:56:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:30 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/373488830' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13e32644-63a4-4a41-8eb7-36955407891c"}]: dispatch 2024-09-16T00:56:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:30 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/373488830' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13e32644-63a4-4a41-8eb7-36955407891c"}]': finished 2024-09-16T00:56:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:30 smithi098 ceph-mon[35346]: osdmap e57: 10 total, 9 up, 10 in 2024-09-16T00:56:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:32.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:31 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/913488319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:32.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:31 smithi119 ceph-mon[35049]: osdmap e58: 10 total, 9 up, 10 in 2024-09-16T00:56:32.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:31 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:32.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:31 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/913488319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:32.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:31 smithi012 ceph-mon[31197]: osdmap e58: 10 total, 9 up, 10 in 2024-09-16T00:56:32.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:31 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:31 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/913488319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:31 smithi098 ceph-mon[35346]: osdmap e58: 10 total, 9 up, 10 in 2024-09-16T00:56:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:31 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:32 smithi119 ceph-mon[35049]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:33.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:32 smithi012 ceph-mon[31197]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:32 smithi098 ceph-mon[35346]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:34.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:33 smithi119 ceph-mon[35049]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-16T00:56:34.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:33 smithi012 ceph-mon[31197]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-16T00:56:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:33 smithi098 ceph-mon[35346]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-16T00:56:36.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:35 smithi012 ceph-mon[31197]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:56:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:35 smithi098 ceph-mon[35346]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:56:36.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:35 smithi119 ceph-mon[35049]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:56:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:37 smithi098 ceph-mon[35346]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-16T00:56:38.258 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:37 smithi012 ceph-mon[31197]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-16T00:56:38.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:37 smithi119 ceph-mon[35049]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-16T00:56:40.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:39 smithi012 ceph-mon[31197]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-16T00:56:40.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:39 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-16T00:56:40.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:39 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:40.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:39 smithi012 ceph-mon[31197]: Deploying daemon osd.9 on smithi012 2024-09-16T00:56:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:39 smithi098 ceph-mon[35346]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-16T00:56:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:39 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-16T00:56:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:39 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:39 smithi098 ceph-mon[35346]: Deploying daemon osd.9 on smithi012 2024-09-16T00:56:40.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:39 smithi119 ceph-mon[35049]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-16T00:56:40.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:39 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-16T00:56:40.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:39 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:40.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:39 smithi119 ceph-mon[35049]: Deploying daemon osd.9 on smithi012 2024-09-16T00:56:42.072 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:41 smithi012 ceph-mon[31197]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:56:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:41 smithi098 ceph-mon[35346]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:56:42.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:41 smithi119 ceph-mon[35049]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:56:44.075 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:43 smithi012 ceph-mon[31197]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-16T00:56:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:43 smithi098 ceph-mon[35346]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-16T00:56:44.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:43 smithi119 ceph-mon[35049]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-16T00:56:46.017 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:45 smithi012 ceph-mon[31197]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:46.017 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:46.017 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:46.017 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:45 smithi098 ceph-mon[35346]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:46.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:45 smithi119 ceph-mon[35049]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:46.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:46.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:46.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:48.178 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:47 smithi012 ceph-mon[31197]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:47 smithi098 ceph-mon[35346]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:48.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:47 smithi119 ceph-mon[35049]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:48.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.858+0000 7f766b7fe640 1 -- 172.21.15.12:0/1186353041 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f767c062630 con 0x7f76640a3270 2024-09-16T00:56:48.859 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 9 on host 'smithi012' 2024-09-16T00:56:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 -- 172.21.15.12:0/1186353041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f76640a3270 msgr2=0x7f76640a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f76640a3270 0x7f76640a5730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f766c005ab0 tx=0x7f766c000bc0 comp rx=0 tx=0).stop 2024-09-16T00:56:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 -- 172.21.15.12:0/1186353041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f767c102e00 msgr2=0x7f767c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f767c102e00 0x7f767c198490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f767000d950 tx=0x7f767000de10 comp rx=0 tx=0).stop 2024-09-16T00:56:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 -- 172.21.15.12:0/1186353041 shutdown_connections 2024-09-16T00:56:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f76640a3270 0x7f76640a5730 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767c1037c0 0x7f767c19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f767c102e00 0x7f767c198490 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 --2- 172.21.15.12:0/1186353041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f767c101c00 0x7f767c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 -- 172.21.15.12:0/1186353041 >> 172.21.15.12:0/1186353041 conn(0x7f767c0fd390 msgr2=0x7f767c1062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 -- 172.21.15.12:0/1186353041 shutdown_connections 2024-09-16T00:56:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:56:48.861+0000 7f7680b36640 1 -- 172.21.15.12:0/1186353041 wait complete. 2024-09-16T00:56:49.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:49 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:49 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:49 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:49.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:49 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:49.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:49 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:49 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:49.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:49 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:49 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:49 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:49 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:49 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:49.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:49 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:49.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:49 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:49 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:49.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:49 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:49 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:49 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:49 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:49 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:49.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:49 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:49.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:49 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:49 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:49.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:49 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:49 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:49.654 DEBUG:teuthology.orchestra.run.smithi012:osd.9> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.9.service 2024-09-16T00:56:49.656 INFO:tasks.cephadm:Deploying osd.10 on smithi098 with /dev/vg_nvme/lv_1... 2024-09-16T00:56:49.657 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-16T00:56:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:56:50.295 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:50 smithi098 ceph-mon[35346]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:50.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:50 smithi012 ceph-mon[31197]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:50.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:50 smithi119 ceph-mon[35049]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:51.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:51 smithi012 ceph-mon[31197]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-16T00:56:51.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 00:56:51 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T00:56:51.138+0000 7fe7e66c7640 -1 osd.9 0 log_to_monitors true 2024-09-16T00:56:51.384 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:51 smithi098 ceph-mon[35346]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-16T00:56:51.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:51 smithi119 ceph-mon[35049]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-16T00:56:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:52 smithi098 ceph-mon[35346]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:52 smithi098 ceph-mon[35346]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-16T00:56:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:52 smithi098 ceph-mon[35346]: osdmap e59: 10 total, 9 up, 10 in 2024-09-16T00:56:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:52 smithi098 ceph-mon[35346]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:56:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:52.496 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T00:56:52.521 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_1 2024-09-16T00:56:52.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:52 smithi012 ceph-mon[31197]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:52.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:52 smithi012 ceph-mon[31197]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-16T00:56:52.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:52 smithi012 ceph-mon[31197]: osdmap e59: 10 total, 9 up, 10 in 2024-09-16T00:56:52.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:52 smithi012 ceph-mon[31197]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:56:52.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:52.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:52 smithi119 ceph-mon[35049]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:52.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:52 smithi119 ceph-mon[35049]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-16T00:56:52.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:52 smithi119 ceph-mon[35049]: osdmap e59: 10 total, 9 up, 10 in 2024-09-16T00:56:52.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:52 smithi119 ceph-mon[35049]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-16T00:56:52.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:52.781 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:56:52.856 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 00:56:52 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T00:56:52.626+0000 7fe7e2e5e640 -1 osd.9 0 waiting for initial osdmap 2024-09-16T00:56:52.856 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 00:56:52 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T00:56:52.638+0000 7fe7da46a640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:56:53.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.273+0000 7f70e07d5640 1 -- 172.21.15.98:0/1213584475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70d81078c0 msgr2=0x7f70d8109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.273+0000 7f70e07d5640 1 --2- 172.21.15.98:0/1213584475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70d81078c0 0x7f70d8109d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009ca0 tx=0x7f70d002a8c0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.273+0000 7f70e07d5640 1 -- 172.21.15.98:0/1213584475 shutdown_connections 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.273+0000 7f70e07d5640 1 --2- 172.21.15.98:0/1213584475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70d81078c0 0x7f70d8109d10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.273+0000 7f70e07d5640 1 --2- 172.21.15.98:0/1213584475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d8104f90 0x7f70d8107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.273+0000 7f70e07d5640 1 --2- 172.21.15.98:0/1213584475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70d8102660 0x7f70d8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.273+0000 7f70e07d5640 1 -- 172.21.15.98:0/1213584475 >> 172.21.15.98:0/1213584475 conn(0x7f70d80fc280 msgr2=0x7f70d80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.273+0000 7f70e07d5640 1 -- 172.21.15.98:0/1213584475 shutdown_connections 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.273+0000 7f70e07d5640 1 -- 172.21.15.98:0/1213584475 wait complete. 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70e07d5640 1 Processor -- start 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70e07d5640 1 -- start start 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70e07d5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70d8102660 0x7f70d8197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70e07d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70d8104f90 0x7f70d8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70e07d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d81078c0 0x7f70d819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70e07d5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f70d810d880 con 0x7f70d8104f90 2024-09-16T00:56:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70e07d5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f70d810d700 con 0x7f70d8102660 2024-09-16T00:56:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70e07d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f70d810da00 con 0x7f70d81078c0 2024-09-16T00:56:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70de571640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70d8102660 0x7f70d8197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70de571640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70d8102660 0x7f70d8197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45038/0 (socket says 172.21.15.98:45038) 2024-09-16T00:56:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70de571640 1 -- 172.21.15.98:0/962526999 learned_addr learned my addr 172.21.15.98:0/962526999 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T00:56:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70ddd70640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70d8104f90 0x7f70d8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70ded72640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d81078c0 0x7f70d819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70de571640 1 -- 172.21.15.98:0/962526999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d81078c0 msgr2=0x7f70d819f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70de571640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d81078c0 0x7f70d819f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70de571640 1 -- 172.21.15.98:0/962526999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70d8104f90 msgr2=0x7f70d8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70de571640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70d8104f90 0x7f70d8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.274+0000 7f70de571640 1 -- 172.21.15.98:0/962526999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d819fb00 con 0x7f70d8102660 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.275+0000 7f70de571640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70d8102660 0x7f70d8197ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f70d400e9f0 tx=0x7f70d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.275+0000 7f70cf7fe640 1 -- 172.21.15.98:0/962526999 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d400cd80 con 0x7f70d8102660 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.275+0000 7f70cf7fe640 1 -- 172.21.15.98:0/962526999 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70d4010910 con 0x7f70d8102660 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.275+0000 7f70e07d5640 1 -- 172.21.15.98:0/962526999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d819fdf0 con 0x7f70d8102660 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.275+0000 7f70cf7fe640 1 -- 172.21.15.98:0/962526999 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4018990 con 0x7f70d8102660 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.275+0000 7f70e07d5640 1 -- 172.21.15.98:0/962526999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d81a02a0 con 0x7f70d8102660 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.276+0000 7f70e07d5640 1 -- 172.21.15.98:0/962526999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d80fdd70 con 0x7f70d8102660 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.277+0000 7f70cf7fe640 1 -- 172.21.15.98:0/962526999 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f70d4010ac0 con 0x7f70d8102660 2024-09-16T00:56:53.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.278+0000 7f70cf7fe640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70c40a32f0 0x7f70c40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.278+0000 7f70cf7fe640 1 -- 172.21.15.98:0/962526999 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5981+0+0 (secure 0 0 0) 0x7f70d40cf2b0 con 0x7f70d8102660 2024-09-16T00:56:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.278+0000 7f70ddd70640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70c40a32f0 0x7f70c40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.278+0000 7f70ddd70640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70c40a32f0 0x7f70c40a57b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70d81993f0 tx=0x7f70c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:53.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.286+0000 7f70cf7fe640 1 -- 172.21.15.98:0/962526999 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70d409c8f0 con 0x7f70d8102660 2024-09-16T00:56:53.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:56:53.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: osdmap e60: 10 total, 9 up, 10 in 2024-09-16T00:56:53.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:53.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:53.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi012 2024-09-16T00:56:53.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-16T00:56:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' 2024-09-16T00:56:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:53 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:56:53.468+0000 7f70e07d5640 1 -- 172.21.15.98:0/962526999 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f70d8062630 con 0x7f70c40a32f0 2024-09-16T00:56:53.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:56:53.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: osdmap e60: 10 total, 9 up, 10 in 2024-09-16T00:56:53.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:53.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:53.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi012 2024-09-16T00:56:53.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.498 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.499 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.499 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.499 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.499 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-16T00:56:53.499 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.499 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:53.499 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' 2024-09-16T00:56:53.499 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:53.499 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:53 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-16T00:56:53.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: osdmap e60: 10 total, 9 up, 10 in 2024-09-16T00:56:53.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:53.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:53.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi012 2024-09-16T00:56:53.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:53.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-16T00:56:53.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:53.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:53.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448]' entity='osd.9' 2024-09-16T00:56:53.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:53.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:53 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:56:54.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:56:54.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:56:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] boot 2024-09-16T00:56:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: osdmap e61: 10 total, 10 up, 10 in 2024-09-16T00:56:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:54 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:54.510 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:56:54.510 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:56:54.510 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:54.510 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:54.510 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:54.510 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:54.510 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:54.511 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:54.511 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] boot 2024-09-16T00:56:54.511 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: osdmap e61: 10 total, 10 up, 10 in 2024-09-16T00:56:54.511 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:54 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:54.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:56:54.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:56:54.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:56:54.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:54.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:54.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:54.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:54.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:54.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: osd.9 [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] boot 2024-09-16T00:56:54.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: osdmap e61: 10 total, 10 up, 10 in 2024-09-16T00:56:54.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:54 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:56:55.702 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:55 smithi098 ceph-mon[35346]: osdmap e62: 10 total, 10 up, 10 in 2024-09-16T00:56:56.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:55 smithi119 ceph-mon[35049]: osdmap e62: 10 total, 10 up, 10 in 2024-09-16T00:56:56.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:55 smithi012 ceph-mon[31197]: osdmap e62: 10 total, 10 up, 10 in 2024-09-16T00:56:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:56 smithi098 ceph-mon[35346]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:56:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:56 smithi098 ceph-mon[35346]: from='client.? 172.21.15.98:0/2682385817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f128201-841b-47a9-84ca-d116ed049062"}]: dispatch 2024-09-16T00:56:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:56 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f128201-841b-47a9-84ca-d116ed049062"}]: dispatch 2024-09-16T00:56:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:56 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f128201-841b-47a9-84ca-d116ed049062"}]': finished 2024-09-16T00:56:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:56 smithi098 ceph-mon[35346]: osdmap e63: 11 total, 10 up, 11 in 2024-09-16T00:56:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:56:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:56 smithi098 ceph-mon[35346]: from='client.? 172.21.15.98:0/2230777387' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:56 smithi119 ceph-mon[35049]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:56:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:56 smithi119 ceph-mon[35049]: from='client.? 172.21.15.98:0/2682385817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f128201-841b-47a9-84ca-d116ed049062"}]: dispatch 2024-09-16T00:56:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:56 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f128201-841b-47a9-84ca-d116ed049062"}]: dispatch 2024-09-16T00:56:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:56 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f128201-841b-47a9-84ca-d116ed049062"}]': finished 2024-09-16T00:56:57.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:56 smithi119 ceph-mon[35049]: osdmap e63: 11 total, 10 up, 11 in 2024-09-16T00:56:57.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:56:57.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:56 smithi119 ceph-mon[35049]: from='client.? 172.21.15.98:0/2230777387' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:56 smithi012 ceph-mon[31197]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:56:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:56 smithi012 ceph-mon[31197]: from='client.? 172.21.15.98:0/2682385817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f128201-841b-47a9-84ca-d116ed049062"}]: dispatch 2024-09-16T00:56:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:56 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f128201-841b-47a9-84ca-d116ed049062"}]: dispatch 2024-09-16T00:56:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:56 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f128201-841b-47a9-84ca-d116ed049062"}]': finished 2024-09-16T00:56:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:56 smithi012 ceph-mon[31197]: osdmap e63: 11 total, 10 up, 11 in 2024-09-16T00:56:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:56:57.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:56 smithi012 ceph-mon[31197]: from='client.? 172.21.15.98:0/2230777387' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:56:58 smithi098 ceph-mon[35346]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:56:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:56:58 smithi119 ceph-mon[35049]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:56:59.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:56:58 smithi012 ceph-mon[31197]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:00.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:00 smithi098 ceph-mon[35346]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:00 smithi119 ceph-mon[35049]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:01.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:00 smithi012 ceph-mon[31197]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:02 smithi098 ceph-mon[35346]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:03.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:02 smithi119 ceph-mon[35049]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:03.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:02 smithi012 ceph-mon[31197]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:04.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:04 smithi098 ceph-mon[35346]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:05.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:04 smithi119 ceph-mon[35049]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:05.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:04 smithi012 ceph-mon[31197]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:05.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-16T00:57:05.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:05.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:05 smithi098 ceph-mon[35346]: Deploying daemon osd.10 on smithi098 2024-09-16T00:57:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-16T00:57:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:05 smithi119 ceph-mon[35049]: Deploying daemon osd.10 on smithi098 2024-09-16T00:57:06.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-16T00:57:06.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:06.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:05 smithi012 ceph-mon[31197]: Deploying daemon osd.10 on smithi098 2024-09-16T00:57:06.770 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:06 smithi098 ceph-mon[35346]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:06 smithi119 ceph-mon[35049]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:07.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:06 smithi012 ceph-mon[31197]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:08.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:08 smithi098 ceph-mon[35346]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:08 smithi119 ceph-mon[35049]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:09.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:08 smithi012 ceph-mon[31197]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:10 smithi098 ceph-mon[35346]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:10 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:10 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:10 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:11.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:10 smithi119 ceph-mon[35049]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:11.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:10 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:11.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:10 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:11.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:10 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:11.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:10 smithi012 ceph-mon[31197]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:11.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:11.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:11.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:12.954 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:12 smithi098 ceph-mon[35346]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:13.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:12 smithi119 ceph-mon[35049]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:13.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:12 smithi012 ceph-mon[31197]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:14.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.175+0000 7f70cf7fe640 1 -- 172.21.15.98:0/962526999 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f70d8062630 con 0x7f70c40a32f0 2024-09-16T00:57:14.177 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 10 on host 'smithi098' 2024-09-16T00:57:14.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 -- 172.21.15.98:0/962526999 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70c40a32f0 msgr2=0x7f70c40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:14.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70c40a32f0 0x7f70c40a57b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70d81993f0 tx=0x7f70c800b390 comp rx=0 tx=0).stop 2024-09-16T00:57:14.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 -- 172.21.15.98:0/962526999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70d8102660 msgr2=0x7f70d8197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:14.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70d8102660 0x7f70d8197ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f70d400e9f0 tx=0x7f70d400eeb0 comp rx=0 tx=0).stop 2024-09-16T00:57:14.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 -- 172.21.15.98:0/962526999 shutdown_connections 2024-09-16T00:57:14.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70c40a32f0 0x7f70c40a57b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:14.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70d81078c0 0x7f70d819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:14.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70d8104f90 0x7f70d8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:14.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 --2- 172.21.15.98:0/962526999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70d8102660 0x7f70d8197ed0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:14.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 -- 172.21.15.98:0/962526999 >> 172.21.15.98:0/962526999 conn(0x7f70d80fc280 msgr2=0x7f70d8102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:14.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 -- 172.21.15.98:0/962526999 shutdown_connections 2024-09-16T00:57:14.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T00:57:14.178+0000 7f70e07d5640 1 -- 172.21.15.98:0/962526999 wait complete. 2024-09-16T00:57:14.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:14 smithi012 ceph-mon[31197]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:14 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:14 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:14 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:14 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:14 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:14 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:14 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:14 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:14 smithi098 ceph-mon[35346]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:14 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:14 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:14 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:14 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:14 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:14 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:14.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:14 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:14 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.826 DEBUG:teuthology.orchestra.run.smithi098:osd.10> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.10.service 2024-09-16T00:57:14.829 INFO:tasks.cephadm:Deploying osd.11 on smithi119 with /dev/vg_nvme/lv_1... 2024-09-16T00:57:14.829 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-16T00:57:14.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:14 smithi119 ceph-mon[35049]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:14.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:14 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:14 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:14 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:14.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:14 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:14.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:14 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:14 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:14.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:14 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:14.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:14 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:15.084 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:57:16.532 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:16 smithi119 ceph-mon[35049]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:16.654 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:16 smithi098 ceph-mon[35346]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:16.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:16 smithi012 ceph-mon[31197]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:16.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 00:57:16 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T00:57:16.652+0000 7f553ff5e640 -1 osd.10 0 log_to_monitors true 2024-09-16T00:57:17.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:17 smithi098 ceph-mon[35346]: from='osd.10 [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:57:17.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:17 smithi098 ceph-mon[35346]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:57:17.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:17 smithi119 ceph-mon[35049]: from='osd.10 [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:57:17.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:17 smithi119 ceph-mon[35049]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:57:17.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:17 smithi012 ceph-mon[31197]: from='osd.10 [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:57:17.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:17 smithi012 ceph-mon[31197]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:57:17.875 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-16T00:57:17.902 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_1 2024-09-16T00:57:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='osd.10 [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: osdmap e64: 11 total, 10 up, 11 in 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi098 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-16T00:57:18.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:18.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:18.598 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.729+0000 7f250603e640 1 -- 172.21.15.119:0/3651200868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500101c00 msgr2=0x7f2500102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:18.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.729+0000 7f250603e640 1 --2- 172.21.15.119:0/3651200868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500101c00 0x7f2500102000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009900 tx=0x7f24f002a410 comp rx=0 tx=0).stop 2024-09-16T00:57:18.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.729+0000 7f250603e640 1 -- 172.21.15.119:0/3651200868 shutdown_connections 2024-09-16T00:57:18.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.729+0000 7f250603e640 1 --2- 172.21.15.119:0/3651200868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25001037c0 0x7f250010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:18.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.729+0000 7f250603e640 1 --2- 172.21.15.119:0/3651200868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2500102e00 0x7f2500103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:18.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.729+0000 7f250603e640 1 --2- 172.21.15.119:0/3651200868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2500101c00 0x7f2500102000 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:18.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.729+0000 7f250603e640 1 -- 172.21.15.119:0/3651200868 >> 172.21.15.119:0/3651200868 conn(0x7f25000fd390 msgr2=0x7f25000ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:18.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.729+0000 7f250603e640 1 -- 172.21.15.119:0/3651200868 shutdown_connections 2024-09-16T00:57:18.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.729+0000 7f250603e640 1 -- 172.21.15.119:0/3651200868 wait complete. 2024-09-16T00:57:18.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f250603e640 1 Processor -- start 2024-09-16T00:57:18.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f250603e640 1 -- start start 2024-09-16T00:57:18.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f250603e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2500101c00 0x7f2500197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:18.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f250603e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2500102e00 0x7f2500198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:18.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f250603e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25001037c0 0x7f250019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:18.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f250603e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f250010d860 con 0x7f2500101c00 2024-09-16T00:57:18.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f250603e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f250010d6e0 con 0x7f2500102e00 2024-09-16T00:57:18.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f250603e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f250010d9e0 con 0x7f25001037c0 2024-09-16T00:57:18.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f24fffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25001037c0 0x7f250019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:18.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f24fffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25001037c0 0x7f250019f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53664/0 (socket says 172.21.15.119:53664) 2024-09-16T00:57:18.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f24fffff640 1 -- 172.21.15.119:0/84971289 learned_addr learned my addr 172.21.15.119:0/84971289 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:57:18.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f24f6ffd640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2500102e00 0x7f2500198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:18.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f24fffff640 1 -- 172.21.15.119:0/84971289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2500102e00 msgr2=0x7f2500198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:18.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.730+0000 7f24fffff640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2500102e00 0x7f2500198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:18.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.731+0000 7f24fffff640 1 -- 172.21.15.119:0/84971289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2500101c00 msgr2=0x7f2500197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:18.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.731+0000 7f24fffff640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2500101c00 0x7f2500197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:18.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.731+0000 7f24fffff640 1 -- 172.21.15.119:0/84971289 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250019fa80 con 0x7f25001037c0 2024-09-16T00:57:18.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.731+0000 7f24fffff640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25001037c0 0x7f250019f410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f24f800eaa0 tx=0x7f24f800eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:18.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.731+0000 7f24fd7fa640 1 -- 172.21.15.119:0/84971289 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8004d20 con 0x7f25001037c0 2024-09-16T00:57:18.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.731+0000 7f24fd7fa640 1 -- 172.21.15.119:0/84971289 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24f8005020 con 0x7f25001037c0 2024-09-16T00:57:18.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.731+0000 7f250603e640 1 -- 172.21.15.119:0/84971289 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250019fd70 con 0x7f25001037c0 2024-09-16T00:57:18.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.731+0000 7f24fd7fa640 1 -- 172.21.15.119:0/84971289 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f80116d0 con 0x7f25001037c0 2024-09-16T00:57:18.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.731+0000 7f250603e640 1 -- 172.21.15.119:0/84971289 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25001a0250 con 0x7f25001037c0 2024-09-16T00:57:18.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.732+0000 7f250603e640 1 -- 172.21.15.119:0/84971289 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2500108fb0 con 0x7f25001037c0 2024-09-16T00:57:18.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.733+0000 7f24fd7fa640 1 -- 172.21.15.119:0/84971289 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f24f80051d0 con 0x7f25001037c0 2024-09-16T00:57:18.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.734+0000 7f24fd7fa640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32f0 0x7f24ec0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:18.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.734+0000 7f24fd7fa640 1 -- 172.21.15.119:0/84971289 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6414+0+0 (secure 0 0 0) 0x7f24f80cf700 con 0x7f25001037c0 2024-09-16T00:57:18.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.734+0000 7f24ff7fe640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32f0 0x7f24ec0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:18.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.735+0000 7f24ff7fe640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32f0 0x7f24ec0a57b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f24f00096c0 tx=0x7f24f0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:18.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.737+0000 7f24fd7fa640 1 -- 172.21.15.119:0/84971289 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24f8016030 con 0x7f25001037c0 2024-09-16T00:57:18.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='osd.10 [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: osdmap e64: 11 total, 10 up, 11 in 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi098 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-16T00:57:18.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:18.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:18.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.886 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:18.886 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-16T00:57:18.886 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='osd.10 [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:57:18.886 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: osdmap e64: 11 total, 10 up, 11 in 2024-09-16T00:57:18.886 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi098 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:18.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:18.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:18.912+0000 7f250603e640 1 -- 172.21.15.119:0/84971289 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2500062630 con 0x7f24ec0a32f0 2024-09-16T00:57:19.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T00:57:18.885+0000 7f553bee1640 -1 osd.10 0 waiting for initial osdmap 2024-09-16T00:57:19.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 00:57:18 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T00:57:18.897+0000 7f5533d01640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:57:19.588 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:19 smithi119 ceph-mon[35049]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:57:19.588 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:19 smithi119 ceph-mon[35049]: osdmap e65: 11 total, 10 up, 11 in 2024-09-16T00:57:19.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:19 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:19.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:19 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:19.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:19 smithi119 ceph-mon[35049]: from='osd.10 ' entity='osd.10' 2024-09-16T00:57:19.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:19 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:19.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:19 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:19.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:19 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:19.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:19 smithi012 ceph-mon[31197]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:57:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:19 smithi012 ceph-mon[31197]: osdmap e65: 11 total, 10 up, 11 in 2024-09-16T00:57:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:19 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:19 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:19 smithi012 ceph-mon[31197]: from='osd.10 ' entity='osd.10' 2024-09-16T00:57:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:19 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:19 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:19.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:19 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:19 smithi098 ceph-mon[35346]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-16T00:57:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:19 smithi098 ceph-mon[35346]: osdmap e65: 11 total, 10 up, 11 in 2024-09-16T00:57:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:19 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:19 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:19 smithi098 ceph-mon[35346]: from='osd.10 ' entity='osd.10' 2024-09-16T00:57:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:19 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:19 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:19 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:20.717 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:20 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:57:20.717 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:20 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:57:20.717 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:20 smithi119 ceph-mon[35049]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:20.717 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:20 smithi119 ceph-mon[35049]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:20.717 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:20 smithi119 ceph-mon[35049]: osd.10 [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] boot 2024-09-16T00:57:20.717 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:20 smithi119 ceph-mon[35049]: osdmap e66: 11 total, 11 up, 11 in 2024-09-16T00:57:20.717 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:20 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:20.717 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:20 smithi119 ceph-mon[35049]: osdmap e67: 11 total, 11 up, 11 in 2024-09-16T00:57:20.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:20 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:57:20.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:20 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:57:20.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:20 smithi012 ceph-mon[31197]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:20.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:20 smithi012 ceph-mon[31197]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:20.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:20 smithi012 ceph-mon[31197]: osd.10 [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] boot 2024-09-16T00:57:20.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:20 smithi012 ceph-mon[31197]: osdmap e66: 11 total, 11 up, 11 in 2024-09-16T00:57:20.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:20 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:20.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:20 smithi012 ceph-mon[31197]: osdmap e67: 11 total, 11 up, 11 in 2024-09-16T00:57:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:20 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:57:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:20 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:57:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:20 smithi098 ceph-mon[35346]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:57:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:20 smithi098 ceph-mon[35346]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:20 smithi098 ceph-mon[35346]: osd.10 [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] boot 2024-09-16T00:57:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:20 smithi098 ceph-mon[35346]: osdmap e66: 11 total, 11 up, 11 in 2024-09-16T00:57:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:20 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:57:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:20 smithi098 ceph-mon[35346]: osdmap e67: 11 total, 11 up, 11 in 2024-09-16T00:57:21.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:21 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/2034166813' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "182d2b8d-ac09-47d4-8bea-716de07f7c9f"}]: dispatch 2024-09-16T00:57:21.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:21 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "182d2b8d-ac09-47d4-8bea-716de07f7c9f"}]: dispatch 2024-09-16T00:57:21.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:21 smithi119 ceph-mon[35049]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "182d2b8d-ac09-47d4-8bea-716de07f7c9f"}]': finished 2024-09-16T00:57:21.771 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:21 smithi119 ceph-mon[35049]: osdmap e68: 12 total, 11 up, 12 in 2024-09-16T00:57:21.772 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:21.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:21 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/2034166813' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "182d2b8d-ac09-47d4-8bea-716de07f7c9f"}]: dispatch 2024-09-16T00:57:21.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:21 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "182d2b8d-ac09-47d4-8bea-716de07f7c9f"}]: dispatch 2024-09-16T00:57:21.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:21 smithi012 ceph-mon[31197]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "182d2b8d-ac09-47d4-8bea-716de07f7c9f"}]': finished 2024-09-16T00:57:21.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:21 smithi012 ceph-mon[31197]: osdmap e68: 12 total, 11 up, 12 in 2024-09-16T00:57:21.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:21 smithi098 ceph-mon[35346]: from='client.? 172.21.15.119:0/2034166813' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "182d2b8d-ac09-47d4-8bea-716de07f7c9f"}]: dispatch 2024-09-16T00:57:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:21 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "182d2b8d-ac09-47d4-8bea-716de07f7c9f"}]: dispatch 2024-09-16T00:57:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:21 smithi098 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "182d2b8d-ac09-47d4-8bea-716de07f7c9f"}]': finished 2024-09-16T00:57:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:21 smithi098 ceph-mon[35346]: osdmap e68: 12 total, 11 up, 12 in 2024-09-16T00:57:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:22.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:22 smithi119 ceph-mon[35049]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:22.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:22 smithi119 ceph-mon[35049]: from='client.? 172.21.15.119:0/2960176748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:22.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:22 smithi012 ceph-mon[31197]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:22.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:22 smithi012 ceph-mon[31197]: from='client.? 172.21.15.119:0/2960176748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:22.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:22 smithi098 ceph-mon[35346]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:22.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:22 smithi098 ceph-mon[35346]: from='client.? 172.21.15.119:0/2960176748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:23.748 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:23 smithi119 ceph-mon[35049]: osdmap e69: 12 total, 11 up, 12 in 2024-09-16T00:57:23.748 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:23 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:23.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:23 smithi012 ceph-mon[31197]: osdmap e69: 12 total, 11 up, 12 in 2024-09-16T00:57:23.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:23 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:23.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:23 smithi098 ceph-mon[35346]: osdmap e69: 12 total, 11 up, 12 in 2024-09-16T00:57:23.863 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:23 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:24.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:24 smithi012 ceph-mon[31197]: pgmap v229: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T00:57:24.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:24 smithi012 ceph-mon[31197]: osdmap e70: 12 total, 11 up, 12 in 2024-09-16T00:57:24.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:24 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:24.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:24 smithi119 ceph-mon[35049]: pgmap v229: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T00:57:24.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:24 smithi119 ceph-mon[35049]: osdmap e70: 12 total, 11 up, 12 in 2024-09-16T00:57:24.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:24 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:24.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:24 smithi098 ceph-mon[35346]: pgmap v229: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T00:57:24.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:24 smithi098 ceph-mon[35346]: osdmap e70: 12 total, 11 up, 12 in 2024-09-16T00:57:24.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:24 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:26.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:26 smithi119 ceph-mon[35049]: pgmap v231: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-16T00:57:26.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:26 smithi012 ceph-mon[31197]: pgmap v231: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-16T00:57:26.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:26 smithi098 ceph-mon[35346]: pgmap v231: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-16T00:57:28.670 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:28 smithi119 ceph-mon[35049]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:57:28.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:28 smithi012 ceph-mon[31197]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:57:28.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:28 smithi098 ceph-mon[35346]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:57:30.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:30 smithi119 ceph-mon[35049]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-16T00:57:30.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-16T00:57:30.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:30.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:30 smithi012 ceph-mon[31197]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-16T00:57:30.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-16T00:57:30.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:30 smithi098 ceph-mon[35346]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-16T00:57:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-16T00:57:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:31.712 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:31 smithi119 ceph-mon[35049]: Deploying daemon osd.11 on smithi119 2024-09-16T00:57:31.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:31 smithi012 ceph-mon[31197]: Deploying daemon osd.11 on smithi119 2024-09-16T00:57:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:31 smithi098 ceph-mon[35346]: Deploying daemon osd.11 on smithi119 2024-09-16T00:57:32.786 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:32 smithi119 ceph-mon[35049]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:32.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:32 smithi012 ceph-mon[31197]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:32.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:32 smithi098 ceph-mon[35346]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:34.740 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:34 smithi119 ceph-mon[35049]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:34.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:34 smithi012 ceph-mon[31197]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:34.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:34 smithi098 ceph-mon[35346]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:36.839 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:36 smithi119 ceph-mon[35049]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:36.840 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:36.840 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:36.840 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:36.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:36 smithi012 ceph-mon[31197]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:36.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:36.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:36.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:36 smithi098 ceph-mon[35346]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:38.773 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:38 smithi119 ceph-mon[35049]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:38.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:38 smithi012 ceph-mon[31197]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:38 smithi098 ceph-mon[35346]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:39.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.744+0000 7f24fd7fa640 1 -- 172.21.15.119:0/84971289 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2500062630 con 0x7f24ec0a32f0 2024-09-16T00:57:39.745 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 11 on host 'smithi119' 2024-09-16T00:57:39.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 -- 172.21.15.119:0/84971289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32f0 msgr2=0x7f24ec0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:39.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32f0 0x7f24ec0a57b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f24f00096c0 tx=0x7f24f0031400 comp rx=0 tx=0).stop 2024-09-16T00:57:39.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 -- 172.21.15.119:0/84971289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25001037c0 msgr2=0x7f250019f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:39.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25001037c0 0x7f250019f410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f24f800eaa0 tx=0x7f24f800eea0 comp rx=0 tx=0).stop 2024-09-16T00:57:39.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 -- 172.21.15.119:0/84971289 shutdown_connections 2024-09-16T00:57:39.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32f0 0x7f24ec0a57b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:39.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25001037c0 0x7f250019f410 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:39.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2500102e00 0x7f2500198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:39.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 --2- 172.21.15.119:0/84971289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2500101c00 0x7f2500197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:39.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 -- 172.21.15.119:0/84971289 >> 172.21.15.119:0/84971289 conn(0x7f25000fd390 msgr2=0x7f2500106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:39.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 -- 172.21.15.119:0/84971289 shutdown_connections 2024-09-16T00:57:39.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:39.746+0000 7f250603e640 1 -- 172.21.15.119:0/84971289 wait complete. 2024-09-16T00:57:40.498 DEBUG:teuthology.orchestra.run.smithi119:osd.11> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.11.service 2024-09-16T00:57:40.500 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-16T00:57:40.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T00:57:40.740 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:40 smithi119 ceph-mon[35049]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:40.740 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:40.740 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:40.740 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:40.740 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:57:40.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:40 smithi012 ceph-mon[31197]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:40.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:40.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:40.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:40.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:40 smithi098 ceph-mon[35346]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:41.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:41.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.253+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/1257610541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f881078c0 msgr2=0x7f6f88109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.253+0000 7f6f8dfc8640 1 --2- 172.21.15.12:0/1257610541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f881078c0 0x7f6f88109d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009ca0 tx=0x7f6f8002a8c0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.253+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/1257610541 shutdown_connections 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.253+0000 7f6f8dfc8640 1 --2- 172.21.15.12:0/1257610541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f881078c0 0x7f6f88109d10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.253+0000 7f6f8dfc8640 1 --2- 172.21.15.12:0/1257610541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f88104f90 0x7f6f88107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.253+0000 7f6f8dfc8640 1 --2- 172.21.15.12:0/1257610541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f88102660 0x7f6f88104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.253+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/1257610541 >> 172.21.15.12:0/1257610541 conn(0x7f6f880fc280 msgr2=0x7f6f880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.253+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/1257610541 shutdown_connections 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.253+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/1257610541 wait complete. 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f8dfc8640 1 Processor -- start 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f8dfc8640 1 -- start start 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f8dfc8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f88102660 0x7f6f88197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:41.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f8dfc8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f88104f90 0x7f6f88198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f8dfc8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f881078c0 0x7f6f8819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f8dfc8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8810d880 con 0x7f6f88104f90 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f8dfc8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8810d700 con 0x7f6f88102660 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f8dfc8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8810da00 con 0x7f6f881078c0 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f86ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f88104f90 0x7f6f88198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f86ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f88104f90 0x7f6f88198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52708/0 (socket says 172.21.15.12:52708) 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.254+0000 7f6f86ffd640 1 -- 172.21.15.12:0/3161357547 learned_addr learned my addr 172.21.15.12:0/3161357547 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f87fff640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f881078c0 0x7f6f8819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f877fe640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f88102660 0x7f6f88197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f86ffd640 1 -- 172.21.15.12:0/3161357547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f881078c0 msgr2=0x7f6f8819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f86ffd640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f881078c0 0x7f6f8819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f86ffd640 1 -- 172.21.15.12:0/3161357547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f88102660 msgr2=0x7f6f88197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f86ffd640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f88102660 0x7f6f88197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f86ffd640 1 -- 172.21.15.12:0/3161357547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8819fb10 con 0x7f6f88104f90 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f86ffd640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f88104f90 0x7f6f88198420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00e9f0 tx=0x7f6f7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f84ff9640 1 -- 172.21.15.12:0/3161357547 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c00ccc0 con 0x7f6f88104f90 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/3161357547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8819fe00 con 0x7f6f88104f90 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f84ff9640 1 -- 172.21.15.12:0/3161357547 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f7c005500 con 0x7f6f88104f90 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f84ff9640 1 -- 172.21.15.12:0/3161357547 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c010690 con 0x7f6f88104f90 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.255+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/3161357547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f881a0260 con 0x7f6f88104f90 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.256+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/3161357547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f880fdd70 con 0x7f6f88104f90 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.257+0000 7f6f84ff9640 1 -- 172.21.15.12:0/3161357547 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6f7c0046c0 con 0x7f6f88104f90 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.258+0000 7f6f84ff9640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6f700a3270 0x7f6f700a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.258+0000 7f6f877fe640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6f700a3270 0x7f6f700a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.258+0000 7f6f84ff9640 1 -- 172.21.15.12:0/3161357547 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6809+0+0 (secure 0 0 0) 0x7f6f7c0cf6e0 con 0x7f6f88104f90 2024-09-16T00:57:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.259+0000 7f6f877fe640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6f700a3270 0x7f6f700a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f78005fd0 tx=0x7f6f78005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:41.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.262+0000 7f6f84ff9640 1 -- 172.21.15.12:0/3161357547 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f7c09c9e0 con 0x7f6f88104f90 2024-09-16T00:57:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.438+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/3161357547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6f8802d970 con 0x7f6f88104f90 2024-09-16T00:57:41.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.439+0000 7f6f84ff9640 1 -- 172.21.15.12:0/3161357547 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f6f7c09c2e0 con 0x7f6f88104f90 2024-09-16T00:57:41.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:57:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/3161357547 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6f700a3270 msgr2=0x7f6f700a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6f700a3270 0x7f6f700a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f78005fd0 tx=0x7f6f78005850 comp rx=0 tx=0).stop 2024-09-16T00:57:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/3161357547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f88104f90 msgr2=0x7f6f88198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f88104f90 0x7f6f88198420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00e9f0 tx=0x7f6f7c00eeb0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/3161357547 shutdown_connections 2024-09-16T00:57:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6f700a3270 0x7f6f700a5730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f881078c0 0x7f6f8819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f88104f90 0x7f6f88198420 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 --2- 172.21.15.12:0/3161357547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f88102660 0x7f6f88197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:41.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/3161357547 >> 172.21.15.12:0/3161357547 conn(0x7f6f880fc280 msgr2=0x7f6f88102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:41.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.441+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/3161357547 shutdown_connections 2024-09-16T00:57:41.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:41.442+0000 7f6f8dfc8640 1 -- 172.21.15.12:0/3161357547 wait complete. 2024-09-16T00:57:42.051 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:41 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3161357547' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:57:42.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:41 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3161357547' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:57:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:41 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3161357547' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:57:42.227 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726448239,"num_in_osds":12,"osd_in_since":1726448241,"num_remapped_pgs":0} 2024-09-16T00:57:42.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 00:57:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T00:57:42.258+0000 7fb378f2f640 -1 osd.11 0 log_to_monitors true 2024-09-16T00:57:43.077 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:42 smithi119 ceph-mon[35049]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:43.077 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:42 smithi119 ceph-mon[35049]: from='osd.11 [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:57:43.078 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:42 smithi119 ceph-mon[35049]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:57:43.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:42 smithi012 ceph-mon[31197]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:43.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:42 smithi012 ceph-mon[31197]: from='osd.11 [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:57:43.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:42 smithi012 ceph-mon[31197]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:57:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:42 smithi098 ceph-mon[35346]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:42 smithi098 ceph-mon[35346]: from='osd.11 [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:57:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:42 smithi098 ceph-mon[35346]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:57:43.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T00:57:43.498 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:57:43.887 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:43 smithi012 ceph-mon[31197]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-16T00:57:43.887 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:43 smithi012 ceph-mon[31197]: osdmap e71: 12 total, 11 up, 12 in 2024-09-16T00:57:43.887 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:43.888 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:43 smithi012 ceph-mon[31197]: from='osd.11 [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:57:43.888 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:43 smithi012 ceph-mon[31197]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:57:44.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.971+0000 7f09ba75d640 1 -- 172.21.15.12:0/1906957188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b4107900 msgr2=0x7f09b4109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:44.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.971+0000 7f09ba75d640 1 --2- 172.21.15.12:0/1906957188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b4107900 0x7f09b4109d50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009ca0 tx=0x7f09ac02a8c0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.971+0000 7f09ba75d640 1 -- 172.21.15.12:0/1906957188 shutdown_connections 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.971+0000 7f09ba75d640 1 --2- 172.21.15.12:0/1906957188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b4107900 0x7f09b4109d50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.971+0000 7f09ba75d640 1 --2- 172.21.15.12:0/1906957188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b4104fd0 0x7f09b41073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.971+0000 7f09ba75d640 1 --2- 172.21.15.12:0/1906957188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b41026a0 0x7f09b4104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.971+0000 7f09ba75d640 1 -- 172.21.15.12:0/1906957188 >> 172.21.15.12:0/1906957188 conn(0x7f09b40fc2a0 msgr2=0x7f09b40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.971+0000 7f09ba75d640 1 -- 172.21.15.12:0/1906957188 shutdown_connections 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.971+0000 7f09ba75d640 1 -- 172.21.15.12:0/1906957188 wait complete. 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09ba75d640 1 Processor -- start 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09ba75d640 1 -- start start 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09ba75d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b41026a0 0x7f09b419a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09ba75d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b4104fd0 0x7f09b419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09ba75d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b4107900 0x7f09b41a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:44.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09ba75d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09b410d8e0 con 0x7f09b4104fd0 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09ba75d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f09b410d760 con 0x7f09b41026a0 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09ba75d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09b410da60 con 0x7f09b4107900 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b4104fd0 0x7f09b419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09b8cfa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b4107900 0x7f09b41a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09b3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b41026a0 0x7f09b419a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09b8cfa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b4107900 0x7f09b41a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:46342/0 (socket says 172.21.15.12:46342) 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b4104fd0 0x7f09b419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52732/0 (socket says 172.21.15.12:52732) 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.972+0000 7f09b8cfa640 1 -- 172.21.15.12:0/3789552662 learned_addr learned my addr 172.21.15.12:0/3789552662 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09b8cfa640 1 -- 172.21.15.12:0/3789552662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b41026a0 msgr2=0x7f09b419a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09b8cfa640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b41026a0 0x7f09b419a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09b8cfa640 1 -- 172.21.15.12:0/3789552662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b4104fd0 msgr2=0x7f09b419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09b8cfa640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b4104fd0 0x7f09b419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09b8cfa640 1 -- 172.21.15.12:0/3789552662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b41a1d60 con 0x7f09b4107900 2024-09-16T00:57:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09b37fe640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b4104fd0 0x7f09b419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09b8cfa640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b4107900 0x7f09b41a16f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09ac031ae0 tx=0x7f09ac031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09b17fa640 1 -- 172.21.15.12:0/3789552662 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac003c30 con 0x7f09b4107900 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09b17fa640 1 -- 172.21.15.12:0/3789552662 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09ac003dd0 con 0x7f09b4107900 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09ba75d640 1 -- 172.21.15.12:0/3789552662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b41a1ff0 con 0x7f09b4107900 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09b17fa640 1 -- 172.21.15.12:0/3789552662 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac02fcb0 con 0x7f09b4107900 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.973+0000 7f09ba75d640 1 -- 172.21.15.12:0/3789552662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b41a24a0 con 0x7f09b4107900 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.974+0000 7f09ba75d640 1 -- 172.21.15.12:0/3789552662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b41093f0 con 0x7f09b4107900 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.976+0000 7f09b17fa640 1 -- 172.21.15.12:0/3789552662 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f09ac004050 con 0x7f09b4107900 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.976+0000 7f09b17fa640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3270 0x7f099c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.976+0000 7f09b3fff640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3270 0x7f099c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.977+0000 7f09b17fa640 1 -- 172.21.15.12:0/3789552662 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6847+0+0 (secure 0 0 0) 0x7f09ac0f0850 con 0x7f09b4107900 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.977+0000 7f09b3fff640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3270 0x7f099c0a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f09a4009bd0 tx=0x7f09a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:44.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:43.983+0000 7f09b17fa640 1 -- 172.21.15.12:0/3789552662 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09ac0bda90 con 0x7f09b4107900 2024-09-16T00:57:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:43 smithi119 ceph-mon[35049]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-16T00:57:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:43 smithi119 ceph-mon[35049]: osdmap e71: 12 total, 11 up, 12 in 2024-09-16T00:57:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:43 smithi119 ceph-mon[35049]: from='osd.11 [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:57:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:43 smithi119 ceph-mon[35049]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:57:44.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.160+0000 7f09ba75d640 1 -- 172.21.15.12:0/3789552662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f09b402da10 con 0x7f09b4107900 2024-09-16T00:57:44.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.160+0000 7f09b17fa640 1 -- 172.21.15.12:0/3789552662 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f09ac0bd390 con 0x7f09b4107900 2024-09-16T00:57:44.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:57:44.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 -- 172.21.15.12:0/3789552662 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3270 msgr2=0x7f099c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:44.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3270 0x7f099c0a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f09a4009bd0 tx=0x7f09a4005f90 comp rx=0 tx=0).stop 2024-09-16T00:57:44.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 -- 172.21.15.12:0/3789552662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b4107900 msgr2=0x7f09b41a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:44.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b4107900 0x7f09b41a16f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09ac031ae0 tx=0x7f09ac031ee0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 -- 172.21.15.12:0/3789552662 shutdown_connections 2024-09-16T00:57:44.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3270 0x7f099c0a5730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b4107900 0x7f09b41a16f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b4104fd0 0x7f09b419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 --2- 172.21.15.12:0/3789552662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b41026a0 0x7f09b419a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:44.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 -- 172.21.15.12:0/3789552662 >> 172.21.15.12:0/3789552662 conn(0x7f09b40fc2a0 msgr2=0x7f09b4101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:44.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 -- 172.21.15.12:0/3789552662 shutdown_connections 2024-09-16T00:57:44.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:44.163+0000 7f09ba75d640 1 -- 172.21.15.12:0/3789552662 wait complete. 2024-09-16T00:57:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:43 smithi098 ceph-mon[35346]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-16T00:57:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:43 smithi098 ceph-mon[35346]: osdmap e71: 12 total, 11 up, 12 in 2024-09-16T00:57:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:43 smithi098 ceph-mon[35346]: from='osd.11 [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:57:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:43 smithi098 ceph-mon[35346]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-16T00:57:44.596 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T00:57:44.164+0000 7fb374eb2640 -1 osd.11 0 waiting for initial osdmap 2024-09-16T00:57:44.596 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T00:57:44.178+0000 7fb36ccd2640 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: osdmap e72: 12 total, 11 up, 12 in 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: Detected new or changed devices on smithi119 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:44.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3789552662' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:57:44.827 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:44 smithi012 ceph-mon[31197]: from='osd.11 ' entity='osd.11' 2024-09-16T00:57:44.853 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726448239,"num_in_osds":12,"osd_in_since":1726448241,"num_remapped_pgs":0} 2024-09-16T00:57:45.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:45.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: osdmap e72: 12 total, 11 up, 12 in 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: Detected new or changed devices on smithi119 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:45.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:45.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:45.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:45.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:45.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:45.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3789552662' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:57:45.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:44 smithi119 ceph-mon[35049]: from='osd.11 ' entity='osd.11' 2024-09-16T00:57:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-16T00:57:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: osdmap e72: 12 total, 11 up, 12 in 2024-09-16T00:57:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: Detected new or changed devices on smithi119 2024-09-16T00:57:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:45.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:45.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:45.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-16T00:57:45.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:45.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:45.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:45.215 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:45.215 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:45.215 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:45.215 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:45.215 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:45.215 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3789552662' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:57:45.215 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:44 smithi098 ceph-mon[35346]: from='osd.11 ' entity='osd.11' 2024-09-16T00:57:45.854 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T00:57:46.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:45 smithi119 ceph-mon[35049]: purged_snaps scrub starts 2024-09-16T00:57:46.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:45 smithi119 ceph-mon[35049]: purged_snaps scrub ok 2024-09-16T00:57:46.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:46.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:45 smithi119 ceph-mon[35049]: osd.11 [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] boot 2024-09-16T00:57:46.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:45 smithi119 ceph-mon[35049]: osdmap e73: 12 total, 12 up, 12 in 2024-09-16T00:57:46.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:46.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:45 smithi012 ceph-mon[31197]: purged_snaps scrub starts 2024-09-16T00:57:46.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:45 smithi012 ceph-mon[31197]: purged_snaps scrub ok 2024-09-16T00:57:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:45 smithi012 ceph-mon[31197]: osd.11 [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] boot 2024-09-16T00:57:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:45 smithi012 ceph-mon[31197]: osdmap e73: 12 total, 12 up, 12 in 2024-09-16T00:57:46.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:57:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:45 smithi098 ceph-mon[35346]: purged_snaps scrub starts 2024-09-16T00:57:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:45 smithi098 ceph-mon[35346]: purged_snaps scrub ok 2024-09-16T00:57:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:45 smithi098 ceph-mon[35346]: osd.11 [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] boot 2024-09-16T00:57:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:45 smithi098 ceph-mon[35346]: osdmap e73: 12 total, 12 up, 12 in 2024-09-16T00:57:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:57:46.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.578+0000 7f33567cd640 1 -- 172.21.15.12:0/871835346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3350101d10 msgr2=0x7f3350102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:46.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.578+0000 7f33567cd640 1 --2- 172.21.15.12:0/871835346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3350101d10 0x7f3350102190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3344009900 tx=0x7f334402a410 comp rx=0 tx=0).stop 2024-09-16T00:57:46.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.578+0000 7f33567cd640 1 -- 172.21.15.12:0/871835346 shutdown_connections 2024-09-16T00:57:46.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.578+0000 7f33567cd640 1 --2- 172.21.15.12:0/871835346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33501026d0 0x7f3350108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:46.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.578+0000 7f33567cd640 1 --2- 172.21.15.12:0/871835346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3350101d10 0x7f3350102190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:46.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.578+0000 7f33567cd640 1 --2- 172.21.15.12:0/871835346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3350100b10 0x7f3350100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.578+0000 7f33567cd640 1 -- 172.21.15.12:0/871835346 >> 172.21.15.12:0/871835346 conn(0x7f33500fc2a0 msgr2=0x7f33500fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.578+0000 7f33567cd640 1 -- 172.21.15.12:0/871835346 shutdown_connections 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.578+0000 7f33567cd640 1 -- 172.21.15.12:0/871835346 wait complete. 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.578+0000 7f33567cd640 1 Processor -- start 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f33567cd640 1 -- start start 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f33567cd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3350100b10 0x7f33501980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f33567cd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3350101d10 0x7f3350198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f33567cd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33501026d0 0x7f335019f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f33567cd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f335010c890 con 0x7f3350100b10 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f33567cd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f335010c710 con 0x7f3350101d10 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f33567cd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f335010ca10 con 0x7f33501026d0 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f334ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3350100b10 0x7f33501980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f334ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3350100b10 0x7f33501980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47958/0 (socket says 172.21.15.12:47958) 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f334ffff640 1 -- 172.21.15.12:0/2368387797 learned_addr learned my addr 172.21.15.12:0/2368387797 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f334ffff640 1 -- 172.21.15.12:0/2368387797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33501026d0 msgr2=0x7f335019f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f334ffff640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33501026d0 0x7f335019f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f334ffff640 1 -- 172.21.15.12:0/2368387797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3350101d10 msgr2=0x7f3350198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f334ffff640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3350101d10 0x7f3350198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f334ffff640 1 -- 172.21.15.12:0/2368387797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335019fcf0 con 0x7f3350100b10 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.579+0000 7f334ffff640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3350100b10 0x7f33501980c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f334000b450 tx=0x7f334000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.580+0000 7f334d7fa640 1 -- 172.21.15.12:0/2368387797 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340015020 con 0x7f3350100b10 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.580+0000 7f334d7fa640 1 -- 172.21.15.12:0/2368387797 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3340011d70 con 0x7f3350100b10 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.580+0000 7f33567cd640 1 -- 172.21.15.12:0/2368387797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335019ffe0 con 0x7f3350100b10 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.580+0000 7f334d7fa640 1 -- 172.21.15.12:0/2368387797 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334000f340 con 0x7f3350100b10 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.580+0000 7f33567cd640 1 -- 172.21.15.12:0/2368387797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33501a04c0 con 0x7f3350100b10 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.581+0000 7f33567cd640 1 -- 172.21.15.12:0/2368387797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33501a0780 con 0x7f3350100b10 2024-09-16T00:57:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.582+0000 7f334d7fa640 1 -- 172.21.15.12:0/2368387797 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3340018020 con 0x7f3350100b10 2024-09-16T00:57:46.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.583+0000 7f334d7fa640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33380a3270 0x7f33380a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:46.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.583+0000 7f334f7fe640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33380a3270 0x7f33380a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:46.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.583+0000 7f334d7fa640 1 -- 172.21.15.12:0/2368387797 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f33400cf070 con 0x7f3350100b10 2024-09-16T00:57:46.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.583+0000 7f334f7fe640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33380a3270 0x7f33380a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f33440096c0 tx=0x7f3344031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:46.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.587+0000 7f334d7fa640 1 -- 172.21.15.12:0/2368387797 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f334001f020 con 0x7f3350100b10 2024-09-16T00:57:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.761+0000 7f33567cd640 1 -- 172.21.15.12:0/2368387797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f33501a0950 con 0x7f3350100b10 2024-09-16T00:57:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.762+0000 7f334d7fa640 1 -- 172.21.15.12:0/2368387797 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f334000d040 con 0x7f3350100b10 2024-09-16T00:57:46.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:57:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 -- 172.21.15.12:0/2368387797 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33380a3270 msgr2=0x7f33380a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33380a3270 0x7f33380a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f33440096c0 tx=0x7f3344031400 comp rx=0 tx=0).stop 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 -- 172.21.15.12:0/2368387797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3350100b10 msgr2=0x7f33501980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3350100b10 0x7f33501980c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f334000b450 tx=0x7f334000b910 comp rx=0 tx=0).stop 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 -- 172.21.15.12:0/2368387797 shutdown_connections 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33380a3270 0x7f33380a5730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33501026d0 0x7f335019f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3350101d10 0x7f3350198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 --2- 172.21.15.12:0/2368387797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3350100b10 0x7f33501980c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 -- 172.21.15.12:0/2368387797 >> 172.21.15.12:0/2368387797 conn(0x7f33500fc2a0 msgr2=0x7f335006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 -- 172.21.15.12:0/2368387797 shutdown_connections 2024-09-16T00:57:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:46.765+0000 7f33567cd640 1 -- 172.21.15.12:0/2368387797 wait complete. 2024-09-16T00:57:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:46 smithi119 ceph-mon[35049]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:46 smithi119 ceph-mon[35049]: osdmap e74: 12 total, 12 up, 12 in 2024-09-16T00:57:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:46 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2368387797' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:57:47.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:46 smithi012 ceph-mon[31197]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:47.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:46 smithi012 ceph-mon[31197]: osdmap e74: 12 total, 12 up, 12 in 2024-09-16T00:57:47.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:46 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2368387797' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:57:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:46 smithi098 ceph-mon[35346]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:57:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:46 smithi098 ceph-mon[35346]: osdmap e74: 12 total, 12 up, 12 in 2024-09-16T00:57:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:46 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2368387797' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:57:47.389 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1726448265,"num_in_osds":12,"osd_in_since":1726448241,"num_remapped_pgs":0} 2024-09-16T00:57:47.389 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:57:47.644 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:57:48.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.119+0000 7fe824d8d640 1 -- 172.21.15.12:0/3177059704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe820101de0 msgr2=0x7fe8201021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:48.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.119+0000 7fe824d8d640 1 --2- 172.21.15.12:0/3177059704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe820101de0 0x7fe8201021c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe810009900 tx=0x7fe81002a410 comp rx=0 tx=0).stop 2024-09-16T00:57:48.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.119+0000 7fe824d8d640 1 -- 172.21.15.12:0/3177059704 shutdown_connections 2024-09-16T00:57:48.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.119+0000 7fe824d8d640 1 --2- 172.21.15.12:0/3177059704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe820106f10 0x7fe82010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:48.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.119+0000 7fe824d8d640 1 --2- 172.21.15.12:0/3177059704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820102790 0x7fe8201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:48.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.119+0000 7fe824d8d640 1 --2- 172.21.15.12:0/3177059704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe820101de0 0x7fe8201021c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.119+0000 7fe824d8d640 1 -- 172.21.15.12:0/3177059704 >> 172.21.15.12:0/3177059704 conn(0x7fe8200fd8c0 msgr2=0x7fe8200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.120+0000 7fe824d8d640 1 -- 172.21.15.12:0/3177059704 shutdown_connections 2024-09-16T00:57:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.120+0000 7fe824d8d640 1 -- 172.21.15.12:0/3177059704 wait complete. 2024-09-16T00:57:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.120+0000 7fe824d8d640 1 Processor -- start 2024-09-16T00:57:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.120+0000 7fe824d8d640 1 -- start start 2024-09-16T00:57:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe824d8d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe820101de0 0x7fe820198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe824d8d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820102790 0x7fe8201988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe824d8d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe820106f10 0x7fe82019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe824d8d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe820111f30 con 0x7fe820106f10 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe824d8d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe820111db0 con 0x7fe820101de0 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe824d8d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8201120b0 con 0x7fe820102790 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe81ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe820106f10 0x7fe82019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe81ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe820106f10 0x7fe82019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47984/0 (socket says 172.21.15.12:47984) 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe81e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe820101de0 0x7fe820198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe81ed9d640 1 -- 172.21.15.12:0/3640634158 learned_addr learned my addr 172.21.15.12:0/3640634158 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe817fff640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820102790 0x7fe8201988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe81ed9d640 1 -- 172.21.15.12:0/3640634158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820102790 msgr2=0x7fe8201988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe81ed9d640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820102790 0x7fe8201988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe81ed9d640 1 -- 172.21.15.12:0/3640634158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe820101de0 msgr2=0x7fe820198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe81ed9d640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe820101de0 0x7fe820198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe81ed9d640 1 -- 172.21.15.12:0/3640634158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82019d340 con 0x7fe820106f10 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe81ed9d640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe820106f10 0x7fe82019cc60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe81800eaa0 tx=0x7fe81800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe8177fe640 1 -- 172.21.15.12:0/3640634158 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81800cdb0 con 0x7fe820106f10 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe824d8d640 1 -- 172.21.15.12:0/3640634158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82019d630 con 0x7fe820106f10 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe8177fe640 1 -- 172.21.15.12:0/3640634158 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe818005020 con 0x7fe820106f10 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe8177fe640 1 -- 172.21.15.12:0/3640634158 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8180116b0 con 0x7fe820106f10 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.121+0000 7fe824d8d640 1 -- 172.21.15.12:0/3640634158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8201a4f10 con 0x7fe820106f10 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.122+0000 7fe824d8d640 1 -- 172.21.15.12:0/3640634158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8201021c0 con 0x7fe820106f10 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.124+0000 7fe8177fe640 1 -- 172.21.15.12:0/3640634158 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe818005560 con 0x7fe820106f10 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.124+0000 7fe8177fe640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe80c0a3240 0x7fe80c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.124+0000 7fe81e59c640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe80c0a3240 0x7fe80c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.124+0000 7fe8177fe640 1 -- 172.21.15.12:0/3640634158 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fe8180cfa10 con 0x7fe820106f10 2024-09-16T00:57:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.125+0000 7fe81e59c640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe80c0a3240 0x7fe80c0a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe810009230 tx=0x7fe8100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.127+0000 7fe8177fe640 1 -- 172.21.15.12:0/3640634158 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe818016030 con 0x7fe820106f10 2024-09-16T00:57:48.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.303+0000 7fe824d8d640 1 -- 172.21.15.12:0/3640634158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8201996f0 con 0x7fe820106f10 2024-09-16T00:57:48.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.304+0000 7fe8177fe640 1 -- 172.21.15.12:0/3640634158 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18445 (secure 0 0 0) 0x7fe8201996f0 con 0x7fe820106f10 2024-09-16T00:57:48.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:57:48.306 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T00:57:46.172031+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:57:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 -- 172.21.15.12:0/3640634158 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe80c0a3240 msgr2=0x7fe80c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe80c0a3240 0x7fe80c0a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe810009230 tx=0x7fe8100058d0 comp rx=0 tx=0).stop 2024-09-16T00:57:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 -- 172.21.15.12:0/3640634158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe820106f10 msgr2=0x7fe82019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe820106f10 0x7fe82019cc60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe81800eaa0 tx=0x7fe81800ef60 comp rx=0 tx=0).stop 2024-09-16T00:57:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 -- 172.21.15.12:0/3640634158 shutdown_connections 2024-09-16T00:57:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe80c0a3240 0x7fe80c0a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe820106f10 0x7fe82019cc60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe820102790 0x7fe8201988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 --2- 172.21.15.12:0/3640634158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe820101de0 0x7fe820198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 -- 172.21.15.12:0/3640634158 >> 172.21.15.12:0/3640634158 conn(0x7fe8200fd8c0 msgr2=0x7fe8200fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 -- 172.21.15.12:0/3640634158 shutdown_connections 2024-09-16T00:57:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:48.307+0000 7fe824d8d640 1 -- 172.21.15.12:0/3640634158 wait complete. 2024-09-16T00:57:49.053 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:48 smithi012 ceph-mon[31197]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:49.053 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:48 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3640634158' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:57:49.084 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T00:53:57.343965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T00:57:49.085 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-16T00:57:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:48 smithi119 ceph-mon[35049]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:48 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3640634158' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:57:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:48 smithi098 ceph-mon[35346]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:48 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3640634158' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:57:49.340 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:57:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 -- 172.21.15.12:0/2943324985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614101de0 msgr2=0x7fe6141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 --2- 172.21.15.12:0/2943324985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614101de0 0x7fe6141021c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe604009900 tx=0x7fe60402a410 comp rx=0 tx=0).stop 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 -- 172.21.15.12:0/2943324985 shutdown_connections 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 --2- 172.21.15.12:0/2943324985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe614106f10 0x7fe61410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 --2- 172.21.15.12:0/2943324985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe614102790 0x7fe6141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 --2- 172.21.15.12:0/2943324985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614101de0 0x7fe6141021c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 -- 172.21.15.12:0/2943324985 >> 172.21.15.12:0/2943324985 conn(0x7fe6140fd8c0 msgr2=0x7fe6140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 -- 172.21.15.12:0/2943324985 shutdown_connections 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 -- 172.21.15.12:0/2943324985 wait complete. 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 Processor -- start 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.800+0000 7fe61a32b640 1 -- start start 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe61a32b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614101de0 0x7fe6140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe61a32b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe614102790 0x7fe614074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe61a32b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe614106f10 0x7fe614074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe61a32b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe614111f70 con 0x7fe614101de0 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe61a32b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe614111df0 con 0x7fe614102790 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe61a32b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe6141120f0 con 0x7fe614106f10 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe613fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614101de0 0x7fe6140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe613fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614101de0 0x7fe6140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48000/0 (socket says 172.21.15.12:48000) 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe613fff640 1 -- 172.21.15.12:0/2848377398 learned_addr learned my addr 172.21.15.12:0/2848377398 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe60bfff640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe614102790 0x7fe614074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe6188c8640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe614106f10 0x7fe614074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe613fff640 1 -- 172.21.15.12:0/2848377398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe614106f10 msgr2=0x7fe614074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe613fff640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe614106f10 0x7fe614074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe613fff640 1 -- 172.21.15.12:0/2848377398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe614102790 msgr2=0x7fe614074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe613fff640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe614102790 0x7fe614074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe613fff640 1 -- 172.21.15.12:0/2848377398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6141a6830 con 0x7fe614101de0 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe6188c8640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe614106f10 0x7fe614074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.801+0000 7fe613fff640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614101de0 0x7fe6140744f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe604006010 tx=0x7fe6040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.802+0000 7fe611ffb640 1 -- 172.21.15.12:0/2848377398 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60403f030 con 0x7fe614101de0 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.802+0000 7fe611ffb640 1 -- 172.21.15.12:0/2848377398 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe604003ce0 con 0x7fe614101de0 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.802+0000 7fe61a32b640 1 -- 172.21.15.12:0/2848377398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6141a6ac0 con 0x7fe614101de0 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.802+0000 7fe611ffb640 1 -- 172.21.15.12:0/2848377398 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604035070 con 0x7fe614101de0 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.802+0000 7fe61a32b640 1 -- 172.21.15.12:0/2848377398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6141a6fa0 con 0x7fe614101de0 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.803+0000 7fe61a32b640 1 -- 172.21.15.12:0/2848377398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6141021c0 con 0x7fe614101de0 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.804+0000 7fe611ffb640 1 -- 172.21.15.12:0/2848377398 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe604042030 con 0x7fe614101de0 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.804+0000 7fe611ffb640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe6000a3240 0x7fe6000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.805+0000 7fe60bfff640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe6000a3240 0x7fe6000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.805+0000 7fe611ffb640 1 -- 172.21.15.12:0/2848377398 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fe6040ef8e0 con 0x7fe614101de0 2024-09-16T00:57:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.805+0000 7fe60bfff640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe6000a3240 0x7fe6000a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe614075f80 tx=0x7fe5fc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.809+0000 7fe611ffb640 1 -- 172.21.15.12:0/2848377398 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6040bcaa0 con 0x7fe614101de0 2024-09-16T00:57:49.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.983+0000 7fe61a32b640 1 -- 172.21.15.12:0/2848377398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe614109b60 con 0x7fe614101de0 2024-09-16T00:57:49.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.983+0000 7fe611ffb640 1 -- 172.21.15.12:0/2848377398 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7fe6040bc3a0 con 0x7fe614101de0 2024-09-16T00:57:49.984 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-16T00:57:49.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 -- 172.21.15.12:0/2848377398 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe6000a3240 msgr2=0x7fe6000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:49.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe6000a3240 0x7fe6000a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe614075f80 tx=0x7fe5fc00a2d0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 -- 172.21.15.12:0/2848377398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614101de0 msgr2=0x7fe6140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:49.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614101de0 0x7fe6140744f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe604006010 tx=0x7fe6040042f0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 -- 172.21.15.12:0/2848377398 shutdown_connections 2024-09-16T00:57:49.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe6000a3240 0x7fe6000a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe614106f10 0x7fe614074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe614102790 0x7fe614074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 --2- 172.21.15.12:0/2848377398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614101de0 0x7fe6140744f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:49.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 -- 172.21.15.12:0/2848377398 >> 172.21.15.12:0/2848377398 conn(0x7fe6140fd8c0 msgr2=0x7fe6140fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:49.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 -- 172.21.15.12:0/2848377398 shutdown_connections 2024-09-16T00:57:49.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:49.986+0000 7fe61a32b640 1 -- 172.21.15.12:0/2848377398 wait complete. 2024-09-16T00:57:50.866 INFO:tasks.cephadm:Adding mds.a on smithi012 2024-09-16T00:57:50.866 INFO:tasks.cephadm:Adding mds.d on smithi012 2024-09-16T00:57:50.866 INFO:tasks.cephadm:Adding mds.g on smithi012 2024-09-16T00:57:50.866 INFO:tasks.cephadm:Adding mds.j on smithi012 2024-09-16T00:57:50.867 INFO:tasks.cephadm:Adding mds.b on smithi098 2024-09-16T00:57:50.867 INFO:tasks.cephadm:Adding mds.e on smithi098 2024-09-16T00:57:50.867 INFO:tasks.cephadm:Adding mds.h on smithi098 2024-09-16T00:57:50.867 INFO:tasks.cephadm:Adding mds.k on smithi098 2024-09-16T00:57:50.867 INFO:tasks.cephadm:Adding mds.c on smithi119 2024-09-16T00:57:50.867 INFO:tasks.cephadm:Adding mds.f on smithi119 2024-09-16T00:57:50.867 INFO:tasks.cephadm:Adding mds.i on smithi119 2024-09-16T00:57:50.867 INFO:tasks.cephadm:Adding mds.l on smithi119 2024-09-16T00:57:50.867 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l' 2024-09-16T00:57:51.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:50 smithi119 ceph-mon[35049]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:51.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:50 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2848377398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T00:57:51.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:50 smithi012 ceph-mon[31197]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:51.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:50 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2848377398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T00:57:51.126 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:57:51.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:50 smithi098 ceph-mon[35346]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:51.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:50 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2848377398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T00:57:51.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 -- 172.21.15.119:0/203640669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdb0100ad0 msgr2=0x7fbdb0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 --2- 172.21.15.119:0/203640669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdb0100ad0 0x7fbdb0100ed0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009900 tx=0x7fbdac02a410 comp rx=0 tx=0).stop 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 -- 172.21.15.119:0/203640669 shutdown_connections 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 --2- 172.21.15.119:0/203640669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdb0102690 0x7fbdb0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 --2- 172.21.15.119:0/203640669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb0101cd0 0x7fbdb0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 --2- 172.21.15.119:0/203640669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdb0100ad0 0x7fbdb0100ed0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 -- 172.21.15.119:0/203640669 >> 172.21.15.119:0/203640669 conn(0x7fbdb00fc280 msgr2=0x7fbdb00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 -- 172.21.15.119:0/203640669 shutdown_connections 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 -- 172.21.15.119:0/203640669 wait complete. 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 Processor -- start 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.658+0000 7fbdb801f640 1 -- start start 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb801f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb0100ad0 0x7fbdb006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:51.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb801f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdb0101cd0 0x7fbdb019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb801f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdb0102690 0x7fbdb019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb801f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb010c730 con 0x7fbdb0100ad0 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb801f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb010c5b0 con 0x7fbdb0101cd0 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb801f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb010c8b0 con 0x7fbdb0102690 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb65bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdb0102690 0x7fbdb019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb65bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdb0102690 0x7fbdb019f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:32870/0 (socket says 172.21.15.119:32870) 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb65bc640 1 -- 172.21.15.119:0/1671011113 learned_addr learned my addr 172.21.15.119:0/1671011113 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb5dbb640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb0100ad0 0x7fbdb006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb55ba640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdb0101cd0 0x7fbdb019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb65bc640 1 -- 172.21.15.119:0/1671011113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdb0101cd0 msgr2=0x7fbdb019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb65bc640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdb0101cd0 0x7fbdb019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:51.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb65bc640 1 -- 172.21.15.119:0/1671011113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb0100ad0 msgr2=0x7fbdb006aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb65bc640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb0100ad0 0x7fbdb006aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb65bc640 1 -- 172.21.15.119:0/1671011113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb019fb60 con 0x7fbdb0102690 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb55ba640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdb0101cd0 0x7fbdb019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb65bc640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdb0102690 0x7fbdb019f250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbda800eaa0 tx=0x7fbda800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbda6ffd640 1 -- 172.21.15.119:0/1671011113 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda800cdb0 con 0x7fbdb0102690 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbdb801f640 1 -- 172.21.15.119:0/1671011113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb019fdf0 con 0x7fbdb0102690 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbda6ffd640 1 -- 172.21.15.119:0/1671011113 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbda8005020 con 0x7fbdb0102690 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.659+0000 7fbda6ffd640 1 -- 172.21.15.119:0/1671011113 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda80116d0 con 0x7fbdb0102690 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.660+0000 7fbdb801f640 1 -- 172.21.15.119:0/1671011113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb01a0300 con 0x7fbdb0102690 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.661+0000 7fbdb801f640 1 -- 172.21.15.119:0/1671011113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb0100ed0 con 0x7fbdb0102690 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.661+0000 7fbda6ffd640 1 -- 172.21.15.119:0/1671011113 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbda80054d0 con 0x7fbdb0102690 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.662+0000 7fbda6ffd640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbd9c0a3240 0x7fbd9c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:51.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.662+0000 7fbda6ffd640 1 -- 172.21.15.119:0/1671011113 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fbda80cf5e0 con 0x7fbdb0102690 2024-09-16T00:57:51.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.663+0000 7fbdb5dbb640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbd9c0a3240 0x7fbd9c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:51.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.663+0000 7fbdb5dbb640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbd9c0a3240 0x7fbd9c0a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbdac005ab0 tx=0x7fbdac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:51.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.666+0000 7fbda6ffd640 1 -- 172.21.15.119:0/1671011113 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbda8016030 con 0x7fbdb0102690 2024-09-16T00:57:51.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.879+0000 7fbdb801f640 1 -- 172.21.15.119:0/1671011113 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}) -- 0x7fbdb0062730 con 0x7fbd9c0a3240 2024-09-16T00:57:51.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.887+0000 7fbda6ffd640 1 -- 172.21.15.119:0/1671011113 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fbdb0062730 con 0x7fbd9c0a3240 2024-09-16T00:57:51.887 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mds.all update... 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 -- 172.21.15.119:0/1671011113 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbd9c0a3240 msgr2=0x7fbd9c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbd9c0a3240 0x7fbd9c0a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbdac005ab0 tx=0x7fbdac000bc0 comp rx=0 tx=0).stop 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 -- 172.21.15.119:0/1671011113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdb0102690 msgr2=0x7fbdb019f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdb0102690 0x7fbdb019f250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbda800eaa0 tx=0x7fbda800ef60 comp rx=0 tx=0).stop 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 -- 172.21.15.119:0/1671011113 shutdown_connections 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbd9c0a3240 0x7fbd9c0a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdb0102690 0x7fbdb019f250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdb0101cd0 0x7fbdb019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 --2- 172.21.15.119:0/1671011113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdb0100ad0 0x7fbdb006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 -- 172.21.15.119:0/1671011113 >> 172.21.15.119:0/1671011113 conn(0x7fbdb00fc280 msgr2=0x7fbdb01050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 -- 172.21.15.119:0/1671011113 shutdown_connections 2024-09-16T00:57:51.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-16T00:57:51.889+0000 7fbdb801f640 1 -- 172.21.15.119:0/1671011113 wait complete. 2024-09-16T00:57:52.630 DEBUG:teuthology.orchestra.run.smithi012:mds.a> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.a.service 2024-09-16T00:57:52.633 DEBUG:teuthology.orchestra.run.smithi012:mds.d> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.d.service 2024-09-16T00:57:52.676 DEBUG:teuthology.orchestra.run.smithi012:mds.g> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.g.service 2024-09-16T00:57:52.719 DEBUG:teuthology.orchestra.run.smithi012:mds.j> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.j.service 2024-09-16T00:57:52.762 DEBUG:teuthology.orchestra.run.smithi098:mds.b> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.b.service 2024-09-16T00:57:52.765 DEBUG:teuthology.orchestra.run.smithi098:mds.e> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.e.service 2024-09-16T00:57:52.815 DEBUG:teuthology.orchestra.run.smithi098:mds.h> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.h.service 2024-09-16T00:57:52.854 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:52 smithi119 ceph-mon[35049]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:52.854 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:52.854 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:52.854 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:52.854 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:52.854 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:52.854 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:52.854 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:57:52.854 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:52 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:52.858 DEBUG:teuthology.orchestra.run.smithi098:mds.k> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.k.service 2024-09-16T00:57:52.902 DEBUG:teuthology.orchestra.run.smithi119:mds.c> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.c.service 2024-09-16T00:57:52.905 DEBUG:teuthology.orchestra.run.smithi119:mds.f> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.f.service 2024-09-16T00:57:52.947 DEBUG:teuthology.orchestra.run.smithi119:mds.i> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.i.service 2024-09-16T00:57:52.990 DEBUG:teuthology.orchestra.run.smithi119:mds.l> sudo journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.l.service 2024-09-16T00:57:53.033 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:52 smithi098 ceph-mon[35346]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:53.033 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:53.033 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:53.033 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:53.033 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:53.033 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:53.033 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:53.033 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:57:53.033 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:52 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:53.034 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-16T00:57:53.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:57:53.061 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:52 smithi012 ceph-mon[31197]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:53.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:53.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:53.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:53.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:53.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:53.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:53.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:57:53.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:52 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:53.303 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:57:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.783+0000 7f3a92036640 1 -- 172.21.15.12:0/179139642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c108290 msgr2=0x7f3a8c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.783+0000 7f3a92036640 1 --2- 172.21.15.12:0/179139642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c108290 0x7f3a8c10ec30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009cd0 tx=0x7f3a8402a8e0 comp rx=0 tx=0).stop 2024-09-16T00:57:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.783+0000 7f3a92036640 1 -- 172.21.15.12:0/179139642 shutdown_connections 2024-09-16T00:57:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.783+0000 7f3a92036640 1 --2- 172.21.15.12:0/179139642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c108290 0x7f3a8c10ec30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.783+0000 7f3a92036640 1 --2- 172.21.15.12:0/179139642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a8c103740 0x7f3a8c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.783+0000 7f3a92036640 1 --2- 172.21.15.12:0/179139642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a8c102d90 0x7f3a8c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.783+0000 7f3a92036640 1 -- 172.21.15.12:0/179139642 >> 172.21.15.12:0/179139642 conn(0x7f3a8c0fc7d0 msgr2=0x7f3a8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.783+0000 7f3a92036640 1 -- 172.21.15.12:0/179139642 shutdown_connections 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.783+0000 7f3a92036640 1 -- 172.21.15.12:0/179139642 wait complete. 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a92036640 1 Processor -- start 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a92036640 1 -- start start 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a92036640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a8c102d90 0x7f3a8c1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a92036640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c103740 0x7f3a8c100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a92036640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a8c108290 0x7f3a8c101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a92036640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1120a0 con 0x7f3a8c103740 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a92036640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c111f20 con 0x7f3a8c102d90 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a92036640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c112220 con 0x7f3a8c108290 2024-09-16T00:57:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a8affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c103740 0x7f3a8c100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a8affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c103740 0x7f3a8c100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48018/0 (socket says 172.21.15.12:48018) 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a8affd640 1 -- 172.21.15.12:0/1335897290 learned_addr learned my addr 172.21.15.12:0/1335897290 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.784+0000 7f3a8bfff640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a8c108290 0x7f3a8c101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a8b7fe640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a8c102d90 0x7f3a8c1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a8b7fe640 1 -- 172.21.15.12:0/1335897290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a8c108290 msgr2=0x7f3a8c101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a8b7fe640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a8c108290 0x7f3a8c101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a8b7fe640 1 -- 172.21.15.12:0/1335897290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c103740 msgr2=0x7f3a8c100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a8b7fe640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c103740 0x7f3a8c100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a8b7fe640 1 -- 172.21.15.12:0/1335897290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c1a6a00 con 0x7f3a8c102d90 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a8affd640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c103740 0x7f3a8c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a8b7fe640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a8c102d90 0x7f3a8c1009f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00e9f0 tx=0x7f3a7c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a88ff9640 1 -- 172.21.15.12:0/1335897290 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00ccc0 con 0x7f3a8c102d90 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a88ff9640 1 -- 172.21.15.12:0/1335897290 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a7c010910 con 0x7f3a8c102d90 2024-09-16T00:57:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a92036640 1 -- 172.21.15.12:0/1335897290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8c1a6cf0 con 0x7f3a8c102d90 2024-09-16T00:57:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a88ff9640 1 -- 172.21.15.12:0/1335897290 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c018960 con 0x7f3a8c102d90 2024-09-16T00:57:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.785+0000 7f3a92036640 1 -- 172.21.15.12:0/1335897290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8c1a71d0 con 0x7f3a8c102d90 2024-09-16T00:57:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.786+0000 7f3a92036640 1 -- 172.21.15.12:0/1335897290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a8c103170 con 0x7f3a8c102d90 2024-09-16T00:57:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.787+0000 7f3a88ff9640 1 -- 172.21.15.12:0/1335897290 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3a7c010ac0 con 0x7f3a8c102d90 2024-09-16T00:57:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.788+0000 7f3a88ff9640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a740a3240 0x7f3a740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.788+0000 7f3a8affd640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a740a3240 0x7f3a740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.788+0000 7f3a88ff9640 1 -- 172.21.15.12:0/1335897290 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f3a7c0cf930 con 0x7f3a8c102d90 2024-09-16T00:57:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.788+0000 7f3a8affd640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a740a3240 0x7f3a740a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c102480 tx=0x7f3a80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:53.793+0000 7f3a88ff9640 1 -- 172.21.15.12:0/1335897290 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a7c09ca50 con 0x7f3a8c102d90 2024-09-16T00:57:53.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:53 smithi012 ceph-mon[31197]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:53.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:53 smithi012 ceph-mon[31197]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2024-09-16T00:57:53.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:53 smithi012 ceph-mon[31197]: Deploying daemon mds.l on smithi119 2024-09-16T00:57:54.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.005+0000 7f3a92036640 1 -- 172.21.15.12:0/1335897290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a8c02d7c0 con 0x7f3a8c102d90 2024-09-16T00:57:54.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.005+0000 7f3a88ff9640 1 -- 172.21.15.12:0/1335897290 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f3a7c09c350 con 0x7f3a8c102d90 2024-09-16T00:57:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:57:54.007 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":1,"btime":"2024-09-16T00:50:45:145115+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-16T00:57:54.008 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 1 2024-09-16T00:57:54.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.007+0000 7f3a92036640 1 -- 172.21.15.12:0/1335897290 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a740a3240 msgr2=0x7f3a740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:54.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.007+0000 7f3a92036640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a740a3240 0x7f3a740a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c102480 tx=0x7f3a80005f90 comp rx=0 tx=0).stop 2024-09-16T00:57:54.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.007+0000 7f3a92036640 1 -- 172.21.15.12:0/1335897290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a8c102d90 msgr2=0x7f3a8c1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:54.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.007+0000 7f3a92036640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a8c102d90 0x7f3a8c1009f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00e9f0 tx=0x7f3a7c00eeb0 comp rx=0 tx=0).stop 2024-09-16T00:57:54.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.007+0000 7f3a92036640 1 -- 172.21.15.12:0/1335897290 shutdown_connections 2024-09-16T00:57:54.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.007+0000 7f3a92036640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a740a3240 0x7f3a740a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:54.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.007+0000 7f3a92036640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a8c108290 0x7f3a8c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:54.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.007+0000 7f3a92036640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c103740 0x7f3a8c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:54.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.007+0000 7f3a92036640 1 --2- 172.21.15.12:0/1335897290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a8c102d90 0x7f3a8c1009f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:54.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.007+0000 7f3a92036640 1 -- 172.21.15.12:0/1335897290 >> 172.21.15.12:0/1335897290 conn(0x7f3a8c0fc7d0 msgr2=0x7f3a8c106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:54.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.008+0000 7f3a92036640 1 -- 172.21.15.12:0/1335897290 shutdown_connections 2024-09-16T00:57:54.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:54.008+0000 7f3a92036640 1 -- 172.21.15.12:0/1335897290 wait complete. 2024-09-16T00:57:54.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:53 smithi119 ceph-mon[35049]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:54.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:53 smithi119 ceph-mon[35049]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2024-09-16T00:57:54.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:53 smithi119 ceph-mon[35049]: Deploying daemon mds.l on smithi119 2024-09-16T00:57:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:53 smithi098 ceph-mon[35346]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:53 smithi098 ceph-mon[35346]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2024-09-16T00:57:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:53 smithi098 ceph-mon[35346]: Deploying daemon mds.l on smithi119 2024-09-16T00:57:54.783 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 00:57:54 smithi119 systemd[1]: Starting Ceph mds.l for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:57:55.046 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:54 smithi119 ceph-mon[35049]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:55.046 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:54 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1335897290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:57:55.046 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 00:57:54 smithi119 podman[64462]: 2024-09-16 00:57:54.784873405 +0000 UTC m=+0.017087872 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:57:55.047 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 00:57:54 smithi119 podman[64462]: 2024-09-16 00:57:54.897559787 +0000 UTC m=+0.129774227 container create f24e9cb767c8c6cf1d3583121388662d4a4ff6207c8b6b511571150d4b0309d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:57:55.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:54 smithi012 ceph-mon[31197]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:55.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:54 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1335897290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:57:55.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:54 smithi098 ceph-mon[35346]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:55.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:54 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1335897290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:57:55.596 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 00:57:55 smithi119 podman[64462]: 2024-09-16 00:57:55.150379386 +0000 UTC m=+0.382593835 container init f24e9cb767c8c6cf1d3583121388662d4a4ff6207c8b6b511571150d4b0309d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-16T00:57:55.596 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 00:57:55 smithi119 podman[64462]: 2024-09-16 00:57:55.153121904 +0000 UTC m=+0.385336345 container start f24e9cb767c8c6cf1d3583121388662d4a4ff6207c8b6b511571150d4b0309d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-16T00:57:55.596 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 00:57:55 smithi119 ceph-mds[64481]: -- 172.21.15.119:0/1605494306 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561937ce5860 con 0x561937cc2800 2024-09-16T00:57:55.596 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 00:57:55 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l[64477]: starting mds.l at 2024-09-16T00:57:55.597 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 00:57:55 smithi119 bash[64462]: f24e9cb767c8c6cf1d3583121388662d4a4ff6207c8b6b511571150d4b0309d7 2024-09-16T00:57:55.597 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 00:57:55 smithi119 systemd[1]: Started Ceph mds.l for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:57:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.119:6832/489944636,v1:172.21.15.119:6833/489944636] up:boot 2024-09-16T00:57:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: fsmap 1 up:standby 2024-09-16T00:57:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T00:57:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:57:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:56 smithi098 ceph-mon[35346]: Deploying daemon mds.k on smithi098 2024-09-16T00:57:56.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:56.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.119:6832/489944636,v1:172.21.15.119:6833/489944636] up:boot 2024-09-16T00:57:56.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: fsmap 1 up:standby 2024-09-16T00:57:56.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T00:57:56.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:56.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:56.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:56.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:56.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:57:56.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:56.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:56 smithi119 ceph-mon[35049]: Deploying daemon mds.k on smithi098 2024-09-16T00:57:56.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:56.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.119:6832/489944636,v1:172.21.15.119:6833/489944636] up:boot 2024-09-16T00:57:56.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: fsmap 1 up:standby 2024-09-16T00:57:56.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T00:57:56.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:56.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:56.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:56.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:56.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:57:56.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:56.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:56 smithi012 ceph-mon[31197]: Deploying daemon mds.k on smithi098 2024-09-16T00:57:56.841 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:57:57.112 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:57:57.462 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 00:57:57 smithi098 systemd[1]: Starting Ceph mds.k for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:57:57.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.558+0000 7f4d53fde640 1 -- 172.21.15.12:0/3150959066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d4c101de0 msgr2=0x7f4d4c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:57.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.558+0000 7f4d53fde640 1 --2- 172.21.15.12:0/3150959066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d4c101de0 0x7f4d4c1021c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009900 tx=0x7f4d4802a410 comp rx=0 tx=0).stop 2024-09-16T00:57:57.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.558+0000 7f4d53fde640 1 -- 172.21.15.12:0/3150959066 shutdown_connections 2024-09-16T00:57:57.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.558+0000 7f4d53fde640 1 --2- 172.21.15.12:0/3150959066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d4c106f10 0x7f4d4c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:57.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.558+0000 7f4d53fde640 1 --2- 172.21.15.12:0/3150959066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d4c102790 0x7f4d4c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:57.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.558+0000 7f4d53fde640 1 --2- 172.21.15.12:0/3150959066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d4c101de0 0x7f4d4c1021c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:57.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.558+0000 7f4d53fde640 1 -- 172.21.15.12:0/3150959066 >> 172.21.15.12:0/3150959066 conn(0x7f4d4c0fd8c0 msgr2=0x7f4d4c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.558+0000 7f4d53fde640 1 -- 172.21.15.12:0/3150959066 shutdown_connections 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.559+0000 7f4d53fde640 1 -- 172.21.15.12:0/3150959066 wait complete. 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.559+0000 7f4d53fde640 1 Processor -- start 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.559+0000 7f4d53fde640 1 -- start start 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.559+0000 7f4d53fde640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d4c101de0 0x7f4d4c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.559+0000 7f4d53fde640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d4c102790 0x7f4d4c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.559+0000 7f4d53fde640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d4c106f10 0x7f4d4c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.559+0000 7f4d53fde640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c111f30 con 0x7f4d4c102790 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.559+0000 7f4d53fde640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c111db0 con 0x7f4d4c106f10 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.559+0000 7f4d53fde640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c1120b0 con 0x7f4d4c101de0 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d51579640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d4c102790 0x7f4d4c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d51579640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d4c102790 0x7f4d4c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52684/0 (socket says 172.21.15.12:52684) 2024-09-16T00:57:57.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d51579640 1 -- 172.21.15.12:0/4147240558 learned_addr learned my addr 172.21.15.12:0/4147240558 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d5257b640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d4c106f10 0x7f4d4c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d51d7a640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d4c101de0 0x7f4d4c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d51579640 1 -- 172.21.15.12:0/4147240558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d4c101de0 msgr2=0x7f4d4c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d51579640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d4c101de0 0x7f4d4c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d51579640 1 -- 172.21.15.12:0/4147240558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d4c106f10 msgr2=0x7f4d4c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d51579640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d4c106f10 0x7f4d4c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d51579640 1 -- 172.21.15.12:0/4147240558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c1a6850 con 0x7f4d4c102790 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d51579640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d4c102790 0x7f4d4c074a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00c920 tx=0x7f4d3c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d42ffd640 1 -- 172.21.15.12:0/4147240558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c007c70 con 0x7f4d4c102790 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d42ffd640 1 -- 172.21.15.12:0/4147240558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d3c007e10 con 0x7f4d4c102790 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d53fde640 1 -- 172.21.15.12:0/4147240558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4c1a6b40 con 0x7f4d4c102790 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d42ffd640 1 -- 172.21.15.12:0/4147240558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c018890 con 0x7f4d4c102790 2024-09-16T00:57:57.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.560+0000 7f4d53fde640 1 -- 172.21.15.12:0/4147240558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4c1a70d0 con 0x7f4d4c102790 2024-09-16T00:57:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.561+0000 7f4d53fde640 1 -- 172.21.15.12:0/4147240558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4c1021c0 con 0x7f4d4c102790 2024-09-16T00:57:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.562+0000 7f4d42ffd640 1 -- 172.21.15.12:0/4147240558 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4d3c018a70 con 0x7f4d4c102790 2024-09-16T00:57:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.563+0000 7f4d42ffd640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d380a32c0 0x7f4d380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.563+0000 7f4d51d7a640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d380a32c0 0x7f4d380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.564+0000 7f4d42ffd640 1 -- 172.21.15.12:0/4147240558 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f4d3c0cf530 con 0x7f4d4c102790 2024-09-16T00:57:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.564+0000 7f4d51d7a640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d380a32c0 0x7f4d380a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4d48005ab0 tx=0x7f4d48005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:57.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.568+0000 7f4d42ffd640 1 -- 172.21.15.12:0/4147240558 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d3c014030 con 0x7f4d4c102790 2024-09-16T00:57:57.748 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 00:57:57 smithi098 podman[64610]: 2024-09-16 00:57:57.381026411 +0000 UTC m=+0.015645248 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:57:57.748 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 00:57:57 smithi098 podman[64610]: 2024-09-16 00:57:57.511972003 +0000 UTC m=+0.146590841 container create 3638a1ad9e48b00603ed0d2c3d85a3c2fdb5c9a9009e05d0f978049fd1a6b025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-16T00:57:57.748 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 00:57:57 smithi098 podman[64610]: 2024-09-16 00:57:57.747938011 +0000 UTC m=+0.382556848 container init 3638a1ad9e48b00603ed0d2c3d85a3c2fdb5c9a9009e05d0f978049fd1a6b025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-16T00:57:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.780+0000 7f4d53fde640 1 -- 172.21.15.12:0/4147240558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d4c109b60 con 0x7f4d4c102790 2024-09-16T00:57:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.780+0000 7f4d42ffd640 1 -- 172.21.15.12:0/4147240558 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f4d3c09c6f0 con 0x7f4d4c102790 2024-09-16T00:57:57.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:57:57.782 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":2,"btime":"2024-09-16T00:57:55:181120+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-16T00:57:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 2 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 -- 172.21.15.12:0/4147240558 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d380a32c0 msgr2=0x7f4d380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d380a32c0 0x7f4d380a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4d48005ab0 tx=0x7f4d48005a20 comp rx=0 tx=0).stop 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 -- 172.21.15.12:0/4147240558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d4c102790 msgr2=0x7f4d4c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d4c102790 0x7f4d4c074a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00c920 tx=0x7f4d3c00cde0 comp rx=0 tx=0).stop 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 -- 172.21.15.12:0/4147240558 shutdown_connections 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d380a32c0 0x7f4d380a5780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d4c106f10 0x7f4d4c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d4c102790 0x7f4d4c074a30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 --2- 172.21.15.12:0/4147240558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d4c101de0 0x7f4d4c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 -- 172.21.15.12:0/4147240558 >> 172.21.15.12:0/4147240558 conn(0x7f4d4c0fd8c0 msgr2=0x7f4d4c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 -- 172.21.15.12:0/4147240558 shutdown_connections 2024-09-16T00:57:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:57:57.782+0000 7f4d53fde640 1 -- 172.21.15.12:0/4147240558 wait complete. 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 00:57:57 smithi098 podman[64610]: 2024-09-16 00:57:57.750890089 +0000 UTC m=+0.385508927 container start 3638a1ad9e48b00603ed0d2c3d85a3c2fdb5c9a9009e05d0f978049fd1a6b025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 00:57:57 smithi098 ceph-mds[64629]: -- 172.21.15.98:0/2202478634 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56048993d860 con 0x56048991a800 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 00:57:57 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k[64625]: starting mds.k at 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 00:57:57 smithi098 bash[64610]: 3638a1ad9e48b00603ed0d2c3d85a3c2fdb5c9a9009e05d0f978049fd1a6b025 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 00:57:57 smithi098 systemd[1]: Started Ceph mds.k for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:57:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:58 smithi098 ceph-mon[35346]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:58 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/4147240558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:57:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:57:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:58 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:58.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:58 smithi012 ceph-mon[31197]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:58.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:58 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/4147240558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:57:58.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:58.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:58.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:58.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:58.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:57:58.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:58 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:58.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:58 smithi119 ceph-mon[35049]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:57:58.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:58 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/4147240558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:57:58.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:58.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:58.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:57:58.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:58.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:57:58.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:58 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:59.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:59 smithi012 ceph-mon[31197]: Deploying daemon mds.j on smithi012 2024-09-16T00:57:59.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:59 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6832/676872767,v1:172.21.15.98:6833/676872767] up:boot 2024-09-16T00:57:59.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:59 smithi012 ceph-mon[31197]: fsmap 2 up:standby 2024-09-16T00:57:59.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:57:59 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T00:57:59.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:59 smithi098 ceph-mon[35346]: Deploying daemon mds.j on smithi012 2024-09-16T00:57:59.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:59 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6832/676872767,v1:172.21.15.98:6833/676872767] up:boot 2024-09-16T00:57:59.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:59 smithi098 ceph-mon[35346]: fsmap 2 up:standby 2024-09-16T00:57:59.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:57:59 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T00:57:59.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:59 smithi119 ceph-mon[35049]: Deploying daemon mds.j on smithi012 2024-09-16T00:57:59.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:59 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6832/676872767,v1:172.21.15.98:6833/676872767] up:boot 2024-09-16T00:57:59.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:59 smithi119 ceph-mon[35049]: fsmap 2 up:standby 2024-09-16T00:57:59.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:57:59 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T00:58:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:00 smithi098 ceph-mon[35346]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:00.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:00 smithi012 ceph-mon[31197]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:00.523 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 00:58:00 smithi012 systemd[1]: Starting Ceph mds.j for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:58:00.545 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:58:00.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:00 smithi119 ceph-mon[35049]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:00.784 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 00:58:00 smithi012 podman[68108]: 2024-09-16 00:58:00.425567452 +0000 UTC m=+0.017168503 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:58:00.784 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 00:58:00 smithi012 podman[68108]: 2024-09-16 00:58:00.540597074 +0000 UTC m=+0.132198154 container create 0b8a1996b3596a7d056fd08bf48b79aad989721b6860b9b501935f3a158f7c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-16T00:58:00.785 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 00:58:00 smithi012 podman[68108]: 2024-09-16 00:58:00.756318312 +0000 UTC m=+0.347919363 container init 0b8a1996b3596a7d056fd08bf48b79aad989721b6860b9b501935f3a158f7c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:58:00.785 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 00:58:00 smithi012 podman[68108]: 2024-09-16 00:58:00.759511622 +0000 UTC m=+0.351112669 container start 0b8a1996b3596a7d056fd08bf48b79aad989721b6860b9b501935f3a158f7c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-j, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T00:58:00.785 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 00:58:00 smithi012 ceph-mds[68158]: -- 172.21.15.12:0/1741029349 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555bd8407860 con 0x555bd83e5400 2024-09-16T00:58:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:01.045 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 00:58:00 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-j[68141]: starting mds.j at 2024-09-16T00:58:01.046 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 00:58:00 smithi012 bash[68108]: 0b8a1996b3596a7d056fd08bf48b79aad989721b6860b9b501935f3a158f7c75 2024-09-16T00:58:01.046 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 00:58:00 smithi012 systemd[1]: Started Ceph mds.j for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:58:01.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.401+0000 7fd746dcd640 1 -- 172.21.15.12:0/4238960996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd740106f10 msgr2=0x7fd74010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:01.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.401+0000 7fd746dcd640 1 --2- 172.21.15.12:0/4238960996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd740106f10 0x7fd74010ea90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd738009ca0 tx=0x7fd73802a8c0 comp rx=0 tx=0).stop 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.401+0000 7fd746dcd640 1 -- 172.21.15.12:0/4238960996 shutdown_connections 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.401+0000 7fd746dcd640 1 --2- 172.21.15.12:0/4238960996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd740106f10 0x7fd74010ea90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.401+0000 7fd746dcd640 1 --2- 172.21.15.12:0/4238960996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd740102790 0x7fd7401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.401+0000 7fd746dcd640 1 --2- 172.21.15.12:0/4238960996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd740101de0 0x7fd7401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.401+0000 7fd746dcd640 1 -- 172.21.15.12:0/4238960996 >> 172.21.15.12:0/4238960996 conn(0x7fd7400fd8c0 msgr2=0x7fd7400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.401+0000 7fd746dcd640 1 -- 172.21.15.12:0/4238960996 shutdown_connections 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.401+0000 7fd746dcd640 1 -- 172.21.15.12:0/4238960996 wait complete. 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.401+0000 7fd746dcd640 1 Processor -- start 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd746dcd640 1 -- start start 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd746dcd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd740101de0 0x7fd740198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd746dcd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd740102790 0x7fd740198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd746dcd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd740106f10 0x7fd74019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd746dcd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd740111f70 con 0x7fd740106f10 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd746dcd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd740111df0 con 0x7fd740101de0 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd746dcd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd7401120f0 con 0x7fd740102790 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd74536a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd740106f10 0x7fd74019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd74536a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd740106f10 0x7fd74019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52728/0 (socket says 172.21.15.12:52728) 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd74536a640 1 -- 172.21.15.12:0/1858693702 learned_addr learned my addr 172.21.15.12:0/1858693702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd744b69640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd740101de0 0x7fd740198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd73ffff640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd740102790 0x7fd740198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd74536a640 1 -- 172.21.15.12:0/1858693702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd740102790 msgr2=0x7fd740198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd74536a640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd740102790 0x7fd740198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd74536a640 1 -- 172.21.15.12:0/1858693702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd740101de0 msgr2=0x7fd740198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd74536a640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd740101de0 0x7fd740198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.402+0000 7fd74536a640 1 -- 172.21.15.12:0/1858693702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74019d3c0 con 0x7fd740106f10 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.403+0000 7fd74536a640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd740106f10 0x7fd74019cce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd738031a20 tx=0x7fd738031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.403+0000 7fd73dffb640 1 -- 172.21.15.12:0/1858693702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd738003b70 con 0x7fd740106f10 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.403+0000 7fd73dffb640 1 -- 172.21.15.12:0/1858693702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd738003d10 con 0x7fd740106f10 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.403+0000 7fd746dcd640 1 -- 172.21.15.12:0/1858693702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74019d650 con 0x7fd740106f10 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.403+0000 7fd73dffb640 1 -- 172.21.15.12:0/1858693702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73802fc40 con 0x7fd740106f10 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.403+0000 7fd746dcd640 1 -- 172.21.15.12:0/1858693702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7401a4f90 con 0x7fd740106f10 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.404+0000 7fd746dcd640 1 -- 172.21.15.12:0/1858693702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7401021c0 con 0x7fd740106f10 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.405+0000 7fd73dffb640 1 -- 172.21.15.12:0/1858693702 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd738004b40 con 0x7fd740106f10 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.406+0000 7fd73dffb640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7300a3240 0x7fd7300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.406+0000 7fd744b69640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7300a3240 0x7fd7300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.406+0000 7fd73dffb640 1 -- 172.21.15.12:0/1858693702 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd7380f0660 con 0x7fd740106f10 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.406+0000 7fd744b69640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7300a3240 0x7fd7300a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd734009bd0 tx=0x7fd734005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.409+0000 7fd73dffb640 1 -- 172.21.15.12:0/1858693702 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7380bd8b0 con 0x7fd740106f10 2024-09-16T00:58:01.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.641+0000 7fd746dcd640 1 -- 172.21.15.12:0/1858693702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd740199770 con 0x7fd740106f10 2024-09-16T00:58:01.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.641+0000 7fd73dffb640 1 -- 172.21.15.12:0/1858693702 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7fd7380bd1b0 con 0x7fd740106f10 2024-09-16T00:58:01.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:01.644 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":4,"btime":"2024-09-16T00:58:01:197547+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-16T00:58:01.644 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 4 2024-09-16T00:58:01.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 -- 172.21.15.12:0/1858693702 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7300a3240 msgr2=0x7fd7300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:01.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7300a3240 0x7fd7300a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd734009bd0 tx=0x7fd734005f90 comp rx=0 tx=0).stop 2024-09-16T00:58:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 -- 172.21.15.12:0/1858693702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd740106f10 msgr2=0x7fd74019cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd740106f10 0x7fd74019cce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd738031a20 tx=0x7fd738031a50 comp rx=0 tx=0).stop 2024-09-16T00:58:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 -- 172.21.15.12:0/1858693702 shutdown_connections 2024-09-16T00:58:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7300a3240 0x7fd7300a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd740106f10 0x7fd74019cce0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd740102790 0x7fd740198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 --2- 172.21.15.12:0/1858693702 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd740101de0 0x7fd740198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 -- 172.21.15.12:0/1858693702 >> 172.21.15.12:0/1858693702 conn(0x7fd7400fd8c0 msgr2=0x7fd7400feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 -- 172.21.15.12:0/1858693702 shutdown_connections 2024-09-16T00:58:01.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:01.644+0000 7fd746dcd640 1 -- 172.21.15.12:0/1858693702 wait complete. 2024-09-16T00:58:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: Deploying daemon mds.d on smithi012 2024-09-16T00:58:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.12:6834/1483789466,v1:172.21.15.12:6835/1483789466] up:boot 2024-09-16T00:58:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: fsmap 3 up:standby 2024-09-16T00:58:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T00:58:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:01 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1858693702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:02.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:02.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:02.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:02.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:02.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:02.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:02.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:02.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: Deploying daemon mds.d on smithi012 2024-09-16T00:58:02.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.12:6834/1483789466,v1:172.21.15.12:6835/1483789466] up:boot 2024-09-16T00:58:02.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: fsmap 3 up:standby 2024-09-16T00:58:02.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T00:58:02.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:01 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1858693702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:02.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:02.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:02.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:02.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:02.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:02.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:02.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:02.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: Deploying daemon mds.d on smithi012 2024-09-16T00:58:02.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.12:6834/1483789466,v1:172.21.15.12:6835/1483789466] up:boot 2024-09-16T00:58:02.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: fsmap 3 up:standby 2024-09-16T00:58:02.358 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T00:58:02.358 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:01 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1858693702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:03 smithi098 ceph-mon[35346]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:04.282 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:03 smithi012 ceph-mon[31197]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:04.283 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 00:58:04 smithi012 systemd[1]: Starting Ceph mds.d for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:58:04.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:03 smithi119 ceph-mon[35049]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:04.512 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:58:04.537 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 00:58:04 smithi012 podman[68519]: 2024-09-16 00:58:04.184665328 +0000 UTC m=+0.016176707 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:58:04.537 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 00:58:04 smithi012 podman[68519]: 2024-09-16 00:58:04.286316883 +0000 UTC m=+0.117828260 container create a5e8bab2b624c6282eca9700048099f5b41529902c4c876b68a43f8231596cec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-d, ceph=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-16T00:58:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:04.857 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 00:58:04 smithi012 podman[68519]: 2024-09-16 00:58:04.539070623 +0000 UTC m=+0.370582002 container init a5e8bab2b624c6282eca9700048099f5b41529902c4c876b68a43f8231596cec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-16T00:58:04.857 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 00:58:04 smithi012 podman[68519]: 2024-09-16 00:58:04.542354805 +0000 UTC m=+0.373866194 container start a5e8bab2b624c6282eca9700048099f5b41529902c4c876b68a43f8231596cec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-16T00:58:04.857 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 00:58:04 smithi012 ceph-mds[68556]: -- 172.21.15.12:0/4165249504 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562bf00d9860 con 0x562bf00b7400 2024-09-16T00:58:04.857 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 00:58:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-d[68534]: starting mds.d at 2024-09-16T00:58:04.857 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 00:58:04 smithi012 bash[68519]: a5e8bab2b624c6282eca9700048099f5b41529902c4c876b68a43f8231596cec 2024-09-16T00:58:04.857 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 00:58:04 smithi012 systemd[1]: Started Ceph mds.d for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:58:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.266+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/656471101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7b0103660 msgr2=0x7fc7b010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.266+0000 7fc7b6c1e640 1 --2- 172.21.15.12:0/656471101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7b0103660 0x7fc7b010bb50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009900 tx=0x7fc7a002a480 comp rx=0 tx=0).stop 2024-09-16T00:58:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.266+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/656471101 shutdown_connections 2024-09-16T00:58:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.266+0000 7fc7b6c1e640 1 --2- 172.21.15.12:0/656471101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7b010c170 0x7fc7b010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.266+0000 7fc7b6c1e640 1 --2- 172.21.15.12:0/656471101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7b0103660 0x7fc7b010bb50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.266+0000 7fc7b6c1e640 1 --2- 172.21.15.12:0/656471101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0102d40 0x7fc7b0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.266+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/656471101 >> 172.21.15.12:0/656471101 conn(0x7fc7b00fc7a0 msgr2=0x7fc7b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.266+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/656471101 shutdown_connections 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.266+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/656471101 wait complete. 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.267+0000 7fc7b6c1e640 1 Processor -- start 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.267+0000 7fc7b6c1e640 1 -- start start 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.267+0000 7fc7b6c1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7b0102d40 0x7fc7b01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.267+0000 7fc7b6c1e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0103660 0x7fc7b0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.267+0000 7fc7b6c1e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7b010c170 0x7fc7b0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.267+0000 7fc7b6c1e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b0111f70 con 0x7fc7b0102d40 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.267+0000 7fc7b6c1e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b0111df0 con 0x7fc7b0103660 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.267+0000 7fc7b6c1e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b01120f0 con 0x7fc7b010c170 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b49ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7b0102d40 0x7fc7b01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b49ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7b0102d40 0x7fc7b01009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52762/0 (socket says 172.21.15.12:52762) 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b49ba640 1 -- 172.21.15.12:0/2682639305 learned_addr learned my addr 172.21.15.12:0/2682639305 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7affff640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0103660 0x7fc7b0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b51bb640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7b010c170 0x7fc7b0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b49ba640 1 -- 172.21.15.12:0/2682639305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7b010c170 msgr2=0x7fc7b0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b49ba640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7b010c170 0x7fc7b0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b49ba640 1 -- 172.21.15.12:0/2682639305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0103660 msgr2=0x7fc7b0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b49ba640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0103660 0x7fc7b0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b49ba640 1 -- 172.21.15.12:0/2682639305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b01a6930 con 0x7fc7b0102d40 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b51bb640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7b010c170 0x7fc7b0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b49ba640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7b0102d40 0x7fc7b01009a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc79800d950 tx=0x7fc79800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7adffb640 1 -- 172.21.15.12:0/2682639305 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798017070 con 0x7fc7b0102d40 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/2682639305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b01a6c20 con 0x7fc7b0102d40 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7adffb640 1 -- 172.21.15.12:0/2682639305 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc798009c30 con 0x7fc7b0102d40 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7adffb640 1 -- 172.21.15.12:0/2682639305 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79800f6b0 con 0x7fc7b0102d40 2024-09-16T00:58:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.268+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/2682639305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b01a7130 con 0x7fc7b0102d40 2024-09-16T00:58:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.270+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/2682639305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b0103120 con 0x7fc7b0102d40 2024-09-16T00:58:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.271+0000 7fc7adffb640 1 -- 172.21.15.12:0/2682639305 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc7980109d0 con 0x7fc7b0102d40 2024-09-16T00:58:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.271+0000 7fc7adffb640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc79c0a3240 0x7fc79c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.271+0000 7fc7affff640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc79c0a3240 0x7fc79c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.272+0000 7fc7adffb640 1 -- 172.21.15.12:0/2682639305 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fc7980cf0c0 con 0x7fc7b0102d40 2024-09-16T00:58:05.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.272+0000 7fc7affff640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc79c0a3240 0x7fc79c0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009230 tx=0x7fc7a00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.275+0000 7fc7adffb640 1 -- 172.21.15.12:0/2682639305 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc798009de0 con 0x7fc7b0102d40 2024-09-16T00:58:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.488+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/2682639305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7b002d7c0 con 0x7fc7b0102d40 2024-09-16T00:58:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.489+0000 7fc7adffb640 1 -- 172.21.15.12:0/2682639305 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7fc79809c280 con 0x7fc7b0102d40 2024-09-16T00:58:05.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:05.491 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"btime":"2024-09-16T00:58:04:912887+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-16T00:58:05.491 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 5 2024-09-16T00:58:05.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/2682639305 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc79c0a3240 msgr2=0x7fc79c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:05.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc79c0a3240 0x7fc79c0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009230 tx=0x7fc7a00058d0 comp rx=0 tx=0).stop 2024-09-16T00:58:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/2682639305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7b0102d40 msgr2=0x7fc7b01009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7b0102d40 0x7fc7b01009a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc79800d950 tx=0x7fc79800de10 comp rx=0 tx=0).stop 2024-09-16T00:58:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/2682639305 shutdown_connections 2024-09-16T00:58:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc79c0a3240 0x7fc79c0a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7b010c170 0x7fc7b0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0103660 0x7fc7b0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 --2- 172.21.15.12:0/2682639305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7b0102d40 0x7fc7b01009a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/2682639305 >> 172.21.15.12:0/2682639305 conn(0x7fc7b00fc7a0 msgr2=0x7fc7b00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/2682639305 shutdown_connections 2024-09-16T00:58:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:05.491+0000 7fc7b6c1e640 1 -- 172.21.15.12:0/2682639305 wait complete. 2024-09-16T00:58:05.847 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:05.847 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:05.847 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:05.847 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:05.847 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:05.847 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:05.848 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: Deploying daemon mds.e on smithi098 2024-09-16T00:58:05.848 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.12:6836/2487951096,v1:172.21.15.12:6837/2487951096] up:boot 2024-09-16T00:58:05.848 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: fsmap 4 up:standby 2024-09-16T00:58:05.848 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T00:58:05.848 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2682639305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: Deploying daemon mds.e on smithi098 2024-09-16T00:58:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.12:6836/2487951096,v1:172.21.15.12:6837/2487951096] up:boot 2024-09-16T00:58:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: fsmap 4 up:standby 2024-09-16T00:58:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T00:58:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:05 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2682639305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:06.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:06.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:06.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:06.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: Deploying daemon mds.e on smithi098 2024-09-16T00:58:06.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.12:6836/2487951096,v1:172.21.15.12:6837/2487951096] up:boot 2024-09-16T00:58:06.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: fsmap 4 up:standby 2024-09-16T00:58:06.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T00:58:06.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:05 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2682639305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:06.910 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:06 smithi098 ceph-mon[35346]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:06 smithi119 ceph-mon[35049]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:07.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:06 smithi012 ceph-mon[31197]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:07.174 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 00:58:07 smithi098 podman[64913]: 2024-09-16 00:58:07.149838608 +0000 UTC m=+0.354064726 container start 62b2d106249f03fb2e0c52e884c378ab768e19c6fa9cce690a5f8a8dbc15b123 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-16T00:58:07.174 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 00:58:07 smithi098 ceph-mds[64932]: -- 172.21.15.98:0/227061738 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562dcceaf860 con 0x562dcce8c800 2024-09-16T00:58:07.462 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 00:58:07 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e[64928]: starting mds.e at 2024-09-16T00:58:07.462 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 00:58:07 smithi098 bash[64913]: 62b2d106249f03fb2e0c52e884c378ab768e19c6fa9cce690a5f8a8dbc15b123 2024-09-16T00:58:07.462 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 00:58:07 smithi098 systemd[1]: Started Ceph mds.e for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:58:08.272 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:58:08.542 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:08.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:08.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:08.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:08.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:08.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:08.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:08.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:08.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: Deploying daemon mds.f on smithi119 2024-09-16T00:58:08.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] up:boot 2024-09-16T00:58:08.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: fsmap 5 up:standby 2024-09-16T00:58:08.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:08 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T00:58:08.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:08.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:08.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:08.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:08.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:08.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:08.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:08.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: Deploying daemon mds.f on smithi119 2024-09-16T00:58:08.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] up:boot 2024-09-16T00:58:08.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: fsmap 5 up:standby 2024-09-16T00:58:08.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:08 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T00:58:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:08.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:08.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:08.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: Deploying daemon mds.f on smithi119 2024-09-16T00:58:08.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] up:boot 2024-09-16T00:58:08.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: fsmap 5 up:standby 2024-09-16T00:58:08.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:08 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T00:58:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.992+0000 7f0b9bee6640 1 -- 172.21.15.12:0/482974498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94101de0 msgr2=0x7f0b941021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.992+0000 7f0b9bee6640 1 --2- 172.21.15.12:0/482974498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94101de0 0x7f0b941021c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009900 tx=0x7f0b9002a410 comp rx=0 tx=0).stop 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.992+0000 7f0b9bee6640 1 -- 172.21.15.12:0/482974498 shutdown_connections 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.992+0000 7f0b9bee6640 1 --2- 172.21.15.12:0/482974498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b94106f10 0x7f0b9410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.992+0000 7f0b9bee6640 1 --2- 172.21.15.12:0/482974498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b94102790 0x7f0b941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.992+0000 7f0b9bee6640 1 --2- 172.21.15.12:0/482974498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94101de0 0x7f0b941021c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.992+0000 7f0b9bee6640 1 -- 172.21.15.12:0/482974498 >> 172.21.15.12:0/482974498 conn(0x7f0b940fd8c0 msgr2=0x7f0b940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.992+0000 7f0b9bee6640 1 -- 172.21.15.12:0/482974498 shutdown_connections 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.992+0000 7f0b9bee6640 1 -- 172.21.15.12:0/482974498 wait complete. 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9bee6640 1 Processor -- start 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9bee6640 1 -- start start 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9bee6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b94101de0 0x7f0b940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9bee6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b94102790 0x7f0b94074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9bee6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94106f10 0x7f0b94074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9bee6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0b94112010 con 0x7f0b94106f10 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9bee6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b94111e90 con 0x7f0b94102790 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9bee6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0b94112190 con 0x7f0b94101de0 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9a483640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94106f10 0x7f0b94074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9a483640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94106f10 0x7f0b94074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49226/0 (socket says 172.21.15.12:49226) 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b9a483640 1 -- 172.21.15.12:0/1421771169 learned_addr learned my addr 172.21.15.12:0/1421771169 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.993+0000 7f0b99c82640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b94101de0 0x7f0b940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b99481640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b94102790 0x7f0b94074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b9a483640 1 -- 172.21.15.12:0/1421771169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b94101de0 msgr2=0x7f0b940744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b9a483640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b94101de0 0x7f0b940744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b9a483640 1 -- 172.21.15.12:0/1421771169 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b94102790 msgr2=0x7f0b94074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b9a483640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b94102790 0x7f0b94074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b9a483640 1 -- 172.21.15.12:0/1421771169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b941a6a70 con 0x7f0b94106f10 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b9a483640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94106f10 0x7f0b94074f70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00b970 tx=0x7f0b8c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b8affd640 1 -- 172.21.15.12:0/1421771169 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c019070 con 0x7f0b94106f10 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b8affd640 1 -- 172.21.15.12:0/1421771169 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b8c00cb40 con 0x7f0b94106f10 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b9bee6640 1 -- 172.21.15.12:0/1421771169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b941a6d60 con 0x7f0b94106f10 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b8affd640 1 -- 172.21.15.12:0/1421771169 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c007650 con 0x7f0b94106f10 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.994+0000 7f0b9bee6640 1 -- 172.21.15.12:0/1421771169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b941a72a0 con 0x7f0b94106f10 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.995+0000 7f0b9bee6640 1 -- 172.21.15.12:0/1421771169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b94102240 con 0x7f0b94106f10 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.996+0000 7f0b8affd640 1 -- 172.21.15.12:0/1421771169 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0b8c01c070 con 0x7f0b94106f10 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.997+0000 7f0b8affd640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0b800a32c0 0x7f0b800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.997+0000 7f0b99c82640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0b800a32c0 0x7f0b800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.997+0000 7f0b8affd640 1 -- 172.21.15.12:0/1421771169 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f0b8c0ce970 con 0x7f0b94106f10 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:08.997+0000 7f0b99c82640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0b800a32c0 0x7f0b800a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b90000c00 tx=0x7f0b900058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.002+0000 7f0b8affd640 1 -- 172.21.15.12:0/1421771169 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b8c09b4e0 con 0x7f0b94106f10 2024-09-16T00:58:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.213+0000 7f0b9bee6640 1 -- 172.21.15.12:0/1421771169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b9410a0f0 con 0x7f0b94106f10 2024-09-16T00:58:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.213+0000 7f0b8affd640 1 -- 172.21.15.12:0/1421771169 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7f0b8c09f7e0 con 0x7f0b94106f10 2024-09-16T00:58:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:09.215 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":6,"btime":"2024-09-16T00:58:07:728930+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-16T00:58:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 6 2024-09-16T00:58:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 -- 172.21.15.12:0/1421771169 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0b800a32c0 msgr2=0x7f0b800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0b800a32c0 0x7f0b800a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b90000c00 tx=0x7f0b900058d0 comp rx=0 tx=0).stop 2024-09-16T00:58:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 -- 172.21.15.12:0/1421771169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94106f10 msgr2=0x7f0b94074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94106f10 0x7f0b94074f70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00b970 tx=0x7f0b8c00be30 comp rx=0 tx=0).stop 2024-09-16T00:58:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 -- 172.21.15.12:0/1421771169 shutdown_connections 2024-09-16T00:58:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0b800a32c0 0x7f0b800a5780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94106f10 0x7f0b94074f70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b94102790 0x7f0b94074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 --2- 172.21.15.12:0/1421771169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b94101de0 0x7f0b940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 -- 172.21.15.12:0/1421771169 >> 172.21.15.12:0/1421771169 conn(0x7f0b940fd8c0 msgr2=0x7f0b940fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 -- 172.21.15.12:0/1421771169 shutdown_connections 2024-09-16T00:58:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:09.216+0000 7f0b9bee6640 1 -- 172.21.15.12:0/1421771169 wait complete. 2024-09-16T00:58:09.494 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:09 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1421771169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:09.494 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 00:58:09 smithi119 systemd[1]: Starting Ceph mds.f for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:58:09.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:09 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1421771169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:09.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:09 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1421771169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:09.758 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 00:58:09 smithi119 podman[64764]: 2024-09-16 00:58:09.396379413 +0000 UTC m=+0.015653701 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:58:09.758 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 00:58:09 smithi119 podman[64764]: 2024-09-16 00:58:09.510741483 +0000 UTC m=+0.130015814 container create deb74c504e4c98e7410ca6ba2ae3a74f0ec443a585954bda47c62dae9d26a7c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-16T00:58:09.758 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 00:58:09 smithi119 podman[64764]: 2024-09-16 00:58:09.757325742 +0000 UTC m=+0.376600035 container init deb74c504e4c98e7410ca6ba2ae3a74f0ec443a585954bda47c62dae9d26a7c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-16T00:58:10.096 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 00:58:09 smithi119 podman[64764]: 2024-09-16 00:58:09.761722707 +0000 UTC m=+0.380997004 container start deb74c504e4c98e7410ca6ba2ae3a74f0ec443a585954bda47c62dae9d26a7c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-16T00:58:10.096 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 00:58:09 smithi119 ceph-mds[64783]: -- 172.21.15.119:0/1340481944 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564a58b6f860 con 0x564a58b4c800 2024-09-16T00:58:10.096 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 00:58:09 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f[64779]: starting mds.f at 2024-09-16T00:58:10.096 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 00:58:09 smithi119 bash[64764]: deb74c504e4c98e7410ca6ba2ae3a74f0ec443a585954bda47c62dae9d26a7c5 2024-09-16T00:58:10.096 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 00:58:09 smithi119 systemd[1]: Started Ceph mds.f for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:58:10.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:10 smithi119 ceph-mon[35049]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:10.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:10 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:10.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:10 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:10.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:10 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:10.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:10 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:10.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:10 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:10.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:10 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:10.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:10 smithi012 ceph-mon[31197]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:10.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:10.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:10.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:10.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:10.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:10.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:10 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:10 smithi098 ceph-mon[35346]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:10 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:10 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:10 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:10 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:10.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:10 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:10.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:10 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:11.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:11 smithi119 ceph-mon[35049]: Deploying daemon mds.c on smithi119 2024-09-16T00:58:11.475 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:11 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.119:6834/3086232870,v1:172.21.15.119:6835/3086232870] up:boot 2024-09-16T00:58:11.475 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:11 smithi119 ceph-mon[35049]: fsmap 6 up:standby 2024-09-16T00:58:11.475 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:11 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T00:58:11.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:11 smithi012 ceph-mon[31197]: Deploying daemon mds.c on smithi119 2024-09-16T00:58:11.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:11 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.119:6834/3086232870,v1:172.21.15.119:6835/3086232870] up:boot 2024-09-16T00:58:11.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:11 smithi012 ceph-mon[31197]: fsmap 6 up:standby 2024-09-16T00:58:11.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:11 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T00:58:11.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:11 smithi098 ceph-mon[35346]: Deploying daemon mds.c on smithi119 2024-09-16T00:58:11.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:11 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.119:6834/3086232870,v1:172.21.15.119:6835/3086232870] up:boot 2024-09-16T00:58:11.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:11 smithi098 ceph-mon[35346]: fsmap 6 up:standby 2024-09-16T00:58:11.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:11 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T00:58:11.880 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:58:12.096 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 00:58:11 smithi119 systemd[1]: Starting Ceph mds.c for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:58:12.148 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:12.407 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:12 smithi119 ceph-mon[35049]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:12.408 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 00:58:12 smithi119 podman[65067]: 2024-09-16 00:58:12.058546893 +0000 UTC m=+0.016063235 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:58:12.408 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 00:58:12 smithi119 podman[65067]: 2024-09-16 00:58:12.177108703 +0000 UTC m=+0.134625034 container create c2178b95243f2a6c50a2e16fb2e44ef1b4518cfb8303a19964d4e839b10d9956 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-16T00:58:12.408 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 00:58:12 smithi119 podman[65067]: 2024-09-16 00:58:12.404942535 +0000 UTC m=+0.362458870 container init c2178b95243f2a6c50a2e16fb2e44ef1b4518cfb8303a19964d4e839b10d9956 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:58:12.408 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 00:58:12 smithi119 podman[65067]: 2024-09-16 00:58:12.40782113 +0000 UTC m=+0.365337462 container start c2178b95243f2a6c50a2e16fb2e44ef1b4518cfb8303a19964d4e839b10d9956 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-16T00:58:12.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:12 smithi012 ceph-mon[31197]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.641+0000 7f81d79e1640 1 -- 172.21.15.12:0/1866898478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d01036e0 msgr2=0x7f81d0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.641+0000 7f81d79e1640 1 --2- 172.21.15.12:0/1866898478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d01036e0 0x7f81d0107b90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009930 tx=0x7f81c002a420 comp rx=0 tx=0).stop 2024-09-16T00:58:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.641+0000 7f81d79e1640 1 -- 172.21.15.12:0/1866898478 shutdown_connections 2024-09-16T00:58:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.641+0000 7f81d79e1640 1 --2- 172.21.15.12:0/1866898478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81d01082a0 0x7f81d010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.641+0000 7f81d79e1640 1 --2- 172.21.15.12:0/1866898478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d01036e0 0x7f81d0107b90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.641+0000 7f81d79e1640 1 --2- 172.21.15.12:0/1866898478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81d0102d30 0x7f81d0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.641+0000 7f81d79e1640 1 -- 172.21.15.12:0/1866898478 >> 172.21.15.12:0/1866898478 conn(0x7f81d00fc7d0 msgr2=0x7f81d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.642+0000 7f81d79e1640 1 -- 172.21.15.12:0/1866898478 shutdown_connections 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.642+0000 7f81d79e1640 1 -- 172.21.15.12:0/1866898478 wait complete. 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.642+0000 7f81d79e1640 1 Processor -- start 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.642+0000 7f81d79e1640 1 -- start start 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d79e1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0102d30 0x7f81d0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d79e1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81d01036e0 0x7f81d0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d79e1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81d01082a0 0x7f81d0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d79e1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f81d01120a0 con 0x7f81d0102d30 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d79e1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f81d0111f20 con 0x7f81d01036e0 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d79e1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f81d0112220 con 0x7f81d01082a0 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d577d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0102d30 0x7f81d0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d577d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0102d30 0x7f81d0100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49244/0 (socket says 172.21.15.12:49244) 2024-09-16T00:58:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d577d640 1 -- 172.21.15.12:0/3142620082 learned_addr learned my addr 172.21.15.12:0/3142620082 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d4f7c640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81d01036e0 0x7f81d0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d5f7e640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81d01082a0 0x7f81d0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d577d640 1 -- 172.21.15.12:0/3142620082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81d01082a0 msgr2=0x7f81d0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d577d640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81d01082a0 0x7f81d0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d577d640 1 -- 172.21.15.12:0/3142620082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81d01036e0 msgr2=0x7f81d0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d577d640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81d01036e0 0x7f81d0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d577d640 1 -- 172.21.15.12:0/3142620082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d01a6aa0 con 0x7f81d0102d30 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d577d640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0102d30 0x7f81d0100990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00e9f0 tx=0x7f81cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81c67fc640 1 -- 172.21.15.12:0/3142620082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc00cd80 con 0x7f81d0102d30 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81c67fc640 1 -- 172.21.15.12:0/3142620082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81cc010910 con 0x7f81d0102d30 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81c67fc640 1 -- 172.21.15.12:0/3142620082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc018990 con 0x7f81d0102d30 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.643+0000 7f81d79e1640 1 -- 172.21.15.12:0/3142620082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d01a6d90 con 0x7f81d0102d30 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.644+0000 7f81d79e1640 1 -- 172.21.15.12:0/3142620082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d01a7240 con 0x7f81d0102d30 2024-09-16T00:58:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.644+0000 7f81d79e1640 1 -- 172.21.15.12:0/3142620082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d0103110 con 0x7f81d0102d30 2024-09-16T00:58:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.646+0000 7f81c67fc640 1 -- 172.21.15.12:0/3142620082 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f81cc010ac0 con 0x7f81d0102d30 2024-09-16T00:58:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.646+0000 7f81c67fc640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f81bc0a32c0 0x7f81bc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.646+0000 7f81c67fc640 1 -- 172.21.15.12:0/3142620082 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f81cc0cfad0 con 0x7f81d0102d30 2024-09-16T00:58:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.646+0000 7f81d4f7c640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f81bc0a32c0 0x7f81bc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.647+0000 7f81d4f7c640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f81bc0a32c0 0x7f81bc0a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81c0005940 tx=0x7f81c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.650+0000 7f81c67fc640 1 -- 172.21.15.12:0/3142620082 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f81cc09c640 con 0x7f81d0102d30 2024-09-16T00:58:12.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:12 smithi098 ceph-mon[35346]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:12.846 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 00:58:12 smithi119 ceph-mds[65086]: -- 172.21.15.119:0/533944761 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5627abf4f860 con 0x5627abf2d000 2024-09-16T00:58:12.846 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 00:58:12 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c[65082]: starting mds.c at 2024-09-16T00:58:12.846 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 00:58:12 smithi119 bash[65067]: c2178b95243f2a6c50a2e16fb2e44ef1b4518cfb8303a19964d4e839b10d9956 2024-09-16T00:58:12.846 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 00:58:12 smithi119 systemd[1]: Started Ceph mds.c for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:58:12.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.864+0000 7f81d79e1640 1 -- 172.21.15.12:0/3142620082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81d010a2e0 con 0x7f81d0102d30 2024-09-16T00:58:12.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.865+0000 7f81c67fc640 1 -- 172.21.15.12:0/3142620082 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5560 (secure 0 0 0) 0x7f81cc098070 con 0x7f81d0102d30 2024-09-16T00:58:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:12.867 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-16T00:58:10:278554+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-16T00:58:12.867 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-16T00:58:12.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 -- 172.21.15.12:0/3142620082 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f81bc0a32c0 msgr2=0x7f81bc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f81bc0a32c0 0x7f81bc0a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81c0005940 tx=0x7f81c00058d0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 -- 172.21.15.12:0/3142620082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0102d30 msgr2=0x7f81d0100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0102d30 0x7f81d0100990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00e9f0 tx=0x7f81cc00eeb0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 -- 172.21.15.12:0/3142620082 shutdown_connections 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f81bc0a32c0 0x7f81bc0a5780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81d01082a0 0x7f81d0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81d01036e0 0x7f81d0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 --2- 172.21.15.12:0/3142620082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0102d30 0x7f81d0100990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 -- 172.21.15.12:0/3142620082 >> 172.21.15.12:0/3142620082 conn(0x7f81d00fc7d0 msgr2=0x7f81d0105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 -- 172.21.15.12:0/3142620082 shutdown_connections 2024-09-16T00:58:12.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:12.867+0000 7f81d79e1640 1 -- 172.21.15.12:0/3142620082 wait complete. 2024-09-16T00:58:13.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:13.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:13.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:13.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:13.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:13.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:13.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: Deploying daemon mds.h on smithi098 2024-09-16T00:58:13.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3142620082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:13.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.119:6836/3417248856,v1:172.21.15.119:6837/3417248856] up:boot 2024-09-16T00:58:13.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: fsmap 7 up:standby 2024-09-16T00:58:13.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:13 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T00:58:13.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:13.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:13.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:13.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:13.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:13.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:13.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: Deploying daemon mds.h on smithi098 2024-09-16T00:58:13.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3142620082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:13.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.119:6836/3417248856,v1:172.21.15.119:6837/3417248856] up:boot 2024-09-16T00:58:13.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: fsmap 7 up:standby 2024-09-16T00:58:13.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:13 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T00:58:13.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:13.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:13.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: Deploying daemon mds.h on smithi098 2024-09-16T00:58:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3142620082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.119:6836/3417248856,v1:172.21.15.119:6837/3417248856] up:boot 2024-09-16T00:58:13.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: fsmap 7 up:standby 2024-09-16T00:58:13.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:13 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T00:58:14.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:14 smithi012 ceph-mon[31197]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:14.876 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:14 smithi098 ceph-mon[35346]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:14.876 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 00:58:14 smithi098 systemd[1]: Starting Ceph mds.h for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:58:15.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:14 smithi119 ceph-mon[35049]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:15.178 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 00:58:14 smithi098 podman[65219]: 2024-09-16 00:58:14.777535067 +0000 UTC m=+0.015840656 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:58:15.178 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 00:58:14 smithi098 podman[65219]: 2024-09-16 00:58:14.89153248 +0000 UTC m=+0.129838059 container create 9e69ba55b170f5780276ed93620ef5f5c90bcd5cc5ffc02fd9ce5b7988da222e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-16T00:58:15.178 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 00:58:15 smithi098 podman[65219]: 2024-09-16 00:58:15.178193829 +0000 UTC m=+0.416499417 container init 9e69ba55b170f5780276ed93620ef5f5c90bcd5cc5ffc02fd9ce5b7988da222e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T00:58:15.462 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 00:58:15 smithi098 podman[65219]: 2024-09-16 00:58:15.181041712 +0000 UTC m=+0.419347293 container start 9e69ba55b170f5780276ed93620ef5f5c90bcd5cc5ffc02fd9ce5b7988da222e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-16T00:58:15.462 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 00:58:15 smithi098 ceph-mds[65238]: -- 172.21.15.98:0/516779574 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56030ce29860 con 0x56030ce06800 2024-09-16T00:58:15.462 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 00:58:15 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h[65234]: starting mds.h at 2024-09-16T00:58:15.463 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 00:58:15 smithi098 bash[65219]: 9e69ba55b170f5780276ed93620ef5f5c90bcd5cc5ffc02fd9ce5b7988da222e 2024-09-16T00:58:15.463 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 00:58:15 smithi098 systemd[1]: Started Ceph mds.h for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:58:15.528 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:58:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.276+0000 7f74a0258640 1 -- 172.21.15.12:0/1233188442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7498074590 msgr2=0x7f7498074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.276+0000 7f74a0258640 1 --2- 172.21.15.12:0/1233188442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7498074590 0x7f7498074970 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7488009ca0 tx=0x7f748802a950 comp rx=0 tx=0).stop 2024-09-16T00:58:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.276+0000 7f74a0258640 1 -- 172.21.15.12:0/1233188442 shutdown_connections 2024-09-16T00:58:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.276+0000 7f74a0258640 1 --2- 172.21.15.12:0/1233188442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7498112ba0 0x7f7498114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.276+0000 7f74a0258640 1 --2- 172.21.15.12:0/1233188442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7498074eb0 0x7f7498112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.276+0000 7f74a0258640 1 --2- 172.21.15.12:0/1233188442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7498074590 0x7f7498074970 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.276+0000 7f74a0258640 1 -- 172.21.15.12:0/1233188442 >> 172.21.15.12:0/1233188442 conn(0x7f74980fd8f0 msgr2=0x7f74980ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.276+0000 7f74a0258640 1 -- 172.21.15.12:0/1233188442 shutdown_connections 2024-09-16T00:58:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.276+0000 7f74a0258640 1 -- 172.21.15.12:0/1233188442 wait complete. 2024-09-16T00:58:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f74a0258640 1 Processor -- start 2024-09-16T00:58:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f74a0258640 1 -- start start 2024-09-16T00:58:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f74a0258640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7498074590 0x7f74981a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f74a0258640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7498074eb0 0x7f74981a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f74a0258640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7498112ba0 0x7f749819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f74a0258640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7498118580 con 0x7f7498074590 2024-09-16T00:58:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f74a0258640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7498118400 con 0x7f7498112ba0 2024-09-16T00:58:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f74a0258640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7498118700 con 0x7f7498074eb0 2024-09-16T00:58:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f749dff4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7498074590 0x7f74981a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f749dff4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7498074590 0x7f74981a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49166/0 (socket says 172.21.15.12:49166) 2024-09-16T00:58:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.277+0000 7f749dff4640 1 -- 172.21.15.12:0/2697998929 learned_addr learned my addr 172.21.15.12:0/2697998929 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f749e7f5640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7498112ba0 0x7f749819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f749d7f3640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7498074eb0 0x7f74981a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f749dff4640 1 -- 172.21.15.12:0/2697998929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7498074eb0 msgr2=0x7f74981a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f749dff4640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7498074eb0 0x7f74981a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f749dff4640 1 -- 172.21.15.12:0/2697998929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7498112ba0 msgr2=0x7f749819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f749dff4640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7498112ba0 0x7f749819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f749dff4640 1 -- 172.21.15.12:0/2697998929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749819f070 con 0x7f7498074590 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f749e7f5640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7498112ba0 0x7f749819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f749dff4640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7498074590 0x7f74981a4780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7488005cc0 tx=0x7f748802f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f7496ffd640 1 -- 172.21.15.12:0/2697998929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488034040 con 0x7f7498074590 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f74a0258640 1 -- 172.21.15.12:0/2697998929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749819f300 con 0x7f7498074590 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f7496ffd640 1 -- 172.21.15.12:0/2697998929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7488030920 con 0x7f7498074590 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f7496ffd640 1 -- 172.21.15.12:0/2697998929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488004830 con 0x7f7498074590 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.278+0000 7f74a0258640 1 -- 172.21.15.12:0/2697998929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74981ab650 con 0x7f7498074590 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.279+0000 7f74a0258640 1 -- 172.21.15.12:0/2697998929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7498074970 con 0x7f7498074590 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.280+0000 7f7496ffd640 1 -- 172.21.15.12:0/2697998929 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7488037020 con 0x7f7498074590 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.281+0000 7f7496ffd640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f74800a3240 0x7f74800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.282+0000 7f749d7f3640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f74800a3240 0x7f74800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:16.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.282+0000 7f7496ffd640 1 -- 172.21.15.12:0/2697998929 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f74880f0560 con 0x7f7498074590 2024-09-16T00:58:16.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.282+0000 7f749d7f3640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f74800a3240 0x7f74800a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f74980fff10 tx=0x7f748c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:16.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.285+0000 7f7496ffd640 1 -- 172.21.15.12:0/2697998929 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f74880bd680 con 0x7f7498074590 2024-09-16T00:58:16.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.498+0000 7f74a0258640 1 -- 172.21.15.12:0/2697998929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7498105000 con 0x7f7498074590 2024-09-16T00:58:16.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:16.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:16.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:16.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:16.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:16.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:16.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:16.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: Deploying daemon mds.i on smithi119 2024-09-16T00:58:16.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] up:boot 2024-09-16T00:58:16.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: fsmap 8 up:standby 2024-09-16T00:58:16.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:16 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T00:58:16.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.499+0000 7f7496ffd640 1 -- 172.21.15.12:0/2697998929 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7f74880bcf80 con 0x7f7498074590 2024-09-16T00:58:16.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:16.502 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"btime":"2024-09-16T00:58:15:598913+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-16T00:58:16.502 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 -- 172.21.15.12:0/2697998929 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f74800a3240 msgr2=0x7f74800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f74800a3240 0x7f74800a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f74980fff10 tx=0x7f748c00b390 comp rx=0 tx=0).stop 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 -- 172.21.15.12:0/2697998929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7498074590 msgr2=0x7f74981a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7498074590 0x7f74981a4780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7488005cc0 tx=0x7f748802f630 comp rx=0 tx=0).stop 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 -- 172.21.15.12:0/2697998929 shutdown_connections 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f74800a3240 0x7f74800a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7498112ba0 0x7f749819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7498074eb0 0x7f74981a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 --2- 172.21.15.12:0/2697998929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7498074590 0x7f74981a4780 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 -- 172.21.15.12:0/2697998929 >> 172.21.15.12:0/2697998929 conn(0x7f74980fd8f0 msgr2=0x7f74980ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 -- 172.21.15.12:0/2697998929 shutdown_connections 2024-09-16T00:58:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:16.501+0000 7f74a0258640 1 -- 172.21.15.12:0/2697998929 wait complete. 2024-09-16T00:58:16.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:16.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:16.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:16.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:16.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:16.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:16.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:16.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: Deploying daemon mds.i on smithi119 2024-09-16T00:58:16.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] up:boot 2024-09-16T00:58:16.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: fsmap 8 up:standby 2024-09-16T00:58:16.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:16 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T00:58:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: Deploying daemon mds.i on smithi119 2024-09-16T00:58:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] up:boot 2024-09-16T00:58:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: fsmap 8 up:standby 2024-09-16T00:58:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:16 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T00:58:17.539 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:17 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2697998929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:17.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:17 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2697998929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:17.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:17 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2697998929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:18.096 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 00:58:17 smithi119 systemd[1]: Started Ceph mds.i for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:58:18.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:18 smithi119 ceph-mon[35049]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:18.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:18.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:18.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:18 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:18.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:18 smithi012 ceph-mon[31197]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:18.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:18.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:18.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:18.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:18.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:18.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:18 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:18.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:18 smithi098 ceph-mon[35346]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:18.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:18.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:18.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:18.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:18.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:18.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:18 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:19.200 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:58:19.498 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:19.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:19 smithi012 ceph-mon[31197]: Deploying daemon mds.g on smithi012 2024-09-16T00:58:19.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:19 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] up:boot 2024-09-16T00:58:19.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:19 smithi012 ceph-mon[31197]: fsmap 9 up:standby 2024-09-16T00:58:19.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:19 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T00:58:19.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:19 smithi098 ceph-mon[35346]: Deploying daemon mds.g on smithi012 2024-09-16T00:58:19.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:19 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] up:boot 2024-09-16T00:58:19.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:19 smithi098 ceph-mon[35346]: fsmap 9 up:standby 2024-09-16T00:58:19.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:19 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T00:58:19.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:19 smithi119 ceph-mon[35049]: Deploying daemon mds.g on smithi012 2024-09-16T00:58:19.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:19 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] up:boot 2024-09-16T00:58:19.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:19 smithi119 ceph-mon[35049]: fsmap 9 up:standby 2024-09-16T00:58:19.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:19 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T00:58:20.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.148+0000 7f08ce8c1640 1 -- 172.21.15.12:0/2116721851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08c8102790 msgr2=0x7f08c81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:20.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.148+0000 7f08ce8c1640 1 --2- 172.21.15.12:0/2116721851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08c8102790 0x7f08c81067e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009900 tx=0x7f08bc02a410 comp rx=0 tx=0).stop 2024-09-16T00:58:20.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.148+0000 7f08ce8c1640 1 -- 172.21.15.12:0/2116721851 shutdown_connections 2024-09-16T00:58:20.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.148+0000 7f08ce8c1640 1 --2- 172.21.15.12:0/2116721851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8106f10 0x7f08c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:20.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.148+0000 7f08ce8c1640 1 --2- 172.21.15.12:0/2116721851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08c8102790 0x7f08c81067e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:20.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.148+0000 7f08ce8c1640 1 --2- 172.21.15.12:0/2116721851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08c8101de0 0x7f08c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:20.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.148+0000 7f08ce8c1640 1 -- 172.21.15.12:0/2116721851 >> 172.21.15.12:0/2116721851 conn(0x7f08c80fd8c0 msgr2=0x7f08c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:20.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.148+0000 7f08ce8c1640 1 -- 172.21.15.12:0/2116721851 shutdown_connections 2024-09-16T00:58:20.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.148+0000 7f08ce8c1640 1 -- 172.21.15.12:0/2116721851 wait complete. 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.149+0000 7f08ce8c1640 1 Processor -- start 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.149+0000 7f08ce8c1640 1 -- start start 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.149+0000 7f08ce8c1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08c8101de0 0x7f08c80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08ce8c1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08c8102790 0x7f08c8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08ce8c1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8106f10 0x7f08c8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08ce8c1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f08c8111f70 con 0x7f08c8101de0 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08ce8c1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f08c8111df0 con 0x7f08c8102790 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08ce8c1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f08c81120f0 con 0x7f08c8106f10 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08c8101de0 0x7f08c80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08c8101de0 0x7f08c80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49184/0 (socket says 172.21.15.12:49184) 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c7fff640 1 -- 172.21.15.12:0/3577855716 learned_addr learned my addr 172.21.15.12:0/3577855716 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c77fe640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08c8102790 0x7f08c8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08cce5e640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8106f10 0x7f08c8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c7fff640 1 -- 172.21.15.12:0/3577855716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8106f10 msgr2=0x7f08c8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c7fff640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8106f10 0x7f08c8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c7fff640 1 -- 172.21.15.12:0/3577855716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08c8102790 msgr2=0x7f08c8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c7fff640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08c8102790 0x7f08c8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c7fff640 1 -- 172.21.15.12:0/3577855716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c81a6900 con 0x7f08c8101de0 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08cce5e640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8106f10 0x7f08c8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c7fff640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08c8101de0 0x7f08c80744f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f08b800d950 tx=0x7f08b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c57fa640 1 -- 172.21.15.12:0/3577855716 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8017070 con 0x7f08c8101de0 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08ce8c1640 1 -- 172.21.15.12:0/3577855716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c81a6bf0 con 0x7f08c8101de0 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c57fa640 1 -- 172.21.15.12:0/3577855716 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08b8009c30 con 0x7f08c8101de0 2024-09-16T00:58:20.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08c57fa640 1 -- 172.21.15.12:0/3577855716 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b800f6b0 con 0x7f08c8101de0 2024-09-16T00:58:20.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.150+0000 7f08ce8c1640 1 -- 172.21.15.12:0/3577855716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c81a7100 con 0x7f08c8101de0 2024-09-16T00:58:20.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.151+0000 7f08ce8c1640 1 -- 172.21.15.12:0/3577855716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c81021c0 con 0x7f08c8101de0 2024-09-16T00:58:20.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.153+0000 7f08c57fa640 1 -- 172.21.15.12:0/3577855716 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f08b80109d0 con 0x7f08c8101de0 2024-09-16T00:58:20.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.153+0000 7f08c57fa640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f08b00a3240 0x7f08b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:20.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.153+0000 7f08c77fe640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f08b00a3240 0x7f08b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:20.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.153+0000 7f08c57fa640 1 -- 172.21.15.12:0/3577855716 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f08b80cf120 con 0x7f08c8101de0 2024-09-16T00:58:20.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.154+0000 7f08c77fe640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f08b00a3240 0x7f08b00a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009230 tx=0x7f08bc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:20.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.158+0000 7f08c57fa640 1 -- 172.21.15.12:0/3577855716 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08b8009de0 con 0x7f08c8101de0 2024-09-16T00:58:20.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.376+0000 7f08ce8c1640 1 -- 172.21.15.12:0/3577855716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08c802d7c0 con 0x7f08c8101de0 2024-09-16T00:58:20.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.376+0000 7f08c57fa640 1 -- 172.21.15.12:0/3577855716 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8040 (secure 0 0 0) 0x7f08b809c240 con 0x7f08c8101de0 2024-09-16T00:58:20.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:20.379 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"btime":"2024-09-16T00:58:18:333526+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-16T00:58:20.379 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 10 2024-09-16T00:58:20.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 -- 172.21.15.12:0/3577855716 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f08b00a3240 msgr2=0x7f08b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f08b00a3240 0x7f08b00a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009230 tx=0x7f08bc0058d0 comp rx=0 tx=0).stop 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 -- 172.21.15.12:0/3577855716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08c8101de0 msgr2=0x7f08c80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08c8101de0 0x7f08c80744f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f08b800d950 tx=0x7f08b800de10 comp rx=0 tx=0).stop 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 -- 172.21.15.12:0/3577855716 shutdown_connections 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f08b00a3240 0x7f08b00a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8106f10 0x7f08c8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08c8102790 0x7f08c8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 --2- 172.21.15.12:0/3577855716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08c8101de0 0x7f08c80744f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 -- 172.21.15.12:0/3577855716 >> 172.21.15.12:0/3577855716 conn(0x7f08c80fd8c0 msgr2=0x7f08c80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 -- 172.21.15.12:0/3577855716 shutdown_connections 2024-09-16T00:58:20.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:20.379+0000 7f08ce8c1640 1 -- 172.21.15.12:0/3577855716 wait complete. 2024-09-16T00:58:20.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:20 smithi012 ceph-mon[31197]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:20.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:20 smithi098 ceph-mon[35346]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:20.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:20 smithi119 ceph-mon[35049]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:21.354 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 00:58:21 smithi012 systemd[1]: Started Ceph mds.g for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:58:21.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:21 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3577855716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:21.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:21.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:21.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:21.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:21.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:21.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:21 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:21 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3577855716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:21.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:21 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:21.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:21 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3577855716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:21.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:21.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:21.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:21.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:21.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:21.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:21 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:22.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:22 smithi012 ceph-mon[31197]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:22.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:22 smithi012 ceph-mon[31197]: Deploying daemon mds.a on smithi012 2024-09-16T00:58:22.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:22 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.12:6838/3964724197,v1:172.21.15.12:6839/3964724197] up:boot 2024-09-16T00:58:22.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:22 smithi012 ceph-mon[31197]: fsmap 10 up:standby 2024-09-16T00:58:22.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:22 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T00:58:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:22 smithi098 ceph-mon[35346]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:22 smithi098 ceph-mon[35346]: Deploying daemon mds.a on smithi012 2024-09-16T00:58:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:22 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.12:6838/3964724197,v1:172.21.15.12:6839/3964724197] up:boot 2024-09-16T00:58:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:22 smithi098 ceph-mon[35346]: fsmap 10 up:standby 2024-09-16T00:58:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:22 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T00:58:22.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:22 smithi119 ceph-mon[35049]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:22.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:22 smithi119 ceph-mon[35049]: Deploying daemon mds.a on smithi012 2024-09-16T00:58:22.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:22 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.12:6838/3964724197,v1:172.21.15.12:6839/3964724197] up:boot 2024-09-16T00:58:22.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:22 smithi119 ceph-mon[35049]: fsmap 10 up:standby 2024-09-16T00:58:22.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:22 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T00:58:23.357 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 00:58:23 smithi012 systemd[1]: Starting Ceph mds.a for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:58:23.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:58:23.656 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 00:58:23 smithi012 podman[69704]: 2024-09-16 00:58:23.301551662 +0000 UTC m=+0.016518377 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:58:23.656 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 00:58:23 smithi012 podman[69704]: 2024-09-16 00:58:23.401499065 +0000 UTC m=+0.116465770 container create 138edc3f38ea9ebfdd10e07969e67c1d34767223c67bd3dd1854fd78e0deed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-16T00:58:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:23.938 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 00:58:23 smithi012 podman[69704]: 2024-09-16 00:58:23.662663355 +0000 UTC m=+0.377630071 container init 138edc3f38ea9ebfdd10e07969e67c1d34767223c67bd3dd1854fd78e0deed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T00:58:23.938 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 00:58:23 smithi012 podman[69704]: 2024-09-16 00:58:23.665887623 +0000 UTC m=+0.380854333 container start 138edc3f38ea9ebfdd10e07969e67c1d34767223c67bd3dd1854fd78e0deed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-16T00:58:23.938 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 00:58:23 smithi012 ceph-mds[69754]: -- 172.21.15.12:0/2639306685 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56059ed2d860 con 0x56059ed0a800 2024-09-16T00:58:23.938 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 00:58:23 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a[69737]: starting mds.a at 2024-09-16T00:58:23.938 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 00:58:23 smithi012 bash[69704]: 138edc3f38ea9ebfdd10e07969e67c1d34767223c67bd3dd1854fd78e0deed70 2024-09-16T00:58:23.939 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 00:58:23 smithi012 systemd[1]: Started Ceph mds.a for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:58:24.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.291+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1840718267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac0100e30 msgr2=0x7f5ac0104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.291+0000 7f5ac7a8b640 1 --2- 172.21.15.12:0/1840718267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac0100e30 0x7f5ac0104e80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009900 tx=0x7f5ab002a410 comp rx=0 tx=0).stop 2024-09-16T00:58:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.291+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1840718267 shutdown_connections 2024-09-16T00:58:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.291+0000 7f5ac7a8b640 1 --2- 172.21.15.12:0/1840718267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01055b0 0x7f5ac010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.291+0000 7f5ac7a8b640 1 --2- 172.21.15.12:0/1840718267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac0100e30 0x7f5ac0104e80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.291+0000 7f5ac7a8b640 1 --2- 172.21.15.12:0/1840718267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ac0100480 0x7f5ac0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.291+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1840718267 >> 172.21.15.12:0/1840718267 conn(0x7f5ac0077210 msgr2=0x7f5ac00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1840718267 shutdown_connections 2024-09-16T00:58:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1840718267 wait complete. 2024-09-16T00:58:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac7a8b640 1 Processor -- start 2024-09-16T00:58:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac7a8b640 1 -- start start 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac7a8b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac0100480 0x7f5ac010e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac7a8b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ac0100e30 0x7f5ac010ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac7a8b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01055b0 0x7f5ac010f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac7a8b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0111f90 con 0x7f5ac0100480 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac7a8b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0111e10 con 0x7f5ac01055b0 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac7a8b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0112110 con 0x7f5ac0100e30 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.292+0000 7f5ac5827640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac0100480 0x7f5ac010e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac5827640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac0100480 0x7f5ac010e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49246/0 (socket says 172.21.15.12:49246) 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac5827640 1 -- 172.21.15.12:0/1445656501 learned_addr learned my addr 172.21.15.12:0/1445656501 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac6028640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01055b0 0x7f5ac010f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac5026640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ac0100e30 0x7f5ac010ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac5827640 1 -- 172.21.15.12:0/1445656501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ac0100e30 msgr2=0x7f5ac010ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac5827640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ac0100e30 0x7f5ac010ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac5827640 1 -- 172.21.15.12:0/1445656501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01055b0 msgr2=0x7f5ac010f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac5827640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01055b0 0x7f5ac010f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac5827640 1 -- 172.21.15.12:0/1445656501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac01a6910 con 0x7f5ac0100480 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac5827640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac0100480 0x7f5ac010e850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00d770 tx=0x7f5abc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ab6ffd640 1 -- 172.21.15.12:0/1445656501 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc017070 con 0x7f5ac0100480 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ab6ffd640 1 -- 172.21.15.12:0/1445656501 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5abc005500 con 0x7f5ac0100480 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1445656501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac01a6c00 con 0x7f5ac0100480 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ab6ffd640 1 -- 172.21.15.12:0/1445656501 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc004e00 con 0x7f5ac0100480 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.293+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1445656501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac01a7110 con 0x7f5ac0100480 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.294+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1445656501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac0100860 con 0x7f5ac0100480 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.295+0000 7f5ab6ffd640 1 -- 172.21.15.12:0/1445656501 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5abc004fa0 con 0x7f5ac0100480 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.296+0000 7f5ab6ffd640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5aac0a32c0 0x7f5aac0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.296+0000 7f5ac5026640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5aac0a32c0 0x7f5aac0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.297+0000 7f5ab6ffd640 1 -- 172.21.15.12:0/1445656501 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f5abc0cee70 con 0x7f5ac0100480 2024-09-16T00:58:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.297+0000 7f5ac5026640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5aac0a32c0 0x7f5aac0a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009230 tx=0x7f5ab00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.301+0000 7f5ab6ffd640 1 -- 172.21.15.12:0/1445656501 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5abc09b940 con 0x7f5ac0100480 2024-09-16T00:58:24.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.515+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1445656501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ac002d7c0 con 0x7f5ac0100480 2024-09-16T00:58:24.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.516+0000 7f5ab6ffd640 1 -- 172.21.15.12:0/1445656501 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9692 (secure 0 0 0) 0x7f5abc09fc40 con 0x7f5ac0100480 2024-09-16T00:58:24.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:24.517 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":12,"btime":"2024-09-16T00:58:24:357102+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-16T00:58:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 12 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1445656501 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5aac0a32c0 msgr2=0x7f5aac0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5aac0a32c0 0x7f5aac0a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009230 tx=0x7f5ab00058d0 comp rx=0 tx=0).stop 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1445656501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac0100480 msgr2=0x7f5ac010e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac0100480 0x7f5ac010e850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00d770 tx=0x7f5abc00dc30 comp rx=0 tx=0).stop 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1445656501 shutdown_connections 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5aac0a32c0 0x7f5aac0a5780 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac01055b0 0x7f5ac010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ac0100e30 0x7f5ac010ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 --2- 172.21.15.12:0/1445656501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac0100480 0x7f5ac010e850 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1445656501 >> 172.21.15.12:0/1445656501 conn(0x7f5ac0077210 msgr2=0x7f5ac0103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1445656501 shutdown_connections 2024-09-16T00:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:24.518+0000 7f5ac7a8b640 1 -- 172.21.15.12:0/1445656501 wait complete. 2024-09-16T00:58:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: Deploying daemon mds.b on smithi098 2024-09-16T00:58:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] up:boot 2024-09-16T00:58:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: fsmap 11 up:standby 2024-09-16T00:58:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T00:58:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:24 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1445656501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:25.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: Deploying daemon mds.b on smithi098 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] up:boot 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: fsmap 11 up:standby 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T00:58:25.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:24 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1445656501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:58:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:58:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: Deploying daemon mds.b on smithi098 2024-09-16T00:58:25.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] up:boot 2024-09-16T00:58:25.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: fsmap 11 up:standby 2024-09-16T00:58:25.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T00:58:25.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:24 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1445656501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:25.871 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:58:25 smithi098 systemd[1]: Starting Ceph mds.b for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:58:26.371 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:58:26 smithi098 podman[65532]: 2024-09-16 00:58:25.985226696 +0000 UTC m=+0.015808303 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:58:26.371 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:58:26 smithi098 podman[65532]: 2024-09-16 00:58:26.100990193 +0000 UTC m=+0.131571799 container create 8ddc78de04377cb88020002e8af35b94b5eecbe59fc634146fe2a2b0749b80e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-16T00:58:26.371 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:58:26 smithi098 podman[65532]: 2024-09-16 00:58:26.370638711 +0000 UTC m=+0.401220317 container init 8ddc78de04377cb88020002e8af35b94b5eecbe59fc634146fe2a2b0749b80e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-16T00:58:26.712 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:58:26 smithi098 podman[65532]: 2024-09-16 00:58:26.373611913 +0000 UTC m=+0.404193529 container start 8ddc78de04377cb88020002e8af35b94b5eecbe59fc634146fe2a2b0749b80e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T00:58:26.712 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:58:26 smithi098 ceph-mds[65551]: -- 172.21.15.98:0/245073303 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560cd9bfd860 con 0x560cd9bda800 2024-09-16T00:58:26.712 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:58:26 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b[65547]: starting mds.b at 2024-09-16T00:58:26.712 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:58:26 smithi098 bash[65532]: 8ddc78de04377cb88020002e8af35b94b5eecbe59fc634146fe2a2b0749b80e5 2024-09-16T00:58:26.712 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:58:26 smithi098 systemd[1]: Started Ceph mds.b for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:58:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:26 smithi119 ceph-mon[35049]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:26 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:27.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:26 smithi012 ceph-mon[31197]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:26 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:26 smithi098 ceph-mon[35346]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:26 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:27.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:58:27.916 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:28.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:27 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] up:boot 2024-09-16T00:58:28.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:27 smithi119 ceph-mon[35049]: fsmap 12 up:standby 2024-09-16T00:58:28.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:27 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T00:58:28.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:27 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] up:boot 2024-09-16T00:58:28.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:27 smithi012 ceph-mon[31197]: fsmap 12 up:standby 2024-09-16T00:58:28.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:27 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T00:58:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:27 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] up:boot 2024-09-16T00:58:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:27 smithi098 ceph-mon[35346]: fsmap 12 up:standby 2024-09-16T00:58:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:27 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T00:58:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 -- 172.21.15.12:0/430564322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d381008d0 msgr2=0x7f7d38100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 --2- 172.21.15.12:0/430564322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d381008d0 0x7f7d38100cb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009900 tx=0x7f7d3402a410 comp rx=0 tx=0).stop 2024-09-16T00:58:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 -- 172.21.15.12:0/430564322 shutdown_connections 2024-09-16T00:58:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 --2- 172.21.15.12:0/430564322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d3810e480 0x7f7d38110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 --2- 172.21.15.12:0/430564322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d38101280 0x7f7d3810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 --2- 172.21.15.12:0/430564322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d381008d0 0x7f7d38100cb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 -- 172.21.15.12:0/430564322 >> 172.21.15.12:0/430564322 conn(0x7f7d380fc7a0 msgr2=0x7f7d380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 -- 172.21.15.12:0/430564322 shutdown_connections 2024-09-16T00:58:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 -- 172.21.15.12:0/430564322 wait complete. 2024-09-16T00:58:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 Processor -- start 2024-09-16T00:58:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.412+0000 7f7d401c6640 1 -- start start 2024-09-16T00:58:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d401c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d381008d0 0x7f7d3819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d401c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d38101280 0x7f7d3819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d401c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d3810e480 0x7f7d3819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d401c6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7d381141b0 con 0x7f7d3810e480 2024-09-16T00:58:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d401c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38114030 con 0x7f7d38101280 2024-09-16T00:58:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d401c6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38114330 con 0x7f7d381008d0 2024-09-16T00:58:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3e763640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d3810e480 0x7f7d3819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3e763640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d3810e480 0x7f7d3819ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44464/0 (socket says 172.21.15.12:44464) 2024-09-16T00:58:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3e763640 1 -- 172.21.15.12:0/2780237988 learned_addr learned my addr 172.21.15.12:0/2780237988 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3df62640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d381008d0 0x7f7d3819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3d761640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d38101280 0x7f7d3819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3e763640 1 -- 172.21.15.12:0/2780237988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d381008d0 msgr2=0x7f7d3819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3e763640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d381008d0 0x7f7d3819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3e763640 1 -- 172.21.15.12:0/2780237988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d38101280 msgr2=0x7f7d3819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3e763640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d38101280 0x7f7d3819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3e763640 1 -- 172.21.15.12:0/2780237988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3819f640 con 0x7f7d3810e480 2024-09-16T00:58:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d3e763640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d3810e480 0x7f7d3819ef60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000eb10 tx=0x7f7d3000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d2effd640 1 -- 172.21.15.12:0/2780237988 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30004b20 con 0x7f7d3810e480 2024-09-16T00:58:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d401c6640 1 -- 172.21.15.12:0/2780237988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3819f930 con 0x7f7d3810e480 2024-09-16T00:58:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d2effd640 1 -- 172.21.15.12:0/2780237988 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d30004cc0 con 0x7f7d3810e480 2024-09-16T00:58:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.413+0000 7f7d2effd640 1 -- 172.21.15.12:0/2780237988 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30010790 con 0x7f7d3810e480 2024-09-16T00:58:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.414+0000 7f7d401c6640 1 -- 172.21.15.12:0/2780237988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d381a7210 con 0x7f7d3810e480 2024-09-16T00:58:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.415+0000 7f7d401c6640 1 -- 172.21.15.12:0/2780237988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d38100cb0 con 0x7f7d3810e480 2024-09-16T00:58:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.416+0000 7f7d2effd640 1 -- 172.21.15.12:0/2780237988 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7d30010930 con 0x7f7d3810e480 2024-09-16T00:58:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.417+0000 7f7d2effd640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d240a3240 0x7f7d240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.417+0000 7f7d3df62640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d240a3240 0x7f7d240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.417+0000 7f7d2effd640 1 -- 172.21.15.12:0/2780237988 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f7d300cfc40 con 0x7f7d3810e480 2024-09-16T00:58:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.417+0000 7f7d3df62640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d240a3240 0x7f7d240a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009230 tx=0x7f7d340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.420+0000 7f7d2effd640 1 -- 172.21.15.12:0/2780237988 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d3009ce00 con 0x7f7d3810e480 2024-09-16T00:58:28.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.671+0000 7f7d401c6640 1 -- 172.21.15.12:0/2780237988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d3819b9f0 con 0x7f7d3810e480 2024-09-16T00:58:28.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.672+0000 7f7d2effd640 1 -- 172.21.15.12:0/2780237988 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10518 (secure 0 0 0) 0x7f7d3819b9f0 con 0x7f7d3810e480 2024-09-16T00:58:28.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:28.673 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"btime":"2024-09-16T00:58:26:822332+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24518,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-16T00:58:28.673 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2024-09-16T00:58:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 -- 172.21.15.12:0/2780237988 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d240a3240 msgr2=0x7f7d240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d240a3240 0x7f7d240a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009230 tx=0x7f7d340058d0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 -- 172.21.15.12:0/2780237988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d3810e480 msgr2=0x7f7d3819ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d3810e480 0x7f7d3819ef60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000eb10 tx=0x7f7d3000c2d0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 -- 172.21.15.12:0/2780237988 shutdown_connections 2024-09-16T00:58:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d240a3240 0x7f7d240a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d3810e480 0x7f7d3819ef60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d38101280 0x7f7d3819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 --2- 172.21.15.12:0/2780237988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d381008d0 0x7f7d3819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 -- 172.21.15.12:0/2780237988 >> 172.21.15.12:0/2780237988 conn(0x7f7d380fc7a0 msgr2=0x7f7d380feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:28.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 -- 172.21.15.12:0/2780237988 shutdown_connections 2024-09-16T00:58:28.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:28.674+0000 7f7d401c6640 1 -- 172.21.15.12:0/2780237988 wait complete. 2024-09-16T00:58:29.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:28 smithi012 ceph-mon[31197]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:29.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:28 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:28 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:28 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:28 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:28 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:28 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2780237988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:28 smithi119 ceph-mon[35049]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:28 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:28 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:28 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:28 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:28 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:28 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2780237988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:28 smithi098 ceph-mon[35346]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:28 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:28 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:28 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:28 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:28 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:28 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2780237988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:29.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-16T00:58:29.665 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:30.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.163+0000 7f250aa57640 1 -- 172.21.15.12:0/2435324603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2504102ef0 msgr2=0x7f250410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:30.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.163+0000 7f250aa57640 1 --2- 172.21.15.12:0/2435324603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2504102ef0 0x7f250410da40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009ca0 tx=0x7f24fc02a950 comp rx=0 tx=0).stop 2024-09-16T00:58:30.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.163+0000 7f250aa57640 1 -- 172.21.15.12:0/2435324603 shutdown_connections 2024-09-16T00:58:30.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.163+0000 7f250aa57640 1 --2- 172.21.15.12:0/2435324603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2504102ef0 0x7f250410da40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.163+0000 7f250aa57640 1 --2- 172.21.15.12:0/2435324603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2504102570 0x7f25041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.163+0000 7f250aa57640 1 --2- 172.21.15.12:0/2435324603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2504100e20 0x7f2504101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.163+0000 7f250aa57640 1 -- 172.21.15.12:0/2435324603 >> 172.21.15.12:0/2435324603 conn(0x7f25040fc7d0 msgr2=0x7f25040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.163+0000 7f250aa57640 1 -- 172.21.15.12:0/2435324603 shutdown_connections 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.163+0000 7f250aa57640 1 -- 172.21.15.12:0/2435324603 wait complete. 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.164+0000 7f250aa57640 1 Processor -- start 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.164+0000 7f250aa57640 1 -- start start 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.164+0000 7f250aa57640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2504100e20 0x7f25041993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.164+0000 7f250aa57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2504102570 0x7f2504199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f250aa57640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2504102ef0 0x7f2504199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f250aa57640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2504110f80 con 0x7f2504102ef0 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f250aa57640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2504110e00 con 0x7f2504102570 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f250aa57640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2504111100 con 0x7f2504100e20 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f2508ff4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2504102ef0 0x7f2504199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f2508ff4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2504102ef0 0x7f2504199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44488/0 (socket says 172.21.15.12:44488) 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f2508ff4640 1 -- 172.21.15.12:0/21623288 learned_addr learned my addr 172.21.15.12:0/21623288 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f25037fe640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2504102570 0x7f2504199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f2503fff640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2504100e20 0x7f25041993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f2508ff4640 1 -- 172.21.15.12:0/21623288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2504100e20 msgr2=0x7f25041993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f2508ff4640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2504100e20 0x7f25041993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f2508ff4640 1 -- 172.21.15.12:0/21623288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2504102570 msgr2=0x7f2504199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f2508ff4640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2504102570 0x7f2504199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f2508ff4640 1 -- 172.21.15.12:0/21623288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25041a47d0 con 0x7f2504102ef0 2024-09-16T00:58:30.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f2508ff4640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2504102ef0 0x7f2504199e90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f24fc02ae70 tx=0x7f24fc02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f25017fa640 1 -- 172.21.15.12:0/21623288 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc034040 con 0x7f2504102ef0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f25017fa640 1 -- 172.21.15.12:0/21623288 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24fc030920 con 0x7f2504102ef0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f250aa57640 1 -- 172.21.15.12:0/21623288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25041a4a60 con 0x7f2504102ef0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f25017fa640 1 -- 172.21.15.12:0/21623288 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc045480 con 0x7f2504102ef0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.165+0000 7f250aa57640 1 -- 172.21.15.12:0/21623288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25041a4f90 con 0x7f2504102ef0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.166+0000 7f250aa57640 1 -- 172.21.15.12:0/21623288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2504101200 con 0x7f2504102ef0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.168+0000 7f25017fa640 1 -- 172.21.15.12:0/21623288 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f24fc037020 con 0x7f2504102ef0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.168+0000 7f25017fa640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32c0 0x7f24ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.168+0000 7f2503fff640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32c0 0x7f24ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.168+0000 7f25017fa640 1 -- 172.21.15.12:0/21623288 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f24fc0f0480 con 0x7f2504102ef0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.169+0000 7f2503fff640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32c0 0x7f24ec0a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f24f4005fd0 tx=0x7f24f4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:30.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.171+0000 7f25017fa640 1 -- 172.21.15.12:0/21623288 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24fc0bd640 con 0x7f2504102ef0 2024-09-16T00:58:30.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.360+0000 7f250aa57640 1 -- 172.21.15.12:0/21623288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2504109090 con 0x7f2504102ef0 2024-09-16T00:58:30.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.361+0000 7f25017fa640 1 -- 172.21.15.12:0/21623288 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f24fc0bcf40 con 0x7f2504102ef0 2024-09-16T00:58:30.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:30.361 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-16T00:58:30.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T00:58:30.362 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-16T00:58:30.362 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-16T00:58:30.362 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T00:58:30.362 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-16T00:58:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 -- 172.21.15.12:0/21623288 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32c0 msgr2=0x7f24ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32c0 0x7f24ec0a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f24f4005fd0 tx=0x7f24f4005850 comp rx=0 tx=0).stop 2024-09-16T00:58:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 -- 172.21.15.12:0/21623288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2504102ef0 msgr2=0x7f2504199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2504102ef0 0x7f2504199e90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f24fc02ae70 tx=0x7f24fc02f5d0 comp rx=0 tx=0).stop 2024-09-16T00:58:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 -- 172.21.15.12:0/21623288 shutdown_connections 2024-09-16T00:58:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24ec0a32c0 0x7f24ec0a5780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2504102ef0 0x7f2504199e90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2504102570 0x7f2504199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 --2- 172.21.15.12:0/21623288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2504100e20 0x7f25041993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 -- 172.21.15.12:0/21623288 >> 172.21.15.12:0/21623288 conn(0x7f25040fc7d0 msgr2=0x7f25041068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:30.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 -- 172.21.15.12:0/21623288 shutdown_connections 2024-09-16T00:58:30.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:30.363+0000 7f250aa57640 1 -- 172.21.15.12:0/21623288 wait complete. 2024-09-16T00:58:30.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:30 smithi012 ceph-mon[31197]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:30.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:30.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:30.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:30.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:30.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:30.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:30 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:30.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:30 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/21623288' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-16T00:58:30.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:30 smithi098 ceph-mon[35346]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:30.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:30.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:30.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:30.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:30.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:30.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:30 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:30.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:30 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/21623288' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-16T00:58:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:30 smithi119 ceph-mon[35049]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:30.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:30.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:30 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:30.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:30 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/21623288' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-16T00:58:31.613 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T00:58:31.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T00:58:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:32.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:32 smithi012 ceph-mon[31197]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:32.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.281 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.281 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:32 smithi119 ceph-mon[35049]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:32.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.363+0000 7fac44f20640 1 -- 172.21.15.12:0/1577414729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40102790 msgr2=0x7fac401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.363+0000 7fac44f20640 1 --2- 172.21.15.12:0/1577414729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40102790 0x7fac401067e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fac28009900 tx=0x7fac2802a410 comp rx=0 tx=0).stop 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.363+0000 7fac44f20640 1 -- 172.21.15.12:0/1577414729 shutdown_connections 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.363+0000 7fac44f20640 1 --2- 172.21.15.12:0/1577414729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac40106f10 0x7fac4010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.363+0000 7fac44f20640 1 --2- 172.21.15.12:0/1577414729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40102790 0x7fac401067e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.363+0000 7fac44f20640 1 --2- 172.21.15.12:0/1577414729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40101de0 0x7fac401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.363+0000 7fac44f20640 1 -- 172.21.15.12:0/1577414729 >> 172.21.15.12:0/1577414729 conn(0x7fac400fd8c0 msgr2=0x7fac400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.363+0000 7fac44f20640 1 -- 172.21.15.12:0/1577414729 shutdown_connections 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.363+0000 7fac44f20640 1 -- 172.21.15.12:0/1577414729 wait complete. 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac44f20640 1 Processor -- start 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac44f20640 1 -- start start 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac44f20640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40101de0 0x7fac40198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac44f20640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac40102790 0x7fac40198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac44f20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40106f10 0x7fac4019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac44f20640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fac40111f90 con 0x7fac40106f10 2024-09-16T00:58:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac44f20640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fac40111e10 con 0x7fac40102790 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac44f20640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fac40112110 con 0x7fac40101de0 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac3ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40106f10 0x7fac4019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac3ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40106f10 0x7fac4019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44500/0 (socket says 172.21.15.12:44500) 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac3ed9d640 1 -- 172.21.15.12:0/1590830388 learned_addr learned my addr 172.21.15.12:0/1590830388 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.364+0000 7fac3e59c640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40101de0 0x7fac40198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac37fff640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac40102790 0x7fac40198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac3ed9d640 1 -- 172.21.15.12:0/1590830388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40101de0 msgr2=0x7fac40198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac3ed9d640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40101de0 0x7fac40198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac3ed9d640 1 -- 172.21.15.12:0/1590830388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac40102790 msgr2=0x7fac40198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac3ed9d640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac40102790 0x7fac40198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac3ed9d640 1 -- 172.21.15.12:0/1590830388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4019d3c0 con 0x7fac40106f10 2024-09-16T00:58:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac3ed9d640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40106f10 0x7fac4019cce0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fac3800cce0 tx=0x7fac3800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac377fe640 1 -- 172.21.15.12:0/1590830388 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3800f450 con 0x7fac40106f10 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac44f20640 1 -- 172.21.15.12:0/1590830388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4019d6b0 con 0x7fac40106f10 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac377fe640 1 -- 172.21.15.12:0/1590830388 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac3800fad0 con 0x7fac40106f10 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac377fe640 1 -- 172.21.15.12:0/1590830388 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38018b60 con 0x7fac40106f10 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.365+0000 7fac44f20640 1 -- 172.21.15.12:0/1590830388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac401a4f90 con 0x7fac40106f10 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.366+0000 7fac44f20640 1 -- 172.21.15.12:0/1590830388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac401021c0 con 0x7fac40106f10 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.367+0000 7fac377fe640 1 -- 172.21.15.12:0/1590830388 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fac3800fc80 con 0x7fac40106f10 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.368+0000 7fac377fe640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fac2c0a3240 0x7fac2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.368+0000 7fac3e59c640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fac2c0a3240 0x7fac2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.368+0000 7fac377fe640 1 -- 172.21.15.12:0/1590830388 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fac380cfd50 con 0x7fac40106f10 2024-09-16T00:58:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.369+0000 7fac3e59c640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fac2c0a3240 0x7fac2c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fac30009990 tx=0x7fac30009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:32.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.371+0000 7fac377fe640 1 -- 172.21.15.12:0/1590830388 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac38014030 con 0x7fac40106f10 2024-09-16T00:58:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:32 smithi098 ceph-mon[35346]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:32.553+0000 7fac44f20640 1 -- 172.21.15.12:0/1590830388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fac4010a150 con 0x7fac40106f10 2024-09-16T00:58:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.452+0000 7fac377fe640 1 -- 172.21.15.12:0/1590830388 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7fac3809cf10 con 0x7fac40106f10 2024-09-16T00:58:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-16T00:58:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 -- 172.21.15.12:0/1590830388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fac2c0a3240 msgr2=0x7fac2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fac2c0a3240 0x7fac2c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fac30009990 tx=0x7fac30009110 comp rx=0 tx=0).stop 2024-09-16T00:58:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 -- 172.21.15.12:0/1590830388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40106f10 msgr2=0x7fac4019cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40106f10 0x7fac4019cce0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fac3800cce0 tx=0x7fac3800a620 comp rx=0 tx=0).stop 2024-09-16T00:58:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 -- 172.21.15.12:0/1590830388 shutdown_connections 2024-09-16T00:58:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fac2c0a3240 0x7fac2c0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac40106f10 0x7fac4019cce0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac40102790 0x7fac40198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 --2- 172.21.15.12:0/1590830388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40101de0 0x7fac40198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 -- 172.21.15.12:0/1590830388 >> 172.21.15.12:0/1590830388 conn(0x7fac400fd8c0 msgr2=0x7fac400fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.455+0000 7fac44f20640 1 -- 172.21.15.12:0/1590830388 shutdown_connections 2024-09-16T00:58:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:33.456+0000 7fac44f20640 1 -- 172.21.15.12:0/1590830388 wait complete. 2024-09-16T00:58:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:33 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:33 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1590830388' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-16T00:58:33.773 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:33.774 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:33.774 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:33.774 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:33.774 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:33 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:33.774 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:33 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1590830388' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-16T00:58:33.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:33.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:33.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:33.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:33.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:33 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:58:33.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:33 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1590830388' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-16T00:58:34.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-16T00:58:34.389 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:34.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:34 smithi012 ceph-mon[31197]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:34.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:34 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1590830388' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-16T00:58:34.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:34 smithi012 ceph-mon[31197]: osdmap e75: 12 total, 12 up, 12 in 2024-09-16T00:58:34.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:34 smithi119 ceph-mon[35049]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:34.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:34 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1590830388' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-16T00:58:34.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:34 smithi119 ceph-mon[35049]: osdmap e75: 12 total, 12 up, 12 in 2024-09-16T00:58:34.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.870+0000 7f4312ad0640 1 -- 172.21.15.12:0/3720790276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c106f10 msgr2=0x7f430c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:34.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.870+0000 7f4312ad0640 1 --2- 172.21.15.12:0/3720790276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c106f10 0x7f430c10ea90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4304009ca0 tx=0x7f430402a8c0 comp rx=0 tx=0).stop 2024-09-16T00:58:34.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.870+0000 7f4312ad0640 1 -- 172.21.15.12:0/3720790276 shutdown_connections 2024-09-16T00:58:34.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.870+0000 7f4312ad0640 1 --2- 172.21.15.12:0/3720790276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c106f10 0x7f430c10ea90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:34.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.870+0000 7f4312ad0640 1 --2- 172.21.15.12:0/3720790276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f430c102790 0x7f430c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:34.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.870+0000 7f4312ad0640 1 --2- 172.21.15.12:0/3720790276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f430c101de0 0x7f430c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:34.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.870+0000 7f4312ad0640 1 -- 172.21.15.12:0/3720790276 >> 172.21.15.12:0/3720790276 conn(0x7f430c0fd8c0 msgr2=0x7f430c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:34.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.870+0000 7f4312ad0640 1 -- 172.21.15.12:0/3720790276 shutdown_connections 2024-09-16T00:58:34.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.870+0000 7f4312ad0640 1 -- 172.21.15.12:0/3720790276 wait complete. 2024-09-16T00:58:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f4312ad0640 1 Processor -- start 2024-09-16T00:58:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f4312ad0640 1 -- start start 2024-09-16T00:58:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f4312ad0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f430c101de0 0x7f430c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f4312ad0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f430c102790 0x7f430c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f4312ad0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c106f10 0x7f430c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f4312ad0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f430c111f70 con 0x7f430c106f10 2024-09-16T00:58:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f4312ad0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f430c111df0 con 0x7f430c102790 2024-09-16T00:58:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f4312ad0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f430c1120f0 con 0x7f430c101de0 2024-09-16T00:58:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f431106d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c106f10 0x7f430c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f431106d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c106f10 0x7f430c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44518/0 (socket says 172.21.15.12:44518) 2024-09-16T00:58:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f431106d640 1 -- 172.21.15.12:0/3958548243 learned_addr learned my addr 172.21.15.12:0/3958548243 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f431086c640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f430c101de0 0x7f430c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f430bfff640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f430c102790 0x7f430c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f431106d640 1 -- 172.21.15.12:0/3958548243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f430c101de0 msgr2=0x7f430c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f431106d640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f430c101de0 0x7f430c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.871+0000 7f431106d640 1 -- 172.21.15.12:0/3958548243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f430c102790 msgr2=0x7f430c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.872+0000 7f431106d640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f430c102790 0x7f430c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.872+0000 7f431106d640 1 -- 172.21.15.12:0/3958548243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c1a6800 con 0x7f430c106f10 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.872+0000 7f430bfff640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f430c102790 0x7f430c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.872+0000 7f431106d640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c106f10 0x7f430c074f70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4304031a60 tx=0x7f4304031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.872+0000 7f4309ffb640 1 -- 172.21.15.12:0/3958548243 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304003c30 con 0x7f430c106f10 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.872+0000 7f4309ffb640 1 -- 172.21.15.12:0/3958548243 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4304003dd0 con 0x7f430c106f10 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.872+0000 7f4309ffb640 1 -- 172.21.15.12:0/3958548243 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43040047e0 con 0x7f430c106f10 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.872+0000 7f4312ad0640 1 -- 172.21.15.12:0/3958548243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430c1a6a90 con 0x7f430c106f10 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.872+0000 7f4312ad0640 1 -- 172.21.15.12:0/3958548243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430c1a7020 con 0x7f430c106f10 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.873+0000 7f4312ad0640 1 -- 172.21.15.12:0/3958548243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430c1021c0 con 0x7f430c106f10 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.874+0000 7f4309ffb640 1 -- 172.21.15.12:0/3958548243 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f430402f790 con 0x7f430c106f10 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.875+0000 7f4309ffb640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42fc0a32c0 0x7f42fc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.875+0000 7f431086c640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42fc0a32c0 0x7f42fc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.875+0000 7f4309ffb640 1 -- 172.21.15.12:0/3958548243 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7f43040f0950 con 0x7f430c106f10 2024-09-16T00:58:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.876+0000 7f431086c640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42fc0a32c0 0x7f42fc0a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f43000058c0 tx=0x7f430000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:34.880+0000 7f4309ffb640 1 -- 172.21.15.12:0/3958548243 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43040bdac0 con 0x7f430c106f10 2024-09-16T00:58:34.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:34 smithi098 ceph-mon[35346]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:34.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:34 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1590830388' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-16T00:58:34.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:34 smithi098 ceph-mon[35346]: osdmap e75: 12 total, 12 up, 12 in 2024-09-16T00:58:35.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.056+0000 7f4312ad0640 1 -- 172.21.15.12:0/3958548243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f430c10a150 con 0x7f430c106f10 2024-09-16T00:58:35.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.490+0000 7f4309ffb640 1 -- 172.21.15.12:0/3958548243 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v77) ==== 171+0+0 (secure 0 0 0) 0x7f43040bd3c0 con 0x7f430c106f10 2024-09-16T00:58:35.491 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-16T00:58:35.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.492+0000 7f4312ad0640 1 -- 172.21.15.12:0/3958548243 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42fc0a32c0 msgr2=0x7f42fc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:35.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.492+0000 7f4312ad0640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42fc0a32c0 0x7f42fc0a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f43000058c0 tx=0x7f430000a2d0 comp rx=0 tx=0).stop 2024-09-16T00:58:35.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.492+0000 7f4312ad0640 1 -- 172.21.15.12:0/3958548243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c106f10 msgr2=0x7f430c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:35.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.492+0000 7f4312ad0640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c106f10 0x7f430c074f70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4304031a60 tx=0x7f4304031a90 comp rx=0 tx=0).stop 2024-09-16T00:58:35.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.493+0000 7f4312ad0640 1 -- 172.21.15.12:0/3958548243 shutdown_connections 2024-09-16T00:58:35.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.493+0000 7f4312ad0640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f42fc0a32c0 0x7f42fc0a5780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:35.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.493+0000 7f4312ad0640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c106f10 0x7f430c074f70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:35.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.493+0000 7f4312ad0640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f430c102790 0x7f430c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:35.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.493+0000 7f4312ad0640 1 --2- 172.21.15.12:0/3958548243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f430c101de0 0x7f430c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:35.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.493+0000 7f4312ad0640 1 -- 172.21.15.12:0/3958548243 >> 172.21.15.12:0/3958548243 conn(0x7f430c0fd8c0 msgr2=0x7f430c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:35.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.493+0000 7f4312ad0640 1 -- 172.21.15.12:0/3958548243 shutdown_connections 2024-09-16T00:58:35.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:35.493+0000 7f4312ad0640 1 -- 172.21.15.12:0/3958548243 wait complete. 2024-09-16T00:58:35.816 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:35 smithi012 ceph-mon[31197]: osdmap e76: 12 total, 12 up, 12 in 2024-09-16T00:58:35.817 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:35 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3958548243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-16T00:58:35.825 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:35 smithi098 ceph-mon[35346]: osdmap e76: 12 total, 12 up, 12 in 2024-09-16T00:58:35.825 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:35 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3958548243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-16T00:58:35.833 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:35 smithi119 ceph-mon[35049]: osdmap e76: 12 total, 12 up, 12 in 2024-09-16T00:58:35.833 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:35 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3958548243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-16T00:58:36.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T00:58:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:36.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:36 smithi012 ceph-mon[31197]: pgmap v272: 33 pgs: 12 creating+peering, 17 unknown, 4 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:36.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:36 smithi119 ceph-mon[35049]: pgmap v272: 33 pgs: 12 creating+peering, 17 unknown, 4 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:36.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:36 smithi119 ceph-mon[35049]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T00:58:36.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:36 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3958548243' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-16T00:58:36.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:36 smithi119 ceph-mon[35049]: osdmap e77: 12 total, 12 up, 12 in 2024-09-16T00:58:36.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:36 smithi119 ceph-mon[35049]: osdmap e78: 12 total, 12 up, 12 in 2024-09-16T00:58:36.854 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:36 smithi012 ceph-mon[31197]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T00:58:36.854 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:36 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3958548243' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-16T00:58:36.854 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:36 smithi012 ceph-mon[31197]: osdmap e77: 12 total, 12 up, 12 in 2024-09-16T00:58:36.854 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:36 smithi012 ceph-mon[31197]: osdmap e78: 12 total, 12 up, 12 in 2024-09-16T00:58:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:36 smithi098 ceph-mon[35346]: pgmap v272: 33 pgs: 12 creating+peering, 17 unknown, 4 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:36 smithi098 ceph-mon[35346]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T00:58:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:36 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3958548243' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-16T00:58:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:36 smithi098 ceph-mon[35346]: osdmap e77: 12 total, 12 up, 12 in 2024-09-16T00:58:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:36 smithi098 ceph-mon[35346]: osdmap e78: 12 total, 12 up, 12 in 2024-09-16T00:58:36.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.938+0000 7f09b50a5640 1 -- 172.21.15.12:0/3417820020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b0102790 msgr2=0x7f09b01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:36.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.938+0000 7f09b50a5640 1 --2- 172.21.15.12:0/3417820020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b0102790 0x7f09b01067e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0998009900 tx=0x7f099802a410 comp rx=0 tx=0).stop 2024-09-16T00:58:36.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.938+0000 7f09b50a5640 1 -- 172.21.15.12:0/3417820020 shutdown_connections 2024-09-16T00:58:36.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.938+0000 7f09b50a5640 1 --2- 172.21.15.12:0/3417820020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b0106f10 0x7f09b010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:36.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.938+0000 7f09b50a5640 1 --2- 172.21.15.12:0/3417820020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b0102790 0x7f09b01067e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.938+0000 7f09b50a5640 1 --2- 172.21.15.12:0/3417820020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b0101de0 0x7f09b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.938+0000 7f09b50a5640 1 -- 172.21.15.12:0/3417820020 >> 172.21.15.12:0/3417820020 conn(0x7f09b00fd8c0 msgr2=0x7f09b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.938+0000 7f09b50a5640 1 -- 172.21.15.12:0/3417820020 shutdown_connections 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.938+0000 7f09b50a5640 1 -- 172.21.15.12:0/3417820020 wait complete. 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09b50a5640 1 Processor -- start 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09b50a5640 1 -- start start 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09b50a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b0101de0 0x7f09b00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09b50a5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b0102790 0x7f09b0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09b50a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b0106f10 0x7f09b0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09b50a5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0111fc0 con 0x7f09b0102790 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09b50a5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0111e40 con 0x7f09b0101de0 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09b50a5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0112140 con 0x7f09b0106f10 2024-09-16T00:58:36.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09a7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b0102790 0x7f09b0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09a7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b0102790 0x7f09b0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54616/0 (socket says 172.21.15.12:54616) 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09a7fff640 1 -- 172.21.15.12:0/1361930066 learned_addr learned my addr 172.21.15.12:0/1361930066 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09af59e640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b0106f10 0x7f09b0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09aed9d640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b0101de0 0x7f09b00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09a7fff640 1 -- 172.21.15.12:0/1361930066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b0106f10 msgr2=0x7f09b0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09a7fff640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b0106f10 0x7f09b0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09a7fff640 1 -- 172.21.15.12:0/1361930066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b0101de0 msgr2=0x7f09b00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09a7fff640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b0101de0 0x7f09b00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09a7fff640 1 -- 172.21.15.12:0/1361930066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b01a68f0 con 0x7f09b0102790 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09af59e640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b0106f10 0x7f09b0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.939+0000 7f09aed9d640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b0101de0 0x7f09b00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.940+0000 7f09a7fff640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b0102790 0x7f09b0074a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0998004770 tx=0x7f0998003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.940+0000 7f09acd99640 1 -- 172.21.15.12:0/1361930066 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099803f070 con 0x7f09b0102790 2024-09-16T00:58:36.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.940+0000 7f09b50a5640 1 -- 172.21.15.12:0/1361930066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b01a6b80 con 0x7f09b0102790 2024-09-16T00:58:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.940+0000 7f09acd99640 1 -- 172.21.15.12:0/1361930066 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0998031ca0 con 0x7f09b0102790 2024-09-16T00:58:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.940+0000 7f09acd99640 1 -- 172.21.15.12:0/1361930066 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998035030 con 0x7f09b0102790 2024-09-16T00:58:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.940+0000 7f09b50a5640 1 -- 172.21.15.12:0/1361930066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b01a70b0 con 0x7f09b0102790 2024-09-16T00:58:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.941+0000 7f09b50a5640 1 -- 172.21.15.12:0/1361930066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b01021c0 con 0x7f09b0102790 2024-09-16T00:58:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.942+0000 7f09acd99640 1 -- 172.21.15.12:0/1361930066 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0998042070 con 0x7f09b0102790 2024-09-16T00:58:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.943+0000 7f09acd99640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3240 0x7f099c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.943+0000 7f09aed9d640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3240 0x7f099c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.943+0000 7f09acd99640 1 -- 172.21.15.12:0/1361930066 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7f09980f0050 con 0x7f09b0102790 2024-09-16T00:58:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.944+0000 7f09aed9d640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3240 0x7f099c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f09a00058c0 tx=0x7f09a0005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:36.947+0000 7f09acd99640 1 -- 172.21.15.12:0/1361930066 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09980bcf20 con 0x7f09b0102790 2024-09-16T00:58:37.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.160+0000 7f09b50a5640 1 -- 172.21.15.12:0/1361930066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f09b0109bc0 con 0x7f09b0102790 2024-09-16T00:58:37.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.566+0000 7f09acd99640 1 -- 172.21.15.12:0/1361930066 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f09980bc820 con 0x7f09b0102790 2024-09-16T00:58:37.567 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2024-09-16T00:58:37.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.568+0000 7f09b50a5640 1 -- 172.21.15.12:0/1361930066 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3240 msgr2=0x7f099c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:37.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.568+0000 7f09b50a5640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3240 0x7f099c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f09a00058c0 tx=0x7f09a0005d30 comp rx=0 tx=0).stop 2024-09-16T00:58:37.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.568+0000 7f09b50a5640 1 -- 172.21.15.12:0/1361930066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b0102790 msgr2=0x7f09b0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:37.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.568+0000 7f09b50a5640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b0102790 0x7f09b0074a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0998004770 tx=0x7f0998003c10 comp rx=0 tx=0).stop 2024-09-16T00:58:37.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.568+0000 7f09b50a5640 1 -- 172.21.15.12:0/1361930066 shutdown_connections 2024-09-16T00:58:37.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.568+0000 7f09b50a5640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f099c0a3240 0x7f099c0a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:37.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.568+0000 7f09b50a5640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09b0106f10 0x7f09b0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:37.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.568+0000 7f09b50a5640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b0102790 0x7f09b0074a30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:37.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.568+0000 7f09b50a5640 1 --2- 172.21.15.12:0/1361930066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09b0101de0 0x7f09b00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:37.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.568+0000 7f09b50a5640 1 -- 172.21.15.12:0/1361930066 >> 172.21.15.12:0/1361930066 conn(0x7f09b00fd8c0 msgr2=0x7f09b00fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:37.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.569+0000 7f09b50a5640 1 -- 172.21.15.12:0/1361930066 shutdown_connections 2024-09-16T00:58:37.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:37.569+0000 7f09b50a5640 1 -- 172.21.15.12:0/1361930066 wait complete. 2024-09-16T00:58:37.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:37 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1361930066' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-16T00:58:37.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:37 smithi119 ceph-mon[35049]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-16T00:58:37.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:37 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1361930066' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-16T00:58:37.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:37 smithi012 ceph-mon[31197]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-16T00:58:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:37 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1361930066' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-16T00:58:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:37 smithi098 ceph-mon[35346]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-16T00:58:38.207 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-16T00:58:38.207 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-16T00:58:38.466 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:38.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:38 smithi119 ceph-mon[35049]: pgmap v275: 97 pgs: 19 creating+peering, 46 unknown, 32 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:38.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:38 smithi119 ceph-mon[35049]: osdmap e79: 12 total, 12 up, 12 in 2024-09-16T00:58:38.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:38 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1361930066' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-16T00:58:38.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:38 smithi119 ceph-mon[35049]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-16T00:58:38.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:38 smithi119 ceph-mon[35049]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-16T00:58:38.855 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:38 smithi012 ceph-mon[31197]: pgmap v275: 97 pgs: 19 creating+peering, 46 unknown, 32 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:38.855 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:38 smithi012 ceph-mon[31197]: osdmap e79: 12 total, 12 up, 12 in 2024-09-16T00:58:38.855 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:38 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1361930066' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-16T00:58:38.855 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:38 smithi012 ceph-mon[31197]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-16T00:58:38.855 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:38 smithi012 ceph-mon[31197]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-16T00:58:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:38 smithi098 ceph-mon[35346]: pgmap v275: 97 pgs: 19 creating+peering, 46 unknown, 32 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:38 smithi098 ceph-mon[35346]: osdmap e79: 12 total, 12 up, 12 in 2024-09-16T00:58:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:38 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1361930066' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-16T00:58:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:38 smithi098 ceph-mon[35346]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-16T00:58:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:38 smithi098 ceph-mon[35346]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-16T00:58:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.941+0000 7fe42750e640 1 -- 172.21.15.12:0/1843260370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe420074620 msgr2=0x7fe420074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.941+0000 7fe42750e640 1 --2- 172.21.15.12:0/1843260370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe420074620 0x7fe420074a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009900 tx=0x7fe41c02a480 comp rx=0 tx=0).stop 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.941+0000 7fe42750e640 1 -- 172.21.15.12:0/1843260370 shutdown_connections 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.941+0000 7fe42750e640 1 --2- 172.21.15.12:0/1843260370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe42010e3c0 0x7fe420110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.941+0000 7fe42750e640 1 --2- 172.21.15.12:0/1843260370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe420074f40 0x7fe42010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.941+0000 7fe42750e640 1 --2- 172.21.15.12:0/1843260370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe420074620 0x7fe420074a00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.941+0000 7fe42750e640 1 -- 172.21.15.12:0/1843260370 >> 172.21.15.12:0/1843260370 conn(0x7fe4200fd8c0 msgr2=0x7fe4200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.941+0000 7fe42750e640 1 -- 172.21.15.12:0/1843260370 shutdown_connections 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.941+0000 7fe42750e640 1 -- 172.21.15.12:0/1843260370 wait complete. 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe42750e640 1 Processor -- start 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe42750e640 1 -- start start 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe42750e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe420074620 0x7fe4201a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe42750e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe420074f40 0x7fe4201a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:38.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe42750e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe42010e3c0 0x7fe42019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:38.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe42750e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe420114230 con 0x7fe42010e3c0 2024-09-16T00:58:38.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe42750e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201140b0 con 0x7fe420074f40 2024-09-16T00:58:38.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe42750e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201143b0 con 0x7fe420074620 2024-09-16T00:58:38.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe425aab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe42010e3c0 0x7fe42019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:38.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe425aab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe42010e3c0 0x7fe42019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54636/0 (socket says 172.21.15.12:54636) 2024-09-16T00:58:38.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.942+0000 7fe425aab640 1 -- 172.21.15.12:0/444814599 learned_addr learned my addr 172.21.15.12:0/444814599 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:38.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe424aa9640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe420074f40 0x7fe4201a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:38.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe4252aa640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe420074620 0x7fe4201a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:38.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe425aab640 1 -- 172.21.15.12:0/444814599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe420074620 msgr2=0x7fe4201a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:38.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe425aab640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe420074620 0x7fe4201a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe425aab640 1 -- 172.21.15.12:0/444814599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe420074f40 msgr2=0x7fe4201a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe425aab640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe420074f40 0x7fe4201a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe425aab640 1 -- 172.21.15.12:0/444814599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42019ad00 con 0x7fe42010e3c0 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe425aab640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe42010e3c0 0x7fe42019a5d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe41800b970 tx=0x7fe41800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe4167fc640 1 -- 172.21.15.12:0/444814599 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418019070 con 0x7fe42010e3c0 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe4167fc640 1 -- 172.21.15.12:0/444814599 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe418014440 con 0x7fe42010e3c0 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe42750e640 1 -- 172.21.15.12:0/444814599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42019aff0 con 0x7fe42010e3c0 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe4167fc640 1 -- 172.21.15.12:0/444814599 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4180075d0 con 0x7fe42010e3c0 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.943+0000 7fe42750e640 1 -- 172.21.15.12:0/444814599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4201a72e0 con 0x7fe42010e3c0 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.944+0000 7fe42750e640 1 -- 172.21.15.12:0/444814599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe420074a80 con 0x7fe42010e3c0 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.946+0000 7fe4167fc640 1 -- 172.21.15.12:0/444814599 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe41801c070 con 0x7fe42010e3c0 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.946+0000 7fe4167fc640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe40c0a3240 0x7fe40c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:38.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.946+0000 7fe4252aa640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe40c0a3240 0x7fe40c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:38.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.946+0000 7fe4167fc640 1 -- 172.21.15.12:0/444814599 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fe4180cf2c0 con 0x7fe42010e3c0 2024-09-16T00:58:38.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.947+0000 7fe4252aa640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe40c0a3240 0x7fe40c0a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0096c0 tx=0x7fe41c031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:38.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:38.949+0000 7fe4167fc640 1 -- 172.21.15.12:0/444814599 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe41809c130 con 0x7fe42010e3c0 2024-09-16T00:58:39.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.132+0000 7fe42750e640 1 -- 172.21.15.12:0/444814599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fe42019bb00 con 0x7fe42010e3c0 2024-09-16T00:58:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.577+0000 7fe4167fc640 1 -- 172.21.15.12:0/444814599 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v80) ==== 157+0+0 (secure 0 0 0) 0x7fe42019bb00 con 0x7fe42010e3c0 2024-09-16T00:58:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.580+0000 7fe42750e640 1 -- 172.21.15.12:0/444814599 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe40c0a3240 msgr2=0x7fe40c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.580+0000 7fe42750e640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe40c0a3240 0x7fe40c0a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0096c0 tx=0x7fe41c031490 comp rx=0 tx=0).stop 2024-09-16T00:58:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.580+0000 7fe42750e640 1 -- 172.21.15.12:0/444814599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe42010e3c0 msgr2=0x7fe42019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.580+0000 7fe42750e640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe42010e3c0 0x7fe42019a5d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe41800b970 tx=0x7fe41800bd70 comp rx=0 tx=0).stop 2024-09-16T00:58:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.580+0000 7fe42750e640 1 -- 172.21.15.12:0/444814599 shutdown_connections 2024-09-16T00:58:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.580+0000 7fe42750e640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe40c0a3240 0x7fe40c0a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.580+0000 7fe42750e640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe42010e3c0 0x7fe42019a5d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.580+0000 7fe42750e640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe420074f40 0x7fe4201a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.580+0000 7fe42750e640 1 --2- 172.21.15.12:0/444814599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe420074620 0x7fe4201a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.580+0000 7fe42750e640 1 -- 172.21.15.12:0/444814599 >> 172.21.15.12:0/444814599 conn(0x7fe4200fd8c0 msgr2=0x7fe4200ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.581+0000 7fe42750e640 1 -- 172.21.15.12:0/444814599 shutdown_connections 2024-09-16T00:58:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:39.581+0000 7fe42750e640 1 -- 172.21.15.12:0/444814599 wait complete. 2024-09-16T00:58:39.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:39 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] up:active 2024-09-16T00:58:39.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:39 smithi119 ceph-mon[35049]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:58:39.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:39 smithi119 ceph-mon[35049]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:58:39.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:39 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/444814599' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-16T00:58:39.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:39 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] up:active 2024-09-16T00:58:39.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:39 smithi012 ceph-mon[31197]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:58:39.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:39 smithi012 ceph-mon[31197]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:58:39.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:39 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/444814599' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-16T00:58:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:39 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] up:active 2024-09-16T00:58:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:39 smithi098 ceph-mon[35346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:58:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:39 smithi098 ceph-mon[35346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:58:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:39 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/444814599' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-16T00:58:40.229 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T00:58:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:40.829 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:40 smithi012 ceph-mon[31197]: pgmap v277: 97 pgs: 10 creating+peering, 6 unknown, 81 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 231 B/s wr, 5 op/s 2024-09-16T00:58:40.829 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:40 smithi012 ceph-mon[31197]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-16T00:58:40.829 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:40 smithi012 ceph-mon[31197]: Cluster is now healthy 2024-09-16T00:58:40.829 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:40 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/444814599' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-16T00:58:40.829 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:40 smithi012 ceph-mon[31197]: osdmap e80: 12 total, 12 up, 12 in 2024-09-16T00:58:40.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:40 smithi119 ceph-mon[35049]: pgmap v277: 97 pgs: 10 creating+peering, 6 unknown, 81 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 231 B/s wr, 5 op/s 2024-09-16T00:58:40.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:40 smithi119 ceph-mon[35049]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-16T00:58:40.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:40 smithi119 ceph-mon[35049]: Cluster is now healthy 2024-09-16T00:58:40.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:40 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/444814599' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-16T00:58:40.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:40 smithi119 ceph-mon[35049]: osdmap e80: 12 total, 12 up, 12 in 2024-09-16T00:58:40.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:40 smithi098 ceph-mon[35346]: pgmap v277: 97 pgs: 10 creating+peering, 6 unknown, 81 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 231 B/s wr, 5 op/s 2024-09-16T00:58:40.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:40 smithi098 ceph-mon[35346]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-16T00:58:40.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:40 smithi098 ceph-mon[35346]: Cluster is now healthy 2024-09-16T00:58:40.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:40 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/444814599' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-16T00:58:40.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:40 smithi098 ceph-mon[35346]: osdmap e80: 12 total, 12 up, 12 in 2024-09-16T00:58:41.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.046+0000 7f223030a640 1 -- 172.21.15.12:0/1823781184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2228102e00 msgr2=0x7f22281031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:41.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.046+0000 7f223030a640 1 --2- 172.21.15.12:0/1823781184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2228102e00 0x7f22281031e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2224009900 tx=0x7f222402a480 comp rx=0 tx=0).stop 2024-09-16T00:58:41.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.046+0000 7f223030a640 1 -- 172.21.15.12:0/1823781184 shutdown_connections 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.046+0000 7f223030a640 1 --2- 172.21.15.12:0/1823781184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f222810c1a0 0x7f222810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.046+0000 7f223030a640 1 --2- 172.21.15.12:0/1823781184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2228103720 0x7f222810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.046+0000 7f223030a640 1 --2- 172.21.15.12:0/1823781184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2228102e00 0x7f22281031e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.046+0000 7f223030a640 1 -- 172.21.15.12:0/1823781184 >> 172.21.15.12:0/1823781184 conn(0x7f22280fc7a0 msgr2=0x7f22280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.046+0000 7f223030a640 1 -- 172.21.15.12:0/1823781184 shutdown_connections 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.046+0000 7f223030a640 1 -- 172.21.15.12:0/1823781184 wait complete. 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f223030a640 1 Processor -- start 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f223030a640 1 -- start start 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f223030a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2228102e00 0x7f2228100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f223030a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2228103720 0x7f2228100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f223030a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f222810c1a0 0x7f22281014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f223030a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2228111f70 con 0x7f222810c1a0 2024-09-16T00:58:41.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f223030a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2228111df0 con 0x7f2228103720 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f223030a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22281120f0 con 0x7f2228102e00 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f222e8a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f222810c1a0 0x7f22281014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f222e8a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f222810c1a0 0x7f22281014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54664/0 (socket says 172.21.15.12:54664) 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f222e8a7640 1 -- 172.21.15.12:0/3946861563 learned_addr learned my addr 172.21.15.12:0/3946861563 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.047+0000 7f222e0a6640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2228102e00 0x7f2228100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f222d8a5640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2228103720 0x7f2228100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f222e8a7640 1 -- 172.21.15.12:0/3946861563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2228102e00 msgr2=0x7f2228100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f222e8a7640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2228102e00 0x7f2228100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f222e8a7640 1 -- 172.21.15.12:0/3946861563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2228103720 msgr2=0x7f2228100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f222e8a7640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2228103720 0x7f2228100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f222e8a7640 1 -- 172.21.15.12:0/3946861563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22281a6950 con 0x7f222810c1a0 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f222e8a7640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f222810c1a0 0x7f22281014e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f222000cad0 tx=0x7f222000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:41.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f221f7fe640 1 -- 172.21.15.12:0/3946861563 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222000ae20 con 0x7f222810c1a0 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f223030a640 1 -- 172.21.15.12:0/3946861563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22281a6c40 con 0x7f222810c1a0 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f221f7fe640 1 -- 172.21.15.12:0/3946861563 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2220005020 con 0x7f222810c1a0 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f221f7fe640 1 -- 172.21.15.12:0/3946861563 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222000f6f0 con 0x7f222810c1a0 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.048+0000 7f223030a640 1 -- 172.21.15.12:0/3946861563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22281a7180 con 0x7f222810c1a0 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.049+0000 7f223030a640 1 -- 172.21.15.12:0/3946861563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22281031e0 con 0x7f222810c1a0 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.050+0000 7f221f7fe640 1 -- 172.21.15.12:0/3946861563 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f22200051d0 con 0x7f222810c1a0 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.051+0000 7f221f7fe640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f22140a3240 0x7f22140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.051+0000 7f222e0a6640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f22140a3240 0x7f22140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.051+0000 7f221f7fe640 1 -- 172.21.15.12:0/3946861563 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8277+0+0 (secure 0 0 0) 0x7f22200cfe10 con 0x7f222810c1a0 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.052+0000 7f222e0a6640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f22140a3240 0x7f22140a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22240096c0 tx=0x7f2224031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:41.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.054+0000 7f221f7fe640 1 -- 172.21.15.12:0/3946861563 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2220014030 con 0x7f222810c1a0 2024-09-16T00:58:41.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:41.230+0000 7f223030a640 1 -- 172.21.15.12:0/3946861563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f222802d7c0 con 0x7f222810c1a0 2024-09-16T00:58:41.833 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:41 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3946861563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-16T00:58:41.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:41 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3946861563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-16T00:58:41.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:41 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3946861563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-16T00:58:42.212 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:58:41 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b[65547]: 2024-09-16T00:58:41.832+0000 7f1c08d6e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T00:58:42.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.583+0000 7f221f7fe640 1 -- 172.21.15.12:0/3946861563 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v82) ==== 228+0+0 (secure 0 0 0) 0x7f222009caa0 con 0x7f222810c1a0 2024-09-16T00:58:42.584 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data_ec' created 2024-09-16T00:58:42.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 -- 172.21.15.12:0/3946861563 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f22140a3240 msgr2=0x7f22140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:42.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f22140a3240 0x7f22140a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22240096c0 tx=0x7f2224031490 comp rx=0 tx=0).stop 2024-09-16T00:58:42.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 -- 172.21.15.12:0/3946861563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f222810c1a0 msgr2=0x7f22281014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:42.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f222810c1a0 0x7f22281014e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f222000cad0 tx=0x7f222000cf90 comp rx=0 tx=0).stop 2024-09-16T00:58:42.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 -- 172.21.15.12:0/3946861563 shutdown_connections 2024-09-16T00:58:42.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f22140a3240 0x7f22140a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:42.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f222810c1a0 0x7f22281014e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:42.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2228103720 0x7f2228100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:42.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 --2- 172.21.15.12:0/3946861563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2228102e00 0x7f2228100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:42.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 -- 172.21.15.12:0/3946861563 >> 172.21.15.12:0/3946861563 conn(0x7f22280fc7a0 msgr2=0x7f22280fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:42.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 -- 172.21.15.12:0/3946861563 shutdown_connections 2024-09-16T00:58:42.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:42.586+0000 7f223030a640 1 -- 172.21.15.12:0/3946861563 wait complete. 2024-09-16T00:58:42.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:42 smithi119 ceph-mon[35049]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 948 B/s wr, 6 op/s 2024-09-16T00:58:42.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:42 smithi119 ceph-mon[35049]: osdmap e81: 12 total, 12 up, 12 in 2024-09-16T00:58:42.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:42 smithi012 ceph-mon[31197]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 948 B/s wr, 6 op/s 2024-09-16T00:58:42.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:42 smithi012 ceph-mon[31197]: osdmap e81: 12 total, 12 up, 12 in 2024-09-16T00:58:42.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:42 smithi098 ceph-mon[35346]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 948 B/s wr, 6 op/s 2024-09-16T00:58:42.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:42 smithi098 ceph-mon[35346]: osdmap e81: 12 total, 12 up, 12 in 2024-09-16T00:58:43.431 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-16T00:58:43.708 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:43.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:43 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3946861563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-16T00:58:43.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:43 smithi012 ceph-mon[31197]: osdmap e82: 12 total, 12 up, 12 in 2024-09-16T00:58:43.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:43 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3946861563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-16T00:58:43.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:43 smithi119 ceph-mon[35049]: osdmap e82: 12 total, 12 up, 12 in 2024-09-16T00:58:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:43 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3946861563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-16T00:58:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:43 smithi098 ceph-mon[35346]: osdmap e82: 12 total, 12 up, 12 in 2024-09-16T00:58:44.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.210+0000 7fa1b985c640 1 -- 172.21.15.12:0/3674395657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b4104000 msgr2=0x7fa1b41043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:44.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.210+0000 7fa1b985c640 1 --2- 172.21.15.12:0/3674395657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b4104000 0x7fa1b41043e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009900 tx=0x7fa1a402a3f0 comp rx=0 tx=0).stop 2024-09-16T00:58:44.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.211+0000 7fa1b985c640 1 -- 172.21.15.12:0/3674395657 shutdown_connections 2024-09-16T00:58:44.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.211+0000 7fa1b985c640 1 --2- 172.21.15.12:0/3674395657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b4109130 0x7fa1b4110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:44.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.211+0000 7fa1b985c640 1 --2- 172.21.15.12:0/3674395657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b41049b0 0x7fa1b4108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:44.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.211+0000 7fa1b985c640 1 --2- 172.21.15.12:0/3674395657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b4104000 0x7fa1b41043e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:44.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.211+0000 7fa1b985c640 1 -- 172.21.15.12:0/3674395657 >> 172.21.15.12:0/3674395657 conn(0x7fa1b40ffa20 msgr2=0x7fa1b4101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:44.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.211+0000 7fa1b985c640 1 -- 172.21.15.12:0/3674395657 shutdown_connections 2024-09-16T00:58:44.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.211+0000 7fa1b985c640 1 -- 172.21.15.12:0/3674395657 wait complete. 2024-09-16T00:58:44.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.211+0000 7fa1b985c640 1 Processor -- start 2024-09-16T00:58:44.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.211+0000 7fa1b985c640 1 -- start start 2024-09-16T00:58:44.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b985c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4104000 0x7fa1b41a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:44.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b985c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b41049b0 0x7fa1b41a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:44.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b985c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b4109130 0x7fa1b419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:44.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b985c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b4114230 con 0x7fa1b41049b0 2024-09-16T00:58:44.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b985c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b41140b0 con 0x7fa1b4109130 2024-09-16T00:58:44.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b985c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b41143b0 con 0x7fa1b4104000 2024-09-16T00:58:44.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b41049b0 0x7fa1b41a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:44.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b41049b0 0x7fa1b41a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54686/0 (socket says 172.21.15.12:54686) 2024-09-16T00:58:44.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b27fc640 1 -- 172.21.15.12:0/2699589911 learned_addr learned my addr 172.21.15.12:0/2699589911 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:44.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b37fe640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b4109130 0x7fa1b419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:44.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b2ffd640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4104000 0x7fa1b41a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:44.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b27fc640 1 -- 172.21.15.12:0/2699589911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4104000 msgr2=0x7fa1b41a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b27fc640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4104000 0x7fa1b41a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b27fc640 1 -- 172.21.15.12:0/2699589911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b4109130 msgr2=0x7fa1b419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b27fc640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b4109130 0x7fa1b419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b27fc640 1 -- 172.21.15.12:0/2699589911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b419acc0 con 0x7fa1b41049b0 2024-09-16T00:58:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b2ffd640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4104000 0x7fa1b41a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:58:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b27fc640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b41049b0 0x7fa1b41a0910 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800b4a0 tx=0x7fa1a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b885a640 1 -- 172.21.15.12:0/2699589911 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8014070 con 0x7fa1b41049b0 2024-09-16T00:58:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b885a640 1 -- 172.21.15.12:0/2699589911 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a8010af0 con 0x7fa1b41049b0 2024-09-16T00:58:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b985c640 1 -- 172.21.15.12:0/2699589911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b419afb0 con 0x7fa1b41049b0 2024-09-16T00:58:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.212+0000 7fa1b885a640 1 -- 172.21.15.12:0/2699589911 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8017d10 con 0x7fa1b41049b0 2024-09-16T00:58:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.213+0000 7fa1b985c640 1 -- 172.21.15.12:0/2699589911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b41a72a0 con 0x7fa1b41049b0 2024-09-16T00:58:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.214+0000 7fa1b985c640 1 -- 172.21.15.12:0/2699589911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b4104460 con 0x7fa1b41049b0 2024-09-16T00:58:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.215+0000 7fa1b885a640 1 -- 172.21.15.12:0/2699589911 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa1a8017070 con 0x7fa1b41049b0 2024-09-16T00:58:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.215+0000 7fa1b885a640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a32c0 0x7fa19c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.216+0000 7fa1b2ffd640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a32c0 0x7fa19c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.216+0000 7fa1b885a640 1 -- 172.21.15.12:0/2699589911 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8770+0+0 (secure 0 0 0) 0x7fa1a80cf240 con 0x7fa1b41049b0 2024-09-16T00:58:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.216+0000 7fa1b2ffd640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a32c0 0x7fa19c0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4005ab0 tx=0x7fa1a4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.219+0000 7fa1b885a640 1 -- 172.21.15.12:0/2699589911 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1a809bd40 con 0x7fa1b41049b0 2024-09-16T00:58:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.394+0000 7fa1b985c640 1 -- 172.21.15.12:0/2699589911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fa1b419bac0 con 0x7fa1b41049b0 2024-09-16T00:58:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.596+0000 7fa1b885a640 1 -- 172.21.15.12:0/2699589911 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v84) ==== 169+0+0 (secure 0 0 0) 0x7fa1b419bac0 con 0x7fa1b41049b0 2024-09-16T00:58:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:set pool 4 allow_ec_overwrites to true 2024-09-16T00:58:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 -- 172.21.15.12:0/2699589911 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a32c0 msgr2=0x7fa19c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a32c0 0x7fa19c0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4005ab0 tx=0x7fa1a4005a20 comp rx=0 tx=0).stop 2024-09-16T00:58:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 -- 172.21.15.12:0/2699589911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b41049b0 msgr2=0x7fa1b41a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b41049b0 0x7fa1b41a0910 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800b4a0 tx=0x7fa1a800b960 comp rx=0 tx=0).stop 2024-09-16T00:58:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 -- 172.21.15.12:0/2699589911 shutdown_connections 2024-09-16T00:58:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a32c0 0x7fa19c0a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b4109130 0x7fa1b419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b41049b0 0x7fa1b41a0910 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 --2- 172.21.15.12:0/2699589911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b4104000 0x7fa1b41a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 -- 172.21.15.12:0/2699589911 >> 172.21.15.12:0/2699589911 conn(0x7fa1b40ffa20 msgr2=0x7fa1b4100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 -- 172.21.15.12:0/2699589911 shutdown_connections 2024-09-16T00:58:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:44.599+0000 7fa1b985c640 1 -- 172.21.15.12:0/2699589911 wait complete. 2024-09-16T00:58:44.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:44 smithi119 ceph-mon[35049]: pgmap v282: 129 pgs: 10 creating+peering, 22 unknown, 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-16T00:58:44.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:44 smithi119 ceph-mon[35049]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T00:58:44.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:44 smithi119 ceph-mon[35049]: osdmap e83: 12 total, 12 up, 12 in 2024-09-16T00:58:44.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:44 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2699589911' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-16T00:58:44.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:44 smithi012 ceph-mon[31197]: pgmap v282: 129 pgs: 10 creating+peering, 22 unknown, 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-16T00:58:44.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:44 smithi012 ceph-mon[31197]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T00:58:44.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:44 smithi012 ceph-mon[31197]: osdmap e83: 12 total, 12 up, 12 in 2024-09-16T00:58:44.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:44 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2699589911' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-16T00:58:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:44 smithi098 ceph-mon[35346]: pgmap v282: 129 pgs: 10 creating+peering, 22 unknown, 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-16T00:58:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:44 smithi098 ceph-mon[35346]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T00:58:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:44 smithi098 ceph-mon[35346]: osdmap e83: 12 total, 12 up, 12 in 2024-09-16T00:58:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:44 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2699589911' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-16T00:58:45.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-16T00:58:45.511 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:45.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:45 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2699589911' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-16T00:58:45.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:45 smithi012 ceph-mon[31197]: osdmap e84: 12 total, 12 up, 12 in 2024-09-16T00:58:45.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:45 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2699589911' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-16T00:58:45.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:45 smithi098 ceph-mon[35346]: osdmap e84: 12 total, 12 up, 12 in 2024-09-16T00:58:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.029+0000 7fea60c52640 1 -- 172.21.15.12:0/3196175693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c106f10 msgr2=0x7fea5c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.029+0000 7fea60c52640 1 --2- 172.21.15.12:0/3196175693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c106f10 0x7fea5c10ea90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fea54009ca0 tx=0x7fea5402a8c0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.029+0000 7fea60c52640 1 -- 172.21.15.12:0/3196175693 shutdown_connections 2024-09-16T00:58:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.029+0000 7fea60c52640 1 --2- 172.21.15.12:0/3196175693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c106f10 0x7fea5c10ea90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.029+0000 7fea60c52640 1 --2- 172.21.15.12:0/3196175693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102790 0x7fea5c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.029+0000 7fea60c52640 1 --2- 172.21.15.12:0/3196175693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5c101de0 0x7fea5c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.029+0000 7fea60c52640 1 -- 172.21.15.12:0/3196175693 >> 172.21.15.12:0/3196175693 conn(0x7fea5c0fd8c0 msgr2=0x7fea5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.029+0000 7fea60c52640 1 -- 172.21.15.12:0/3196175693 shutdown_connections 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.029+0000 7fea60c52640 1 -- 172.21.15.12:0/3196175693 wait complete. 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea60c52640 1 Processor -- start 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea60c52640 1 -- start start 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea60c52640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c101de0 0x7fea5c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea60c52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102790 0x7fea5c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea60c52640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5c106f10 0x7fea5c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea60c52640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c111f70 con 0x7fea5c101de0 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea60c52640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c111df0 con 0x7fea5c102790 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea60c52640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c1120f0 con 0x7fea5c106f10 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea5a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c101de0 0x7fea5c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea5a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c101de0 0x7fea5c198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54704/0 (socket says 172.21.15.12:54704) 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea5a59c640 1 -- 172.21.15.12:0/1600187538 learned_addr learned my addr 172.21.15.12:0/1600187538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:46.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea59d9b640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102790 0x7fea5c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea5a59c640 1 -- 172.21.15.12:0/1600187538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5c106f10 msgr2=0x7fea5c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea5ad9d640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5c106f10 0x7fea5c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea5a59c640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5c106f10 0x7fea5c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea5a59c640 1 -- 172.21.15.12:0/1600187538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102790 msgr2=0x7fea5c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea5a59c640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102790 0x7fea5c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea5a59c640 1 -- 172.21.15.12:0/1600187538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c19d2e0 con 0x7fea5c101de0 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.030+0000 7fea5ad9d640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5c106f10 0x7fea5c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.031+0000 7fea5a59c640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c101de0 0x7fea5c198330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c920 tx=0x7fea4c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.031+0000 7fea4b7fe640 1 -- 172.21.15.12:0/1600187538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c007c70 con 0x7fea5c101de0 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.031+0000 7fea4b7fe640 1 -- 172.21.15.12:0/1600187538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea4c007e10 con 0x7fea5c101de0 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.031+0000 7fea60c52640 1 -- 172.21.15.12:0/1600187538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5c19d5d0 con 0x7fea5c101de0 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.031+0000 7fea4b7fe640 1 -- 172.21.15.12:0/1600187538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c018890 con 0x7fea5c101de0 2024-09-16T00:58:46.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.031+0000 7fea60c52640 1 -- 172.21.15.12:0/1600187538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea5c1a4eb0 con 0x7fea5c101de0 2024-09-16T00:58:46.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.032+0000 7fea60c52640 1 -- 172.21.15.12:0/1600187538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5c1021c0 con 0x7fea5c101de0 2024-09-16T00:58:46.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.033+0000 7fea4b7fe640 1 -- 172.21.15.12:0/1600187538 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fea4c018a70 con 0x7fea5c101de0 2024-09-16T00:58:46.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.034+0000 7fea4b7fe640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fea440a32c0 0x7fea440a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:46.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.034+0000 7fea59d9b640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fea440a32c0 0x7fea440a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:46.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.034+0000 7fea4b7fe640 1 -- 172.21.15.12:0/1600187538 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8770+0+0 (secure 0 0 0) 0x7fea4c0cfc50 con 0x7fea5c101de0 2024-09-16T00:58:46.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.034+0000 7fea59d9b640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fea440a32c0 0x7fea440a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fea5c108880 tx=0x7fea5000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:46.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.038+0000 7fea4b7fe640 1 -- 172.21.15.12:0/1600187538 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea4c014030 con 0x7fea5c101de0 2024-09-16T00:58:46.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:45 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2699589911' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-16T00:58:46.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:45 smithi119 ceph-mon[35049]: osdmap e84: 12 total, 12 up, 12 in 2024-09-16T00:58:46.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.250+0000 7fea60c52640 1 -- 172.21.15.12:0/1600187538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fea5c10a120 con 0x7fea5c101de0 2024-09-16T00:58:46.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.602+0000 7fea4b7fe640 1 -- 172.21.15.12:0/1600187538 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fea4c09c6f0 con 0x7fea5c101de0 2024-09-16T00:58:46.603 INFO:teuthology.orchestra.run.smithi012.stderr:added data pool 4 to fsmap 2024-09-16T00:58:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.604+0000 7fea60c52640 1 -- 172.21.15.12:0/1600187538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fea440a32c0 msgr2=0x7fea440a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.604+0000 7fea60c52640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fea440a32c0 0x7fea440a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fea5c108880 tx=0x7fea5000b390 comp rx=0 tx=0).stop 2024-09-16T00:58:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.604+0000 7fea60c52640 1 -- 172.21.15.12:0/1600187538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c101de0 msgr2=0x7fea5c198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:46.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.604+0000 7fea60c52640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c101de0 0x7fea5c198330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c920 tx=0x7fea4c00cde0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.605+0000 7fea60c52640 1 -- 172.21.15.12:0/1600187538 shutdown_connections 2024-09-16T00:58:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.605+0000 7fea60c52640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fea440a32c0 0x7fea440a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.605+0000 7fea60c52640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea5c106f10 0x7fea5c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.605+0000 7fea60c52640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea5c102790 0x7fea5c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.605+0000 7fea60c52640 1 --2- 172.21.15.12:0/1600187538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c101de0 0x7fea5c198330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.605+0000 7fea60c52640 1 -- 172.21.15.12:0/1600187538 >> 172.21.15.12:0/1600187538 conn(0x7fea5c0fd8c0 msgr2=0x7fea5c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.605+0000 7fea60c52640 1 -- 172.21.15.12:0/1600187538 shutdown_connections 2024-09-16T00:58:46.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:46.605+0000 7fea60c52640 1 -- 172.21.15.12:0/1600187538 wait complete. 2024-09-16T00:58:46.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:46 smithi012 ceph-mon[31197]: pgmap v285: 129 pgs: 10 creating+peering, 14 unknown, 105 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 1 op/s 2024-09-16T00:58:46.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:46 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1600187538' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-16T00:58:46.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:46 smithi012 ceph-mon[31197]: osdmap e85: 12 total, 12 up, 12 in 2024-09-16T00:58:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:46 smithi098 ceph-mon[35346]: pgmap v285: 129 pgs: 10 creating+peering, 14 unknown, 105 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 1 op/s 2024-09-16T00:58:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:46 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1600187538' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-16T00:58:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:46 smithi098 ceph-mon[35346]: osdmap e85: 12 total, 12 up, 12 in 2024-09-16T00:58:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:46 smithi119 ceph-mon[35049]: pgmap v285: 129 pgs: 10 creating+peering, 14 unknown, 105 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 1 op/s 2024-09-16T00:58:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:46 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1600187538' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-16T00:58:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:46 smithi119 ceph-mon[35049]: osdmap e85: 12 total, 12 up, 12 in 2024-09-16T00:58:47.273 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:58:47.539 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:47.866 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:47 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1600187538' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-16T00:58:47.866 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:47 smithi012 ceph-mon[31197]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:58:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:47 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1600187538' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-16T00:58:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:47 smithi098 ceph-mon[35346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:58:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.067+0000 7ffbf6223640 1 -- 172.21.15.12:0/2249073648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbf0106a80 msgr2=0x7ffbf0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.067+0000 7ffbf6223640 1 --2- 172.21.15.12:0/2249073648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbf0106a80 0x7ffbf0106e60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009930 tx=0x7ffbe002a420 comp rx=0 tx=0).stop 2024-09-16T00:58:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.067+0000 7ffbf6223640 1 -- 172.21.15.12:0/2249073648 shutdown_connections 2024-09-16T00:58:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.067+0000 7ffbf6223640 1 --2- 172.21.15.12:0/2249073648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbf0101420 0x7ffbf010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.067+0000 7ffbf6223640 1 --2- 172.21.15.12:0/2249073648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100a80 0x7ffbf0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.067+0000 7ffbf6223640 1 --2- 172.21.15.12:0/2249073648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbf0106a80 0x7ffbf0106e60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.067+0000 7ffbf6223640 1 -- 172.21.15.12:0/2249073648 >> 172.21.15.12:0/2249073648 conn(0x7ffbf00fc7a0 msgr2=0x7ffbf00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.067+0000 7ffbf6223640 1 -- 172.21.15.12:0/2249073648 shutdown_connections 2024-09-16T00:58:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.067+0000 7ffbf6223640 1 -- 172.21.15.12:0/2249073648 wait complete. 2024-09-16T00:58:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbf6223640 1 Processor -- start 2024-09-16T00:58:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbf6223640 1 -- start start 2024-09-16T00:58:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbf6223640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100a80 0x7ffbf01985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbf6223640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbf0101420 0x7ffbf0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbf6223640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbf0106a80 0x7ffbf019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbf6223640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0110f20 con 0x7ffbf0101420 2024-09-16T00:58:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbf6223640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0110da0 con 0x7ffbf0100a80 2024-09-16T00:58:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbf6223640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01110a0 con 0x7ffbf0106a80 2024-09-16T00:58:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbeeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbf0101420 0x7ffbf0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbeeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbf0101420 0x7ffbf0198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34306/0 (socket says 172.21.15.12:34306) 2024-09-16T00:58:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.068+0000 7ffbeeffd640 1 -- 172.21.15.12:0/1988973817 learned_addr learned my addr 172.21.15.12:0/1988973817 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbeeffd640 1 -- 172.21.15.12:0/1988973817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbf0106a80 msgr2=0x7ffbf019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbeffff640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbf0106a80 0x7ffbf019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbef7fe640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100a80 0x7ffbf01985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbeeffd640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbf0106a80 0x7ffbf019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbeeffd640 1 -- 172.21.15.12:0/1988973817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100a80 msgr2=0x7ffbf01985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbeeffd640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100a80 0x7ffbf01985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbeeffd640 1 -- 172.21.15.12:0/1988973817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf019d5a0 con 0x7ffbf0101420 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbef7fe640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100a80 0x7ffbf01985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbeeffd640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbf0101420 0x7ffbf0198b30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400b4a0 tx=0x7ffbe400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbecff9640 1 -- 172.21.15.12:0/1988973817 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4014070 con 0x7ffbf0101420 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbf6223640 1 -- 172.21.15.12:0/1988973817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf019d890 con 0x7ffbf0101420 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbecff9640 1 -- 172.21.15.12:0/1988973817 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbe4010af0 con 0x7ffbf0101420 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbecff9640 1 -- 172.21.15.12:0/1988973817 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4017d10 con 0x7ffbf0101420 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.069+0000 7ffbf6223640 1 -- 172.21.15.12:0/1988973817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf01a5170 con 0x7ffbf0101420 2024-09-16T00:58:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.070+0000 7ffbf6223640 1 -- 172.21.15.12:0/1988973817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf0100f60 con 0x7ffbf0101420 2024-09-16T00:58:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.071+0000 7ffbecff9640 1 -- 172.21.15.12:0/1988973817 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ffbe4017070 con 0x7ffbf0101420 2024-09-16T00:58:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.072+0000 7ffbecff9640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffbd80a3240 0x7ffbd80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.072+0000 7ffbef7fe640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffbd80a3240 0x7ffbd80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.072+0000 7ffbecff9640 1 -- 172.21.15.12:0/1988973817 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7ffbe40ceff0 con 0x7ffbf0101420 2024-09-16T00:58:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.072+0000 7ffbef7fe640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffbd80a3240 0x7ffbd80a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0000c00 tx=0x7ffbe0032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.076+0000 7ffbecff9640 1 -- 172.21.15.12:0/1988973817 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffbe409bab0 con 0x7ffbf0101420 2024-09-16T00:58:48.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:47 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1600187538' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-16T00:58:48.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:47 smithi119 ceph-mon[35049]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:58:48.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.289+0000 7ffbf6223640 1 -- 172.21.15.12:0/1988973817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbf01a54a0 con 0x7ffbf0101420 2024-09-16T00:58:48.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.290+0000 7ffbecff9640 1 -- 172.21.15.12:0/1988973817 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11836 (secure 0 0 0) 0x7ffbe409b3b0 con 0x7ffbf0101420 2024-09-16T00:58:48.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:48.291 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"btime":"2024-09-16T00:58:46:601966+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T00:58:46.252261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24518},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24518,"qdb_cluster":[24518]},"id":1}]} 2024-09-16T00:58:48.291 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 17 2024-09-16T00:58:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.292+0000 7ffbf6223640 1 -- 172.21.15.12:0/1988973817 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffbd80a3240 msgr2=0x7ffbd80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.292+0000 7ffbf6223640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffbd80a3240 0x7ffbd80a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0000c00 tx=0x7ffbe0032d50 comp rx=0 tx=0).stop 2024-09-16T00:58:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.292+0000 7ffbf6223640 1 -- 172.21.15.12:0/1988973817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbf0101420 msgr2=0x7ffbf0198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.292+0000 7ffbf6223640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbf0101420 0x7ffbf0198b30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400b4a0 tx=0x7ffbe400b960 comp rx=0 tx=0).stop 2024-09-16T00:58:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.292+0000 7ffbf6223640 1 -- 172.21.15.12:0/1988973817 shutdown_connections 2024-09-16T00:58:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.292+0000 7ffbf6223640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffbd80a3240 0x7ffbd80a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.292+0000 7ffbf6223640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbf0106a80 0x7ffbf019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.292+0000 7ffbf6223640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbf0101420 0x7ffbf0198b30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.292+0000 7ffbf6223640 1 --2- 172.21.15.12:0/1988973817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100a80 0x7ffbf01985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.292+0000 7ffbf6223640 1 -- 172.21.15.12:0/1988973817 >> 172.21.15.12:0/1988973817 conn(0x7ffbf00fc7a0 msgr2=0x7ffbf0104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.293+0000 7ffbf6223640 1 -- 172.21.15.12:0/1988973817 shutdown_connections 2024-09-16T00:58:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:48.293+0000 7ffbf6223640 1 -- 172.21.15.12:0/1988973817 wait complete. 2024-09-16T00:58:48.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:48 smithi098 ceph-mon[35346]: pgmap v287: 129 pgs: 10 creating+peering, 4 unknown, 115 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:48.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:48 smithi098 ceph-mon[35346]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-16T00:58:48.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:48 smithi098 ceph-mon[35346]: Cluster is now healthy 2024-09-16T00:58:48.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:48 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1988973817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:48.991 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:48 smithi012 ceph-mon[31197]: pgmap v287: 129 pgs: 10 creating+peering, 4 unknown, 115 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:48.991 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:48 smithi012 ceph-mon[31197]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-16T00:58:48.991 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:48 smithi012 ceph-mon[31197]: Cluster is now healthy 2024-09-16T00:58:48.991 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:48 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1988973817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:49.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:58:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:48 smithi119 ceph-mon[35049]: pgmap v287: 129 pgs: 10 creating+peering, 4 unknown, 115 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:48 smithi119 ceph-mon[35049]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-16T00:58:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:48 smithi119 ceph-mon[35049]: Cluster is now healthy 2024-09-16T00:58:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:48 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1988973817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 -- 172.21.15.12:0/2935600849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c101420 msgr2=0x7f960c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 --2- 172.21.15.12:0/2935600849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c101420 0x7f960c10d950 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9604009cd0 tx=0x7f960402a8e0 comp rx=0 tx=0).stop 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 -- 172.21.15.12:0/2935600849 shutdown_connections 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 --2- 172.21.15.12:0/2935600849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c101420 0x7f960c10d950 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 --2- 172.21.15.12:0/2935600849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f960c100a80 0x7f960c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 --2- 172.21.15.12:0/2935600849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f960c106a80 0x7f960c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 -- 172.21.15.12:0/2935600849 >> 172.21.15.12:0/2935600849 conn(0x7f960c0fc7a0 msgr2=0x7f960c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 -- 172.21.15.12:0/2935600849 shutdown_connections 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 -- 172.21.15.12:0/2935600849 wait complete. 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 Processor -- start 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.785+0000 7f9614219640 1 -- start start 2024-09-16T00:58:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9614219640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c100a80 0x7f960c102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9614219640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f960c101420 0x7f960c102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9614219640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f960c106a80 0x7f960c1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9614219640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f960c110ed0 con 0x7f960c100a80 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9614219640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f960c110d50 con 0x7f960c101420 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9614219640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f960c111050 con 0x7f960c106a80 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9611fb5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c100a80 0x7f960c102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9611fb5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c100a80 0x7f960c102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34324/0 (socket says 172.21.15.12:34324) 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9611fb5640 1 -- 172.21.15.12:0/2839481908 learned_addr learned my addr 172.21.15.12:0/2839481908 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f96117b4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f960c101420 0x7f960c102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f96127b6640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f960c106a80 0x7f960c1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9611fb5640 1 -- 172.21.15.12:0/2839481908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f960c106a80 msgr2=0x7f960c1030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9611fb5640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f960c106a80 0x7f960c1030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9611fb5640 1 -- 172.21.15.12:0/2839481908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f960c101420 msgr2=0x7f960c102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9611fb5640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f960c101420 0x7f960c102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9611fb5640 1 -- 172.21.15.12:0/2839481908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c1a68c0 con 0x7f960c100a80 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9611fb5640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c100a80 0x7f960c102650 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f960800d950 tx=0x7f960800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9602ffd640 1 -- 172.21.15.12:0/2839481908 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608017070 con 0x7f960c100a80 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9602ffd640 1 -- 172.21.15.12:0/2839481908 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9608009c30 con 0x7f960c100a80 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9614219640 1 -- 172.21.15.12:0/2839481908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960c1a6bb0 con 0x7f960c100a80 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.786+0000 7f9602ffd640 1 -- 172.21.15.12:0/2839481908 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960800f6b0 con 0x7f960c100a80 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.787+0000 7f9614219640 1 -- 172.21.15.12:0/2839481908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f960c1a70f0 con 0x7f960c100a80 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.787+0000 7f9614219640 1 -- 172.21.15.12:0/2839481908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f960c100ee0 con 0x7f960c100a80 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.789+0000 7f9602ffd640 1 -- 172.21.15.12:0/2839481908 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f96080109d0 con 0x7f960c100a80 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.790+0000 7f9602ffd640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95f80a3240 0x7f95f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.790+0000 7f96117b4640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95f80a3240 0x7f95f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.790+0000 7f9602ffd640 1 -- 172.21.15.12:0/2839481908 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f96080cf690 con 0x7f960c100a80 2024-09-16T00:58:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.791+0000 7f96117b4640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95f80a3240 0x7f95f80a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f960c0fea50 tx=0x7f95fc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.793+0000 7f9602ffd640 1 -- 172.21.15.12:0/2839481908 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9608009de0 con 0x7f960c100a80 2024-09-16T00:58:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.969+0000 7f9614219640 1 -- 172.21.15.12:0/2839481908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f960c1a73e0 con 0x7f960c100a80 2024-09-16T00:58:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.971+0000 7f9602ffd640 1 -- 172.21.15.12:0/2839481908 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24189 (secure 0 0 0) 0x7f960809bac0 con 0x7f960c100a80 2024-09-16T00:58:49.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:49.972 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T00:58:46.252124+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:58:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 -- 172.21.15.12:0/2839481908 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95f80a3240 msgr2=0x7f95f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95f80a3240 0x7f95f80a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f960c0fea50 tx=0x7f95fc00b410 comp rx=0 tx=0).stop 2024-09-16T00:58:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 -- 172.21.15.12:0/2839481908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c100a80 msgr2=0x7f960c102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c100a80 0x7f960c102650 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f960800d950 tx=0x7f960800de10 comp rx=0 tx=0).stop 2024-09-16T00:58:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 -- 172.21.15.12:0/2839481908 shutdown_connections 2024-09-16T00:58:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95f80a3240 0x7f95f80a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f960c106a80 0x7f960c1030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f960c101420 0x7f960c102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 --2- 172.21.15.12:0/2839481908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c100a80 0x7f960c102650 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 -- 172.21.15.12:0/2839481908 >> 172.21.15.12:0/2839481908 conn(0x7f960c0fc7a0 msgr2=0x7f960c06a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 -- 172.21.15.12:0/2839481908 shutdown_connections 2024-09-16T00:58:49.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:49.973+0000 7f9614219640 1 -- 172.21.15.12:0/2839481908 wait complete. 2024-09-16T00:58:50.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:58:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:50.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:50 smithi012 ceph-mon[31197]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:50.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:50 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2839481908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:58:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:50 smithi098 ceph-mon[35346]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:50 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2839481908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:58:51.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:50 smithi119 ceph-mon[35049]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:51.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:50 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2839481908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:58:51.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.323+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2591216614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ac100a80 msgr2=0x7ff1ac100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:51.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.323+0000 7ff1b0e95640 1 --2- 172.21.15.12:0/2591216614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ac100a80 0x7ff1ac100ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009930 tx=0x7ff1a002a420 comp rx=0 tx=0).stop 2024-09-16T00:58:51.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.323+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2591216614 shutdown_connections 2024-09-16T00:58:51.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.323+0000 7ff1b0e95640 1 --2- 172.21.15.12:0/2591216614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac101420 0x7ff1ac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:51.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.323+0000 7ff1b0e95640 1 --2- 172.21.15.12:0/2591216614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ac100a80 0x7ff1ac100ee0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:51.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.323+0000 7ff1b0e95640 1 --2- 172.21.15.12:0/2591216614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1ac106a80 0x7ff1ac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.323+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2591216614 >> 172.21.15.12:0/2591216614 conn(0x7ff1ac0fc7a0 msgr2=0x7ff1ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.324+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2591216614 shutdown_connections 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.324+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2591216614 wait complete. 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.324+0000 7ff1b0e95640 1 Processor -- start 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.324+0000 7ff1b0e95640 1 -- start start 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1b0e95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1ac100a80 0x7ff1ac198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1b0e95640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac101420 0x7ff1ac1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1b0e95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ac106a80 0x7ff1ac19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1b0e95640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac110e40 con 0x7ff1ac106a80 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1b0e95640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac110cc0 con 0x7ff1ac100a80 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1b0e95640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac110fc0 con 0x7ff1ac101420 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1aad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ac106a80 0x7ff1ac19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1aa59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1ac100a80 0x7ff1ac198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:51.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1aad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ac106a80 0x7ff1ac19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34342/0 (socket says 172.21.15.12:34342) 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1aad9d640 1 -- 172.21.15.12:0/2398429234 learned_addr learned my addr 172.21.15.12:0/2398429234 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1a9d9b640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac101420 0x7ff1ac1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1aad9d640 1 -- 172.21.15.12:0/2398429234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac101420 msgr2=0x7ff1ac1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1aad9d640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac101420 0x7ff1ac1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1aad9d640 1 -- 172.21.15.12:0/2398429234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1ac100a80 msgr2=0x7ff1ac198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1aad9d640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1ac100a80 0x7ff1ac198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1aad9d640 1 -- 172.21.15.12:0/2398429234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac19d320 con 0x7ff1ac106a80 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1aad9d640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ac106a80 0x7ff1ac19cc40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400cce0 tx=0x7ff1a400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff19b7fe640 1 -- 172.21.15.12:0/2398429234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400f450 con 0x7ff1ac106a80 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff19b7fe640 1 -- 172.21.15.12:0/2398429234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1a400fad0 con 0x7ff1ac106a80 2024-09-16T00:58:51.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.325+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2398429234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ac19d610 con 0x7ff1ac106a80 2024-09-16T00:58:51.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.326+0000 7ff19b7fe640 1 -- 172.21.15.12:0/2398429234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4018b60 con 0x7ff1ac106a80 2024-09-16T00:58:51.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.326+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2398429234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ac1a4ef0 con 0x7ff1ac106a80 2024-09-16T00:58:51.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.327+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2398429234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ac100ee0 con 0x7ff1ac106a80 2024-09-16T00:58:51.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.328+0000 7ff19b7fe640 1 -- 172.21.15.12:0/2398429234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff1a400fc80 con 0x7ff1ac106a80 2024-09-16T00:58:51.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.328+0000 7ff19b7fe640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1940a32c0 0x7ff1940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:51.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.329+0000 7ff1aa59c640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1940a32c0 0x7ff1940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:51.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.329+0000 7ff19b7fe640 1 -- 172.21.15.12:0/2398429234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7ff1a40cff80 con 0x7ff1ac106a80 2024-09-16T00:58:51.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.329+0000 7ff1aa59c640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1940a32c0 0x7ff1940a5780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00ab60 tx=0x7ff19c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:51.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.332+0000 7ff19b7fe640 1 -- 172.21.15.12:0/2398429234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1a4014030 con 0x7ff1ac106a80 2024-09-16T00:58:51.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.510+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2398429234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1ac02d7c0 con 0x7ff1ac106a80 2024-09-16T00:58:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.511+0000 7ff19b7fe640 1 -- 172.21.15.12:0/2398429234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24189 (secure 0 0 0) 0x7ff1a409ca60 con 0x7ff1ac106a80 2024-09-16T00:58:51.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:51.512 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T00:58:46.252124+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:58:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.514+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2398429234 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1940a32c0 msgr2=0x7ff1940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.514+0000 7ff1b0e95640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1940a32c0 0x7ff1940a5780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00ab60 tx=0x7ff19c00a2d0 comp rx=0 tx=0).stop 2024-09-16T00:58:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.514+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2398429234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ac106a80 msgr2=0x7ff1ac19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.514+0000 7ff1b0e95640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ac106a80 0x7ff1ac19cc40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400cce0 tx=0x7ff1a400a620 comp rx=0 tx=0).stop 2024-09-16T00:58:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.514+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2398429234 shutdown_connections 2024-09-16T00:58:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.514+0000 7ff1b0e95640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1940a32c0 0x7ff1940a5780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.514+0000 7ff1b0e95640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1ac106a80 0x7ff1ac19cc40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.514+0000 7ff1b0e95640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac101420 0x7ff1ac1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.514+0000 7ff1b0e95640 1 --2- 172.21.15.12:0/2398429234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1ac100a80 0x7ff1ac198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.514+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2398429234 >> 172.21.15.12:0/2398429234 conn(0x7ff1ac0fc7a0 msgr2=0x7ff1ac06a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.515+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2398429234 shutdown_connections 2024-09-16T00:58:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:51.515+0000 7ff1b0e95640 1 -- 172.21.15.12:0/2398429234 wait complete. 2024-09-16T00:58:51.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:51 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2398429234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:58:51.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:51 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2398429234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:58:52.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:51 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2398429234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:58:52.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:58:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:52.871 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:52 smithi012 ceph-mon[31197]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:52.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:52 smithi098 ceph-mon[35346]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.952+0000 7f24ae6c0640 1 -- 172.21.15.12:0/783675899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24a8100a60 msgr2=0x7f24a8100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.952+0000 7f24ae6c0640 1 --2- 172.21.15.12:0/783675899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24a8100a60 0x7f24a8100ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2490009930 tx=0x7f249002a420 comp rx=0 tx=0).stop 2024-09-16T00:58:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.952+0000 7f24ae6c0640 1 -- 172.21.15.12:0/783675899 shutdown_connections 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.952+0000 7f24ae6c0640 1 --2- 172.21.15.12:0/783675899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a8101400 0x7f24a810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.952+0000 7f24ae6c0640 1 --2- 172.21.15.12:0/783675899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24a8100a60 0x7f24a8100ec0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.952+0000 7f24ae6c0640 1 --2- 172.21.15.12:0/783675899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24a8106a60 0x7f24a8106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.952+0000 7f24ae6c0640 1 -- 172.21.15.12:0/783675899 >> 172.21.15.12:0/783675899 conn(0x7f24a80fc780 msgr2=0x7f24a80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.952+0000 7f24ae6c0640 1 -- 172.21.15.12:0/783675899 shutdown_connections 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.952+0000 7f24ae6c0640 1 -- 172.21.15.12:0/783675899 wait complete. 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24ae6c0640 1 Processor -- start 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24ae6c0640 1 -- start start 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24ae6c0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a8100a60 0x7f24a8198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24ae6c0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24a8101400 0x7f24a8198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24ae6c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24a8106a60 0x7f24a819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24ae6c0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f24a8110ea0 con 0x7f24a8106a60 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24ae6c0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f24a8110d20 con 0x7f24a8101400 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24ae6c0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f24a8111020 con 0x7f24a8100a60 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24acc5d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24a8106a60 0x7f24a819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24acc5d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24a8106a60 0x7f24a819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34358/0 (socket says 172.21.15.12:34358) 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24acc5d640 1 -- 172.21.15.12:0/2968575539 learned_addr learned my addr 172.21.15.12:0/2968575539 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24a7fff640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a8100a60 0x7f24a8198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f249ffff640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24a8101400 0x7f24a8198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24acc5d640 1 -- 172.21.15.12:0/2968575539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a8100a60 msgr2=0x7f24a8198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24acc5d640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a8100a60 0x7f24a8198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24acc5d640 1 -- 172.21.15.12:0/2968575539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24a8101400 msgr2=0x7f24a8198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24acc5d640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24a8101400 0x7f24a8198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.953+0000 7f24acc5d640 1 -- 172.21.15.12:0/2968575539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a819d4e0 con 0x7f24a8106a60 2024-09-16T00:58:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.954+0000 7f24acc5d640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24a8106a60 0x7f24a819ce00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f24a000cad0 tx=0x7f24a000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.954+0000 7f24a5ffb640 1 -- 172.21.15.12:0/2968575539 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a000ad60 con 0x7f24a8106a60 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.954+0000 7f24a5ffb640 1 -- 172.21.15.12:0/2968575539 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24a0005020 con 0x7f24a8106a60 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.954+0000 7f24ae6c0640 1 -- 172.21.15.12:0/2968575539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a819d7d0 con 0x7f24a8106a60 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.954+0000 7f24a5ffb640 1 -- 172.21.15.12:0/2968575539 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a000f6b0 con 0x7f24a8106a60 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.954+0000 7f24ae6c0640 1 -- 172.21.15.12:0/2968575539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a81a50b0 con 0x7f24a8106a60 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.955+0000 7f24ae6c0640 1 -- 172.21.15.12:0/2968575539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a8100ec0 con 0x7f24a8106a60 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.956+0000 7f24a5ffb640 1 -- 172.21.15.12:0/2968575539 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f24a0005560 con 0x7f24a8106a60 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.957+0000 7f24a5ffb640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24940a32c0 0x7f24940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.957+0000 7f24a7fff640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24940a32c0 0x7f24940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.957+0000 7f24a5ffb640 1 -- 172.21.15.12:0/2968575539 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f24a00cfa70 con 0x7f24a8106a60 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.957+0000 7f24a7fff640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24940a32c0 0x7f24940a5780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2498009990 tx=0x7f2498009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:52.961+0000 7f24a5ffb640 1 -- 172.21.15.12:0/2968575539 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24a0014030 con 0x7f24a8106a60 2024-09-16T00:58:53.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:52 smithi119 ceph-mon[35049]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.171+0000 7f24ae6c0640 1 -- 172.21.15.12:0/2968575539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24a802d7c0 con 0x7f24a8106a60 2024-09-16T00:58:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.172+0000 7f24a5ffb640 1 -- 172.21.15.12:0/2968575539 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11836 (secure 0 0 0) 0x7f24a009c550 con 0x7f24a8106a60 2024-09-16T00:58:53.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:53.173 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"btime":"2024-09-16T00:58:46:601966+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T00:58:46.252261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24518},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24518,"qdb_cluster":[24518]},"id":1}]} 2024-09-16T00:58:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 17 2024-09-16T00:58:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.174+0000 7f24ae6c0640 1 -- 172.21.15.12:0/2968575539 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24940a32c0 msgr2=0x7f24940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.174+0000 7f24ae6c0640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24940a32c0 0x7f24940a5780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2498009990 tx=0x7f2498009110 comp rx=0 tx=0).stop 2024-09-16T00:58:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.174+0000 7f24ae6c0640 1 -- 172.21.15.12:0/2968575539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24a8106a60 msgr2=0x7f24a819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.174+0000 7f24ae6c0640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24a8106a60 0x7f24a819ce00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f24a000cad0 tx=0x7f24a000ced0 comp rx=0 tx=0).stop 2024-09-16T00:58:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.174+0000 7f24ae6c0640 1 -- 172.21.15.12:0/2968575539 shutdown_connections 2024-09-16T00:58:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.174+0000 7f24ae6c0640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f24940a32c0 0x7f24940a5780 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.174+0000 7f24ae6c0640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24a8106a60 0x7f24a819ce00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.174+0000 7f24ae6c0640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24a8101400 0x7f24a8198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.174+0000 7f24ae6c0640 1 --2- 172.21.15.12:0/2968575539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a8100a60 0x7f24a8198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.174+0000 7f24ae6c0640 1 -- 172.21.15.12:0/2968575539 >> 172.21.15.12:0/2968575539 conn(0x7f24a80fc780 msgr2=0x7f24a806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.175+0000 7f24ae6c0640 1 -- 172.21.15.12:0/2968575539 shutdown_connections 2024-09-16T00:58:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:53.175+0000 7f24ae6c0640 1 -- 172.21.15.12:0/2968575539 wait complete. 2024-09-16T00:58:53.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:53 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2968575539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:53.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:58:53.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:53 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2968575539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:54.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:53 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2968575539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:58:54.218 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.763+0000 7ff8db7b7640 1 -- 172.21.15.12:0/758154482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d4102ef0 msgr2=0x7ff8d410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.763+0000 7ff8db7b7640 1 --2- 172.21.15.12:0/758154482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d4102ef0 0x7ff8d410da40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009ca0 tx=0x7ff8cc02a950 comp rx=0 tx=0).stop 2024-09-16T00:58:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.763+0000 7ff8db7b7640 1 -- 172.21.15.12:0/758154482 shutdown_connections 2024-09-16T00:58:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.763+0000 7ff8db7b7640 1 --2- 172.21.15.12:0/758154482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d4102ef0 0x7ff8d410da40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.763+0000 7ff8db7b7640 1 --2- 172.21.15.12:0/758154482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d4102570 0x7ff8d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.763+0000 7ff8db7b7640 1 --2- 172.21.15.12:0/758154482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d4100e20 0x7ff8d4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.763+0000 7ff8db7b7640 1 -- 172.21.15.12:0/758154482 >> 172.21.15.12:0/758154482 conn(0x7ff8d40fc7d0 msgr2=0x7ff8d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.763+0000 7ff8db7b7640 1 -- 172.21.15.12:0/758154482 shutdown_connections 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.763+0000 7ff8db7b7640 1 -- 172.21.15.12:0/758154482 wait complete. 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.764+0000 7ff8db7b7640 1 Processor -- start 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.764+0000 7ff8db7b7640 1 -- start start 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.764+0000 7ff8db7b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d4100e20 0x7ff8d4197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.764+0000 7ff8db7b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d4102570 0x7ff8d4197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.764+0000 7ff8db7b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d4102ef0 0x7ff8d419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.764+0000 7ff8db7b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d4110f80 con 0x7ff8d4102ef0 2024-09-16T00:58:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.764+0000 7ff8db7b7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d4110e00 con 0x7ff8d4100e20 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.764+0000 7ff8db7b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d4111100 con 0x7ff8d4102570 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.764+0000 7ff8d9d54640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d4102ef0 0x7ff8d419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d9d54640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d4102ef0 0x7ff8d419bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34374/0 (socket says 172.21.15.12:34374) 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d9d54640 1 -- 172.21.15.12:0/2387114026 learned_addr learned my addr 172.21.15.12:0/2387114026 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d9553640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d4100e20 0x7ff8d4197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d8d52640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d4102570 0x7ff8d4197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d9d54640 1 -- 172.21.15.12:0/2387114026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d4102570 msgr2=0x7ff8d4197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d9d54640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d4102570 0x7ff8d4197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d9d54640 1 -- 172.21.15.12:0/2387114026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d4100e20 msgr2=0x7ff8d4197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d9d54640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d4100e20 0x7ff8d4197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d9d54640 1 -- 172.21.15.12:0/2387114026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d419c2b0 con 0x7ff8d4102ef0 2024-09-16T00:58:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d8d52640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d4102570 0x7ff8d4197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:58:54.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8d9d54640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d4102ef0 0x7ff8d419bbd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc02ae70 tx=0x7ff8cc02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:54.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8ca7fc640 1 -- 172.21.15.12:0/2387114026 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc034040 con 0x7ff8d4102ef0 2024-09-16T00:58:54.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8ca7fc640 1 -- 172.21.15.12:0/2387114026 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8cc030920 con 0x7ff8d4102ef0 2024-09-16T00:58:54.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8db7b7640 1 -- 172.21.15.12:0/2387114026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d419c540 con 0x7ff8d4102ef0 2024-09-16T00:58:54.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8ca7fc640 1 -- 172.21.15.12:0/2387114026 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc0047f0 con 0x7ff8d4102ef0 2024-09-16T00:58:54.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.765+0000 7ff8db7b7640 1 -- 172.21.15.12:0/2387114026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d41a3e80 con 0x7ff8d4102ef0 2024-09-16T00:58:54.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.767+0000 7ff8db7b7640 1 -- 172.21.15.12:0/2387114026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d4101200 con 0x7ff8d4102ef0 2024-09-16T00:58:54.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.768+0000 7ff8ca7fc640 1 -- 172.21.15.12:0/2387114026 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff8cc037020 con 0x7ff8d4102ef0 2024-09-16T00:58:54.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.768+0000 7ff8ca7fc640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff8c00a32c0 0x7ff8c00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:54.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.768+0000 7ff8d9553640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff8c00a32c0 0x7ff8c00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:54.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.768+0000 7ff8ca7fc640 1 -- 172.21.15.12:0/2387114026 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7ff8cc0f0a90 con 0x7ff8d4102ef0 2024-09-16T00:58:54.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.769+0000 7ff8d9553640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff8c00a32c0 0x7ff8c00a5780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000abe0 tx=0x7ff8d000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:54.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.772+0000 7ff8ca7fc640 1 -- 172.21.15.12:0/2387114026 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8cc0bd570 con 0x7ff8d4102ef0 2024-09-16T00:58:54.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.956+0000 7ff8db7b7640 1 -- 172.21.15.12:0/2387114026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8d41a4050 con 0x7ff8d4102ef0 2024-09-16T00:58:54.957 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:54 smithi012 ceph-mon[31197]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:54.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.957+0000 7ff8ca7fc640 1 -- 172.21.15.12:0/2387114026 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24189 (secure 0 0 0) 0x7ff8cc0bce70 con 0x7ff8d4102ef0 2024-09-16T00:58:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:58:54.959 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T00:58:46.252124+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:58:54.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 -- 172.21.15.12:0/2387114026 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff8c00a32c0 msgr2=0x7ff8c00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:54.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff8c00a32c0 0x7ff8c00a5780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000abe0 tx=0x7ff8d000a2d0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 -- 172.21.15.12:0/2387114026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d4102ef0 msgr2=0x7ff8d419bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:54.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d4102ef0 0x7ff8d419bbd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc02ae70 tx=0x7ff8cc02f5d0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 -- 172.21.15.12:0/2387114026 shutdown_connections 2024-09-16T00:58:54.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff8c00a32c0 0x7ff8c00a5780 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d4102ef0 0x7ff8d419bbd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d4102570 0x7ff8d4197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 --2- 172.21.15.12:0/2387114026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d4100e20 0x7ff8d4197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:54.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 -- 172.21.15.12:0/2387114026 >> 172.21.15.12:0/2387114026 conn(0x7ff8d40fc7d0 msgr2=0x7ff8d41067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:54.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 -- 172.21.15.12:0/2387114026 shutdown_connections 2024-09-16T00:58:54.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:54.960+0000 7ff8db7b7640 1 -- 172.21.15.12:0/2387114026 wait complete. 2024-09-16T00:58:54.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:54 smithi098 ceph-mon[35346]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:55.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:54 smithi119 ceph-mon[35049]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:55.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T00:58:37.161987+0000', 'modified': '2024-09-16T00:58:46.252261+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24518}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24518': {'gid': 24518, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.98:6839/2784619271', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 2784619271}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 2784619271}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24518, 'qdb_cluster': [24518]} 2024-09-16T00:58:55.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T00:58:55.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-16T00:58:55.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:55 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2387114026' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:58:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:55 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2387114026' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:58:55.997 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:55 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2387114026' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:58:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.371+0000 7fafff5dd640 1 -- 172.21.15.12:0/1008153752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff810e3c0 msgr2=0x7faff8110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.371+0000 7fafff5dd640 1 --2- 172.21.15.12:0/1008153752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff810e3c0 0x7faff8110810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faff0009900 tx=0x7faff002a480 comp rx=0 tx=0).stop 2024-09-16T00:58:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.371+0000 7fafff5dd640 1 -- 172.21.15.12:0/1008153752 shutdown_connections 2024-09-16T00:58:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.371+0000 7fafff5dd640 1 --2- 172.21.15.12:0/1008153752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff810e3c0 0x7faff8110810 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.371+0000 7fafff5dd640 1 --2- 172.21.15.12:0/1008153752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff8074f40 0x7faff810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.371+0000 7fafff5dd640 1 --2- 172.21.15.12:0/1008153752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff8074620 0x7faff8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.371+0000 7fafff5dd640 1 -- 172.21.15.12:0/1008153752 >> 172.21.15.12:0/1008153752 conn(0x7faff80fd8c0 msgr2=0x7faff80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.371+0000 7fafff5dd640 1 -- 172.21.15.12:0/1008153752 shutdown_connections 2024-09-16T00:58:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.371+0000 7fafff5dd640 1 -- 172.21.15.12:0/1008153752 wait complete. 2024-09-16T00:58:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7fafff5dd640 1 Processor -- start 2024-09-16T00:58:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7fafff5dd640 1 -- start start 2024-09-16T00:58:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7fafff5dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff8074620 0x7faff819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7fafff5dd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff8074f40 0x7faff819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7fafff5dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff810e3c0 0x7faff819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7fafff5dd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faff8114160 con 0x7faff8074620 2024-09-16T00:58:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7fafff5dd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faff8113fe0 con 0x7faff810e3c0 2024-09-16T00:58:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7fafff5dd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faff81142e0 con 0x7faff8074f40 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7faffd379640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff8074620 0x7faff819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7faffd379640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff8074620 0x7faff819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56238/0 (socket says 172.21.15.12:56238) 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7faffd379640 1 -- 172.21.15.12:0/2246350369 learned_addr learned my addr 172.21.15.12:0/2246350369 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7faffcb78640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff8074f40 0x7faff819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.372+0000 7faffdb7a640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff810e3c0 0x7faff819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7faffd379640 1 -- 172.21.15.12:0/2246350369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff8074f40 msgr2=0x7faff819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7faffd379640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff8074f40 0x7faff819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7faffd379640 1 -- 172.21.15.12:0/2246350369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff810e3c0 msgr2=0x7faff819efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7faffd379640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff810e3c0 0x7faff819efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7faffd379640 1 -- 172.21.15.12:0/2246350369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff819f6b0 con 0x7faff8074620 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7faffd379640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff8074620 0x7faff819a700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fafe800d770 tx=0x7fafe800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7faff67fc640 1 -- 172.21.15.12:0/2246350369 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe8017070 con 0x7faff8074620 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7faff67fc640 1 -- 172.21.15.12:0/2246350369 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafe8005500 con 0x7faff8074620 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7fafff5dd640 1 -- 172.21.15.12:0/2246350369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff819f9a0 con 0x7faff8074620 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7faff67fc640 1 -- 172.21.15.12:0/2246350369 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe8004e00 con 0x7faff8074620 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.373+0000 7fafff5dd640 1 -- 172.21.15.12:0/2246350369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff81a7280 con 0x7faff8074620 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.375+0000 7faff67fc640 1 -- 172.21.15.12:0/2246350369 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fafe8004fa0 con 0x7faff8074620 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7fb0019b6740 1 Processor -- start 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7fb0019b6740 1 -- start start 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b732db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b73d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b73ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7fb0019b6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56506b699090 con 0x56506b73dbb0 2024-09-16T00:58:56.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7fb0019b6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56506b640a70 con 0x56506b7329d0 2024-09-16T00:58:56.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7fb0019b6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56506b695050 con 0x56506b7332f0 2024-09-16T00:58:56.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faff67fc640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fafe00a3240 0x7fafe00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faffcb78640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b73ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faffd379640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b73d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faffcb78640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b73ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56246/0 (socket says 172.21.15.12:56246) 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faffcb78640 1 -- 172.21.15.12:0/3388182638 learned_addr learned my addr 172.21.15.12:0/3388182638 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faffdb7a640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fafe00a3240 0x7fafe00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faff67fc640 1 -- 172.21.15.12:0/2246350369 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fafe80cf520 con 0x7faff8074620 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faffdb7a640 1 --2- 172.21.15.12:0/3388182638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b732db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faffcb78640 1 -- 172.21.15.12:0/3388182638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 msgr2=0x56506b73d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faffcb78640 1 --2- 172.21.15.12:0/3388182638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b73d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.376+0000 7faffcb78640 1 -- 172.21.15.12:0/3388182638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 msgr2=0x56506b732db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.377+0000 7faffcb78640 1 --2- 172.21.15.12:0/3388182638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b732db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.377+0000 7faffcb78640 1 -- 172.21.15.12:0/3388182638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506b64d130 con 0x56506b73dbb0 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.377+0000 7faffd379640 1 --2- 172.21.15.12:0/3388182638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b73d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.377+0000 7faffdb7a640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fafe00a3240 0x7fafe00a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faff0031550 tx=0x7faff0031480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.377+0000 7faffcb78640 1 --2- 172.21.15.12:0/3388182638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b73ffa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fafec009fc0 tx=0x7fafec010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2132760a6c5b28 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:56.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.377+0000 7fafdf7fe640 1 -- 172.21.15.12:0/3388182638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec016070 con 0x56506b73dbb0 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.377+0000 7fafdf7fe640 1 -- 172.21.15.12:0/3388182638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafec003e50 con 0x56506b73dbb0 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.377+0000 7fafdf7fe640 1 -- 172.21.15.12:0/3388182638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec012510 con 0x56506b73dbb0 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 -- 172.21.15.12:0/3388182638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 msgr2=0x56506b73ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 --2- 172.21.15.12:0/3388182638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b73ffa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fafec009fc0 tx=0x7fafec010800 comp rx=0 tx=0).stop 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 -- 172.21.15.12:0/3388182638 shutdown_connections 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 --2- 172.21.15.12:0/3388182638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b73ffa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 --2- 172.21.15.12:0/3388182638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b73d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 --2- 172.21.15.12:0/3388182638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b732db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 -- 172.21.15.12:0/3388182638 >> 172.21.15.12:0/3388182638 conn(0x56506b72ef60 msgr2=0x56506b72f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 -- 172.21.15.12:0/3388182638 shutdown_connections 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 -- 172.21.15.12:0/3388182638 wait complete. 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 -- start start 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.378+0000 7fb0019b6740 1 Processor -- start 2024-09-16T00:58:56.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b73d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b7332f0 0x56506b73a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b73dbb0 0x56506b73aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fb0019b6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56506b740780 con 0x56506b7332f0 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fb0019b6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56506b653f20 con 0x56506b7329d0 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fb0019b6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56506b740900 con 0x56506b73dbb0 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fb0019b6740 10 client.0 _ll_register_callbacks cb 0x56506b61d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffcb78640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b7332f0 0x56506b73a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffcb78640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b7332f0 0x56506b73a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56256/0 (socket says 172.21.15.12:56256) 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffcb78640 1 -- 172.21.15.12:0/355977935 learned_addr learned my addr 172.21.15.12:0/355977935 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffd379640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b73d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffdb7a640 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b73dbb0 0x56506b73aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffcb78640 1 -- 172.21.15.12:0/355977935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b73dbb0 msgr2=0x56506b73aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T00:58:56.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffcb78640 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b73dbb0 0x56506b73aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffcb78640 1 -- 172.21.15.12:0/355977935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 msgr2=0x56506b73d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffcb78640 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b73d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffcb78640 1 -- 172.21.15.12:0/355977935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56506b40a2b0 con 0x56506b7332f0 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffd379640 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b73d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7faffcb78640 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b7332f0 0x56506b73a760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fafec005c10 tx=0x7fafec004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ddf661f3411a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fafdcff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fafdcff9640 1 -- 172.21.15.12:0/355977935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec029060 con 0x56506b7332f0 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fafdcff9640 1 -- 172.21.15.12:0/355977935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fafec004210 con 0x56506b7332f0 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.379+0000 7fb0019b6740 1 -- 172.21.15.12:0/355977935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafec003e50 con 0x56506b7332f0 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fafdcff9640 1 -- 172.21.15.12:0/355977935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fafec030050 con 0x56506b7332f0 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fb0019b6740 10 client.14706 fetch_fsmap learned FSMap version 17 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fb0019b6740 1 -- 172.21.15.12:0/355977935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x56506b74c070 con 0x56506b7332f0 2024-09-16T00:58:56.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fafdcff9640 1 -- 172.21.15.12:0/355977935 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafec003e50 con 0x56506b7332f0 2024-09-16T00:58:56.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fafdcff9640 1 -- 172.21.15.12:0/355977935 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fafec00f040 con 0x56506b7332f0 2024-09-16T00:58:56.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fb0019b6740 10 client.14706 fetch_fsmap finished waiting for FSMap version 17 2024-09-16T00:58:56.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fb0019b6740 10 client.14706 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T00:58:56.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fb0019b6740 20 client.14706 populate_metadata read hostname 'smithi012' 2024-09-16T00:58:56.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fb0019b6740 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56506b74e350 0x56506b74f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fb0019b6740 4 client.14706 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T00:58:56.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7fb0019b6740 1 -- 172.21.15.12:0/355977935 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56506b6a6600 con 0x56506b74e350 2024-09-16T00:58:56.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.380+0000 7faffd379640 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56506b74e350 0x56506b74f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.381+0000 7faffd379640 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56506b74e350 0x56506b74f7c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aa9c0bf12b4d7ce server_cookie=ed195dbf04519b8d in_seq=0 out_seq=0 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.381+0000 7fafdcff9640 10 client.14706 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.381+0000 7fafdcff9640 1 -- 172.21.15.12:0/355977935 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56506b6a6600 con 0x56506b74e350 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.381+0000 7fafdcff9640 10 client.14706 handle_command_reply: tid=0 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.381+0000 7fb0019b6740 1 client.14706 shutdown 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.381+0000 7fb0019b6740 1 -- 172.21.15.12:0/355977935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b7332f0 msgr2=0x56506b73a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.381+0000 7fb0019b6740 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b7332f0 0x56506b73a760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fafec005c10 tx=0x7fafec004810 comp rx=0 tx=0).stop 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.381+0000 7fb0019b6740 1 -- 172.21.15.12:0/355977935 shutdown_connections 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.382+0000 7fb0019b6740 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56506b74e350 0x56506b74f7c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.382+0000 7fb0019b6740 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b73dbb0 0x56506b73aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.382+0000 7fb0019b6740 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b7332f0 0x56506b73a760 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.382+0000 7fafdcff9640 0 client.14706 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.382+0000 7fb0019b6740 1 --2- 172.21.15.12:0/355977935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b73d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.382+0000 7fb0019b6740 1 -- 172.21.15.12:0/355977935 >> 172.21.15.12:0/355977935 conn(0x56506b72ef60 msgr2=0x56506b734c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:56.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.382+0000 7fb0019b6740 1 -- 172.21.15.12:0/355977935 shutdown_connections 2024-09-16T00:58:56.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.382+0000 7fb0019b6740 1 -- 172.21.15.12:0/355977935 wait complete. 2024-09-16T00:58:56.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.382+0000 7fb0019b6740 20 client.14706 trim_cache size 0 max 16384 2024-09-16T00:58:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7fb0019b6740 1 Processor -- start 2024-09-16T00:58:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7fb0019b6740 1 -- start start 2024-09-16T00:58:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b74ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b73c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7fb0019b6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56506b74db00 con 0x56506b73dbb0 2024-09-16T00:58:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7fb0019b6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56506b74e1d0 con 0x56506b7329d0 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7fb0019b6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56506b74e8a0 con 0x56506b7332f0 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7faffdb7a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7faffdb7a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56270/0 (socket says 172.21.15.12:56270) 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7faffdb7a640 1 -- 172.21.15.12:0/1056499657 learned_addr learned my addr 172.21.15.12:0/1056499657 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7faffcb78640 1 --2- 172.21.15.12:0/1056499657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b73c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.400+0000 7faffd379640 1 --2- 172.21.15.12:0/1056499657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b74ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.401+0000 7faffdb7a640 1 -- 172.21.15.12:0/1056499657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 msgr2=0x56506b73c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.401+0000 7faffdb7a640 1 --2- 172.21.15.12:0/1056499657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b73c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.401+0000 7faffdb7a640 1 -- 172.21.15.12:0/1056499657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 msgr2=0x56506b74ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.401+0000 7faffdb7a640 1 --2- 172.21.15.12:0/1056499657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b74ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.401+0000 7faffdb7a640 1 -- 172.21.15.12:0/1056499657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506b740310 con 0x56506b73dbb0 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.401+0000 7faffdb7a640 1 --2- 172.21.15.12:0/1056499657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7379e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faff0009900 tx=0x7faff003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104f6718d8b5ea9c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.401+0000 7fafdeffd640 1 -- 172.21.15.12:0/1056499657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0005220 con 0x56506b73dbb0 2024-09-16T00:58:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.401+0000 7fafdeffd640 1 -- 172.21.15.12:0/1056499657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faff0004c80 con 0x56506b73dbb0 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.401+0000 7fafdeffd640 1 -- 172.21.15.12:0/1056499657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0003970 con 0x56506b73dbb0 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 -- 172.21.15.12:0/1056499657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 msgr2=0x56506b7379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 --2- 172.21.15.12:0/1056499657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7379e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faff0009900 tx=0x7faff003c000 comp rx=0 tx=0).stop 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 -- 172.21.15.12:0/1056499657 shutdown_connections 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 --2- 172.21.15.12:0/1056499657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7379e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 --2- 172.21.15.12:0/1056499657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b73c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 --2- 172.21.15.12:0/1056499657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b74ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 -- 172.21.15.12:0/1056499657 >> 172.21.15.12:0/1056499657 conn(0x56506b72ef60 msgr2=0x56506b73beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 -- 172.21.15.12:0/1056499657 shutdown_connections 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 -- 172.21.15.12:0/1056499657 wait complete. 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 -- start start 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.402+0000 7fb0019b6740 1 Processor -- start 2024-09-16T00:58:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b752d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b753270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7fb0019b6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7fb0019b6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56506b74f640 con 0x56506b73dbb0 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7fb0019b6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56506b74ef70 con 0x56506b7329d0 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7fb0019b6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56506b74fd10 con 0x56506b7332f0 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7fb0019b6740 10 client.0 _ll_register_callbacks cb 0x7faff0032ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffdb7a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffd379640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b752d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffcb78640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b753270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffdb7a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7b6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56280/0 (socket says 172.21.15.12:56280) 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffdb7a640 1 -- 172.21.15.12:0/1940375836 learned_addr learned my addr 172.21.15.12:0/1940375836 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffd379640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b752d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:34440/0 (socket says 172.21.15.12:34440) 2024-09-16T00:58:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffcb78640 1 -- 172.21.15.12:0/1940375836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 msgr2=0x56506b752d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T00:58:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffcb78640 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b752d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffcb78640 1 -- 172.21.15.12:0/1940375836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 msgr2=0x56506b7b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T00:58:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffcb78640 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffcb78640 1 -- 172.21.15.12:0/1940375836 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56506b7b6f90 con 0x56506b7332f0 2024-09-16T00:58:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffdb7a640 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:58:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7faffcb78640 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b753270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafec002230 tx=0x7fafec009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e75d0a5f7d59fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.403+0000 7fafdcff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-16T00:58:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fafdcff9640 1 -- 172.21.15.12:0/1940375836 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec016070 con 0x56506b7332f0 2024-09-16T00:58:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fb0019b6740 1 -- 172.21.15.12:0/1940375836 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff0004c80 con 0x56506b7332f0 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fafdcff9640 1 -- 172.21.15.12:0/1940375836 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fafec003970 con 0x56506b7332f0 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fafdcff9640 1 -- 172.21.15.12:0/1940375836 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fafec004420 con 0x56506b7332f0 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fb0019b6740 10 client.24568 fetch_fsmap learned FSMap version 17 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fb0019b6740 1 -- 172.21.15.12:0/1940375836 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x56506b7b8180 con 0x56506b7332f0 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fafdcff9640 1 -- 172.21.15.12:0/1940375836 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faff0004c80 con 0x56506b7332f0 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fafdcff9640 1 -- 172.21.15.12:0/1940375836 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fafec012510 con 0x56506b7332f0 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fb0019b6740 10 client.24568 fetch_fsmap finished waiting for FSMap version 17 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fb0019b6740 10 client.24568 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fb0019b6740 20 client.24568 populate_metadata read hostname 'smithi012' 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fb0019b6740 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56506b7bcd20 0x56506b7bba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fb0019b6740 4 client.24568 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7fb0019b6740 1 -- 172.21.15.12:0/1940375836 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "status"}) -- 0x56506b6a0b10 con 0x56506b7bcd20 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.404+0000 7faffd379640 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56506b7bcd20 0x56506b7bba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fafdcff9640 10 client.24568 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T00:58:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7faffd379640 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56506b7bcd20 0x56506b7bba30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffd67b9db5456e3c server_cookie=6bd726b84503100c in_seq=0 out_seq=0 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fafdcff9640 1 -- 172.21.15.12:0/1940375836 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56506b6a0b10 con 0x56506b7bcd20 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fafdcff9640 10 client.24568 handle_command_reply: tid=0 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 client.24568 shutdown 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 -- 172.21.15.12:0/1940375836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 msgr2=0x56506b753270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b753270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafec002230 tx=0x7fafec009ea0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 -- 172.21.15.12:0/1940375836 shutdown_connections 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56506b7bcd20 0x56506b7bba30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56506b73dbb0 0x56506b7b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fafdcff9640 0 client.24568 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506b7332f0 0x56506b753270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 --2- 172.21.15.12:0/1940375836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56506b7329d0 0x56506b752d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 -- 172.21.15.12:0/1940375836 >> 172.21.15.12:0/1940375836 conn(0x56506b72ef60 msgr2=0x56506b72e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:56.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 -- 172.21.15.12:0/1940375836 shutdown_connections 2024-09-16T00:58:56.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 1 -- 172.21.15.12:0/1940375836 wait complete. 2024-09-16T00:58:56.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.405+0000 7fb0019b6740 20 client.24568 trim_cache size 0 max 16384 2024-09-16T00:58:56.413 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T00:58:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T00:58:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-16T00:58:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24518, 2024-09-16T00:58:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T00:58:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T00:58:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T00:58:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 18.835369454999999, 2024-09-16T00:58:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 17, 2024-09-16T00:58:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-16T00:58:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T00:58:56.414 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 30.005928345000001 2024-09-16T00:58:56.414 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T00:58:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 -- 172.21.15.12:0/2246350369 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fafe00a3240 msgr2=0x7fafe00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fafe00a3240 0x7fafe00a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faff0031550 tx=0x7faff0031480 comp rx=0 tx=0).stop 2024-09-16T00:58:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 -- 172.21.15.12:0/2246350369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff8074620 msgr2=0x7faff819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff8074620 0x7faff819a700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fafe800d770 tx=0x7fafe800dc30 comp rx=0 tx=0).stop 2024-09-16T00:58:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 -- 172.21.15.12:0/2246350369 shutdown_connections 2024-09-16T00:58:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fafe00a3240 0x7fafe00a5700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff810e3c0 0x7faff819efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faff8074f40 0x7faff819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 --2- 172.21.15.12:0/2246350369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff8074620 0x7faff819a700 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 -- 172.21.15.12:0/2246350369 >> 172.21.15.12:0/2246350369 conn(0x7faff80fd8c0 msgr2=0x7faff80fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 -- 172.21.15.12:0/2246350369 shutdown_connections 2024-09-16T00:58:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:56.406+0000 7fafff5dd640 1 -- 172.21.15.12:0/2246350369 wait complete. 2024-09-16T00:58:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:56 smithi098 ceph-mon[35346]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:57.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:56 smithi012 ceph-mon[31197]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:56 smithi119 ceph-mon[35049]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:57.165 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T00:58:57.166 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-16T00:58:57.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-16T00:58:57.421 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.913+0000 7f29fab0c640 1 -- 172.21.15.12:0/3700964365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29f4106f10 msgr2=0x7f29f410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.913+0000 7f29fab0c640 1 --2- 172.21.15.12:0/3700964365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29f4106f10 0x7f29f410ea90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009900 tx=0x7f29ec02a410 comp rx=0 tx=0).stop 2024-09-16T00:58:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.913+0000 7f29fab0c640 1 -- 172.21.15.12:0/3700964365 shutdown_connections 2024-09-16T00:58:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.913+0000 7f29fab0c640 1 --2- 172.21.15.12:0/3700964365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29f4106f10 0x7f29f410ea90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.913+0000 7f29fab0c640 1 --2- 172.21.15.12:0/3700964365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f4102790 0x7f29f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.913+0000 7f29fab0c640 1 --2- 172.21.15.12:0/3700964365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f4101de0 0x7f29f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.913+0000 7f29fab0c640 1 -- 172.21.15.12:0/3700964365 >> 172.21.15.12:0/3700964365 conn(0x7f29f40fd8c0 msgr2=0x7f29f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.913+0000 7f29fab0c640 1 -- 172.21.15.12:0/3700964365 shutdown_connections 2024-09-16T00:58:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.913+0000 7f29fab0c640 1 -- 172.21.15.12:0/3700964365 wait complete. 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29fab0c640 1 Processor -- start 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29fab0c640 1 -- start start 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29fab0c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29f4101de0 0x7f29f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29fab0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f4102790 0x7f29f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29fab0c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f4106f10 0x7f29f4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29fab0c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29f4111f70 con 0x7f29f4101de0 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29fab0c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f29f4111df0 con 0x7f29f4102790 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29fab0c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f29f41120f0 con 0x7f29f4106f10 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f88a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29f4101de0 0x7f29f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f88a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29f4101de0 0x7f29f40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56296/0 (socket says 172.21.15.12:56296) 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f88a8640 1 -- 172.21.15.12:0/2440621638 learned_addr learned my addr 172.21.15.12:0/2440621638 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f3fff640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f4102790 0x7f29f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f90a9640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f4106f10 0x7f29f4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f88a8640 1 -- 172.21.15.12:0/2440621638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f4106f10 msgr2=0x7f29f4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f88a8640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f4106f10 0x7f29f4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f88a8640 1 -- 172.21.15.12:0/2440621638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f4102790 msgr2=0x7f29f4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f88a8640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f4102790 0x7f29f4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f88a8640 1 -- 172.21.15.12:0/2440621638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f41a6810 con 0x7f29f4101de0 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.914+0000 7f29f3fff640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f4102790 0x7f29f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.915+0000 7f29f88a8640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29f4101de0 0x7f29f40744f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00c890 tx=0x7f29dc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.915+0000 7f29f1ffb640 1 -- 172.21.15.12:0/2440621638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc004220 con 0x7f29f4101de0 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.915+0000 7f29fab0c640 1 -- 172.21.15.12:0/2440621638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f41a6b00 con 0x7f29f4101de0 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.915+0000 7f29f1ffb640 1 -- 172.21.15.12:0/2440621638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29dc0043c0 con 0x7f29f4101de0 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.915+0000 7f29f1ffb640 1 -- 172.21.15.12:0/2440621638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc004a00 con 0x7f29f4101de0 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.915+0000 7f29fab0c640 1 -- 172.21.15.12:0/2440621638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f41a7090 con 0x7f29f4101de0 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.916+0000 7f29fab0c640 1 -- 172.21.15.12:0/2440621638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f41021c0 con 0x7f29f4101de0 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.917+0000 7f29f1ffb640 1 -- 172.21.15.12:0/2440621638 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f29dc0079b0 con 0x7f29f4101de0 2024-09-16T00:58:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.918+0000 7f29f1ffb640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29e00a32c0 0x7f29e00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.918+0000 7f29f3fff640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29e00a32c0 0x7f29e00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.918+0000 7f29f1ffb640 1 -- 172.21.15.12:0/2440621638 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f29dc0cf960 con 0x7f29f4101de0 2024-09-16T00:58:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.918+0000 7f29f3fff640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29e00a32c0 0x7f29e00a5780 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f29e4007350 tx=0x7f29e40072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:57.922+0000 7f29f1ffb640 1 -- 172.21.15.12:0/2440621638 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29dc014030 con 0x7f29f4101de0 2024-09-16T00:58:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.134+0000 7f29fab0c640 1 -- 172.21.15.12:0/2440621638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f29f41a7370 con 0x7f29f4101de0 2024-09-16T00:58:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.135+0000 7f29f1ffb640 1 -- 172.21.15.12:0/2440621638 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f29dc09c3e0 con 0x7f29f4101de0 2024-09-16T00:58:58.136 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 -- 172.21.15.12:0/2440621638 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29e00a32c0 msgr2=0x7f29e00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29e00a32c0 0x7f29e00a5780 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f29e4007350 tx=0x7f29e40072e0 comp rx=0 tx=0).stop 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 -- 172.21.15.12:0/2440621638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29f4101de0 msgr2=0x7f29f40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29f4101de0 0x7f29f40744f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00c890 tx=0x7f29dc00cd50 comp rx=0 tx=0).stop 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 -- 172.21.15.12:0/2440621638 shutdown_connections 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29e00a32c0 0x7f29e00a5780 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29f4106f10 0x7f29f4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f4102790 0x7f29f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 --2- 172.21.15.12:0/2440621638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29f4101de0 0x7f29f40744f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 -- 172.21.15.12:0/2440621638 >> 172.21.15.12:0/2440621638 conn(0x7f29f40fd8c0 msgr2=0x7f29f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 -- 172.21.15.12:0/2440621638 shutdown_connections 2024-09-16T00:58:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58.137+0000 7f29fab0c640 1 -- 172.21.15.12:0/2440621638 wait complete. 2024-09-16T00:58:58.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:58 smithi012 ceph-mon[31197]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:58.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:58:58 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2440621638' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T00:58:58.865 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T00:58:58.865 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T00:58:58.865 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-16T00:58:58.865 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-16T00:58:58.865 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-16T00:58:58.865 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T00:58:58.865 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T00:58:58.865 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T00:58:58.865 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-16T00:58:58.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:58:58.866 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-16T00:58:58.884 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T00:58:58.884 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T00:58:58.885 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-16T00:58:58.886 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-16T00:58:58.886 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-16T00:58:58.886 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42323sec preferred_lft 42323sec 2024-09-16T00:58:58.886 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-16T00:58:58.886 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-16T00:58:58.886 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T00:58:58.886 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-16T00:58:58.886 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-16T00:58:58.887 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T00:58:58.887 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:58:58.887 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-16T00:58:58.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2024-09-16T00:58:58.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2024-09-16T00:58:58.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2024-09-16T00:58:58.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T00:58:58.887 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-16T00:58:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:58 smithi098 ceph-mon[35346]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:58:58 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2440621638' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T00:58:58.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:58:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:58 smithi119 ceph-mon[35049]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:58:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:58:58 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2440621638' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T00:58:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:58:59.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:58:59.134 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T00:58:59.159 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-16T00:58:59.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:58:59.161 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-16T00:58:59.234 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-16T00:58:59.234 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T00:58:59.234 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-16T00:58:59.234 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-16T00:58:59.234 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T00:58:59.234 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:58:59.235 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-16T00:58:59.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-16T00:58:59.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-16T00:58:59.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-16T00:58:59.235 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-16T00:58:59.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:58:59.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:58:59.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:58:59.523 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-16T00:58:59.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:58:59.539 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-09-16T00:58:59.596 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:58:59.596 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-16T00:58:59.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T00:58:59.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-16T00:58:59.596 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-16T00:58:59.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:58:59.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:58:59.716 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-16T00:58:59.716 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:58:59.716 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-16T00:58:59.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-16T00:58:59.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T00:58:59.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-16T00:58:59.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-16T00:58:59.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-16T00:58:59.716 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-16T00:58:59.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:58:59.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:58:59.851 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:58:59.851 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-16T00:58:59.851 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-16T00:58:59.851 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T00:58:59.851 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-16T00:58:59.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:58:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:58:59.930 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-16T00:58:59.930 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T00:58:59.930 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-16T00:58:59.946 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-16T00:58:59.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T00:58:59.946 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-16T00:59:00.002 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-16T00:59:00.070 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T00:59:00.127 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-16T00:59:00.127 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-16T00:59:00.127 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-16T00:59:00.127 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/selinux 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-16T00:59:00.128 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/30aa27a66e64349d6c79d03d1b46edcdbd4882bf9306b46554c88000c8d9a04d/merged 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/e02b69b019cf3a07a506caf56dc2e44344e8a4caba83bfa457219bba32edb6c0/merged 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/0 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T00:59:00.129 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/3ae3198606a2ac0b593ea14c55bee84e9114eb77bf53d03b7adfeef886072024/merged 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/b7861865a0e4a9ebe0a4d37bda46ac5879c1979df68beecd62de789af865dc5b/merged 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/a83c24379fc0f3d7c1a45b7e08716adc14541a968e778115d3fa8521ac8b19fd/merged 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/49e80330a48341993c86ccbabdb795680e728d68c02199b977bea1f22880bc07/merged 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/d84335987e878dc8a6ee6e5cc1e5acacb83b1434f05ae7d39111af750b1029ea/merged 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/59254901b4481e62b1f426695eb9144a33c168dc8d44c866f00b631bf1d7cccb/merged 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/d9e6b4138c1e6ceb61cd36ff26531253d62a53c2123a0ba33d39477fdc7edd66/merged 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/96bf600d4e1ebfdc6a2b147b8cf6d7652f9a249954eefeb2af49e4f65a577004/merged 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T00:59:00.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:59:00.131 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-16T00:59:00.183 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-16T00:59:00.183 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-16T00:59:00.226 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-16T00:59:00.252 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T00:59:00.309 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-16T00:59:00.309 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-16T00:59:00.309 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/selinux 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-16T00:59:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/30aa27a66e64349d6c79d03d1b46edcdbd4882bf9306b46554c88000c8d9a04d/merged 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/e02b69b019cf3a07a506caf56dc2e44344e8a4caba83bfa457219bba32edb6c0/merged 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/0 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T00:59:00.311 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/3ae3198606a2ac0b593ea14c55bee84e9114eb77bf53d03b7adfeef886072024/merged 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/b7861865a0e4a9ebe0a4d37bda46ac5879c1979df68beecd62de789af865dc5b/merged 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/a83c24379fc0f3d7c1a45b7e08716adc14541a968e778115d3fa8521ac8b19fd/merged 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/49e80330a48341993c86ccbabdb795680e728d68c02199b977bea1f22880bc07/merged 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/d84335987e878dc8a6ee6e5cc1e5acacb83b1434f05ae7d39111af750b1029ea/merged 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/59254901b4481e62b1f426695eb9144a33c168dc8d44c866f00b631bf1d7cccb/merged 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/d9e6b4138c1e6ceb61cd36ff26531253d62a53c2123a0ba33d39477fdc7edd66/merged 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/96bf600d4e1ebfdc6a2b147b8cf6d7652f9a249954eefeb2af49e4f65a577004/merged 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T00:59:00.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:59:00.313 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-16T00:59:00.370 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:2024-09-16T00:59:00.370+0000 7ff35ef1e480 -1 init, newargv = 0x5652d1e1be50 newargc=15 2024-09-16T00:59:00.370 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:ceph-fuse[72888]: starting ceph client 2024-09-16T00:59:00.376 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:ceph-fuse[72888]: starting fuse 2024-09-16T00:59:00.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:00 smithi098 ceph-mon[35346]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:00 smithi119 ceph-mon[35049]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:01.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:00 smithi012 ceph-mon[31197]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:01.466 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-16T00:59:01.501 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T00:59:01.561 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-16T00:59:01.561 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-16T00:59:01.561 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-16T00:59:01.561 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/selinux 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-16T00:59:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/30aa27a66e64349d6c79d03d1b46edcdbd4882bf9306b46554c88000c8d9a04d/merged 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/e02b69b019cf3a07a506caf56dc2e44344e8a4caba83bfa457219bba32edb6c0/merged 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/0 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T00:59:01.563 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/3ae3198606a2ac0b593ea14c55bee84e9114eb77bf53d03b7adfeef886072024/merged 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/b7861865a0e4a9ebe0a4d37bda46ac5879c1979df68beecd62de789af865dc5b/merged 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/a83c24379fc0f3d7c1a45b7e08716adc14541a968e778115d3fa8521ac8b19fd/merged 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/49e80330a48341993c86ccbabdb795680e728d68c02199b977bea1f22880bc07/merged 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/d84335987e878dc8a6ee6e5cc1e5acacb83b1434f05ae7d39111af750b1029ea/merged 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/59254901b4481e62b1f426695eb9144a33c168dc8d44c866f00b631bf1d7cccb/merged 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/d9e6b4138c1e6ceb61cd36ff26531253d62a53c2123a0ba33d39477fdc7edd66/merged 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/96bf600d4e1ebfdc6a2b147b8cf6d7652f9a249954eefeb2af49e4f65a577004/merged 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-16T00:59:01.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:59:01.565 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-16T00:59:01.620 INFO:teuthology.orchestra.run.smithi012.stdout:120 2024-09-16T00:59:01.620 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-16T00:59:01.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-16T00:59:01.620 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-16T00:59:01.620 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-16T00:59:01.620 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-16T00:59:01.621 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-16T00:59:01.622 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-16T00:59:01.622 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-16T00:59:01.622 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-16T00:59:01.622 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-16T00:59:01.622 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-16T00:59:01.622 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-16T00:59:01.622 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.admin")) 2024-09-16T00:59:01.622 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-16T00:59:01.749 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.admin.72888.asok 2024-09-16T00:59:01.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:59:01.761 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.72888.asok 2024-09-16T00:59:01.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:59:01.761 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.72888.asok status 2024-09-16T00:59:01.900 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T00:59:01.900 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "admin", 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "72888", 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 14724, 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-16T00:59:01.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 14724 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1212968863 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1212968863 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T00:59:01.902 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.14724 192.168.0.1:0/1212968863", 2024-09-16T00:59:01.903 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.1:0/1212968863", 2024-09-16T00:59:01.903 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-16T00:59:01.903 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 17, 2024-09-16T00:59:01.903 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 85, 2024-09-16T00:59:01.903 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-16T00:59:01.903 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-16T00:59:01.903 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-16T00:59:01.903 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T00:59:01.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:59:01.909 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-16T00:59:01.909 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-16T00:59:01.925 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-16T00:59:01.926 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-16T00:59:01.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:59:01.926 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-16T00:59:01.993 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-16T00:59:02.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T00:59:02.102 INFO:teuthology.orchestra.run.smithi012.stdout:# file: . 2024-09-16T00:59:02.102 INFO:teuthology.orchestra.run.smithi012.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-16T00:59:02.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:59:02.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:59:02.108 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:59:02.108 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T00:59:02.126 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T00:59:02.424 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:02.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:02 smithi012 ceph-mon[31197]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:02 smithi098 ceph-mon[35346]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:02.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.946+0000 7f0f70d9a640 1 -- 172.21.15.12:0/2043422772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f6c102570 msgr2=0x7f0f6c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:02.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.946+0000 7f0f70d9a640 1 --2- 172.21.15.12:0/2043422772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f6c102570 0x7f0f6c1029b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009ca0 tx=0x7f0f6002a950 comp rx=0 tx=0).stop 2024-09-16T00:59:02.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.946+0000 7f0f70d9a640 1 -- 172.21.15.12:0/2043422772 shutdown_connections 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.946+0000 7f0f70d9a640 1 --2- 172.21.15.12:0/2043422772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f6c102ef0 0x7f0f6c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.946+0000 7f0f70d9a640 1 --2- 172.21.15.12:0/2043422772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f6c102570 0x7f0f6c1029b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.946+0000 7f0f70d9a640 1 --2- 172.21.15.12:0/2043422772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f6c100e20 0x7f0f6c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.946+0000 7f0f70d9a640 1 -- 172.21.15.12:0/2043422772 >> 172.21.15.12:0/2043422772 conn(0x7f0f6c0fc7d0 msgr2=0x7f0f6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.946+0000 7f0f70d9a640 1 -- 172.21.15.12:0/2043422772 shutdown_connections 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.946+0000 7f0f70d9a640 1 -- 172.21.15.12:0/2043422772 wait complete. 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.947+0000 7f0f70d9a640 1 Processor -- start 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.947+0000 7f0f70d9a640 1 -- start start 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.947+0000 7f0f70d9a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f6c100e20 0x7f0f6c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.947+0000 7f0f70d9a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f6c102570 0x7f0f6c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.947+0000 7f0f70d9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f6c102ef0 0x7f0f6c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.947+0000 7f0f70d9a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c110f80 con 0x7f0f6c102ef0 2024-09-16T00:59:02.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.947+0000 7f0f70d9a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c110e00 con 0x7f0f6c100e20 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.947+0000 7f0f70d9a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c111100 con 0x7f0f6c102570 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.947+0000 7f0f6ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f6c102ef0 0x7f0f6c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.947+0000 7f0f6a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f6c100e20 0x7f0f6c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f6a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f6c100e20 0x7f0f6c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:34470/0 (socket says 172.21.15.12:34470) 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f6ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f6c102ef0 0x7f0f6c19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56322/0 (socket says 172.21.15.12:56322) 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f6a59c640 1 -- 172.21.15.12:0/1039588233 learned_addr learned my addr 172.21.15.12:0/1039588233 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f69d9b640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f6c102570 0x7f0f6c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f6ad9d640 1 -- 172.21.15.12:0/1039588233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f6c102570 msgr2=0x7f0f6c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f6ad9d640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f6c102570 0x7f0f6c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f6ad9d640 1 -- 172.21.15.12:0/1039588233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f6c100e20 msgr2=0x7f0f6c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f6ad9d640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f6c100e20 0x7f0f6c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f6ad9d640 1 -- 172.21.15.12:0/1039588233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c19f660 con 0x7f0f6c102ef0 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f6a59c640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f6c100e20 0x7f0f6c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:59:02.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f6ad9d640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f6c102ef0 0x7f0f6c19ef80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400d680 tx=0x7f0f6400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f5b7fe640 1 -- 172.21.15.12:0/1039588233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64017070 con 0x7f0f6c102ef0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f5b7fe640 1 -- 172.21.15.12:0/1039588233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f64009820 con 0x7f0f6c102ef0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f70d9a640 1 -- 172.21.15.12:0/1039588233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c19f950 con 0x7f0f6c102ef0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f5b7fe640 1 -- 172.21.15.12:0/1039588233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64004e00 con 0x7f0f6c102ef0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.948+0000 7f0f70d9a640 1 -- 172.21.15.12:0/1039588233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c1a7230 con 0x7f0f6c102ef0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.949+0000 7f0f70d9a640 1 -- 172.21.15.12:0/1039588233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6c101200 con 0x7f0f6c102ef0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.950+0000 7f0f5b7fe640 1 -- 172.21.15.12:0/1039588233 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0f640099d0 con 0x7f0f6c102ef0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.951+0000 7f0f5b7fe640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0f540a3240 0x7f0f540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.951+0000 7f0f5b7fe640 1 -- 172.21.15.12:0/1039588233 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f0f640cf3f0 con 0x7f0f6c102ef0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.951+0000 7f0f6a59c640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0f540a3240 0x7f0f540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.952+0000 7f0f6a59c640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0f540a3240 0x7f0f540a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0058c0 tx=0x7f0f5c00a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:02.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:02.956+0000 7f0f5b7fe640 1 -- 172.21.15.12:0/1039588233 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f6409b820 con 0x7f0f6c102ef0 2024-09-16T00:59:03.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:02 smithi119 ceph-mon[35049]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.143+0000 7f0f70d9a640 1 -- 172.21.15.12:0/1039588233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0f6c1a7400 con 0x7f0f6c102ef0 2024-09-16T00:59:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.143+0000 7f0f5b7fe640 1 -- 172.21.15.12:0/1039588233 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+591 (secure 0 0 0) 0x7f0f6409fb20 con 0x7f0f6c102ef0 2024-09-16T00:59:03.144 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2197597102 2024-09-17T00:51:42.808843+0000 2024-09-16T00:59:03.144 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2549589240 2024-09-17T00:51:42.808843+0000 2024-09-16T00:59:03.144 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/1863535251 2024-09-17T00:51:42.808843+0000 2024-09-16T00:59:03.144 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/570072659 2024-09-17T00:51:42.808843+0000 2024-09-16T00:59:03.145 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/1863535251 2024-09-17T00:51:42.808843+0000 2024-09-16T00:59:03.145 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1710824695 2024-09-17T00:51:19.512115+0000 2024-09-16T00:59:03.145 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/4246888310 2024-09-17T00:51:19.512115+0000 2024-09-16T00:59:03.145 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/3324219193 2024-09-17T00:51:19.512115+0000 2024-09-16T00:59:03.145 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/3324219193 2024-09-17T00:51:19.512115+0000 2024-09-16T00:59:03.145 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2420216586 2024-09-17T00:51:19.512115+0000 2024-09-16T00:59:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:listed 10 entries 2024-09-16T00:59:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.145+0000 7f0f70d9a640 1 -- 172.21.15.12:0/1039588233 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0f540a3240 msgr2=0x7f0f540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.145+0000 7f0f70d9a640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0f540a3240 0x7f0f540a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0058c0 tx=0x7f0f5c00a380 comp rx=0 tx=0).stop 2024-09-16T00:59:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.145+0000 7f0f70d9a640 1 -- 172.21.15.12:0/1039588233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f6c102ef0 msgr2=0x7f0f6c19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.145+0000 7f0f70d9a640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f6c102ef0 0x7f0f6c19ef80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400d680 tx=0x7f0f6400db40 comp rx=0 tx=0).stop 2024-09-16T00:59:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.146+0000 7f0f70d9a640 1 -- 172.21.15.12:0/1039588233 shutdown_connections 2024-09-16T00:59:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.146+0000 7f0f70d9a640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f0f540a3240 0x7f0f540a5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.146+0000 7f0f70d9a640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f6c102ef0 0x7f0f6c19ef80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.146+0000 7f0f70d9a640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f6c102570 0x7f0f6c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.146+0000 7f0f70d9a640 1 --2- 172.21.15.12:0/1039588233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f6c100e20 0x7f0f6c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.146+0000 7f0f70d9a640 1 -- 172.21.15.12:0/1039588233 >> 172.21.15.12:0/1039588233 conn(0x7f0f6c0fc7d0 msgr2=0x7f0f6c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.146+0000 7f0f70d9a640 1 -- 172.21.15.12:0/1039588233 shutdown_connections 2024-09-16T00:59:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:03.146+0000 7f0f70d9a640 1 -- 172.21.15.12:0/1039588233 wait complete. 2024-09-16T00:59:03.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:03 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1039588233' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T00:59:03.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:03 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1039588233' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T00:59:04.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:03 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1039588233' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T00:59:04.162 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:59:04.162 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T00:59:04.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T00:59:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:04.874 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:04 smithi012 ceph-mon[31197]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:04.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:04 smithi098 ceph-mon[35346]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:04.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.959+0000 7f151dece640 1 -- 172.21.15.12:0/3107268768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151810c170 msgr2=0x7f151810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.959+0000 7f151dece640 1 --2- 172.21.15.12:0/3107268768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151810c170 0x7f151810e610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1510009ca0 tx=0x7f151002a950 comp rx=0 tx=0).stop 2024-09-16T00:59:04.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.959+0000 7f151dece640 1 -- 172.21.15.12:0/3107268768 shutdown_connections 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.959+0000 7f151dece640 1 --2- 172.21.15.12:0/3107268768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151810c170 0x7f151810e610 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.959+0000 7f151dece640 1 --2- 172.21.15.12:0/3107268768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1518103660 0x7f151810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.959+0000 7f151dece640 1 --2- 172.21.15.12:0/3107268768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1518102d40 0x7f1518103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.959+0000 7f151dece640 1 -- 172.21.15.12:0/3107268768 >> 172.21.15.12:0/3107268768 conn(0x7f15180fc7a0 msgr2=0x7f15180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.959+0000 7f151dece640 1 -- 172.21.15.12:0/3107268768 shutdown_connections 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.959+0000 7f151dece640 1 -- 172.21.15.12:0/3107268768 wait complete. 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.959+0000 7f151dece640 1 Processor -- start 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f151dece640 1 -- start start 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f151dece640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1518102d40 0x7f15181009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f151dece640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1518103660 0x7f1518100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f151dece640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f151810c170 0x7f1518101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f151dece640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1518111f70 con 0x7f1518103660 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f151dece640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1518111df0 con 0x7f151810c170 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f151dece640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f15181120f0 con 0x7f1518102d40 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f1516ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1518103660 0x7f1518100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f1516ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1518103660 0x7f1518100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56334/0 (socket says 172.21.15.12:56334) 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f1516ffd640 1 -- 172.21.15.12:0/648468556 learned_addr learned my addr 172.21.15.12:0/648468556 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f1517fff640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f151810c170 0x7f1518101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f15177fe640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1518102d40 0x7f15181009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f1516ffd640 1 -- 172.21.15.12:0/648468556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1518102d40 msgr2=0x7f15181009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f1516ffd640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1518102d40 0x7f15181009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f1516ffd640 1 -- 172.21.15.12:0/648468556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f151810c170 msgr2=0x7f1518101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f1516ffd640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f151810c170 0x7f1518101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f1516ffd640 1 -- 172.21.15.12:0/648468556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15181a6830 con 0x7f1518103660 2024-09-16T00:59:04.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.960+0000 7f15177fe640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1518102d40 0x7f15181009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:04.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.961+0000 7f1516ffd640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1518103660 0x7f1518100ee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f150c00d950 tx=0x7f150c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:04.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.961+0000 7f1514ff9640 1 -- 172.21.15.12:0/648468556 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c017030 con 0x7f1518103660 2024-09-16T00:59:04.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.961+0000 7f1514ff9640 1 -- 172.21.15.12:0/648468556 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f150c004020 con 0x7f1518103660 2024-09-16T00:59:04.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.961+0000 7f151dece640 1 -- 172.21.15.12:0/648468556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15181a6b20 con 0x7f1518103660 2024-09-16T00:59:04.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.961+0000 7f1514ff9640 1 -- 172.21.15.12:0/648468556 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0047a0 con 0x7f1518103660 2024-09-16T00:59:04.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.961+0000 7f151dece640 1 -- 172.21.15.12:0/648468556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15181a7060 con 0x7f1518103660 2024-09-16T00:59:04.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.962+0000 7f151dece640 1 -- 172.21.15.12:0/648468556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1518103120 con 0x7f1518103660 2024-09-16T00:59:04.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.963+0000 7f1514ff9640 1 -- 172.21.15.12:0/648468556 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f150c0041d0 con 0x7f1518103660 2024-09-16T00:59:04.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.964+0000 7f1514ff9640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f15000a3240 0x7f15000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:04.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.964+0000 7f15177fe640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f15000a3240 0x7f15000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:04.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.964+0000 7f1514ff9640 1 -- 172.21.15.12:0/648468556 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f150c0cf490 con 0x7f1518103660 2024-09-16T00:59:04.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.964+0000 7f15177fe640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f15000a3240 0x7f15000a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f150800abe0 tx=0x7f150800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:04.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:04.968+0000 7f1514ff9640 1 -- 172.21.15.12:0/648468556 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f150c09bf70 con 0x7f1518103660 2024-09-16T00:59:05.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:04 smithi119 ceph-mon[35049]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:05.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.154+0000 7f151dece640 1 -- 172.21.15.12:0/648468556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1518101ed0 con 0x7f1518103660 2024-09-16T00:59:05.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.155+0000 7f1514ff9640 1 -- 172.21.15.12:0/648468556 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+591 (secure 0 0 0) 0x7f150c09b870 con 0x7f1518103660 2024-09-16T00:59:05.156 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2197597102 2024-09-17T00:51:42.808843+0000 2024-09-16T00:59:05.156 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2549589240 2024-09-17T00:51:42.808843+0000 2024-09-16T00:59:05.156 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/1863535251 2024-09-17T00:51:42.808843+0000 2024-09-16T00:59:05.156 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/570072659 2024-09-17T00:51:42.808843+0000 2024-09-16T00:59:05.156 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/1863535251 2024-09-17T00:51:42.808843+0000 2024-09-16T00:59:05.156 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1710824695 2024-09-17T00:51:19.512115+0000 2024-09-16T00:59:05.156 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/4246888310 2024-09-17T00:51:19.512115+0000 2024-09-16T00:59:05.156 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/3324219193 2024-09-17T00:51:19.512115+0000 2024-09-16T00:59:05.156 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/3324219193 2024-09-17T00:51:19.512115+0000 2024-09-16T00:59:05.156 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2420216586 2024-09-17T00:51:19.512115+0000 2024-09-16T00:59:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:listed 10 entries 2024-09-16T00:59:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 -- 172.21.15.12:0/648468556 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f15000a3240 msgr2=0x7f15000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f15000a3240 0x7f15000a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f150800abe0 tx=0x7f150800a5c0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 -- 172.21.15.12:0/648468556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1518103660 msgr2=0x7f1518100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1518103660 0x7f1518100ee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f150c00d950 tx=0x7f150c00de10 comp rx=0 tx=0).stop 2024-09-16T00:59:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 -- 172.21.15.12:0/648468556 shutdown_connections 2024-09-16T00:59:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f15000a3240 0x7f15000a5700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f151810c170 0x7f1518101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1518103660 0x7f1518100ee0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 --2- 172.21.15.12:0/648468556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1518102d40 0x7f15181009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 -- 172.21.15.12:0/648468556 >> 172.21.15.12:0/648468556 conn(0x7f15180fc7a0 msgr2=0x7f15180fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:05.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 -- 172.21.15.12:0/648468556 shutdown_connections 2024-09-16T00:59:05.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:05.157+0000 7f151dece640 1 -- 172.21.15.12:0/648468556 wait complete. 2024-09-16T00:59:05.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/648468556' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T00:59:05.911 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-16T00:59:05.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:59:05.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-16T00:59:05.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:ceph-fuse[72888]: fuse finished with error 0 and tester_r 0 2024-09-16T00:59:05.945 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T00:59:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:05 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/648468556' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T00:59:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:05 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/648468556' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T00:59:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:06 smithi098 ceph-mon[35346]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-16T00:59:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:06 smithi119 ceph-mon[35049]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-16T00:59:07.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:06 smithi012 ceph-mon[31197]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-16T00:59:08.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:08 smithi098 ceph-mon[35346]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-16T00:59:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:08 smithi119 ceph-mon[35049]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-16T00:59:09.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:08 smithi012 ceph-mon[31197]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-16T00:59:10.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:10 smithi098 ceph-mon[35346]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-16T00:59:11.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:10 smithi119 ceph-mon[35049]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-16T00:59:11.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:10 smithi012 ceph-mon[31197]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-16T00:59:12.046 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-16T00:59:12.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:59:12.047 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-16T00:59:12.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:59:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:12.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:12 smithi012 ceph-mon[31197]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-16T00:59:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.870+0000 7f70f5872640 1 -- 172.21.15.12:0/1007350741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f010e3c0 msgr2=0x7f70f0110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.870+0000 7f70f5872640 1 --2- 172.21.15.12:0/1007350741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f010e3c0 0x7f70f0110810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009ca0 tx=0x7f70e802a950 comp rx=0 tx=0).stop 2024-09-16T00:59:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.870+0000 7f70f5872640 1 -- 172.21.15.12:0/1007350741 shutdown_connections 2024-09-16T00:59:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.870+0000 7f70f5872640 1 --2- 172.21.15.12:0/1007350741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f010e3c0 0x7f70f0110810 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.870+0000 7f70f5872640 1 --2- 172.21.15.12:0/1007350741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f0074f40 0x7f70f010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.870+0000 7f70f5872640 1 --2- 172.21.15.12:0/1007350741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f0074620 0x7f70f0074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.870+0000 7f70f5872640 1 -- 172.21.15.12:0/1007350741 >> 172.21.15.12:0/1007350741 conn(0x7f70f00fd8c0 msgr2=0x7f70f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.871+0000 7f70f5872640 1 -- 172.21.15.12:0/1007350741 shutdown_connections 2024-09-16T00:59:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.871+0000 7f70f5872640 1 -- 172.21.15.12:0/1007350741 wait complete. 2024-09-16T00:59:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.871+0000 7f70f5872640 1 Processor -- start 2024-09-16T00:59:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.871+0000 7f70f5872640 1 -- start start 2024-09-16T00:59:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70f5872640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f0074620 0x7f70f019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70f5872640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f0074f40 0x7f70f019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70f5872640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f010e3c0 0x7f70f019ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70f5872640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f70f0114150 con 0x7f70f0074f40 2024-09-16T00:59:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70f5872640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f70f0113fd0 con 0x7f70f0074620 2024-09-16T00:59:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70f5872640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f70f01142d0 con 0x7f70f010e3c0 2024-09-16T00:59:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70ee7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f0074f40 0x7f70f019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70ee7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f0074f40 0x7f70f019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33562/0 (socket says 172.21.15.12:33562) 2024-09-16T00:59:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70ee7fc640 1 -- 172.21.15.12:0/691784187 learned_addr learned my addr 172.21.15.12:0/691784187 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70ef7fe640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f010e3c0 0x7f70f019ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70eeffd640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f0074620 0x7f70f019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:12.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70ee7fc640 1 -- 172.21.15.12:0/691784187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f010e3c0 msgr2=0x7f70f019ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:12.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70ee7fc640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f010e3c0 0x7f70f019ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:12.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70ee7fc640 1 -- 172.21.15.12:0/691784187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f0074620 msgr2=0x7f70f019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:12.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70ee7fc640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f0074620 0x7f70f019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:12.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70ee7fc640 1 -- 172.21.15.12:0/691784187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f019f520 con 0x7f70f0074f40 2024-09-16T00:59:12.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70eeffd640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f0074620 0x7f70f019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:12.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70ee7fc640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f0074f40 0x7f70f019aab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c890 tx=0x7f70e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:12.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70f4870640 1 -- 172.21.15.12:0/691784187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4004220 con 0x7f70f0074f40 2024-09-16T00:59:12.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70f4870640 1 -- 172.21.15.12:0/691784187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70e40043c0 con 0x7f70f0074f40 2024-09-16T00:59:12.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70f5872640 1 -- 172.21.15.12:0/691784187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f019f810 con 0x7f70f0074f40 2024-09-16T00:59:12.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.872+0000 7f70f4870640 1 -- 172.21.15.12:0/691784187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e40049e0 con 0x7f70f0074f40 2024-09-16T00:59:12.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.873+0000 7f70f5872640 1 -- 172.21.15.12:0/691784187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f01a70f0 con 0x7f70f0074f40 2024-09-16T00:59:12.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.873+0000 7f70f5872640 1 -- 172.21.15.12:0/691784187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f0074a00 con 0x7f70f0074f40 2024-09-16T00:59:12.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.875+0000 7f70f4870640 1 -- 172.21.15.12:0/691784187 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f70e40079b0 con 0x7f70f0074f40 2024-09-16T00:59:12.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.875+0000 7f70f4870640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70d80a32c0 0x7f70d80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:12.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.875+0000 7f70eeffd640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70d80a32c0 0x7f70d80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:12.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.875+0000 7f70f4870640 1 -- 172.21.15.12:0/691784187 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f70e40cfaf0 con 0x7f70f0074f40 2024-09-16T00:59:12.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.876+0000 7f70eeffd640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70d80a32c0 0x7f70d80a5780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f70e000abe0 tx=0x7f70e000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:12.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:12.880+0000 7f70f4870640 1 -- 172.21.15.12:0/691784187 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70e4014030 con 0x7f70f0074f40 2024-09-16T00:59:12.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:12 smithi098 ceph-mon[35346]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-16T00:59:13.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.057+0000 7f70f5872640 1 -- 172.21.15.12:0/691784187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70f01a7480 con 0x7f70f0074f40 2024-09-16T00:59:13.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.059+0000 7f70f4870640 1 -- 172.21.15.12:0/691784187 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24189 (secure 0 0 0) 0x7f70e409c5d0 con 0x7f70f0074f40 2024-09-16T00:59:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:59:13.060 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T00:58:46.252124+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:59:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.061+0000 7f70f5872640 1 -- 172.21.15.12:0/691784187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70d80a32c0 msgr2=0x7f70d80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.061+0000 7f70f5872640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70d80a32c0 0x7f70d80a5780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f70e000abe0 tx=0x7f70e000a5c0 comp rx=0 tx=0).stop 2024-09-16T00:59:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.061+0000 7f70f5872640 1 -- 172.21.15.12:0/691784187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f0074f40 msgr2=0x7f70f019aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.061+0000 7f70f5872640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f0074f40 0x7f70f019aab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c890 tx=0x7f70e400cd50 comp rx=0 tx=0).stop 2024-09-16T00:59:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.061+0000 7f70f5872640 1 -- 172.21.15.12:0/691784187 shutdown_connections 2024-09-16T00:59:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.061+0000 7f70f5872640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f70d80a32c0 0x7f70d80a5780 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:13.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.061+0000 7f70f5872640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70f010e3c0 0x7f70f019ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:13.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.061+0000 7f70f5872640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70f0074f40 0x7f70f019aab0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:13.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.061+0000 7f70f5872640 1 --2- 172.21.15.12:0/691784187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f0074620 0x7f70f019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:13.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.061+0000 7f70f5872640 1 -- 172.21.15.12:0/691784187 >> 172.21.15.12:0/691784187 conn(0x7f70f00fd8c0 msgr2=0x7f70f00fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:13.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.062+0000 7f70f5872640 1 -- 172.21.15.12:0/691784187 shutdown_connections 2024-09-16T00:59:13.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:13.062+0000 7f70f5872640 1 -- 172.21.15.12:0/691784187 wait complete. 2024-09-16T00:59:13.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:12 smithi119 ceph-mon[35049]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-16T00:59:13.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:13 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/691784187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:14.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:59:14.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:13 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/691784187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:14.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:13 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/691784187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:14.292 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:14.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.771+0000 7fa61be23640 1 -- 172.21.15.12:0/1215515137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa614101420 msgr2=0x7fa61410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:14.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.771+0000 7fa61be23640 1 --2- 172.21.15.12:0/1215515137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa614101420 0x7fa61410d950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009cd0 tx=0x7fa60c02a8e0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.771+0000 7fa61be23640 1 -- 172.21.15.12:0/1215515137 shutdown_connections 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.771+0000 7fa61be23640 1 --2- 172.21.15.12:0/1215515137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa614101420 0x7fa61410d950 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.771+0000 7fa61be23640 1 --2- 172.21.15.12:0/1215515137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614100a80 0x7fa614100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.771+0000 7fa61be23640 1 --2- 172.21.15.12:0/1215515137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa614106a80 0x7fa614106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.771+0000 7fa61be23640 1 -- 172.21.15.12:0/1215515137 >> 172.21.15.12:0/1215515137 conn(0x7fa6140fc7a0 msgr2=0x7fa6140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.772+0000 7fa61be23640 1 -- 172.21.15.12:0/1215515137 shutdown_connections 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.772+0000 7fa61be23640 1 -- 172.21.15.12:0/1215515137 wait complete. 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.772+0000 7fa61be23640 1 Processor -- start 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.772+0000 7fa61be23640 1 -- start start 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.772+0000 7fa61be23640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa614100a80 0x7fa61410e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.772+0000 7fa61be23640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614101420 0x7fa61410e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.772+0000 7fa61be23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa614106a80 0x7fa61410ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.772+0000 7fa61be23640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa614111f90 con 0x7fa614106a80 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.772+0000 7fa61be23640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa614111e10 con 0x7fa614100a80 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.772+0000 7fa61be23640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa614112110 con 0x7fa614101420 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61a3c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa614106a80 0x7fa61410ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61a3c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa614106a80 0x7fa61410ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33572/0 (socket says 172.21.15.12:33572) 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61a3c0640 1 -- 172.21.15.12:0/1809885772 learned_addr learned my addr 172.21.15.12:0/1809885772 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa6193be640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614101420 0x7fa61410e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa619bbf640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa614100a80 0x7fa61410e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61a3c0640 1 -- 172.21.15.12:0/1809885772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614101420 msgr2=0x7fa61410e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61a3c0640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614101420 0x7fa61410e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61a3c0640 1 -- 172.21.15.12:0/1809885772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa614100a80 msgr2=0x7fa61410e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61a3c0640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa614100a80 0x7fa61410e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61a3c0640 1 -- 172.21.15.12:0/1809885772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6141a6820 con 0x7fa614106a80 2024-09-16T00:59:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61a3c0640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa614106a80 0x7fa61410ece0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa60c005cc0 tx=0x7fa60c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa60affd640 1 -- 172.21.15.12:0/1809885772 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c004040 con 0x7fa614106a80 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa60affd640 1 -- 172.21.15.12:0/1809885772 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa60c0046c0 con 0x7fa614106a80 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61be23640 1 -- 172.21.15.12:0/1809885772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6141a6ab0 con 0x7fa614106a80 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa60affd640 1 -- 172.21.15.12:0/1809885772 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c046480 con 0x7fa614106a80 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.773+0000 7fa61be23640 1 -- 172.21.15.12:0/1809885772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6141a6ff0 con 0x7fa614106a80 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.774+0000 7fa61be23640 1 -- 172.21.15.12:0/1809885772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa614100ee0 con 0x7fa614106a80 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.775+0000 7fa60affd640 1 -- 172.21.15.12:0/1809885772 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa60c0305a0 con 0x7fa614106a80 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.776+0000 7fa60affd640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa6000a3240 0x7fa6000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.776+0000 7fa60affd640 1 -- 172.21.15.12:0/1809885772 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fa60c02e030 con 0x7fa614106a80 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.776+0000 7fa619bbf640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa6000a3240 0x7fa6000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.777+0000 7fa619bbf640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa6000a3240 0x7fa6000a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa61000cac0 tx=0x7fa61000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.780+0000 7fa60affd640 1 -- 172.21.15.12:0/1809885772 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa60c04b060 con 0x7fa614106a80 2024-09-16T00:59:14.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.957+0000 7fa61be23640 1 -- 172.21.15.12:0/1809885772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6141a7220 con 0x7fa614106a80 2024-09-16T00:59:14.960 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:14 smithi012 ceph-mon[31197]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-16T00:59:14.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.959+0000 7fa60affd640 1 -- 172.21.15.12:0/1809885772 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24189 (secure 0 0 0) 0x7fa60c0bde50 con 0x7fa614106a80 2024-09-16T00:59:14.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:59:14.963 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T00:58:46.252124+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 -- 172.21.15.12:0/1809885772 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa6000a3240 msgr2=0x7fa6000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa6000a3240 0x7fa6000a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa61000cac0 tx=0x7fa61000c4a0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 -- 172.21.15.12:0/1809885772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa614106a80 msgr2=0x7fa61410ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa614106a80 0x7fa61410ece0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa60c005cc0 tx=0x7fa60c003970 comp rx=0 tx=0).stop 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 -- 172.21.15.12:0/1809885772 shutdown_connections 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa6000a3240 0x7fa6000a5700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa614106a80 0x7fa61410ece0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614101420 0x7fa61410e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 --2- 172.21.15.12:0/1809885772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa614100a80 0x7fa61410e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 -- 172.21.15.12:0/1809885772 >> 172.21.15.12:0/1809885772 conn(0x7fa6140fc7a0 msgr2=0x7fa6140fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:14.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 -- 172.21.15.12:0/1809885772 shutdown_connections 2024-09-16T00:59:14.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:14.961+0000 7fa61be23640 1 -- 172.21.15.12:0/1809885772 wait complete. 2024-09-16T00:59:15.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:14 smithi119 ceph-mon[35049]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-16T00:59:15.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:14 smithi098 ceph-mon[35346]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-16T00:59:15.644 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-16T00:59:15.908 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:16.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:15 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1809885772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:16.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:15 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1809885772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:16.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:15 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1809885772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.382+0000 7fb54e7e5640 1 -- 172.21.15.12:0/2039202317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb548074f40 msgr2=0x7fb54810de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.382+0000 7fb54e7e5640 1 --2- 172.21.15.12:0/2039202317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb548074f40 0x7fb54810de90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb530009900 tx=0x7fb53002a480 comp rx=0 tx=0).stop 2024-09-16T00:59:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.382+0000 7fb54e7e5640 1 -- 172.21.15.12:0/2039202317 shutdown_connections 2024-09-16T00:59:16.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.382+0000 7fb54e7e5640 1 --2- 172.21.15.12:0/2039202317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb54810e3d0 0x7fb548110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.382+0000 7fb54e7e5640 1 --2- 172.21.15.12:0/2039202317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb548074f40 0x7fb54810de90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.382+0000 7fb54e7e5640 1 --2- 172.21.15.12:0/2039202317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb548074620 0x7fb548074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.382+0000 7fb54e7e5640 1 -- 172.21.15.12:0/2039202317 >> 172.21.15.12:0/2039202317 conn(0x7fb5480fd8f0 msgr2=0x7fb5480ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.382+0000 7fb54e7e5640 1 -- 172.21.15.12:0/2039202317 shutdown_connections 2024-09-16T00:59:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.382+0000 7fb54e7e5640 1 -- 172.21.15.12:0/2039202317 wait complete. 2024-09-16T00:59:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb54e7e5640 1 Processor -- start 2024-09-16T00:59:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb54e7e5640 1 -- start start 2024-09-16T00:59:16.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb54e7e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb548074620 0x7fb5481a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb54e7e5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb548074f40 0x7fb5481a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb54e7e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb54810e3d0 0x7fb54819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb54e7e5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb548114240 con 0x7fb548074620 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb54e7e5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb5481140c0 con 0x7fb548074f40 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb54e7e5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb5481143c0 con 0x7fb54810e3d0 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb547fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb548074620 0x7fb5481a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb547fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb548074620 0x7fb5481a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52060/0 (socket says 172.21.15.12:52060) 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb547fff640 1 -- 172.21.15.12:0/384762018 learned_addr learned my addr 172.21.15.12:0/384762018 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb53ffff640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb548074f40 0x7fb5481a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb547fff640 1 -- 172.21.15.12:0/384762018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb54810e3d0 msgr2=0x7fb54819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb547fff640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb54810e3d0 0x7fb54819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb547fff640 1 -- 172.21.15.12:0/384762018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb548074f40 msgr2=0x7fb5481a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:16.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb547fff640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb548074f40 0x7fb5481a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.383+0000 7fb547fff640 1 -- 172.21.15.12:0/384762018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54819ad30 con 0x7fb548074620 2024-09-16T00:59:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.384+0000 7fb547fff640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb548074620 0x7fb5481a0440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb53800b4a0 tx=0x7fb53800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.384+0000 7fb545ffb640 1 -- 172.21.15.12:0/384762018 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb538014070 con 0x7fb548074620 2024-09-16T00:59:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.384+0000 7fb545ffb640 1 -- 172.21.15.12:0/384762018 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb538010af0 con 0x7fb548074620 2024-09-16T00:59:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.384+0000 7fb54e7e5640 1 -- 172.21.15.12:0/384762018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54819b020 con 0x7fb548074620 2024-09-16T00:59:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.384+0000 7fb545ffb640 1 -- 172.21.15.12:0/384762018 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb538017d10 con 0x7fb548074620 2024-09-16T00:59:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.384+0000 7fb54e7e5640 1 -- 172.21.15.12:0/384762018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5481a7310 con 0x7fb548074620 2024-09-16T00:59:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.385+0000 7fb54e7e5640 1 -- 172.21.15.12:0/384762018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb548074a80 con 0x7fb548074620 2024-09-16T00:59:16.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.386+0000 7fb545ffb640 1 -- 172.21.15.12:0/384762018 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb538017070 con 0x7fb548074620 2024-09-16T00:59:16.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.387+0000 7fb545ffb640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb5340a3240 0x7fb5340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:16.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.387+0000 7fb53ffff640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb5340a3240 0x7fb5340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:16.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.388+0000 7fb545ffb640 1 -- 172.21.15.12:0/384762018 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fb5380cf3c0 con 0x7fb548074620 2024-09-16T00:59:16.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.388+0000 7fb53ffff640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb5340a3240 0x7fb5340a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb5300096c0 tx=0x7fb530000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:16.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.391+0000 7fb545ffb640 1 -- 172.21.15.12:0/384762018 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb53809be40 con 0x7fb548074620 2024-09-16T00:59:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.605+0000 7fb54e7e5640 1 -- 172.21.15.12:0/384762018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb54802d7c0 con 0x7fb548074620 2024-09-16T00:59:16.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.724+0000 7fb545ffb640 1 -- 172.21.15.12:0/384762018 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fb53809b740 con 0x7fb548074620 2024-09-16T00:59:16.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.726+0000 7fb54e7e5640 1 -- 172.21.15.12:0/384762018 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb5340a3240 msgr2=0x7fb5340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:16.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.726+0000 7fb54e7e5640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb5340a3240 0x7fb5340a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb5300096c0 tx=0x7fb530000bc0 comp rx=0 tx=0).stop 2024-09-16T00:59:16.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.726+0000 7fb54e7e5640 1 -- 172.21.15.12:0/384762018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb548074620 msgr2=0x7fb5481a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:16.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.726+0000 7fb54e7e5640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb548074620 0x7fb5481a0440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb53800b4a0 tx=0x7fb53800b960 comp rx=0 tx=0).stop 2024-09-16T00:59:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.727+0000 7fb54e7e5640 1 -- 172.21.15.12:0/384762018 shutdown_connections 2024-09-16T00:59:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.727+0000 7fb54e7e5640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb5340a3240 0x7fb5340a5700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.727+0000 7fb54e7e5640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb54810e3d0 0x7fb54819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.727+0000 7fb54e7e5640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb548074f40 0x7fb5481a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.727+0000 7fb54e7e5640 1 --2- 172.21.15.12:0/384762018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb548074620 0x7fb5481a0440 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.727+0000 7fb54e7e5640 1 -- 172.21.15.12:0/384762018 >> 172.21.15.12:0/384762018 conn(0x7fb5480fd8f0 msgr2=0x7fb5480ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.727+0000 7fb54e7e5640 1 -- 172.21.15.12:0/384762018 shutdown_connections 2024-09-16T00:59:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:16.727+0000 7fb54e7e5640 1 -- 172.21.15.12:0/384762018 wait complete. 2024-09-16T00:59:17.094 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:16 smithi012 ceph-mon[31197]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-16T00:59:17.094 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:16 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/384762018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-16T00:59:17.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:16 smithi119 ceph-mon[35049]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-16T00:59:17.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:16 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/384762018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-16T00:59:17.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:16 smithi098 ceph-mon[35346]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-16T00:59:17.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:16 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/384762018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-16T00:59:17.549 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-16T00:59:17.549 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-16T00:59:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:17.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:17 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/384762018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-16T00:59:17.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:17 smithi012 ceph-mon[31197]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:59:18.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:17 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/384762018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-16T00:59:18.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:17 smithi119 ceph-mon[35049]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:59:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:17 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/384762018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-16T00:59:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:17 smithi098 ceph-mon[35346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:59:18.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.295+0000 7fd26ec80640 1 -- 172.21.15.12:0/1895294375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd268101de0 msgr2=0x7fd2681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:18.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.295+0000 7fd26ec80640 1 --2- 172.21.15.12:0/1895294375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd268101de0 0x7fd2681021c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009900 tx=0x7fd25c02a410 comp rx=0 tx=0).stop 2024-09-16T00:59:18.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.295+0000 7fd26ec80640 1 -- 172.21.15.12:0/1895294375 shutdown_connections 2024-09-16T00:59:18.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.295+0000 7fd26ec80640 1 --2- 172.21.15.12:0/1895294375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd268106f10 0x7fd26810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:18.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.295+0000 7fd26ec80640 1 --2- 172.21.15.12:0/1895294375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd268102790 0x7fd2681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:18.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.295+0000 7fd26ec80640 1 --2- 172.21.15.12:0/1895294375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd268101de0 0x7fd2681021c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:18.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.295+0000 7fd26ec80640 1 -- 172.21.15.12:0/1895294375 >> 172.21.15.12:0/1895294375 conn(0x7fd2680fd8c0 msgr2=0x7fd2680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:18.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.295+0000 7fd26ec80640 1 -- 172.21.15.12:0/1895294375 shutdown_connections 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.295+0000 7fd26ec80640 1 -- 172.21.15.12:0/1895294375 wait complete. 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd26ec80640 1 Processor -- start 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd26ec80640 1 -- start start 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd26ec80640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd268101de0 0x7fd2680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd26ec80640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd268102790 0x7fd268074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd26ec80640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd268106f10 0x7fd268074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd26ec80640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd268111f70 con 0x7fd268102790 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd26ec80640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd268111df0 con 0x7fd268106f10 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd26ec80640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd2681120f0 con 0x7fd268101de0 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd267fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd268102790 0x7fd268074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd267fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd268102790 0x7fd268074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52072/0 (socket says 172.21.15.12:52072) 2024-09-16T00:59:18.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd267fff640 1 -- 172.21.15.12:0/784043039 learned_addr learned my addr 172.21.15.12:0/784043039 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.296+0000 7fd26d21d640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd268106f10 0x7fd268074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd26ca1c640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd268101de0 0x7fd2680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd267fff640 1 -- 172.21.15.12:0/784043039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd268101de0 msgr2=0x7fd2680744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd267fff640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd268101de0 0x7fd2680744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd267fff640 1 -- 172.21.15.12:0/784043039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd268106f10 msgr2=0x7fd268074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd267fff640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd268106f10 0x7fd268074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd267fff640 1 -- 172.21.15.12:0/784043039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2681a6890 con 0x7fd268102790 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd26d21d640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd268106f10 0x7fd268074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd267fff640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd268102790 0x7fd268074a30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd25400c890 tx=0x7fd25400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd265ffb640 1 -- 172.21.15.12:0/784043039 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254004220 con 0x7fd268102790 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd265ffb640 1 -- 172.21.15.12:0/784043039 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2540043c0 con 0x7fd268102790 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd265ffb640 1 -- 172.21.15.12:0/784043039 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2540049e0 con 0x7fd268102790 2024-09-16T00:59:18.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd26ec80640 1 -- 172.21.15.12:0/784043039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2681a6b80 con 0x7fd268102790 2024-09-16T00:59:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.297+0000 7fd26ec80640 1 -- 172.21.15.12:0/784043039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2681a70c0 con 0x7fd268102790 2024-09-16T00:59:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.298+0000 7fd26ec80640 1 -- 172.21.15.12:0/784043039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2681021c0 con 0x7fd268102790 2024-09-16T00:59:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.299+0000 7fd265ffb640 1 -- 172.21.15.12:0/784043039 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd2540079b0 con 0x7fd268102790 2024-09-16T00:59:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.300+0000 7fd265ffb640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2580a3240 0x7fd2580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.300+0000 7fd265ffb640 1 -- 172.21.15.12:0/784043039 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fd2540cfc60 con 0x7fd268102790 2024-09-16T00:59:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.300+0000 7fd26ca1c640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2580a3240 0x7fd2580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.300+0000 7fd26ca1c640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2580a3240 0x7fd2580a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0096c0 tx=0x7fd25c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:18.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.304+0000 7fd265ffb640 1 -- 172.21.15.12:0/784043039 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd254014030 con 0x7fd268102790 2024-09-16T00:59:18.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.517+0000 7fd26ec80640 1 -- 172.21.15.12:0/784043039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fd26802d7c0 con 0x7fd268102790 2024-09-16T00:59:18.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.735+0000 7fd265ffb640 1 -- 172.21.15.12:0/784043039 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fd25409c740 con 0x7fd268102790 2024-09-16T00:59:18.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 -- 172.21.15.12:0/784043039 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2580a3240 msgr2=0x7fd2580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2580a3240 0x7fd2580a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0096c0 tx=0x7fd25c000bc0 comp rx=0 tx=0).stop 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 -- 172.21.15.12:0/784043039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd268102790 msgr2=0x7fd268074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd268102790 0x7fd268074a30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd25400c890 tx=0x7fd25400cd50 comp rx=0 tx=0).stop 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 -- 172.21.15.12:0/784043039 shutdown_connections 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2580a3240 0x7fd2580a5700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd268106f10 0x7fd268074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd268102790 0x7fd268074a30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 --2- 172.21.15.12:0/784043039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd268101de0 0x7fd2680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 -- 172.21.15.12:0/784043039 >> 172.21.15.12:0/784043039 conn(0x7fd2680fd8c0 msgr2=0x7fd2680febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 -- 172.21.15.12:0/784043039 shutdown_connections 2024-09-16T00:59:18.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:18.738+0000 7fd26ec80640 1 -- 172.21.15.12:0/784043039 wait complete. 2024-09-16T00:59:18.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:18 smithi012 ceph-mon[31197]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-16T00:59:18.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:18 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/784043039' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-16T00:59:19.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:18 smithi119 ceph-mon[35049]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-16T00:59:19.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:18 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/784043039' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-16T00:59:19.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:18 smithi098 ceph-mon[35346]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-16T00:59:19.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:18 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/784043039' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-16T00:59:19.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-16T00:59:19.723 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:20.001 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:19 smithi012 ceph-mon[31197]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T00:59:20.001 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:19 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/784043039' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-16T00:59:20.001 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:19 smithi012 ceph-mon[31197]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-16T00:59:20.001 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:19 smithi012 ceph-mon[31197]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:59:20.001 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:19 smithi012 ceph-mon[31197]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-16T00:59:20.001 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:19 smithi012 ceph-mon[31197]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-16T00:59:20.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:19 smithi119 ceph-mon[35049]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T00:59:20.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:19 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/784043039' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-16T00:59:20.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:19 smithi119 ceph-mon[35049]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-16T00:59:20.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:19 smithi119 ceph-mon[35049]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:59:20.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:19 smithi119 ceph-mon[35049]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-16T00:59:20.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:19 smithi119 ceph-mon[35049]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-16T00:59:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:19 smithi098 ceph-mon[35346]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T00:59:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:19 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/784043039' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-16T00:59:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:19 smithi098 ceph-mon[35346]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-16T00:59:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:19 smithi098 ceph-mon[35346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T00:59:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:19 smithi098 ceph-mon[35346]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-16T00:59:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:19 smithi098 ceph-mon[35346]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-16T00:59:20.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.212+0000 7f2beebc5640 1 -- 172.21.15.12:0/2878798117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2be8102790 msgr2=0x7f2be81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:20.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.212+0000 7f2beebc5640 1 --2- 172.21.15.12:0/2878798117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2be8102790 0x7f2be81067e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009900 tx=0x7f2bd802a410 comp rx=0 tx=0).stop 2024-09-16T00:59:20.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.212+0000 7f2beebc5640 1 -- 172.21.15.12:0/2878798117 shutdown_connections 2024-09-16T00:59:20.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.212+0000 7f2beebc5640 1 --2- 172.21.15.12:0/2878798117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2be8106f10 0x7f2be810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:20.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.212+0000 7f2beebc5640 1 --2- 172.21.15.12:0/2878798117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2be8102790 0x7f2be81067e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.212+0000 7f2beebc5640 1 --2- 172.21.15.12:0/2878798117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be8101de0 0x7f2be81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.212+0000 7f2beebc5640 1 -- 172.21.15.12:0/2878798117 >> 172.21.15.12:0/2878798117 conn(0x7f2be80fd8c0 msgr2=0x7f2be80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.212+0000 7f2beebc5640 1 -- 172.21.15.12:0/2878798117 shutdown_connections 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.212+0000 7f2beebc5640 1 -- 172.21.15.12:0/2878798117 wait complete. 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2beebc5640 1 Processor -- start 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2beebc5640 1 -- start start 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2beebc5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2be8101de0 0x7f2be81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2beebc5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be8102790 0x7f2be81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2beebc5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2be8106f10 0x7f2be819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2beebc5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2be8111f70 con 0x7f2be8101de0 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2beebc5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2be8111df0 con 0x7f2be8106f10 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2beebc5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2be81120f0 con 0x7f2be8102790 2024-09-16T00:59:20.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bec961640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2be8101de0 0x7f2be81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bec961640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2be8101de0 0x7f2be81983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52094/0 (socket says 172.21.15.12:52094) 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bec961640 1 -- 172.21.15.12:0/2569696186 learned_addr learned my addr 172.21.15.12:0/2569696186 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bed162640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2be8106f10 0x7f2be819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bdffff640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be8102790 0x7f2be81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bec961640 1 -- 172.21.15.12:0/2569696186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be8102790 msgr2=0x7f2be81988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bec961640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be8102790 0x7f2be81988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bec961640 1 -- 172.21.15.12:0/2569696186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2be8106f10 msgr2=0x7f2be819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bec961640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2be8106f10 0x7f2be819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bec961640 1 -- 172.21.15.12:0/2569696186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be819d360 con 0x7f2be8101de0 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bed162640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2be8106f10 0x7f2be819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.213+0000 7f2bdffff640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be8102790 0x7f2be81988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.214+0000 7f2bec961640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2be8101de0 0x7f2be81983b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2be400d950 tx=0x7f2be400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:20.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.214+0000 7f2bddffb640 1 -- 172.21.15.12:0/2569696186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4017070 con 0x7f2be8101de0 2024-09-16T00:59:20.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.214+0000 7f2bddffb640 1 -- 172.21.15.12:0/2569696186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2be4009c30 con 0x7f2be8101de0 2024-09-16T00:59:20.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.214+0000 7f2beebc5640 1 -- 172.21.15.12:0/2569696186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be819d650 con 0x7f2be8101de0 2024-09-16T00:59:20.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.214+0000 7f2bddffb640 1 -- 172.21.15.12:0/2569696186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be400f6b0 con 0x7f2be8101de0 2024-09-16T00:59:20.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.214+0000 7f2beebc5640 1 -- 172.21.15.12:0/2569696186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be81a4f30 con 0x7f2be8101de0 2024-09-16T00:59:20.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.215+0000 7f2beebc5640 1 -- 172.21.15.12:0/2569696186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be81021c0 con 0x7f2be8101de0 2024-09-16T00:59:20.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.216+0000 7f2bddffb640 1 -- 172.21.15.12:0/2569696186 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2be40109d0 con 0x7f2be8101de0 2024-09-16T00:59:20.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.217+0000 7f2bddffb640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2bd00a32c0 0x7f2bd00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:20.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.217+0000 7f2bddffb640 1 -- 172.21.15.12:0/2569696186 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f2be40cf7d0 con 0x7f2be8101de0 2024-09-16T00:59:20.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.217+0000 7f2bdffff640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2bd00a32c0 0x7f2bd00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:20.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.218+0000 7f2bdffff640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2bd00a32c0 0x7f2bd00a5780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8000c00 tx=0x7f2bd8032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:20.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.220+0000 7f2bddffb640 1 -- 172.21.15.12:0/2569696186 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2be4009de0 con 0x7f2be8101de0 2024-09-16T00:59:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.432+0000 7f2beebc5640 1 -- 172.21.15.12:0/2569696186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f2be810a1b0 con 0x7f2be8101de0 2024-09-16T00:59:20.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.755+0000 7f2bddffb640 1 -- 172.21.15.12:0/2569696186 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f2be409c330 con 0x7f2be8101de0 2024-09-16T00:59:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 -- 172.21.15.12:0/2569696186 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2bd00a32c0 msgr2=0x7f2bd00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2bd00a32c0 0x7f2bd00a5780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8000c00 tx=0x7f2bd8032c70 comp rx=0 tx=0).stop 2024-09-16T00:59:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 -- 172.21.15.12:0/2569696186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2be8101de0 msgr2=0x7f2be81983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2be8101de0 0x7f2be81983b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2be400d950 tx=0x7f2be400de10 comp rx=0 tx=0).stop 2024-09-16T00:59:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 -- 172.21.15.12:0/2569696186 shutdown_connections 2024-09-16T00:59:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2bd00a32c0 0x7f2bd00a5780 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2be8106f10 0x7f2be819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be8102790 0x7f2be81988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 --2- 172.21.15.12:0/2569696186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2be8101de0 0x7f2be81983b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:20.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 -- 172.21.15.12:0/2569696186 >> 172.21.15.12:0/2569696186 conn(0x7f2be80fd8c0 msgr2=0x7f2be80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:20.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 -- 172.21.15.12:0/2569696186 shutdown_connections 2024-09-16T00:59:20.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:20.757+0000 7f2beebc5640 1 -- 172.21.15.12:0/2569696186 wait complete. 2024-09-16T00:59:21.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:20 smithi012 ceph-mon[31197]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-16T00:59:21.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:20 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] up:active 2024-09-16T00:59:21.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:20 smithi012 ceph-mon[31197]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-16T00:59:21.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:20 smithi012 ceph-mon[31197]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-16T00:59:21.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:20 smithi012 ceph-mon[31197]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-16T00:59:21.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:20 smithi012 ceph-mon[31197]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-16T00:59:21.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:20 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2569696186' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T00:59:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:20 smithi119 ceph-mon[35049]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-16T00:59:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:20 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] up:active 2024-09-16T00:59:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:20 smithi119 ceph-mon[35049]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-16T00:59:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:20 smithi119 ceph-mon[35049]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-16T00:59:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:20 smithi119 ceph-mon[35049]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-16T00:59:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:20 smithi119 ceph-mon[35049]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-16T00:59:21.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:20 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2569696186' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T00:59:21.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:20 smithi098 ceph-mon[35346]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-16T00:59:21.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:20 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] up:active 2024-09-16T00:59:21.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:20 smithi098 ceph-mon[35346]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-16T00:59:21.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:20 smithi098 ceph-mon[35346]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-16T00:59:21.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:20 smithi098 ceph-mon[35346]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-16T00:59:21.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:20 smithi098 ceph-mon[35346]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-16T00:59:21.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:20 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2569696186' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T00:59:21.450 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-16T00:59:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:22.014 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2569696186' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T00:59:22.014 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] up:active 2024-09-16T00:59:22.014 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-16T00:59:22.014 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-16T00:59:22.014 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-16T00:59:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-16T00:59:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] up:active 2024-09-16T00:59:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-16T00:59:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T00:59:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: Cluster is now healthy 2024-09-16T00:59:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-09-16T00:59:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-16T00:59:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:21 smithi012 ceph-mon[31197]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-16T00:59:22.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2569696186' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T00:59:22.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] up:active 2024-09-16T00:59:22.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-16T00:59:22.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-16T00:59:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-16T00:59:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-16T00:59:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] up:active 2024-09-16T00:59:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-16T00:59:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T00:59:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: Cluster is now healthy 2024-09-16T00:59:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-09-16T00:59:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-16T00:59:22.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:21 smithi119 ceph-mon[35049]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-16T00:59:22.212 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b[65547]: 2024-09-16T00:59:21.834+0000 7f1c08d6e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-16T00:59:22.212 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b[65547]: 2024-09-16T00:59:21.834+0000 7f1c08d6e640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-16T00:59:22.212 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b[65547]: 2024-09-16T00:59:21.834+0000 7f1c08d6e640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2569696186' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] up:active 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] up:active 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: Cluster is now healthy 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-16T00:59:22.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:21 smithi098 ceph-mon[35346]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-16T00:59:22.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.204+0000 7f6ca8874640 1 -- 172.21.15.12:0/578304662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca4100a80 msgr2=0x7f6ca4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:22.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.204+0000 7f6ca8874640 1 --2- 172.21.15.12:0/578304662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca4100a80 0x7f6ca4100ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009930 tx=0x7f6c8c02a420 comp rx=0 tx=0).stop 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.204+0000 7f6ca8874640 1 -- 172.21.15.12:0/578304662 shutdown_connections 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.204+0000 7f6ca8874640 1 --2- 172.21.15.12:0/578304662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca4101420 0x7f6ca410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.204+0000 7f6ca8874640 1 --2- 172.21.15.12:0/578304662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca4100a80 0x7f6ca4100ee0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.204+0000 7f6ca8874640 1 --2- 172.21.15.12:0/578304662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca4106a80 0x7f6ca4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.204+0000 7f6ca8874640 1 -- 172.21.15.12:0/578304662 >> 172.21.15.12:0/578304662 conn(0x7f6ca40fc7a0 msgr2=0x7f6ca40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.204+0000 7f6ca8874640 1 -- 172.21.15.12:0/578304662 shutdown_connections 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.204+0000 7f6ca8874640 1 -- 172.21.15.12:0/578304662 wait complete. 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca8874640 1 Processor -- start 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca8874640 1 -- start start 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca8874640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca4100a80 0x7f6ca4199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca8874640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca4101420 0x7f6ca4199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca8874640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca4106a80 0x7f6ca41a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:22.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca8874640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca4110f20 con 0x7f6ca4101420 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca8874640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca4110da0 con 0x7f6ca4106a80 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca8874640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca41110a0 con 0x7f6ca4100a80 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6c9bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca4101420 0x7f6ca4199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6c9bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca4101420 0x7f6ca4199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52116/0 (socket says 172.21.15.12:52116) 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6c9bfff640 1 -- 172.21.15.12:0/3654575794 learned_addr learned my addr 172.21.15.12:0/3654575794 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca2d9d640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca4106a80 0x7f6ca41a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca259c640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca4100a80 0x7f6ca4199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6c9bfff640 1 -- 172.21.15.12:0/3654575794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca4100a80 msgr2=0x7f6ca4199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6c9bfff640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca4100a80 0x7f6ca4199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6c9bfff640 1 -- 172.21.15.12:0/3654575794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca4106a80 msgr2=0x7f6ca41a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6c9bfff640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca4106a80 0x7f6ca41a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6c9bfff640 1 -- 172.21.15.12:0/3654575794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca41a4a10 con 0x7f6ca4101420 2024-09-16T00:59:22.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.205+0000 7f6ca2d9d640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca4106a80 0x7f6ca41a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.206+0000 7f6c9bfff640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca4101420 0x7f6ca4199990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009a50 tx=0x7f6c8c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.206+0000 7f6c9b7fe640 1 -- 172.21.15.12:0/3654575794 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c03f030 con 0x7f6ca4101420 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.206+0000 7f6c9b7fe640 1 -- 172.21.15.12:0/3654575794 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c8c003ce0 con 0x7f6ca4101420 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.206+0000 7f6ca8874640 1 -- 172.21.15.12:0/3654575794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca41a4be0 con 0x7f6ca4101420 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.206+0000 7f6c9b7fe640 1 -- 172.21.15.12:0/3654575794 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c035070 con 0x7f6ca4101420 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.206+0000 7f6ca8874640 1 -- 172.21.15.12:0/3654575794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca41a5090 con 0x7f6ca4101420 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.207+0000 7f6ca8874640 1 -- 172.21.15.12:0/3654575794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca4100f60 con 0x7f6ca4101420 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.208+0000 7f6c9b7fe640 1 -- 172.21.15.12:0/3654575794 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6c8c042030 con 0x7f6ca4101420 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.209+0000 7f6c9b7fe640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c900a32c0 0x7f6c900a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.209+0000 7f6ca259c640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c900a32c0 0x7f6c900a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.209+0000 7f6c9b7fe640 1 -- 172.21.15.12:0/3654575794 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f6c8c0f0160 con 0x7f6ca4101420 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.210+0000 7f6ca259c640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c900a32c0 0x7f6c900a5780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009890 tx=0x7f6c94008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:22.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.213+0000 7f6c9b7fe640 1 -- 172.21.15.12:0/3654575794 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c8c0bcc40 con 0x7f6ca4101420 2024-09-16T00:59:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.427+0000 7f6ca8874640 1 -- 172.21.15.12:0/3654575794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f6ca402d7c0 con 0x7f6ca4101420 2024-09-16T00:59:22.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.577+0000 7f6c9b7fe640 1 -- 172.21.15.12:0/3654575794 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v27) ==== 115+0+0 (secure 0 0 0) 0x7f6c8c0bc540 con 0x7f6ca4101420 2024-09-16T00:59:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 -- 172.21.15.12:0/3654575794 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c900a32c0 msgr2=0x7f6c900a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c900a32c0 0x7f6c900a5780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009890 tx=0x7f6c94008040 comp rx=0 tx=0).stop 2024-09-16T00:59:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 -- 172.21.15.12:0/3654575794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca4101420 msgr2=0x7f6ca4199990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca4101420 0x7f6ca4199990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009a50 tx=0x7f6c8c004270 comp rx=0 tx=0).stop 2024-09-16T00:59:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 -- 172.21.15.12:0/3654575794 shutdown_connections 2024-09-16T00:59:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c900a32c0 0x7f6c900a5780 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ca4106a80 0x7f6ca41a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca4101420 0x7f6ca4199990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 --2- 172.21.15.12:0/3654575794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ca4100a80 0x7f6ca4199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 -- 172.21.15.12:0/3654575794 >> 172.21.15.12:0/3654575794 conn(0x7f6ca40fc7a0 msgr2=0x7f6ca40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 -- 172.21.15.12:0/3654575794 shutdown_connections 2024-09-16T00:59:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:22.580+0000 7f6ca8874640 1 -- 172.21.15.12:0/3654575794 wait complete. 2024-09-16T00:59:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:22 smithi119 ceph-mon[35049]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 1 op/s 2024-09-16T00:59:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:22 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3654575794' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-16T00:59:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:22 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3654575794' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-16T00:59:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:22 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] up:active 2024-09-16T00:59:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:22 smithi119 ceph-mon[35049]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-16T00:59:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:22 smithi119 ceph-mon[35049]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T00:59:23.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:22 smithi012 ceph-mon[31197]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 1 op/s 2024-09-16T00:59:23.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:22 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3654575794' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-16T00:59:23.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:22 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3654575794' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-16T00:59:23.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:22 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] up:active 2024-09-16T00:59:23.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:22 smithi012 ceph-mon[31197]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-16T00:59:23.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:22 smithi012 ceph-mon[31197]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T00:59:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:22 smithi098 ceph-mon[35346]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 1 op/s 2024-09-16T00:59:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:22 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3654575794' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-16T00:59:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:22 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3654575794' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-16T00:59:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:22 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] up:active 2024-09-16T00:59:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:22 smithi098 ceph-mon[35346]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-16T00:59:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:22 smithi098 ceph-mon[35346]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T00:59:23.307 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-16T00:59:23.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-16T00:59:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:24.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.015+0000 7f7daf864640 1 -- 172.21.15.12:0/1116200464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7da81036e0 msgr2=0x7f7da8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.015+0000 7f7daf864640 1 --2- 172.21.15.12:0/1116200464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7da81036e0 0x7f7da8107b90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009930 tx=0x7f7d9802a420 comp rx=0 tx=0).stop 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.015+0000 7f7daf864640 1 -- 172.21.15.12:0/1116200464 shutdown_connections 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.015+0000 7f7daf864640 1 --2- 172.21.15.12:0/1116200464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7da81082a0 0x7f7da810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.015+0000 7f7daf864640 1 --2- 172.21.15.12:0/1116200464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7da81036e0 0x7f7da8107b90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.015+0000 7f7daf864640 1 --2- 172.21.15.12:0/1116200464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da8102d30 0x7f7da8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.015+0000 7f7daf864640 1 -- 172.21.15.12:0/1116200464 >> 172.21.15.12:0/1116200464 conn(0x7f7da80fc7d0 msgr2=0x7f7da80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.016+0000 7f7daf864640 1 -- 172.21.15.12:0/1116200464 shutdown_connections 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.016+0000 7f7daf864640 1 -- 172.21.15.12:0/1116200464 wait complete. 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.016+0000 7f7daf864640 1 Processor -- start 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.016+0000 7f7daf864640 1 -- start start 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7daf864640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da8102d30 0x7f7da8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:24.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7daf864640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7da81036e0 0x7f7da8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7daf864640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7da81082a0 0x7f7da8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7daf864640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7da81120a0 con 0x7f7da81082a0 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7daf864640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7da8111f20 con 0x7f7da8102d30 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7daf864640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7da8112220 con 0x7f7da81036e0 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dade01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7da81082a0 0x7f7da8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dade01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7da81082a0 0x7f7da8101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52136/0 (socket says 172.21.15.12:52136) 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dade01640 1 -- 172.21.15.12:0/1506102562 learned_addr learned my addr 172.21.15.12:0/1506102562 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dad600640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da8102d30 0x7f7da8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dacdff640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7da81036e0 0x7f7da8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dade01640 1 -- 172.21.15.12:0/1506102562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7da81036e0 msgr2=0x7f7da8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dade01640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7da81036e0 0x7f7da8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dade01640 1 -- 172.21.15.12:0/1506102562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da8102d30 msgr2=0x7f7da8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:24.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dade01640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da8102d30 0x7f7da8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dade01640 1 -- 172.21.15.12:0/1506102562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da81a6a70 con 0x7f7da81082a0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7dade01640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7da81082a0 0x7f7da8101410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7da000d750 tx=0x7f7da000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7d9e7fc640 1 -- 172.21.15.12:0/1506102562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0017070 con 0x7f7da81082a0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7d9e7fc640 1 -- 172.21.15.12:0/1506102562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da0005500 con 0x7f7da81082a0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7daf864640 1 -- 172.21.15.12:0/1506102562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da81a6d60 con 0x7f7da81082a0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7d9e7fc640 1 -- 172.21.15.12:0/1506102562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0004d90 con 0x7f7da81082a0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.017+0000 7f7daf864640 1 -- 172.21.15.12:0/1506102562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da81a7270 con 0x7f7da81082a0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.018+0000 7f7daf864640 1 -- 172.21.15.12:0/1506102562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da8103110 con 0x7f7da81082a0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.020+0000 7f7d9e7fc640 1 -- 172.21.15.12:0/1506102562 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7da0004f30 con 0x7f7da81082a0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.020+0000 7f7d9e7fc640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d940a3240 0x7f7d940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.021+0000 7f7d9e7fc640 1 -- 172.21.15.12:0/1506102562 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f7da00cf3a0 con 0x7f7da81082a0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.021+0000 7f7dad600640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d940a3240 0x7f7d940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:24.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.021+0000 7f7dad600640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d940a3240 0x7f7d940a5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7da4005fd0 tx=0x7f7da4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:24.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.025+0000 7f7d9e7fc640 1 -- 172.21.15.12:0/1506102562 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7da009b830 con 0x7f7da81082a0 2024-09-16T00:59:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.223+0000 7f7daf864640 1 -- 172.21.15.12:0/1506102562 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7da8062630 con 0x7f7d940a3240 2024-09-16T00:59:24.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.250+0000 7f7d9e7fc640 1 -- 172.21.15.12:0/1506102562 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7da8062630 con 0x7f7d940a3240 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 -- 172.21.15.12:0/1506102562 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d940a3240 msgr2=0x7f7d940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d940a3240 0x7f7d940a5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7da4005fd0 tx=0x7f7da4009500 comp rx=0 tx=0).stop 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 -- 172.21.15.12:0/1506102562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7da81082a0 msgr2=0x7f7da8101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7da81082a0 0x7f7da8101410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7da000d750 tx=0x7f7da000dc10 comp rx=0 tx=0).stop 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 -- 172.21.15.12:0/1506102562 shutdown_connections 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7d940a3240 0x7f7d940a5700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7da81082a0 0x7f7da8101410 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7da81036e0 0x7f7da8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 --2- 172.21.15.12:0/1506102562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da8102d30 0x7f7da8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 -- 172.21.15.12:0/1506102562 >> 172.21.15.12:0/1506102562 conn(0x7f7da80fc7d0 msgr2=0x7f7da8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 -- 172.21.15.12:0/1506102562 shutdown_connections 2024-09-16T00:59:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:24.252+0000 7f7daf864640 1 -- 172.21.15.12:0/1506102562 wait complete. 2024-09-16T00:59:24.356 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:59:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:59:24.228+0000 7f4c7ed57640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T00:59:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:59:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:59:24.228+0000 7f4c7ed57640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T00:59:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:59:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:59:24.228+0000 7f4c7ed57640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T00:59:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:59:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:59:24.228+0000 7f4c7ed57640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T00:59:24.357 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 00:59:24 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x[31424]: 2024-09-16T00:59:24.228+0000 7f4c7ed57640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T00:59:24.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:24 smithi012 ceph-mon[31197]: pgmap v305: 129 pgs: 129 active+clean; 586 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-16T00:59:24.984 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-16T00:59:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:24 smithi119 ceph-mon[35049]: pgmap v305: 129 pgs: 129 active+clean; 586 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-16T00:59:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:24 smithi098 ceph-mon[35346]: pgmap v305: 129 pgs: 129 active+clean; 586 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-16T00:59:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:25.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:25 smithi012 ceph-mon[31197]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:25.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.926+0000 7f6893917640 1 -- 172.21.15.12:0/3065162744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c106f10 msgr2=0x7f688c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:25.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.926+0000 7f6893917640 1 --2- 172.21.15.12:0/3065162744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c106f10 0x7f688c10ea90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6884009ca0 tx=0x7f688402a8c0 comp rx=0 tx=0).stop 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.926+0000 7f6893917640 1 -- 172.21.15.12:0/3065162744 shutdown_connections 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.926+0000 7f6893917640 1 --2- 172.21.15.12:0/3065162744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c106f10 0x7f688c10ea90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.926+0000 7f6893917640 1 --2- 172.21.15.12:0/3065162744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f688c102790 0x7f688c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.926+0000 7f6893917640 1 --2- 172.21.15.12:0/3065162744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f688c101de0 0x7f688c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.926+0000 7f6893917640 1 -- 172.21.15.12:0/3065162744 >> 172.21.15.12:0/3065162744 conn(0x7f688c0fd8c0 msgr2=0x7f688c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.927+0000 7f6893917640 1 -- 172.21.15.12:0/3065162744 shutdown_connections 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.927+0000 7f6893917640 1 -- 172.21.15.12:0/3065162744 wait complete. 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.927+0000 7f6893917640 1 Processor -- start 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.927+0000 7f6893917640 1 -- start start 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.927+0000 7f6893917640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f688c101de0 0x7f688c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.927+0000 7f6893917640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c102790 0x7f688c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.927+0000 7f6893917640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f688c106f10 0x7f688c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.927+0000 7f6893917640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f688c111f70 con 0x7f688c102790 2024-09-16T00:59:25.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.927+0000 7f6893917640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f688c111df0 con 0x7f688c106f10 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.927+0000 7f6893917640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f688c1120f0 con 0x7f688c101de0 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6890eb2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c102790 0x7f688c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6890eb2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c102790 0x7f688c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52160/0 (socket says 172.21.15.12:52160) 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6890eb2640 1 -- 172.21.15.12:0/1440203464 learned_addr learned my addr 172.21.15.12:0/1440203464 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6891eb4640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f688c106f10 0x7f688c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f68916b3640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f688c101de0 0x7f688c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6890eb2640 1 -- 172.21.15.12:0/1440203464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f688c101de0 msgr2=0x7f688c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6890eb2640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f688c101de0 0x7f688c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6890eb2640 1 -- 172.21.15.12:0/1440203464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f688c106f10 msgr2=0x7f688c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6890eb2640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f688c106f10 0x7f688c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6890eb2640 1 -- 172.21.15.12:0/1440203464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688c1a6800 con 0x7f688c102790 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6890eb2640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c102790 0x7f688c074a30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c920 tx=0x7f687c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:25.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f68827fc640 1 -- 172.21.15.12:0/1440203464 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c007c70 con 0x7f688c102790 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6893917640 1 -- 172.21.15.12:0/1440203464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688c1a6af0 con 0x7f688c102790 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f68827fc640 1 -- 172.21.15.12:0/1440203464 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f687c007e10 con 0x7f688c102790 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f68827fc640 1 -- 172.21.15.12:0/1440203464 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c018890 con 0x7f688c102790 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.928+0000 7f6893917640 1 -- 172.21.15.12:0/1440203464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688c1a7030 con 0x7f688c102790 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.929+0000 7f6893917640 1 -- 172.21.15.12:0/1440203464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688c1021c0 con 0x7f688c102790 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.931+0000 7f68827fc640 1 -- 172.21.15.12:0/1440203464 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f687c018a50 con 0x7f688c102790 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.931+0000 7f68827fc640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f68780a32d0 0x7f68780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.932+0000 7f68916b3640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f68780a32d0 0x7f68780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.932+0000 7f68827fc640 1 -- 172.21.15.12:0/1440203464 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f687c0cffe0 con 0x7f688c102790 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.932+0000 7f68916b3640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f68780a32d0 0x7f68780a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f688800bbe0 tx=0x7f688800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:25.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:25.935+0000 7f68827fc640 1 -- 172.21.15.12:0/1440203464 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f687c014030 con 0x7f688c102790 2024-09-16T00:59:26.031 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:25 smithi098 ceph-mon[35346]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:26.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:25 smithi119 ceph-mon[35049]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:26.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.135+0000 7f6893917640 1 -- 172.21.15.12:0/1440203464 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f688c062630 con 0x7f68780a32d0 2024-09-16T00:59:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.156+0000 7f68827fc640 1 -- 172.21.15.12:0/1440203464 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f688c062630 con 0x7f68780a32d0 2024-09-16T00:59:26.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 -- 172.21.15.12:0/1440203464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f68780a32d0 msgr2=0x7f68780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f68780a32d0 0x7f68780a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f688800bbe0 tx=0x7f688800b390 comp rx=0 tx=0).stop 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 -- 172.21.15.12:0/1440203464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c102790 msgr2=0x7f688c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c102790 0x7f688c074a30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c920 tx=0x7f687c00cde0 comp rx=0 tx=0).stop 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 -- 172.21.15.12:0/1440203464 shutdown_connections 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f68780a32d0 0x7f68780a5790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f688c106f10 0x7f688c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c102790 0x7f688c074a30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 --2- 172.21.15.12:0/1440203464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f688c101de0 0x7f688c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 -- 172.21.15.12:0/1440203464 >> 172.21.15.12:0/1440203464 conn(0x7f688c0fd8c0 msgr2=0x7f688c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 -- 172.21.15.12:0/1440203464 shutdown_connections 2024-09-16T00:59:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:26.158+0000 7f6893917640 1 -- 172.21.15.12:0/1440203464 wait complete. 2024-09-16T00:59:26.863 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:26 smithi012 ceph-mon[31197]: pgmap v306: 129 pgs: 129 active+clean; 593 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-16T00:59:26.863 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:26 smithi012 ceph-mon[31197]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-16T00:59:26.897 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-16T00:59:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:26 smithi119 ceph-mon[35049]: pgmap v306: 129 pgs: 129 active+clean; 593 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-16T00:59:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:26 smithi119 ceph-mon[35049]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-16T00:59:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:26 smithi098 ceph-mon[35346]: pgmap v306: 129 pgs: 129 active+clean; 593 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-16T00:59:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:26 smithi098 ceph-mon[35346]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-16T00:59:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.587+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/70547195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a38106f10 msgr2=0x7f2a3810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.587+0000 7f2a3eaa3640 1 --2- 172.21.15.12:0/70547195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a38106f10 0x7f2a3810ea90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009ca0 tx=0x7f2a3002a8c0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.587+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/70547195 shutdown_connections 2024-09-16T00:59:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.587+0000 7f2a3eaa3640 1 --2- 172.21.15.12:0/70547195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a38106f10 0x7f2a3810ea90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.587+0000 7f2a3eaa3640 1 --2- 172.21.15.12:0/70547195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a38102790 0x7f2a381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.587+0000 7f2a3eaa3640 1 --2- 172.21.15.12:0/70547195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a38101de0 0x7f2a381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.587+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/70547195 >> 172.21.15.12:0/70547195 conn(0x7f2a380fd8c0 msgr2=0x7f2a380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.587+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/70547195 shutdown_connections 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.587+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/70547195 wait complete. 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a3eaa3640 1 Processor -- start 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a3eaa3640 1 -- start start 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a3eaa3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a38101de0 0x7f2a3819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a3eaa3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a38102790 0x7f2a3819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a3eaa3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a38106f10 0x7f2a3819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a3eaa3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2a38111f70 con 0x7f2a38102790 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a3eaa3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a38111df0 con 0x7f2a38101de0 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a3eaa3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2a381120f0 con 0x7f2a38106f10 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a38102790 0x7f2a3819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:27.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a38102790 0x7f2a3819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49962/0 (socket says 172.21.15.12:49962) 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.588+0000 7f2a37fff640 1 -- 172.21.15.12:0/3069734092 learned_addr learned my addr 172.21.15.12:0/3069734092 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a3d040640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a38106f10 0x7f2a3819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a3c83f640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a38101de0 0x7f2a3819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a37fff640 1 -- 172.21.15.12:0/3069734092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a38106f10 msgr2=0x7f2a3819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a37fff640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a38106f10 0x7f2a3819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a37fff640 1 -- 172.21.15.12:0/3069734092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a38101de0 msgr2=0x7f2a3819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a37fff640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a38101de0 0x7f2a3819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a37fff640 1 -- 172.21.15.12:0/3069734092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3819f620 con 0x7f2a38102790 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a37fff640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a38102790 0x7f2a3819abb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400e9f0 tx=0x7f2a2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a35ffb640 1 -- 172.21.15.12:0/3069734092 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400cd80 con 0x7f2a38102790 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/3069734092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3819f910 con 0x7f2a38102790 2024-09-16T00:59:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a35ffb640 1 -- 172.21.15.12:0/3069734092 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a24010910 con 0x7f2a38102790 2024-09-16T00:59:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a35ffb640 1 -- 172.21.15.12:0/3069734092 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a240188f0 con 0x7f2a38102790 2024-09-16T00:59:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.589+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/3069734092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a381a71f0 con 0x7f2a38102790 2024-09-16T00:59:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.591+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/3069734092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a381021c0 con 0x7f2a38102790 2024-09-16T00:59:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.592+0000 7f2a35ffb640 1 -- 172.21.15.12:0/3069734092 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2a24010ac0 con 0x7f2a38102790 2024-09-16T00:59:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.592+0000 7f2a35ffb640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a280a32d0 0x7f2a280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.592+0000 7f2a3c83f640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a280a32d0 0x7f2a280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.592+0000 7f2a35ffb640 1 -- 172.21.15.12:0/3069734092 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f2a240d00d0 con 0x7f2a38102790 2024-09-16T00:59:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.593+0000 7f2a3c83f640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a280a32d0 0x7f2a280a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009b60 tx=0x7f2a2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.596+0000 7f2a35ffb640 1 -- 172.21.15.12:0/3069734092 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a2409ca50 con 0x7f2a38102790 2024-09-16T00:59:27.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.804+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/3069734092 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f2a3810de00 con 0x7f2a280a32d0 2024-09-16T00:59:27.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.810+0000 7f2a35ffb640 1 -- 172.21.15.12:0/3069734092 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2a3810de00 con 0x7f2a280a32d0 2024-09-16T00:59:27.811 INFO:teuthology.orchestra.run.smithi012.stdout:/volumes/qa/sv_0/040964a0-30be-4af0-a59f-b96ea535fee5 2024-09-16T00:59:27.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/3069734092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a280a32d0 msgr2=0x7f2a280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a280a32d0 0x7f2a280a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009b60 tx=0x7f2a2c005f90 comp rx=0 tx=0).stop 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/3069734092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a38102790 msgr2=0x7f2a3819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a38102790 0x7f2a3819abb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400e9f0 tx=0x7f2a2400eeb0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/3069734092 shutdown_connections 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a280a32d0 0x7f2a280a5790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a38106f10 0x7f2a3819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a38102790 0x7f2a3819abb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 --2- 172.21.15.12:0/3069734092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a38101de0 0x7f2a3819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/3069734092 >> 172.21.15.12:0/3069734092 conn(0x7f2a380fd8c0 msgr2=0x7f2a380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/3069734092 shutdown_connections 2024-09-16T00:59:27.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:27.813+0000 7f2a3eaa3640 1 -- 172.21.15.12:0/3069734092 wait complete. 2024-09-16T00:59:27.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:27 smithi012 ceph-mon[31197]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:28.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:27 smithi119 ceph-mon[35049]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:27 smithi098 ceph-mon[35346]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:28.473 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-16T00:59:28.734 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:28 smithi012 ceph-mon[31197]: pgmap v307: 129 pgs: 129 active+clean; 594 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.9 KiB/s wr, 18 op/s 2024-09-16T00:59:29.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:28 smithi012 ceph-mon[31197]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:28 smithi119 ceph-mon[35049]: pgmap v307: 129 pgs: 129 active+clean; 594 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.9 KiB/s wr, 18 op/s 2024-09-16T00:59:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:28 smithi119 ceph-mon[35049]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:28 smithi098 ceph-mon[35346]: pgmap v307: 129 pgs: 129 active+clean; 594 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.9 KiB/s wr, 18 op/s 2024-09-16T00:59:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:28 smithi098 ceph-mon[35346]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.218+0000 7fa47b708640 1 -- 172.21.15.12:0/124639233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa474100b30 msgr2=0x7fa474100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.218+0000 7fa47b708640 1 --2- 172.21.15.12:0/124639233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa474100b30 0x7fa474100f10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa470009900 tx=0x7fa47002a470 comp rx=0 tx=0).stop 2024-09-16T00:59:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.218+0000 7fa47b708640 1 -- 172.21.15.12:0/124639233 shutdown_connections 2024-09-16T00:59:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.218+0000 7fa47b708640 1 --2- 172.21.15.12:0/124639233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa474105f40 0x7fa4741063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.218+0000 7fa47b708640 1 --2- 172.21.15.12:0/124639233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474101450 0x7fa474105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.218+0000 7fa47b708640 1 --2- 172.21.15.12:0/124639233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa474100b30 0x7fa474100f10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.218+0000 7fa47b708640 1 -- 172.21.15.12:0/124639233 >> 172.21.15.12:0/124639233 conn(0x7fa4740fc7a0 msgr2=0x7fa4740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.218+0000 7fa47b708640 1 -- 172.21.15.12:0/124639233 shutdown_connections 2024-09-16T00:59:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.218+0000 7fa47b708640 1 -- 172.21.15.12:0/124639233 wait complete. 2024-09-16T00:59:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa47b708640 1 Processor -- start 2024-09-16T00:59:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa47b708640 1 -- start start 2024-09-16T00:59:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa47b708640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474100b30 0x7fa4741a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa47b708640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa474101450 0x7fa4741a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa47b708640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa474105f40 0x7fa47419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa47b708640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4741185c0 con 0x7fa474101450 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa47b708640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa474118440 con 0x7fa474105f40 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa47b708640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa474118740 con 0x7fa474100b30 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa478ca3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa474101450 0x7fa4741a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa478ca3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa474101450 0x7fa4741a4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49980/0 (socket says 172.21.15.12:49980) 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa478ca3640 1 -- 172.21.15.12:0/2642762763 learned_addr learned my addr 172.21.15.12:0/2642762763 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa479ca5640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa474105f40 0x7fa47419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa4794a4640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474100b30 0x7fa4741a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa478ca3640 1 -- 172.21.15.12:0/2642762763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474100b30 msgr2=0x7fa4741a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa478ca3640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474100b30 0x7fa4741a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa478ca3640 1 -- 172.21.15.12:0/2642762763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa474105f40 msgr2=0x7fa47419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa478ca3640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa474105f40 0x7fa47419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa478ca3640 1 -- 172.21.15.12:0/2642762763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47419f020 con 0x7fa474101450 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.219+0000 7fa4794a4640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474100b30 0x7fa4741a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.220+0000 7fa478ca3640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa474101450 0x7fa4741a4c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa46400b3f0 tx=0x7fa46400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.220+0000 7fa46a7fc640 1 -- 172.21.15.12:0/2642762763 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464015020 con 0x7fa474101450 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.220+0000 7fa47b708640 1 -- 172.21.15.12:0/2642762763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47419f310 con 0x7fa474101450 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.220+0000 7fa46a7fc640 1 -- 172.21.15.12:0/2642762763 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa464011d10 con 0x7fa474101450 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.220+0000 7fa46a7fc640 1 -- 172.21.15.12:0/2642762763 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46400f2e0 con 0x7fa474101450 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.220+0000 7fa47b708640 1 -- 172.21.15.12:0/2642762763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4741ab600 con 0x7fa474101450 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.221+0000 7fa47b708640 1 -- 172.21.15.12:0/2642762763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa474105920 con 0x7fa474101450 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.222+0000 7fa46a7fc640 1 -- 172.21.15.12:0/2642762763 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa464018020 con 0x7fa474101450 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.223+0000 7fa46a7fc640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4600a32d0 0x7fa4600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.223+0000 7fa4794a4640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4600a32d0 0x7fa4600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.223+0000 7fa46a7fc640 1 -- 172.21.15.12:0/2642762763 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fa4640cf430 con 0x7fa474101450 2024-09-16T00:59:29.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.223+0000 7fa4794a4640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4600a32d0 0x7fa4600a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa470000c00 tx=0x7fa470005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:29.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.227+0000 7fa46a7fc640 1 -- 172.21.15.12:0/2642762763 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa46401f020 con 0x7fa474101450 2024-09-16T00:59:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.426+0000 7fa47b708640 1 -- 172.21.15.12:0/2642762763 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa47410fe10 con 0x7fa4600a32d0 2024-09-16T00:59:29.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.450+0000 7fa46a7fc640 1 -- 172.21.15.12:0/2642762763 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa47410fe10 con 0x7fa4600a32d0 2024-09-16T00:59:29.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 -- 172.21.15.12:0/2642762763 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4600a32d0 msgr2=0x7fa4600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:29.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4600a32d0 0x7fa4600a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa470000c00 tx=0x7fa470005a20 comp rx=0 tx=0).stop 2024-09-16T00:59:29.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 -- 172.21.15.12:0/2642762763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa474101450 msgr2=0x7fa4741a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:29.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa474101450 0x7fa4741a4c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa46400b3f0 tx=0x7fa46400b8b0 comp rx=0 tx=0).stop 2024-09-16T00:59:29.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 -- 172.21.15.12:0/2642762763 shutdown_connections 2024-09-16T00:59:29.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4600a32d0 0x7fa4600a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:29.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa474105f40 0x7fa47419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:29.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa474101450 0x7fa4741a4c70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:29.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 --2- 172.21.15.12:0/2642762763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474100b30 0x7fa4741a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:29.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 -- 172.21.15.12:0/2642762763 >> 172.21.15.12:0/2642762763 conn(0x7fa4740fc7a0 msgr2=0x7fa47410f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:29.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 -- 172.21.15.12:0/2642762763 shutdown_connections 2024-09-16T00:59:29.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:29.452+0000 7fa47b708640 1 -- 172.21.15.12:0/2642762763 wait complete. 2024-09-16T00:59:30.092 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-16T00:59:30.350 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.853+0000 7f600833e640 1 -- 172.21.15.12:0/3006370454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6000101420 msgr2=0x7f600010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.853+0000 7f600833e640 1 --2- 172.21.15.12:0/3006370454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6000101420 0x7f600010d950 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009cd0 tx=0x7f5ff802a8e0 comp rx=0 tx=0).stop 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.853+0000 7f600833e640 1 -- 172.21.15.12:0/3006370454 shutdown_connections 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.853+0000 7f600833e640 1 --2- 172.21.15.12:0/3006370454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6000101420 0x7f600010d950 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.853+0000 7f600833e640 1 --2- 172.21.15.12:0/3006370454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6000100a80 0x7f6000100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.853+0000 7f600833e640 1 --2- 172.21.15.12:0/3006370454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6000106a80 0x7f6000106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.853+0000 7f600833e640 1 -- 172.21.15.12:0/3006370454 >> 172.21.15.12:0/3006370454 conn(0x7f60000fc7a0 msgr2=0x7f60000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.853+0000 7f600833e640 1 -- 172.21.15.12:0/3006370454 shutdown_connections 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.853+0000 7f600833e640 1 -- 172.21.15.12:0/3006370454 wait complete. 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f600833e640 1 Processor -- start 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f600833e640 1 -- start start 2024-09-16T00:59:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f600833e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6000100a80 0x7f6000197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f600833e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6000101420 0x7f6000197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f600833e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6000106a80 0x7f600019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f600833e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6000110ed0 con 0x7f6000106a80 2024-09-16T00:59:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f600833e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6000110d50 con 0x7f6000100a80 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f600833e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6000111050 con 0x7f6000101420 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f60068db640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6000106a80 0x7f600019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f60068db640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6000106a80 0x7f600019bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49992/0 (socket says 172.21.15.12:49992) 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f60068db640 1 -- 172.21.15.12:0/4243954041 learned_addr learned my addr 172.21.15.12:0/4243954041 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.854+0000 7f60060da640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6000100a80 0x7f6000197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f60058d9640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6000101420 0x7f6000197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f60068db640 1 -- 172.21.15.12:0/4243954041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6000101420 msgr2=0x7f6000197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f60068db640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6000101420 0x7f6000197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f60068db640 1 -- 172.21.15.12:0/4243954041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6000100a80 msgr2=0x7f6000197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f60068db640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6000100a80 0x7f6000197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f60068db640 1 -- 172.21.15.12:0/4243954041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600019c2e0 con 0x7f6000106a80 2024-09-16T00:59:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f60068db640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6000106a80 0x7f600019bc00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8033040 tx=0x7f5ff8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f5ff77fe640 1 -- 172.21.15.12:0/4243954041 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8004040 con 0x7f6000106a80 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f600833e640 1 -- 172.21.15.12:0/4243954041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600019c570 con 0x7f6000106a80 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f5ff77fe640 1 -- 172.21.15.12:0/4243954041 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ff80046c0 con 0x7f6000106a80 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f5ff77fe640 1 -- 172.21.15.12:0/4243954041 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8046480 con 0x7f6000106a80 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.855+0000 7f600833e640 1 -- 172.21.15.12:0/4243954041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60001a3eb0 con 0x7f6000106a80 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.856+0000 7f600833e640 1 -- 172.21.15.12:0/4243954041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6000100ee0 con 0x7f6000106a80 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.857+0000 7f5ff77fe640 1 -- 172.21.15.12:0/4243954041 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5ff80305a0 con 0x7f6000106a80 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.858+0000 7f5ff77fe640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fec0a32d0 0x7f5fec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.858+0000 7f60060da640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fec0a32d0 0x7f5fec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.858+0000 7f5ff77fe640 1 -- 172.21.15.12:0/4243954041 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f5ff802e030 con 0x7f6000106a80 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.859+0000 7f60060da640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fec0a32d0 0x7f5fec0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc005fd0 tx=0x7f5ffc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:30.861+0000 7f5ff77fe640 1 -- 172.21.15.12:0/4243954041 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ff804b060 con 0x7f6000106a80 2024-09-16T00:59:31.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.065+0000 7f600833e640 1 -- 172.21.15.12:0/4243954041 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f60000fd5c0 con 0x7f5fec0a32d0 2024-09-16T00:59:31.066 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:30 smithi012 ceph-mon[31197]: pgmap v308: 129 pgs: 129 active+clean; 594 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-16T00:59:31.067 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:30 smithi012 ceph-mon[31197]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:31.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.070+0000 7f5ff77fe640 1 -- 172.21.15.12:0/4243954041 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f60000fd5c0 con 0x7f5fec0a32d0 2024-09-16T00:59:31.071 INFO:teuthology.orchestra.run.smithi012.stdout:/volumes/qa/sv_1/c02c8b8a-a475-4c71-a880-51674f5240bb 2024-09-16T00:59:31.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.072+0000 7f600833e640 1 -- 172.21.15.12:0/4243954041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fec0a32d0 msgr2=0x7f5fec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:31.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.072+0000 7f600833e640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fec0a32d0 0x7f5fec0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc005fd0 tx=0x7f5ffc00b390 comp rx=0 tx=0).stop 2024-09-16T00:59:31.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.072+0000 7f600833e640 1 -- 172.21.15.12:0/4243954041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6000106a80 msgr2=0x7f600019bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:31.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.072+0000 7f600833e640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6000106a80 0x7f600019bc00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8033040 tx=0x7f5ff8003970 comp rx=0 tx=0).stop 2024-09-16T00:59:31.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.072+0000 7f600833e640 1 -- 172.21.15.12:0/4243954041 shutdown_connections 2024-09-16T00:59:31.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.072+0000 7f600833e640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fec0a32d0 0x7f5fec0a5790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:31.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.072+0000 7f600833e640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6000106a80 0x7f600019bc00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:31.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.072+0000 7f600833e640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6000101420 0x7f6000197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:31.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.073+0000 7f600833e640 1 --2- 172.21.15.12:0/4243954041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6000100a80 0x7f6000197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:31.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.073+0000 7f600833e640 1 -- 172.21.15.12:0/4243954041 >> 172.21.15.12:0/4243954041 conn(0x7f60000fc7a0 msgr2=0x7f60000fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:31.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.073+0000 7f600833e640 1 -- 172.21.15.12:0/4243954041 shutdown_connections 2024-09-16T00:59:31.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:31.073+0000 7f600833e640 1 -- 172.21.15.12:0/4243954041 wait complete. 2024-09-16T00:59:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:30 smithi119 ceph-mon[35049]: pgmap v308: 129 pgs: 129 active+clean; 594 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-16T00:59:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:30 smithi119 ceph-mon[35049]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:30 smithi098 ceph-mon[35346]: pgmap v308: 129 pgs: 129 active+clean; 594 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-16T00:59:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:30 smithi098 ceph-mon[35346]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:31.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:59:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.456+0000 7f8073df2640 1 -- 172.21.15.12:0/684160161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f806c1036c0 msgr2=0x7f806c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.456+0000 7f8073df2640 1 --2- 172.21.15.12:0/684160161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f806c1036c0 0x7f806c10bbb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f805c009900 tx=0x7f805c02a480 comp rx=0 tx=0).stop 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.456+0000 7f8073df2640 1 -- 172.21.15.12:0/684160161 shutdown_connections 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.456+0000 7f8073df2640 1 --2- 172.21.15.12:0/684160161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f806c10c180 0x7f806c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.456+0000 7f8073df2640 1 --2- 172.21.15.12:0/684160161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f806c1036c0 0x7f806c10bbb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.456+0000 7f8073df2640 1 --2- 172.21.15.12:0/684160161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f806c102da0 0x7f806c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.456+0000 7f8073df2640 1 -- 172.21.15.12:0/684160161 >> 172.21.15.12:0/684160161 conn(0x7f806c0fc7a0 msgr2=0x7f806c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.456+0000 7f8073df2640 1 -- 172.21.15.12:0/684160161 shutdown_connections 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.456+0000 7f8073df2640 1 -- 172.21.15.12:0/684160161 wait complete. 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.457+0000 7f8073df2640 1 Processor -- start 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.457+0000 7f8073df2640 1 -- start start 2024-09-16T00:59:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.457+0000 7f8073df2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f806c102da0 0x7f806c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.457+0000 7f8073df2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f806c1036c0 0x7f806c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.457+0000 7f8073df2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f806c10c180 0x7f806c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.457+0000 7f8073df2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f806c111f60 con 0x7f806c1036c0 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.457+0000 7f8073df2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f806c111de0 con 0x7f806c102da0 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.457+0000 7f8073df2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f806c1120e0 con 0x7f806c10c180 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f807138d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f806c1036c0 0x7f806c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f807138d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f806c1036c0 0x7f806c1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50010/0 (socket says 172.21.15.12:50010) 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f807138d640 1 -- 172.21.15.12:0/2951072389 learned_addr learned my addr 172.21.15.12:0/2951072389 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f8071b8e640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f806c102da0 0x7f806c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f807238f640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f806c10c180 0x7f806c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f807138d640 1 -- 172.21.15.12:0/2951072389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f806c10c180 msgr2=0x7f806c19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f807138d640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f806c10c180 0x7f806c19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f807138d640 1 -- 172.21.15.12:0/2951072389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f806c102da0 msgr2=0x7f806c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f807138d640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f806c102da0 0x7f806c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f807138d640 1 -- 172.21.15.12:0/2951072389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c19d450 con 0x7f806c1036c0 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f807138d640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f806c1036c0 0x7f806c1989e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f805c005ab0 tx=0x7f805c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f8062ffd640 1 -- 172.21.15.12:0/2951072389 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c03f030 con 0x7f806c1036c0 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f8062ffd640 1 -- 172.21.15.12:0/2951072389 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f805c003ce0 con 0x7f806c1036c0 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f8062ffd640 1 -- 172.21.15.12:0/2951072389 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c035070 con 0x7f806c1036c0 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f8073df2640 1 -- 172.21.15.12:0/2951072389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806c19d6e0 con 0x7f806c1036c0 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.458+0000 7f8073df2640 1 -- 172.21.15.12:0/2951072389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806c1a5020 con 0x7f806c1036c0 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.459+0000 7f8073df2640 1 -- 172.21.15.12:0/2951072389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806c06b010 con 0x7f806c1036c0 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.461+0000 7f8062ffd640 1 -- 172.21.15.12:0/2951072389 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f805c042030 con 0x7f806c1036c0 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.461+0000 7f8062ffd640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f80580a32d0 0x7f80580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.461+0000 7f8071b8e640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f80580a32d0 0x7f80580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.461+0000 7f8062ffd640 1 -- 172.21.15.12:0/2951072389 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f805c0f0820 con 0x7f806c1036c0 2024-09-16T00:59:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.462+0000 7f8071b8e640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f80580a32d0 0x7f80580a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80680058c0 tx=0x7f806800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.464+0000 7f8062ffd640 1 -- 172.21.15.12:0/2951072389 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f805c0bd1a0 con 0x7f806c1036c0 2024-09-16T00:59:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.680+0000 7f8073df2640 1 -- 172.21.15.12:0/2951072389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f806c1071c0 con 0x7f806c1036c0 2024-09-16T00:59:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.681+0000 7f8062ffd640 1 -- 172.21.15.12:0/2951072389 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7f805c0bcaa0 con 0x7f806c1036c0 2024-09-16T00:59:32.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:59:32.682 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-16T00:59:22:581924+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T00:59:22.581909+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24482,24475,24458,14601]},"id":1}]} 2024-09-16T00:59:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-16T00:59:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.683+0000 7f8073df2640 1 -- 172.21.15.12:0/2951072389 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f80580a32d0 msgr2=0x7f80580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.683+0000 7f8073df2640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f80580a32d0 0x7f80580a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80680058c0 tx=0x7f806800a250 comp rx=0 tx=0).stop 2024-09-16T00:59:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.683+0000 7f8073df2640 1 -- 172.21.15.12:0/2951072389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f806c1036c0 msgr2=0x7f806c1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.683+0000 7f8073df2640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f806c1036c0 0x7f806c1989e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f805c005ab0 tx=0x7f805c0042f0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.683+0000 7f8073df2640 1 -- 172.21.15.12:0/2951072389 shutdown_connections 2024-09-16T00:59:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.683+0000 7f8073df2640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f80580a32d0 0x7f80580a5790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.683+0000 7f8073df2640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f806c10c180 0x7f806c19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.683+0000 7f8073df2640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f806c1036c0 0x7f806c1989e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.683+0000 7f8073df2640 1 --2- 172.21.15.12:0/2951072389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f806c102da0 0x7f806c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.683+0000 7f8073df2640 1 -- 172.21.15.12:0/2951072389 >> 172.21.15.12:0/2951072389 conn(0x7f806c0fc7a0 msgr2=0x7f806c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.684+0000 7f8073df2640 1 -- 172.21.15.12:0/2951072389 shutdown_connections 2024-09-16T00:59:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:32.684+0000 7f8073df2640 1 -- 172.21.15.12:0/2951072389 wait complete. 2024-09-16T00:59:33.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:32 smithi012 ceph-mon[31197]: pgmap v309: 129 pgs: 129 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.9 KiB/s wr, 23 op/s 2024-09-16T00:59:33.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:32 smithi012 ceph-mon[31197]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:33.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:32 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:32 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2951072389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:32 smithi119 ceph-mon[35049]: pgmap v309: 129 pgs: 129 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.9 KiB/s wr, 23 op/s 2024-09-16T00:59:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:32 smithi119 ceph-mon[35049]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:32 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:32 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2951072389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.202 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:32 smithi098 ceph-mon[35346]: pgmap v309: 129 pgs: 129 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.9 KiB/s wr, 23 op/s 2024-09-16T00:59:33.202 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:32 smithi098 ceph-mon[35346]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:33.202 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:32 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.202 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:32 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2951072389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.420 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:59:34.335 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.824+0000 7f1863e7f640 1 -- 172.21.15.12:0/2951447567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f185c106f10 msgr2=0x7f185c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.824+0000 7f1863e7f640 1 --2- 172.21.15.12:0/2951447567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f185c106f10 0x7f185c10ea90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1854009ca0 tx=0x7f185402a8c0 comp rx=0 tx=0).stop 2024-09-16T00:59:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.824+0000 7f1863e7f640 1 -- 172.21.15.12:0/2951447567 shutdown_connections 2024-09-16T00:59:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.824+0000 7f1863e7f640 1 --2- 172.21.15.12:0/2951447567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f185c106f10 0x7f185c10ea90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.824+0000 7f1863e7f640 1 --2- 172.21.15.12:0/2951447567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f185c102790 0x7f185c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.824+0000 7f1863e7f640 1 --2- 172.21.15.12:0/2951447567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f185c101de0 0x7f185c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.824+0000 7f1863e7f640 1 -- 172.21.15.12:0/2951447567 >> 172.21.15.12:0/2951447567 conn(0x7f185c0fd8c0 msgr2=0x7f185c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.824+0000 7f1863e7f640 1 -- 172.21.15.12:0/2951447567 shutdown_connections 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.824+0000 7f1863e7f640 1 -- 172.21.15.12:0/2951447567 wait complete. 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f1863e7f640 1 Processor -- start 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f1863e7f640 1 -- start start 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f1863e7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f185c101de0 0x7f185c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f1863e7f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f185c102790 0x7f185c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f1863e7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f185c106f10 0x7f185c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f1863e7f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f185c111fc0 con 0x7f185c106f10 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f1863e7f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f185c111e40 con 0x7f185c101de0 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f1863e7f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f185c112140 con 0x7f185c102790 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f186241c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f185c106f10 0x7f185c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f186241c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f185c106f10 0x7f185c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50020/0 (socket says 172.21.15.12:50020) 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f186241c640 1 -- 172.21.15.12:0/1631957320 learned_addr learned my addr 172.21.15.12:0/1631957320 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f186141a640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f185c102790 0x7f185c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f1861c1b640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f185c101de0 0x7f185c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f186241c640 1 -- 172.21.15.12:0/1631957320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f185c102790 msgr2=0x7f185c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f186241c640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f185c102790 0x7f185c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f186241c640 1 -- 172.21.15.12:0/1631957320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f185c101de0 msgr2=0x7f185c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f186241c640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f185c101de0 0x7f185c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f186241c640 1 -- 172.21.15.12:0/1631957320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185c19d380 con 0x7f185c106f10 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.825+0000 7f1861c1b640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f185c101de0 0x7f185c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.826+0000 7f186241c640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f185c106f10 0x7f185c19cca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1854003f10 tx=0x7f1854003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.826+0000 7f1852ffd640 1 -- 172.21.15.12:0/1631957320 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1854031710 con 0x7f185c106f10 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.826+0000 7f1852ffd640 1 -- 172.21.15.12:0/1631957320 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18540318b0 con 0x7f185c106f10 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.826+0000 7f1863e7f640 1 -- 172.21.15.12:0/1631957320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185c19d610 con 0x7f185c106f10 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.826+0000 7f1852ffd640 1 -- 172.21.15.12:0/1631957320 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185402fb90 con 0x7f185c106f10 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.826+0000 7f1863e7f640 1 -- 172.21.15.12:0/1631957320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f185c1a4f50 con 0x7f185c106f10 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.827+0000 7f1863e7f640 1 -- 172.21.15.12:0/1631957320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f185c1021c0 con 0x7f185c106f10 2024-09-16T00:59:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.828+0000 7f1852ffd640 1 -- 172.21.15.12:0/1631957320 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f185402fd30 con 0x7f185c106f10 2024-09-16T00:59:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.829+0000 7f1852ffd640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f18480a32d0 0x7f18480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.829+0000 7f1861c1b640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f18480a32d0 0x7f18480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.829+0000 7f1852ffd640 1 -- 172.21.15.12:0/1631957320 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f18540f1230 con 0x7f185c106f10 2024-09-16T00:59:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.829+0000 7f1861c1b640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f18480a32d0 0x7f18480a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1858005fd0 tx=0x7f1858005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:34.833+0000 7f1852ffd640 1 -- 172.21.15.12:0/1631957320 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18540bdd60 con 0x7f185c106f10 2024-09-16T00:59:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.017+0000 7f1863e7f640 1 -- 172.21.15.12:0/1631957320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f185c10a1b0 con 0x7f185c106f10 2024-09-16T00:59:35.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:34 smithi012 ceph-mon[31197]: pgmap v310: 129 pgs: 129 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.9 KiB/s wr, 24 op/s 2024-09-16T00:59:35.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:34 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:34 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:34 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:34 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.020+0000 7f1852ffd640 1 -- 172.21.15.12:0/1631957320 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24189 (secure 0 0 0) 0x7f18540bd660 con 0x7f185c106f10 2024-09-16T00:59:35.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:59:35.021 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T00:58:46.252124+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:59:35.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 -- 172.21.15.12:0/1631957320 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f18480a32d0 msgr2=0x7f18480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:35.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f18480a32d0 0x7f18480a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1858005fd0 tx=0x7f1858005ea0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 -- 172.21.15.12:0/1631957320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f185c106f10 msgr2=0x7f185c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:35.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f185c106f10 0x7f185c19cca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1854003f10 tx=0x7f1854003f40 comp rx=0 tx=0).stop 2024-09-16T00:59:35.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 -- 172.21.15.12:0/1631957320 shutdown_connections 2024-09-16T00:59:35.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f18480a32d0 0x7f18480a5790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f185c106f10 0x7f185c19cca0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f185c102790 0x7f185c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 --2- 172.21.15.12:0/1631957320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f185c101de0 0x7f185c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 -- 172.21.15.12:0/1631957320 >> 172.21.15.12:0/1631957320 conn(0x7f185c0fd8c0 msgr2=0x7f185c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:35.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 -- 172.21.15.12:0/1631957320 shutdown_connections 2024-09-16T00:59:35.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:35.023+0000 7f1863e7f640 1 -- 172.21.15.12:0/1631957320 wait complete. 2024-09-16T00:59:35.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:34 smithi119 ceph-mon[35049]: pgmap v310: 129 pgs: 129 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.9 KiB/s wr, 24 op/s 2024-09-16T00:59:35.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:34 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:34 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:34 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:34 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:34 smithi098 ceph-mon[35346]: pgmap v310: 129 pgs: 129 active+clean; 626 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.9 KiB/s wr, 24 op/s 2024-09-16T00:59:35.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:34 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:34 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:34 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:34 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:35.733 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T00:59:35.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T00:59:36.005 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:36.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:35 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1631957320' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:36.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:35 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:36.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:35 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:36.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:35 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1631957320' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:36.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:35 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:36.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:35 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:35 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1631957320' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:35 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:35 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.465+0000 7f8a3d64f640 1 -- 172.21.15.12:0/1444407569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a381082a0 msgr2=0x7f8a3810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.465+0000 7f8a3d64f640 1 --2- 172.21.15.12:0/1444407569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a381082a0 0x7f8a3810ec40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009cd0 tx=0x7f8a3002a8e0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.465+0000 7f8a3d64f640 1 -- 172.21.15.12:0/1444407569 shutdown_connections 2024-09-16T00:59:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.465+0000 7f8a3d64f640 1 --2- 172.21.15.12:0/1444407569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a381082a0 0x7f8a3810ec40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.465+0000 7f8a3d64f640 1 --2- 172.21.15.12:0/1444407569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381036e0 0x7f8a38107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.465+0000 7f8a3d64f640 1 --2- 172.21.15.12:0/1444407569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a38102d30 0x7f8a38103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.465+0000 7f8a3d64f640 1 -- 172.21.15.12:0/1444407569 >> 172.21.15.12:0/1444407569 conn(0x7f8a380fc7d0 msgr2=0x7f8a380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.465+0000 7f8a3d64f640 1 -- 172.21.15.12:0/1444407569 shutdown_connections 2024-09-16T00:59:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.465+0000 7f8a3d64f640 1 -- 172.21.15.12:0/1444407569 wait complete. 2024-09-16T00:59:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.465+0000 7f8a3d64f640 1 Processor -- start 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a3d64f640 1 -- start start 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a3d64f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a38102d30 0x7f8a3819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a3d64f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a381036e0 0x7f8a3819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a3d64f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381082a0 0x7f8a3819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a3d64f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8a381120a0 con 0x7f8a381036e0 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a3d64f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a38111f20 con 0x7f8a381082a0 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a3d64f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8a38112220 con 0x7f8a38102d30 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a367fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a381036e0 0x7f8a3819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a367fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a381036e0 0x7f8a3819ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43768/0 (socket says 172.21.15.12:43768) 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a367fc640 1 -- 172.21.15.12:0/2193778586 learned_addr learned my addr 172.21.15.12:0/2193778586 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a36ffd640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a38102d30 0x7f8a3819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a377fe640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381082a0 0x7f8a3819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a367fc640 1 -- 172.21.15.12:0/2193778586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a38102d30 msgr2=0x7f8a3819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a367fc640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a38102d30 0x7f8a3819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a367fc640 1 -- 172.21.15.12:0/2193778586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381082a0 msgr2=0x7f8a3819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a367fc640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381082a0 0x7f8a3819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a367fc640 1 -- 172.21.15.12:0/2193778586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3819f6e0 con 0x7f8a381036e0 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a377fe640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381082a0 0x7f8a3819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a36ffd640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a38102d30 0x7f8a3819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.466+0000 7f8a367fc640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a381036e0 0x7f8a3819ac70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00d950 tx=0x7f8a2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.467+0000 7f8a1ffff640 1 -- 172.21.15.12:0/2193778586 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c017070 con 0x7f8a381036e0 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.467+0000 7f8a3d64f640 1 -- 172.21.15.12:0/2193778586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3819f9d0 con 0x7f8a381036e0 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.467+0000 7f8a1ffff640 1 -- 172.21.15.12:0/2193778586 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a2c009c30 con 0x7f8a381036e0 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.467+0000 7f8a1ffff640 1 -- 172.21.15.12:0/2193778586 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0047a0 con 0x7f8a381036e0 2024-09-16T00:59:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.467+0000 7f8a3d64f640 1 -- 172.21.15.12:0/2193778586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a381a72b0 con 0x7f8a381036e0 2024-09-16T00:59:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.468+0000 7f8a3d64f640 1 -- 172.21.15.12:0/2193778586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a38103110 con 0x7f8a381036e0 2024-09-16T00:59:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.469+0000 7f8a1ffff640 1 -- 172.21.15.12:0/2193778586 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8a2c004020 con 0x7f8a381036e0 2024-09-16T00:59:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.470+0000 7f8a1ffff640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8a200a32d0 0x7f8a200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.470+0000 7f8a36ffd640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8a200a32d0 0x7f8a200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.470+0000 7f8a1ffff640 1 -- 172.21.15.12:0/2193778586 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f8a2c0cfdf0 con 0x7f8a381036e0 2024-09-16T00:59:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.470+0000 7f8a36ffd640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8a200a32d0 0x7f8a200a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009c20 tx=0x7f8a28005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.473+0000 7f8a1ffff640 1 -- 172.21.15.12:0/2193778586 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a2c020020 con 0x7f8a381036e0 2024-09-16T00:59:36.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.646+0000 7f8a3d64f640 1 -- 172.21.15.12:0/2193778586 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a3810c2f0 con 0x7f8a200a32d0 2024-09-16T00:59:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.655+0000 7f8a1ffff640 1 -- 172.21.15.12:0/2193778586 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340659 (secure 0 0 0) 0x7f8a3810c2f0 con 0x7f8a200a32d0 2024-09-16T00:59:36.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:59:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-16T00:59:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 -- 172.21.15.12:0/2193778586 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8a200a32d0 msgr2=0x7f8a200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8a200a32d0 0x7f8a200a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009c20 tx=0x7f8a28005f90 comp rx=0 tx=0).stop 2024-09-16T00:59:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 -- 172.21.15.12:0/2193778586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a381036e0 msgr2=0x7f8a3819ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a381036e0 0x7f8a3819ac70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00d950 tx=0x7f8a2c00de10 comp rx=0 tx=0).stop 2024-09-16T00:59:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 -- 172.21.15.12:0/2193778586 shutdown_connections 2024-09-16T00:59:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8a200a32d0 0x7f8a200a5790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381082a0 0x7f8a3819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a381036e0 0x7f8a3819ac70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 --2- 172.21.15.12:0/2193778586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a38102d30 0x7f8a3819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 -- 172.21.15.12:0/2193778586 >> 172.21.15.12:0/2193778586 conn(0x7f8a380fc7d0 msgr2=0x7f8a38101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:36.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 -- 172.21.15.12:0/2193778586 shutdown_connections 2024-09-16T00:59:36.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:36.659+0000 7f8a3d64f640 1 -- 172.21.15.12:0/2193778586 wait complete. 2024-09-16T00:59:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:36 smithi119 ceph-mon[35049]: pgmap v311: 129 pgs: 129 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 20 op/s 2024-09-16T00:59:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:36 smithi012 ceph-mon[31197]: pgmap v311: 129 pgs: 129 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 20 op/s 2024-09-16T00:59:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:37.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:37.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:36 smithi098 ceph-mon[35346]: pgmap v311: 129 pgs: 129 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 20 op/s 2024-09-16T00:59:37.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:37.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:37.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T00:59:37.395 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-16T00:59:34.903277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649316,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":284,"num_read_kb":258,"num_write":421,"num_write_kb":3067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369120,"kb_used_data":11552,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572704,"statfs":{"total":1151940427776,"available":1151562448896,"internally_reserved":0,"allocated":11829248,"data_stored":7619558,"data_compressed":319413,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49758,"num_objects":35,"num_object_clones":0,"num_object_copies":107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":137,"num_read_kb":132,"num_write":104,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003619"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:32.604941+0000","last_change":"2024-09-16T00:58:34.473346+0000","last_active":"2024-09-16T00:59:32.604941+0000","last_peered":"2024-09-16T00:59:32.604941+0000","last_clean":"2024-09-16T00:59:32.604941+0000","last_became_active":"2024-09-16T00:58:34.472992+0000","last_became_peered":"2024-09-16T00:58:34.472992+0000","last_unstale":"2024-09-16T00:59:32.604941+0000","last_undegraded":"2024-09-16T00:59:32.604941+0000","last_fullsized":"2024-09-16T00:59:32.604941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:47.064421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.588202+0000","last_change":"2024-09-16T00:58:36.507955+0000","last_active":"2024-09-16T00:58:46.588202+0000","last_peered":"2024-09-16T00:58:46.588202+0000","last_clean":"2024-09-16T00:58:46.588202+0000","last_became_active":"2024-09-16T00:58:36.507660+0000","last_became_peered":"2024-09-16T00:58:36.507660+0000","last_unstale":"2024-09-16T00:58:46.588202+0000","last_undegraded":"2024-09-16T00:58:46.588202+0000","last_fullsized":"2024-09-16T00:58:46.588202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:05.408460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808783+0000","last_change":"2024-09-16T00:58:43.620365+0000","last_active":"2024-09-16T00:58:46.808783+0000","last_peered":"2024-09-16T00:58:46.808783+0000","last_clean":"2024-09-16T00:58:46.808783+0000","last_became_active":"2024-09-16T00:58:43.619976+0000","last_became_peered":"2024-09-16T00:58:43.619976+0000","last_unstale":"2024-09-16T00:58:46.808783+0000","last_undegraded":"2024-09-16T00:58:46.808783+0000","last_fullsized":"2024-09-16T00:58:46.808783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:37.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.588422+0000","last_change":"2024-09-16T00:58:34.829549+0000","last_active":"2024-09-16T00:58:46.588422+0000","last_peered":"2024-09-16T00:58:46.588422+0000","last_clean":"2024-09-16T00:58:46.588422+0000","last_became_active":"2024-09-16T00:58:34.829180+0000","last_became_peered":"2024-09-16T00:58:34.829180+0000","last_unstale":"2024-09-16T00:58:46.588422+0000","last_undegraded":"2024-09-16T00:58:46.588422+0000","last_fullsized":"2024-09-16T00:58:46.588422+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:40.731288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962477+0000","last_change":"2024-09-16T00:58:36.517190+0000","last_active":"2024-09-16T00:58:46.962477+0000","last_peered":"2024-09-16T00:58:46.962477+0000","last_clean":"2024-09-16T00:58:46.962477+0000","last_became_active":"2024-09-16T00:58:36.516877+0000","last_became_peered":"2024-09-16T00:58:36.516877+0000","last_unstale":"2024-09-16T00:58:46.962477+0000","last_undegraded":"2024-09-16T00:58:46.962477+0000","last_fullsized":"2024-09-16T00:58:46.962477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.408011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560281+0000","last_change":"2024-09-16T00:58:43.617071+0000","last_active":"2024-09-16T00:58:46.560281+0000","last_peered":"2024-09-16T00:58:46.560281+0000","last_clean":"2024-09-16T00:58:46.560281+0000","last_became_active":"2024-09-16T00:58:43.616637+0000","last_became_peered":"2024-09-16T00:58:43.616637+0000","last_unstale":"2024-09-16T00:58:46.560281+0000","last_undegraded":"2024-09-16T00:58:46.560281+0000","last_fullsized":"2024-09-16T00:58:46.560281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:08.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.586267+0000","last_change":"2024-09-16T00:58:34.472375+0000","last_active":"2024-09-16T00:59:21.586267+0000","last_peered":"2024-09-16T00:59:21.586267+0000","last_clean":"2024-09-16T00:59:21.586267+0000","last_became_active":"2024-09-16T00:58:34.471990+0000","last_became_peered":"2024-09-16T00:58:34.471990+0000","last_unstale":"2024-09-16T00:59:21.586267+0000","last_undegraded":"2024-09-16T00:59:21.586267+0000","last_fullsized":"2024-09-16T00:59:21.586267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:15.746005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809287+0000","last_change":"2024-09-16T00:58:36.513747+0000","last_active":"2024-09-16T00:58:46.809287+0000","last_peered":"2024-09-16T00:58:46.809287+0000","last_clean":"2024-09-16T00:58:46.809287+0000","last_became_active":"2024-09-16T00:58:36.512635+0000","last_became_peered":"2024-09-16T00:58:36.512635+0000","last_unstale":"2024-09-16T00:58:46.809287+0000","last_undegraded":"2024-09-16T00:58:46.809287+0000","last_fullsized":"2024-09-16T00:58:46.809287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:39.014961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560583+0000","last_change":"2024-09-16T00:58:43.609355+0000","last_active":"2024-09-16T00:58:46.560583+0000","last_peered":"2024-09-16T00:58:46.560583+0000","last_clean":"2024-09-16T00:58:46.560583+0000","last_became_active":"2024-09-16T00:58:43.608892+0000","last_became_peered":"2024-09-16T00:58:43.608892+0000","last_unstale":"2024-09-16T00:58:46.560583+0000","last_undegraded":"2024-09-16T00:58:46.560583+0000","last_fullsized":"2024-09-16T00:58:46.560583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:20.718163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.586022+0000","last_change":"2024-09-16T00:58:34.469650+0000","last_active":"2024-09-16T00:59:21.586022+0000","last_peered":"2024-09-16T00:59:21.586022+0000","last_clean":"2024-09-16T00:59:21.586022+0000","last_became_active":"2024-09-16T00:58:34.468939+0000","last_became_peered":"2024-09-16T00:58:34.468939+0000","last_unstale":"2024-09-16T00:59:21.586022+0000","last_undegraded":"2024-09-16T00:59:21.586022+0000","last_fullsized":"2024-09-16T00:59:21.586022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:34.511111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560471+0000","last_change":"2024-09-16T00:58:36.518113+0000","last_active":"2024-09-16T00:58:46.560471+0000","last_peered":"2024-09-16T00:58:46.560471+0000","last_clean":"2024-09-16T00:58:46.560471+0000","last_became_active":"2024-09-16T00:58:36.517812+0000","last_became_peered":"2024-09-16T00:58:36.517812+0000","last_unstale":"2024-09-16T00:58:46.560471+0000","last_undegraded":"2024-09-16T00:58:46.560471+0000","last_fullsized":"2024-09-16T00:58:46.560471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:45.204894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560484+0000","last_change":"2024-09-16T00:58:43.612479+0000","last_active":"2024-09-16T00:58:46.560484+0000","last_peered":"2024-09-16T00:58:46.560484+0000","last_clean":"2024-09-16T00:58:46.560484+0000","last_became_active":"2024-09-16T00:58:43.612001+0000","last_became_peered":"2024-09-16T00:58:43.612001+0000","last_unstale":"2024-09-16T00:58:46.560484+0000","last_undegraded":"2024-09-16T00:58:46.560484+0000","last_fullsized":"2024-09-16T00:58:46.560484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:33.056052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809202+0000","last_change":"2024-09-16T00:58:36.519407+0000","last_active":"2024-09-16T00:58:46.809202+0000","last_peered":"2024-09-16T00:58:46.809202+0000","last_clean":"2024-09-16T00:58:46.809202+0000","last_became_active":"2024-09-16T00:58:36.519108+0000","last_became_peered":"2024-09-16T00:58:36.519108+0000","last_unstale":"2024-09-16T00:58:46.809202+0000","last_undegraded":"2024-09-16T00:58:46.809202+0000","last_fullsized":"2024-09-16T00:58:46.809202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:28.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:18.750854+0000","last_change":"2024-09-16T00:58:34.472295+0000","last_active":"2024-09-16T00:59:18.750854+0000","last_peered":"2024-09-16T00:59:18.750854+0000","last_clean":"2024-09-16T00:59:18.750854+0000","last_became_active":"2024-09-16T00:58:34.471968+0000","last_became_peered":"2024-09-16T00:58:34.471968+0000","last_unstale":"2024-09-16T00:59:18.750854+0000","last_undegraded":"2024-09-16T00:59:18.750854+0000","last_fullsized":"2024-09-16T00:59:18.750854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:44.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560784+0000","last_change":"2024-09-16T00:58:43.615870+0000","last_active":"2024-09-16T00:58:46.560784+0000","last_peered":"2024-09-16T00:58:46.560784+0000","last_clean":"2024-09-16T00:58:46.560784+0000","last_became_active":"2024-09-16T00:58:43.615116+0000","last_became_peered":"2024-09-16T00:58:43.615116+0000","last_unstale":"2024-09-16T00:58:46.560784+0000","last_undegraded":"2024-09-16T00:58:46.560784+0000","last_fullsized":"2024-09-16T00:58:46.560784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:44.742792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587943+0000","last_change":"2024-09-16T00:58:36.512485+0000","last_active":"2024-09-16T00:58:46.587943+0000","last_peered":"2024-09-16T00:58:46.587943+0000","last_clean":"2024-09-16T00:58:46.587943+0000","last_became_active":"2024-09-16T00:58:36.512175+0000","last_became_peered":"2024-09-16T00:58:36.512175+0000","last_unstale":"2024-09-16T00:58:46.587943+0000","last_undegraded":"2024-09-16T00:58:46.587943+0000","last_fullsized":"2024-09-16T00:58:46.587943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.328409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:20.771286+0000","last_change":"2024-09-16T00:58:34.469225+0000","last_active":"2024-09-16T00:59:20.771286+0000","last_peered":"2024-09-16T00:59:20.771286+0000","last_clean":"2024-09-16T00:59:20.771286+0000","last_became_active":"2024-09-16T00:58:34.468858+0000","last_became_peered":"2024-09-16T00:58:34.468858+0000","last_unstale":"2024-09-16T00:59:20.771286+0000","last_undegraded":"2024-09-16T00:59:20.771286+0000","last_fullsized":"2024-09-16T00:59:20.771286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:45.499471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560753+0000","last_change":"2024-09-16T00:58:43.610265+0000","last_active":"2024-09-16T00:58:46.560753+0000","last_peered":"2024-09-16T00:58:46.560753+0000","last_clean":"2024-09-16T00:58:46.560753+0000","last_became_active":"2024-09-16T00:58:43.609868+0000","last_became_peered":"2024-09-16T00:58:43.609868+0000","last_unstale":"2024-09-16T00:58:46.560753+0000","last_undegraded":"2024-09-16T00:58:46.560753+0000","last_fullsized":"2024-09-16T00:58:46.560753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:54.689332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809368+0000","last_change":"2024-09-16T00:58:36.512801+0000","last_active":"2024-09-16T00:58:46.809368+0000","last_peered":"2024-09-16T00:58:46.809368+0000","last_clean":"2024-09-16T00:58:46.809368+0000","last_became_active":"2024-09-16T00:58:36.512469+0000","last_became_peered":"2024-09-16T00:58:36.512469+0000","last_unstale":"2024-09-16T00:58:46.809368+0000","last_undegraded":"2024-09-16T00:58:46.809368+0000","last_fullsized":"2024-09-16T00:58:46.809368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:57.951743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.582796+0000","last_change":"2024-09-16T00:58:34.471498+0000","last_active":"2024-09-16T00:59:21.582796+0000","last_peered":"2024-09-16T00:59:21.582796+0000","last_clean":"2024-09-16T00:59:21.582796+0000","last_became_active":"2024-09-16T00:58:34.471093+0000","last_became_peered":"2024-09-16T00:58:34.471093+0000","last_unstale":"2024-09-16T00:59:21.582796+0000","last_undegraded":"2024-09-16T00:59:21.582796+0000","last_fullsized":"2024-09-16T00:59:21.582796+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:35.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809828+0000","last_change":"2024-09-16T00:58:43.616376+0000","last_active":"2024-09-16T00:58:46.809828+0000","last_peered":"2024-09-16T00:58:46.809828+0000","last_clean":"2024-09-16T00:58:46.809828+0000","last_became_active":"2024-09-16T00:58:43.616029+0000","last_became_peered":"2024-09-16T00:58:43.616029+0000","last_unstale":"2024-09-16T00:58:46.809828+0000","last_undegraded":"2024-09-16T00:58:46.809828+0000","last_fullsized":"2024-09-16T00:58:46.809828+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:54.776250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808935+0000","last_change":"2024-09-16T00:58:36.506625+0000","last_active":"2024-09-16T00:58:46.808935+0000","last_peered":"2024-09-16T00:58:46.808935+0000","last_clean":"2024-09-16T00:58:46.808935+0000","last_became_active":"2024-09-16T00:58:36.506337+0000","last_became_peered":"2024-09-16T00:58:36.506337+0000","last_unstale":"2024-09-16T00:58:46.808935+0000","last_undegraded":"2024-09-16T00:58:46.808935+0000","last_fullsized":"2024-09-16T00:58:46.808935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:22.080165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:18.750817+0000","last_change":"2024-09-16T00:58:34.831309+0000","last_active":"2024-09-16T00:59:18.750817+0000","last_peered":"2024-09-16T00:59:18.750817+0000","last_clean":"2024-09-16T00:59:18.750817+0000","last_became_active":"2024-09-16T00:58:34.830980+0000","last_became_peered":"2024-09-16T00:58:34.830980+0000","last_unstale":"2024-09-16T00:59:18.750817+0000","last_undegraded":"2024-09-16T00:59:18.750817+0000","last_fullsized":"2024-09-16T00:59:18.750817+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:30.405426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560718+0000","last_change":"2024-09-16T00:58:43.609399+0000","last_active":"2024-09-16T00:58:46.560718+0000","last_peered":"2024-09-16T00:58:46.560718+0000","last_clean":"2024-09-16T00:58:46.560718+0000","last_became_active":"2024-09-16T00:58:43.608988+0000","last_became_peered":"2024-09-16T00:58:43.608988+0000","last_unstale":"2024-09-16T00:58:46.560718+0000","last_undegraded":"2024-09-16T00:58:46.560718+0000","last_fullsized":"2024-09-16T00:58:46.560718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.500071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962403+0000","last_change":"2024-09-16T00:58:36.515930+0000","last_active":"2024-09-16T00:58:46.962403+0000","last_peered":"2024-09-16T00:58:46.962403+0000","last_clean":"2024-09-16T00:58:46.962403+0000","last_became_active":"2024-09-16T00:58:36.515625+0000","last_became_peered":"2024-09-16T00:58:36.515625+0000","last_unstale":"2024-09-16T00:58:46.962403+0000","last_undegraded":"2024-09-16T00:58:46.962403+0000","last_fullsized":"2024-09-16T00:58:46.962403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:55.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.584254+0000","last_change":"2024-09-16T00:58:34.508686+0000","last_active":"2024-09-16T00:59:21.584254+0000","last_peered":"2024-09-16T00:59:21.584254+0000","last_clean":"2024-09-16T00:59:21.584254+0000","last_became_active":"2024-09-16T00:58:34.508284+0000","last_became_peered":"2024-09-16T00:58:34.508284+0000","last_unstale":"2024-09-16T00:59:21.584254+0000","last_undegraded":"2024-09-16T00:59:21.584254+0000","last_fullsized":"2024-09-16T00:59:21.584254+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:47.545949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808967+0000","last_change":"2024-09-16T00:58:43.615852+0000","last_active":"2024-09-16T00:58:46.808967+0000","last_peered":"2024-09-16T00:58:46.808967+0000","last_clean":"2024-09-16T00:58:46.808967+0000","last_became_active":"2024-09-16T00:58:43.615474+0000","last_became_peered":"2024-09-16T00:58:43.615474+0000","last_unstale":"2024-09-16T00:58:46.808967+0000","last_undegraded":"2024-09-16T00:58:46.808967+0000","last_fullsized":"2024-09-16T00:58:46.808967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:39.596924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.588333+0000","last_change":"2024-09-16T00:58:36.513820+0000","last_active":"2024-09-16T00:58:46.588333+0000","last_peered":"2024-09-16T00:58:46.588333+0000","last_clean":"2024-09-16T00:58:46.588333+0000","last_became_active":"2024-09-16T00:58:36.513513+0000","last_became_peered":"2024-09-16T00:58:36.513513+0000","last_unstale":"2024-09-16T00:58:46.588333+0000","last_undegraded":"2024-09-16T00:58:46.588333+0000","last_fullsized":"2024-09-16T00:58:46.588333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:34.584214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'12","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:31.584665+0000","last_change":"2024-09-16T00:58:34.462794+0000","last_active":"2024-09-16T00:59:31.584665+0000","last_peered":"2024-09-16T00:59:31.584665+0000","last_clean":"2024-09-16T00:59:31.584665+0000","last_became_active":"2024-09-16T00:58:34.462471+0000","last_became_peered":"2024-09-16T00:58:34.462471+0000","last_unstale":"2024-09-16T00:59:31.584665+0000","last_undegraded":"2024-09-16T00:59:31.584665+0000","last_fullsized":"2024-09-16T00:59:31.584665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:13.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587794+0000","last_change":"2024-09-16T00:58:43.607718+0000","last_active":"2024-09-16T00:58:46.587794+0000","last_peered":"2024-09-16T00:58:46.587794+0000","last_clean":"2024-09-16T00:58:46.587794+0000","last_became_active":"2024-09-16T00:58:43.607347+0000","last_became_peered":"2024-09-16T00:58:43.607347+0000","last_unstale":"2024-09-16T00:58:46.587794+0000","last_undegraded":"2024-09-16T00:58:46.587794+0000","last_fullsized":"2024-09-16T00:58:46.587794+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:12.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560021+0000","last_change":"2024-09-16T00:58:36.507161+0000","last_active":"2024-09-16T00:58:46.560021+0000","last_peered":"2024-09-16T00:58:46.560021+0000","last_clean":"2024-09-16T00:58:46.560021+0000","last_became_active":"2024-09-16T00:58:36.504062+0000","last_became_peered":"2024-09-16T00:58:36.504062+0000","last_unstale":"2024-09-16T00:58:46.560021+0000","last_undegraded":"2024-09-16T00:58:46.560021+0000","last_fullsized":"2024-09-16T00:58:46.560021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.572614+0000","last_change":"2024-09-16T00:58:34.829848+0000","last_active":"2024-09-16T00:59:21.572614+0000","last_peered":"2024-09-16T00:59:21.572614+0000","last_clean":"2024-09-16T00:59:21.572614+0000","last_became_active":"2024-09-16T00:58:34.829439+0000","last_became_peered":"2024-09-16T00:58:34.829439+0000","last_unstale":"2024-09-16T00:59:21.572614+0000","last_undegraded":"2024-09-16T00:59:21.572614+0000","last_fullsized":"2024-09-16T00:59:21.572614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:06.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809128+0000","last_change":"2024-09-16T00:58:43.618334+0000","last_active":"2024-09-16T00:58:46.809128+0000","last_peered":"2024-09-16T00:58:46.809128+0000","last_clean":"2024-09-16T00:58:46.809128+0000","last_became_active":"2024-09-16T00:58:43.617810+0000","last_became_peered":"2024-09-16T00:58:43.617810+0000","last_unstale":"2024-09-16T00:58:46.809128+0000","last_undegraded":"2024-09-16T00:58:46.809128+0000","last_fullsized":"2024-09-16T00:58:46.809128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:58.202973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810579+0000","last_change":"2024-09-16T00:58:36.509025+0000","last_active":"2024-09-16T00:58:46.810579+0000","last_peered":"2024-09-16T00:58:46.810579+0000","last_clean":"2024-09-16T00:58:46.810579+0000","last_became_active":"2024-09-16T00:58:36.508660+0000","last_became_peered":"2024-09-16T00:58:36.508660+0000","last_unstale":"2024-09-16T00:58:46.810579+0000","last_undegraded":"2024-09-16T00:58:46.810579+0000","last_fullsized":"2024-09-16T00:58:46.810579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:01.433486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809783+0000","last_change":"2024-09-16T00:58:34.829899+0000","last_active":"2024-09-16T00:58:46.809783+0000","last_peered":"2024-09-16T00:58:46.809783+0000","last_clean":"2024-09-16T00:58:46.809783+0000","last_became_active":"2024-09-16T00:58:34.829546+0000","last_became_peered":"2024-09-16T00:58:34.829546+0000","last_unstale":"2024-09-16T00:58:46.809783+0000","last_undegraded":"2024-09-16T00:58:46.809783+0000","last_fullsized":"2024-09-16T00:58:46.809783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:21.253829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810508+0000","last_change":"2024-09-16T00:58:43.610143+0000","last_active":"2024-09-16T00:58:46.810508+0000","last_peered":"2024-09-16T00:58:46.810508+0000","last_clean":"2024-09-16T00:58:46.810508+0000","last_became_active":"2024-09-16T00:58:43.609739+0000","last_became_peered":"2024-09-16T00:58:43.609739+0000","last_unstale":"2024-09-16T00:58:46.810508+0000","last_undegraded":"2024-09-16T00:58:46.810508+0000","last_fullsized":"2024-09-16T00:58:46.810508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:28.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810522+0000","last_change":"2024-09-16T00:58:36.520423+0000","last_active":"2024-09-16T00:58:46.810522+0000","last_peered":"2024-09-16T00:58:46.810522+0000","last_clean":"2024-09-16T00:58:46.810522+0000","last_became_active":"2024-09-16T00:58:36.520117+0000","last_became_peered":"2024-09-16T00:58:36.520117+0000","last_unstale":"2024-09-16T00:58:46.810522+0000","last_undegraded":"2024-09-16T00:58:46.810522+0000","last_fullsized":"2024-09-16T00:58:46.810522+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.652142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:30.602894+0000","last_change":"2024-09-16T00:58:34.475161+0000","last_active":"2024-09-16T00:59:30.602894+0000","last_peered":"2024-09-16T00:59:30.602894+0000","last_clean":"2024-09-16T00:59:30.602894+0000","last_became_active":"2024-09-16T00:58:34.474755+0000","last_became_peered":"2024-09-16T00:58:34.474755+0000","last_unstale":"2024-09-16T00:59:30.602894+0000","last_undegraded":"2024-09-16T00:59:30.602894+0000","last_fullsized":"2024-09-16T00:59:30.602894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:12.884466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559896+0000","last_change":"2024-09-16T00:58:43.609042+0000","last_active":"2024-09-16T00:58:46.559896+0000","last_peered":"2024-09-16T00:58:46.559896+0000","last_clean":"2024-09-16T00:58:46.559896+0000","last_became_active":"2024-09-16T00:58:43.608596+0000","last_became_peered":"2024-09-16T00:58:43.608596+0000","last_unstale":"2024-09-16T00:58:46.559896+0000","last_undegraded":"2024-09-16T00:58:46.559896+0000","last_fullsized":"2024-09-16T00:58:46.559896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:47.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560016+0000","last_change":"2024-09-16T00:58:36.509147+0000","last_active":"2024-09-16T00:58:46.560016+0000","last_peered":"2024-09-16T00:58:46.560016+0000","last_clean":"2024-09-16T00:58:46.560016+0000","last_became_active":"2024-09-16T00:58:36.508838+0000","last_became_peered":"2024-09-16T00:58:36.508838+0000","last_unstale":"2024-09-16T00:58:46.560016+0000","last_undegraded":"2024-09-16T00:58:46.560016+0000","last_fullsized":"2024-09-16T00:58:46.560016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:28.870177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:32.591633+0000","last_change":"2024-09-16T00:58:34.829452+0000","last_active":"2024-09-16T00:59:32.591633+0000","last_peered":"2024-09-16T00:59:32.591633+0000","last_clean":"2024-09-16T00:59:32.591633+0000","last_became_active":"2024-09-16T00:58:34.829129+0000","last_became_peered":"2024-09-16T00:58:34.829129+0000","last_unstale":"2024-09-16T00:59:32.591633+0000","last_undegraded":"2024-09-16T00:59:32.591633+0000","last_fullsized":"2024-09-16T00:59:32.591633+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559981+0000","last_change":"2024-09-16T00:58:43.609230+0000","last_active":"2024-09-16T00:58:46.559981+0000","last_peered":"2024-09-16T00:58:46.559981+0000","last_clean":"2024-09-16T00:58:46.559981+0000","last_became_active":"2024-09-16T00:58:43.608879+0000","last_became_peered":"2024-09-16T00:58:43.608879+0000","last_unstale":"2024-09-16T00:58:46.559981+0000","last_undegraded":"2024-09-16T00:58:46.559981+0000","last_fullsized":"2024-09-16T00:58:46.559981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.112878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559551+0000","last_change":"2024-09-16T00:58:36.503412+0000","last_active":"2024-09-16T00:58:46.559551+0000","last_peered":"2024-09-16T00:58:46.559551+0000","last_clean":"2024-09-16T00:58:46.559551+0000","last_became_active":"2024-09-16T00:58:36.503043+0000","last_became_peered":"2024-09-16T00:58:36.503043+0000","last_unstale":"2024-09-16T00:58:46.559551+0000","last_undegraded":"2024-09-16T00:58:46.559551+0000","last_fullsized":"2024-09-16T00:58:46.559551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:18.495669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:19.765899+0000","last_change":"2024-09-16T00:58:34.468460+0000","last_active":"2024-09-16T00:59:19.765899+0000","last_peered":"2024-09-16T00:59:19.765899+0000","last_clean":"2024-09-16T00:59:19.765899+0000","last_became_active":"2024-09-16T00:58:34.468104+0000","last_became_peered":"2024-09-16T00:58:34.468104+0000","last_unstale":"2024-09-16T00:59:19.765899+0000","last_undegraded":"2024-09-16T00:59:19.765899+0000","last_fullsized":"2024-09-16T00:59:19.765899+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:13.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560633+0000","last_change":"2024-09-16T00:58:43.607443+0000","last_active":"2024-09-16T00:58:46.560633+0000","last_peered":"2024-09-16T00:58:46.560633+0000","last_clean":"2024-09-16T00:58:46.560633+0000","last_became_active":"2024-09-16T00:58:43.607019+0000","last_became_peered":"2024-09-16T00:58:43.607019+0000","last_unstale":"2024-09-16T00:58:46.560633+0000","last_undegraded":"2024-09-16T00:58:46.560633+0000","last_fullsized":"2024-09-16T00:58:46.560633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:45.076547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587910+0000","last_change":"2024-09-16T00:58:36.509749+0000","last_active":"2024-09-16T00:58:46.587910+0000","last_peered":"2024-09-16T00:58:46.587910+0000","last_clean":"2024-09-16T00:58:46.587910+0000","last_became_active":"2024-09-16T00:58:36.509411+0000","last_became_peered":"2024-09-16T00:58:36.509411+0000","last_unstale":"2024-09-16T00:58:46.587910+0000","last_undegraded":"2024-09-16T00:58:46.587910+0000","last_fullsized":"2024-09-16T00:58:46.587910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:14.291956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.585623+0000","last_change":"2024-09-16T00:58:34.470190+0000","last_active":"2024-09-16T00:59:21.585623+0000","last_peered":"2024-09-16T00:59:21.585623+0000","last_clean":"2024-09-16T00:59:21.585623+0000","last_became_active":"2024-09-16T00:58:34.469832+0000","last_became_peered":"2024-09-16T00:58:34.469832+0000","last_unstale":"2024-09-16T00:59:21.585623+0000","last_undegraded":"2024-09-16T00:59:21.585623+0000","last_fullsized":"2024-09-16T00:59:21.585623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:03.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808815+0000","last_change":"2024-09-16T00:57:23.502001+0000","last_active":"2024-09-16T00:58:46.808815+0000","last_peered":"2024-09-16T00:58:46.808815+0000","last_clean":"2024-09-16T00:58:46.808815+0000","last_became_active":"2024-09-16T00:57:23.501465+0000","last_became_peered":"2024-09-16T00:57:23.501465+0000","last_unstale":"2024-09-16T00:58:46.808815+0000","last_undegraded":"2024-09-16T00:58:46.808815+0000","last_fullsized":"2024-09-16T00:58:46.808815+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_clean_scrub_stamp":"2024-09-16T00:53:57.344038+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:22.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.845945+0000","last_change":"2024-09-16T00:58:43.609572+0000","last_active":"2024-09-16T00:58:46.845945+0000","last_peered":"2024-09-16T00:58:46.845945+0000","last_clean":"2024-09-16T00:58:46.845945+0000","last_became_active":"2024-09-16T00:58:43.609185+0000","last_became_peered":"2024-09-16T00:58:43.609185+0000","last_unstale":"2024-09-16T00:58:46.845945+0000","last_undegraded":"2024-09-16T00:58:46.845945+0000","last_fullsized":"2024-09-16T00:58:46.845945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.199976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810018+0000","last_change":"2024-09-16T00:58:36.510761+0000","last_active":"2024-09-16T00:58:46.810018+0000","last_peered":"2024-09-16T00:58:46.810018+0000","last_clean":"2024-09-16T00:58:46.810018+0000","last_became_active":"2024-09-16T00:58:36.510456+0000","last_became_peered":"2024-09-16T00:58:36.510456+0000","last_unstale":"2024-09-16T00:58:46.810018+0000","last_undegraded":"2024-09-16T00:58:46.810018+0000","last_fullsized":"2024-09-16T00:58:46.810018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:02.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:30.589778+0000","last_change":"2024-09-16T00:58:34.830238+0000","last_active":"2024-09-16T00:59:30.589778+0000","last_peered":"2024-09-16T00:59:30.589778+0000","last_clean":"2024-09-16T00:59:30.589778+0000","last_became_active":"2024-09-16T00:58:34.829558+0000","last_became_peered":"2024-09-16T00:58:34.829558+0000","last_unstale":"2024-09-16T00:59:30.589778+0000","last_undegraded":"2024-09-16T00:59:30.589778+0000","last_fullsized":"2024-09-16T00:59:30.589778+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.347122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809029+0000","last_change":"2024-09-16T00:58:43.613179+0000","last_active":"2024-09-16T00:58:46.809029+0000","last_peered":"2024-09-16T00:58:46.809029+0000","last_clean":"2024-09-16T00:58:46.809029+0000","last_became_active":"2024-09-16T00:58:43.612794+0000","last_became_peered":"2024-09-16T00:58:43.612794+0000","last_unstale":"2024-09-16T00:58:46.809029+0000","last_undegraded":"2024-09-16T00:58:46.809029+0000","last_fullsized":"2024-09-16T00:58:46.809029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:04:24.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809767+0000","last_change":"2024-09-16T00:58:36.512600+0000","last_active":"2024-09-16T00:58:46.809767+0000","last_peered":"2024-09-16T00:58:46.809767+0000","last_clean":"2024-09-16T00:58:46.809767+0000","last_became_active":"2024-09-16T00:58:36.512309+0000","last_became_peered":"2024-09-16T00:58:36.512309+0000","last_unstale":"2024-09-16T00:58:46.809767+0000","last_undegraded":"2024-09-16T00:58:46.809767+0000","last_fullsized":"2024-09-16T00:58:46.809767+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.790755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.571663+0000","last_change":"2024-09-16T00:58:34.471787+0000","last_active":"2024-09-16T00:59:21.571663+0000","last_peered":"2024-09-16T00:59:21.571663+0000","last_clean":"2024-09-16T00:59:21.571663+0000","last_became_active":"2024-09-16T00:58:34.471119+0000","last_became_peered":"2024-09-16T00:58:34.471119+0000","last_unstale":"2024-09-16T00:59:21.571663+0000","last_undegraded":"2024-09-16T00:59:21.571663+0000","last_fullsized":"2024-09-16T00:59:21.571663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:26.121669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962180+0000","last_change":"2024-09-16T00:58:43.609676+0000","last_active":"2024-09-16T00:58:46.962180+0000","last_peered":"2024-09-16T00:58:46.962180+0000","last_clean":"2024-09-16T00:58:46.962180+0000","last_became_active":"2024-09-16T00:58:43.609313+0000","last_became_peered":"2024-09-16T00:58:43.609313+0000","last_unstale":"2024-09-16T00:58:46.962180+0000","last_undegraded":"2024-09-16T00:58:46.962180+0000","last_fullsized":"2024-09-16T00:58:46.962180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:53.339070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810171+0000","last_change":"2024-09-16T00:58:36.514621+0000","last_active":"2024-09-16T00:58:46.810171+0000","last_peered":"2024-09-16T00:58:46.810171+0000","last_clean":"2024-09-16T00:58:46.810171+0000","last_became_active":"2024-09-16T00:58:36.514259+0000","last_became_peered":"2024-09-16T00:58:36.514259+0000","last_unstale":"2024-09-16T00:58:46.810171+0000","last_undegraded":"2024-09-16T00:58:46.810171+0000","last_fullsized":"2024-09-16T00:58:46.810171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:11.411742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.582994+0000","last_change":"2024-09-16T00:58:34.470512+0000","last_active":"2024-09-16T00:59:21.582994+0000","last_peered":"2024-09-16T00:59:21.582994+0000","last_clean":"2024-09-16T00:59:21.582994+0000","last_became_active":"2024-09-16T00:58:34.470140+0000","last_became_peered":"2024-09-16T00:58:34.470140+0000","last_unstale":"2024-09-16T00:59:21.582994+0000","last_undegraded":"2024-09-16T00:59:21.582994+0000","last_fullsized":"2024-09-16T00:59:21.582994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:04.068901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559846+0000","last_change":"2024-09-16T00:58:43.615221+0000","last_active":"2024-09-16T00:58:46.559846+0000","last_peered":"2024-09-16T00:58:46.559846+0000","last_clean":"2024-09-16T00:58:46.559846+0000","last_became_active":"2024-09-16T00:58:43.614820+0000","last_became_peered":"2024-09-16T00:58:43.614820+0000","last_unstale":"2024-09-16T00:58:46.559846+0000","last_undegraded":"2024-09-16T00:58:46.559846+0000","last_fullsized":"2024-09-16T00:58:46.559846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:31.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809637+0000","last_change":"2024-09-16T00:58:36.515470+0000","last_active":"2024-09-16T00:58:46.809637+0000","last_peered":"2024-09-16T00:58:46.809637+0000","last_clean":"2024-09-16T00:58:46.809637+0000","last_became_active":"2024-09-16T00:58:36.515145+0000","last_became_peered":"2024-09-16T00:58:36.515145+0000","last_unstale":"2024-09-16T00:58:46.809637+0000","last_undegraded":"2024-09-16T00:58:46.809637+0000","last_fullsized":"2024-09-16T00:58:46.809637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:10.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:20.760881+0000","last_change":"2024-09-16T00:58:34.464865+0000","last_active":"2024-09-16T00:59:20.760881+0000","last_peered":"2024-09-16T00:59:20.760881+0000","last_clean":"2024-09-16T00:59:20.760881+0000","last_became_active":"2024-09-16T00:58:34.464448+0000","last_became_peered":"2024-09-16T00:58:34.464448+0000","last_unstale":"2024-09-16T00:59:20.760881+0000","last_undegraded":"2024-09-16T00:59:20.760881+0000","last_fullsized":"2024-09-16T00:59:20.760881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:47.454251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560114+0000","last_change":"2024-09-16T00:58:43.610348+0000","last_active":"2024-09-16T00:58:46.560114+0000","last_peered":"2024-09-16T00:58:46.560114+0000","last_clean":"2024-09-16T00:58:46.560114+0000","last_became_active":"2024-09-16T00:58:43.609497+0000","last_became_peered":"2024-09-16T00:58:43.609497+0000","last_unstale":"2024-09-16T00:58:46.560114+0000","last_undegraded":"2024-09-16T00:58:46.560114+0000","last_fullsized":"2024-09-16T00:58:46.560114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:52.931325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560040+0000","last_change":"2024-09-16T00:58:36.517412+0000","last_active":"2024-09-16T00:58:46.560040+0000","last_peered":"2024-09-16T00:58:46.560040+0000","last_clean":"2024-09-16T00:58:46.560040+0000","last_became_active":"2024-09-16T00:58:36.516600+0000","last_became_peered":"2024-09-16T00:58:36.516600+0000","last_unstale":"2024-09-16T00:58:46.560040+0000","last_undegraded":"2024-09-16T00:58:46.560040+0000","last_fullsized":"2024-09-16T00:58:46.560040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:39.445454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.572895+0000","last_change":"2024-09-16T00:58:34.831420+0000","last_active":"2024-09-16T00:59:21.572895+0000","last_peered":"2024-09-16T00:59:21.572895+0000","last_clean":"2024-09-16T00:59:21.572895+0000","last_became_active":"2024-09-16T00:58:34.830991+0000","last_became_peered":"2024-09-16T00:58:34.830991+0000","last_unstale":"2024-09-16T00:59:21.572895+0000","last_undegraded":"2024-09-16T00:59:21.572895+0000","last_fullsized":"2024-09-16T00:59:21.572895+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:13.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560210+0000","last_change":"2024-09-16T00:58:43.611781+0000","last_active":"2024-09-16T00:58:46.560210+0000","last_peered":"2024-09-16T00:58:46.560210+0000","last_clean":"2024-09-16T00:58:46.560210+0000","last_became_active":"2024-09-16T00:58:43.610332+0000","last_became_peered":"2024-09-16T00:58:43.610332+0000","last_unstale":"2024-09-16T00:58:46.560210+0000","last_undegraded":"2024-09-16T00:58:46.560210+0000","last_fullsized":"2024-09-16T00:58:46.560210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:18.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808628+0000","last_change":"2024-09-16T00:58:36.514395+0000","last_active":"2024-09-16T00:58:46.808628+0000","last_peered":"2024-09-16T00:58:46.808628+0000","last_clean":"2024-09-16T00:58:46.808628+0000","last_became_active":"2024-09-16T00:58:36.513570+0000","last_became_peered":"2024-09-16T00:58:36.513570+0000","last_unstale":"2024-09-16T00:58:46.808628+0000","last_undegraded":"2024-09-16T00:58:46.808628+0000","last_fullsized":"2024-09-16T00:58:46.808628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:56.148815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:31.590807+0000","last_change":"2024-09-16T00:58:34.473583+0000","last_active":"2024-09-16T00:59:31.590807+0000","last_peered":"2024-09-16T00:59:31.590807+0000","last_clean":"2024-09-16T00:59:31.590807+0000","last_became_active":"2024-09-16T00:58:34.473259+0000","last_became_peered":"2024-09-16T00:58:34.473259+0000","last_unstale":"2024-09-16T00:59:31.590807+0000","last_undegraded":"2024-09-16T00:59:31.590807+0000","last_fullsized":"2024-09-16T00:59:31.590807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:55.622609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809848+0000","last_change":"2024-09-16T00:58:43.614282+0000","last_active":"2024-09-16T00:58:46.809848+0000","last_peered":"2024-09-16T00:58:46.809848+0000","last_clean":"2024-09-16T00:58:46.809848+0000","last_became_active":"2024-09-16T00:58:43.613873+0000","last_became_peered":"2024-09-16T00:58:43.613873+0000","last_unstale":"2024-09-16T00:58:46.809848+0000","last_undegraded":"2024-09-16T00:58:46.809848+0000","last_fullsized":"2024-09-16T00:58:46.809848+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:57.421234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809388+0000","last_change":"2024-09-16T00:58:36.519735+0000","last_active":"2024-09-16T00:58:46.809388+0000","last_peered":"2024-09-16T00:58:46.809388+0000","last_clean":"2024-09-16T00:58:46.809388+0000","last_became_active":"2024-09-16T00:58:36.519431+0000","last_became_peered":"2024-09-16T00:58:36.519431+0000","last_unstale":"2024-09-16T00:58:46.809388+0000","last_undegraded":"2024-09-16T00:58:46.809388+0000","last_fullsized":"2024-09-16T00:58:46.809388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:05.976023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.585233+0000","last_change":"2024-09-16T00:58:34.470326+0000","last_active":"2024-09-16T00:59:21.585233+0000","last_peered":"2024-09-16T00:59:21.585233+0000","last_clean":"2024-09-16T00:59:21.585233+0000","last_became_active":"2024-09-16T00:58:34.469920+0000","last_became_peered":"2024-09-16T00:58:34.469920+0000","last_unstale":"2024-09-16T00:59:21.585233+0000","last_undegraded":"2024-09-16T00:59:21.585233+0000","last_fullsized":"2024-09-16T00:59:21.585233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:58.718004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809299+0000","last_change":"2024-09-16T00:58:43.616324+0000","last_active":"2024-09-16T00:58:46.809299+0000","last_peered":"2024-09-16T00:58:46.809299+0000","last_clean":"2024-09-16T00:58:46.809299+0000","last_became_active":"2024-09-16T00:58:43.615903+0000","last_became_peered":"2024-09-16T00:58:43.615903+0000","last_unstale":"2024-09-16T00:58:46.809299+0000","last_undegraded":"2024-09-16T00:58:46.809299+0000","last_fullsized":"2024-09-16T00:58:46.809299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.683788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559735+0000","last_change":"2024-09-16T00:58:36.512490+0000","last_active":"2024-09-16T00:58:46.559735+0000","last_peered":"2024-09-16T00:58:46.559735+0000","last_clean":"2024-09-16T00:58:46.559735+0000","last_became_active":"2024-09-16T00:58:36.512167+0000","last_became_peered":"2024-09-16T00:58:36.512167+0000","last_unstale":"2024-09-16T00:58:46.559735+0000","last_undegraded":"2024-09-16T00:58:46.559735+0000","last_fullsized":"2024-09-16T00:58:46.559735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.584948+0000","last_change":"2024-09-16T00:58:34.471603+0000","last_active":"2024-09-16T00:59:21.584948+0000","last_peered":"2024-09-16T00:59:21.584948+0000","last_clean":"2024-09-16T00:59:21.584948+0000","last_became_active":"2024-09-16T00:58:34.471241+0000","last_became_peered":"2024-09-16T00:58:34.471241+0000","last_unstale":"2024-09-16T00:59:21.584948+0000","last_undegraded":"2024-09-16T00:59:21.584948+0000","last_fullsized":"2024-09-16T00:59:21.584948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:33.756759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560595+0000","last_change":"2024-09-16T00:58:43.607428+0000","last_active":"2024-09-16T00:58:46.560595+0000","last_peered":"2024-09-16T00:58:46.560595+0000","last_clean":"2024-09-16T00:58:46.560595+0000","last_became_active":"2024-09-16T00:58:43.606990+0000","last_became_peered":"2024-09-16T00:58:43.606990+0000","last_unstale":"2024-09-16T00:58:46.560595+0000","last_undegraded":"2024-09-16T00:58:46.560595+0000","last_fullsized":"2024-09-16T00:58:46.560595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:52.367384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809424+0000","last_change":"2024-09-16T00:58:36.513967+0000","last_active":"2024-09-16T00:58:46.809424+0000","last_peered":"2024-09-16T00:58:46.809424+0000","last_clean":"2024-09-16T00:58:46.809424+0000","last_became_active":"2024-09-16T00:58:36.513610+0000","last_became_peered":"2024-09-16T00:58:36.513610+0000","last_unstale":"2024-09-16T00:58:46.809424+0000","last_undegraded":"2024-09-16T00:58:46.809424+0000","last_fullsized":"2024-09-16T00:58:46.809424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:22.763430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'31","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:33.595779+0000","last_change":"2024-09-16T00:58:34.471511+0000","last_active":"2024-09-16T00:59:33.595779+0000","last_peered":"2024-09-16T00:59:33.595779+0000","last_clean":"2024-09-16T00:59:33.595779+0000","last_became_active":"2024-09-16T00:58:34.470597+0000","last_became_peered":"2024-09-16T00:58:34.470597+0000","last_unstale":"2024-09-16T00:59:33.595779+0000","last_undegraded":"2024-09-16T00:59:33.595779+0000","last_fullsized":"2024-09-16T00:59:33.595779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.782592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51899,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":67,"num_write":33,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809461+0000","last_change":"2024-09-16T00:58:43.612177+0000","last_active":"2024-09-16T00:58:46.809461+0000","last_peered":"2024-09-16T00:58:46.809461+0000","last_clean":"2024-09-16T00:58:46.809461+0000","last_became_active":"2024-09-16T00:58:43.611801+0000","last_became_peered":"2024-09-16T00:58:43.611801+0000","last_unstale":"2024-09-16T00:58:46.809461+0000","last_undegraded":"2024-09-16T00:58:46.809461+0000","last_fullsized":"2024-09-16T00:58:46.809461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.781429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809467+0000","last_change":"2024-09-16T00:58:36.502231+0000","last_active":"2024-09-16T00:58:46.809467+0000","last_peered":"2024-09-16T00:58:46.809467+0000","last_clean":"2024-09-16T00:58:46.809467+0000","last_became_active":"2024-09-16T00:58:36.501934+0000","last_became_peered":"2024-09-16T00:58:36.501934+0000","last_unstale":"2024-09-16T00:58:46.809467+0000","last_undegraded":"2024-09-16T00:58:46.809467+0000","last_fullsized":"2024-09-16T00:58:46.809467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:29.769186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:20.769468+0000","last_change":"2024-09-16T00:58:34.829872+0000","last_active":"2024-09-16T00:59:20.769468+0000","last_peered":"2024-09-16T00:59:20.769468+0000","last_clean":"2024-09-16T00:59:20.769468+0000","last_became_active":"2024-09-16T00:58:34.829496+0000","last_became_peered":"2024-09-16T00:58:34.829496+0000","last_unstale":"2024-09-16T00:59:20.769468+0000","last_undegraded":"2024-09-16T00:59:20.769468+0000","last_fullsized":"2024-09-16T00:59:20.769468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:47.035177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560841+0000","last_change":"2024-09-16T00:58:43.615560+0000","last_active":"2024-09-16T00:58:46.560841+0000","last_peered":"2024-09-16T00:58:46.560841+0000","last_clean":"2024-09-16T00:58:46.560841+0000","last_became_active":"2024-09-16T00:58:43.615124+0000","last_became_peered":"2024-09-16T00:58:43.615124+0000","last_unstale":"2024-09-16T00:58:46.560841+0000","last_undegraded":"2024-09-16T00:58:46.560841+0000","last_fullsized":"2024-09-16T00:58:46.560841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.455528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962517+0000","last_change":"2024-09-16T00:58:36.514456+0000","last_active":"2024-09-16T00:58:46.962517+0000","last_peered":"2024-09-16T00:58:46.962517+0000","last_clean":"2024-09-16T00:58:46.962517+0000","last_became_active":"2024-09-16T00:58:36.514146+0000","last_became_peered":"2024-09-16T00:58:36.514146+0000","last_unstale":"2024-09-16T00:58:46.962517+0000","last_undegraded":"2024-09-16T00:58:46.962517+0000","last_fullsized":"2024-09-16T00:58:46.962517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:06.760121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.583564+0000","last_change":"2024-09-16T00:58:34.471316+0000","last_active":"2024-09-16T00:59:21.583564+0000","last_peered":"2024-09-16T00:59:21.583564+0000","last_clean":"2024-09-16T00:59:21.583564+0000","last_became_active":"2024-09-16T00:58:34.470991+0000","last_became_peered":"2024-09-16T00:58:34.470991+0000","last_unstale":"2024-09-16T00:59:21.583564+0000","last_undegraded":"2024-09-16T00:59:21.583564+0000","last_fullsized":"2024-09-16T00:59:21.583564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:44.492439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809238+0000","last_change":"2024-09-16T00:58:43.617202+0000","last_active":"2024-09-16T00:58:46.809238+0000","last_peered":"2024-09-16T00:58:46.809238+0000","last_clean":"2024-09-16T00:58:46.809238+0000","last_became_active":"2024-09-16T00:58:43.616824+0000","last_became_peered":"2024-09-16T00:58:43.616824+0000","last_unstale":"2024-09-16T00:58:46.809238+0000","last_undegraded":"2024-09-16T00:58:46.809238+0000","last_fullsized":"2024-09-16T00:58:46.809238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:43.035003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810116+0000","last_change":"2024-09-16T00:58:36.512079+0000","last_active":"2024-09-16T00:58:46.810116+0000","last_peered":"2024-09-16T00:58:46.810116+0000","last_clean":"2024-09-16T00:58:46.810116+0000","last_became_active":"2024-09-16T00:58:36.511220+0000","last_became_peered":"2024-09-16T00:58:36.511220+0000","last_unstale":"2024-09-16T00:58:46.810116+0000","last_undegraded":"2024-09-16T00:58:46.810116+0000","last_fullsized":"2024-09-16T00:58:46.810116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:49.798132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:33.593141+0000","last_change":"2024-09-16T00:58:34.470682+0000","last_active":"2024-09-16T00:59:33.593141+0000","last_peered":"2024-09-16T00:59:33.593141+0000","last_clean":"2024-09-16T00:59:33.593141+0000","last_became_active":"2024-09-16T00:58:34.470323+0000","last_became_peered":"2024-09-16T00:58:34.470323+0000","last_unstale":"2024-09-16T00:59:33.593141+0000","last_undegraded":"2024-09-16T00:59:33.593141+0000","last_fullsized":"2024-09-16T00:59:33.593141+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.361374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587947+0000","last_change":"2024-09-16T00:58:43.608941+0000","last_active":"2024-09-16T00:58:46.587947+0000","last_peered":"2024-09-16T00:58:46.587947+0000","last_clean":"2024-09-16T00:58:46.587947+0000","last_became_active":"2024-09-16T00:58:43.607406+0000","last_became_peered":"2024-09-16T00:58:43.607406+0000","last_unstale":"2024-09-16T00:58:46.587947+0000","last_undegraded":"2024-09-16T00:58:46.587947+0000","last_fullsized":"2024-09-16T00:58:46.587947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:10.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962335+0000","last_change":"2024-09-16T00:58:43.613902+0000","last_active":"2024-09-16T00:58:46.962335+0000","last_peered":"2024-09-16T00:58:46.962335+0000","last_clean":"2024-09-16T00:58:46.962335+0000","last_became_active":"2024-09-16T00:58:43.613530+0000","last_became_peered":"2024-09-16T00:58:43.613530+0000","last_unstale":"2024-09-16T00:58:46.962335+0000","last_undegraded":"2024-09-16T00:58:46.962335+0000","last_fullsized":"2024-09-16T00:58:46.962335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:34.774810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809338+0000","last_change":"2024-09-16T00:58:36.504745+0000","last_active":"2024-09-16T00:58:46.809338+0000","last_peered":"2024-09-16T00:58:46.809338+0000","last_clean":"2024-09-16T00:58:46.809338+0000","last_became_active":"2024-09-16T00:58:36.504400+0000","last_became_peered":"2024-09-16T00:58:36.504400+0000","last_unstale":"2024-09-16T00:58:46.809338+0000","last_undegraded":"2024-09-16T00:58:46.809338+0000","last_fullsized":"2024-09-16T00:58:46.809338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:34.444019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.576425+0000","last_change":"2024-09-16T00:58:34.470285+0000","last_active":"2024-09-16T00:59:21.576425+0000","last_peered":"2024-09-16T00:59:21.576425+0000","last_clean":"2024-09-16T00:59:21.576425+0000","last_became_active":"2024-09-16T00:58:34.469948+0000","last_became_peered":"2024-09-16T00:58:34.469948+0000","last_unstale":"2024-09-16T00:59:21.576425+0000","last_undegraded":"2024-09-16T00:59:21.576425+0000","last_fullsized":"2024-09-16T00:59:21.576425+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:28.553863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809844+0000","last_change":"2024-09-16T00:58:43.614818+0000","last_active":"2024-09-16T00:58:46.809844+0000","last_peered":"2024-09-16T00:58:46.809844+0000","last_clean":"2024-09-16T00:58:46.809844+0000","last_became_active":"2024-09-16T00:58:43.614376+0000","last_became_peered":"2024-09-16T00:58:43.614376+0000","last_unstale":"2024-09-16T00:58:46.809844+0000","last_undegraded":"2024-09-16T00:58:46.809844+0000","last_fullsized":"2024-09-16T00:58:46.809844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:41.699930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587872+0000","last_change":"2024-09-16T00:58:36.505127+0000","last_active":"2024-09-16T00:58:46.587872+0000","last_peered":"2024-09-16T00:58:46.587872+0000","last_clean":"2024-09-16T00:58:46.587872+0000","last_became_active":"2024-09-16T00:58:36.504552+0000","last_became_peered":"2024-09-16T00:58:36.504552+0000","last_unstale":"2024-09-16T00:58:46.587872+0000","last_undegraded":"2024-09-16T00:58:46.587872+0000","last_fullsized":"2024-09-16T00:58:46.587872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:48.104109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:19.764899+0000","last_change":"2024-09-16T00:58:34.462231+0000","last_active":"2024-09-16T00:59:19.764899+0000","last_peered":"2024-09-16T00:59:19.764899+0000","last_clean":"2024-09-16T00:59:19.764899+0000","last_became_active":"2024-09-16T00:58:34.461891+0000","last_became_peered":"2024-09-16T00:58:34.461891+0000","last_unstale":"2024-09-16T00:59:19.764899+0000","last_undegraded":"2024-09-16T00:59:19.764899+0000","last_fullsized":"2024-09-16T00:59:19.764899+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.483996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:20.770828+0000","last_change":"2024-09-16T00:58:34.472457+0000","last_active":"2024-09-16T00:59:20.770828+0000","last_peered":"2024-09-16T00:59:20.770828+0000","last_clean":"2024-09-16T00:59:20.770828+0000","last_became_active":"2024-09-16T00:58:34.472084+0000","last_became_peered":"2024-09-16T00:58:34.472084+0000","last_unstale":"2024-09-16T00:59:20.770828+0000","last_undegraded":"2024-09-16T00:59:20.770828+0000","last_fullsized":"2024-09-16T00:59:20.770828+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:08.005195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560409+0000","last_change":"2024-09-16T00:58:36.508791+0000","last_active":"2024-09-16T00:58:46.560409+0000","last_peered":"2024-09-16T00:58:46.560409+0000","last_clean":"2024-09-16T00:58:46.560409+0000","last_became_active":"2024-09-16T00:58:36.508461+0000","last_became_peered":"2024-09-16T00:58:36.508461+0000","last_unstale":"2024-09-16T00:58:46.560409+0000","last_undegraded":"2024-09-16T00:58:46.560409+0000","last_fullsized":"2024-09-16T00:58:46.560409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.938067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809557+0000","last_change":"2024-09-16T00:58:43.620439+0000","last_active":"2024-09-16T00:58:46.809557+0000","last_peered":"2024-09-16T00:58:46.809557+0000","last_clean":"2024-09-16T00:58:46.809557+0000","last_became_active":"2024-09-16T00:58:43.619952+0000","last_became_peered":"2024-09-16T00:58:43.619952+0000","last_unstale":"2024-09-16T00:58:46.809557+0000","last_undegraded":"2024-09-16T00:58:46.809557+0000","last_fullsized":"2024-09-16T00:58:46.809557+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:30.589767+0000","last_change":"2024-09-16T00:58:34.473169+0000","last_active":"2024-09-16T00:59:30.589767+0000","last_peered":"2024-09-16T00:59:30.589767+0000","last_clean":"2024-09-16T00:59:30.589767+0000","last_became_active":"2024-09-16T00:58:34.472839+0000","last_became_peered":"2024-09-16T00:58:34.472839+0000","last_unstale":"2024-09-16T00:59:30.589767+0000","last_undegraded":"2024-09-16T00:59:30.589767+0000","last_fullsized":"2024-09-16T00:59:30.589767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:03.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810474+0000","last_change":"2024-09-16T00:58:36.508719+0000","last_active":"2024-09-16T00:58:46.810474+0000","last_peered":"2024-09-16T00:58:46.810474+0000","last_clean":"2024-09-16T00:58:46.810474+0000","last_became_active":"2024-09-16T00:58:36.508427+0000","last_became_peered":"2024-09-16T00:58:36.508427+0000","last_unstale":"2024-09-16T00:58:46.810474+0000","last_undegraded":"2024-09-16T00:58:46.810474+0000","last_fullsized":"2024-09-16T00:58:46.810474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:44.134558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809823+0000","last_change":"2024-09-16T00:58:43.616532+0000","last_active":"2024-09-16T00:58:46.809823+0000","last_peered":"2024-09-16T00:58:46.809823+0000","last_clean":"2024-09-16T00:58:46.809823+0000","last_became_active":"2024-09-16T00:58:43.616146+0000","last_became_peered":"2024-09-16T00:58:43.616146+0000","last_unstale":"2024-09-16T00:58:46.809823+0000","last_undegraded":"2024-09-16T00:58:46.809823+0000","last_fullsized":"2024-09-16T00:58:46.809823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:50.904766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809268+0000","last_change":"2024-09-16T00:58:36.513232+0000","last_active":"2024-09-16T00:58:46.809268+0000","last_peered":"2024-09-16T00:58:46.809268+0000","last_clean":"2024-09-16T00:58:46.809268+0000","last_became_active":"2024-09-16T00:58:36.512239+0000","last_became_peered":"2024-09-16T00:58:36.512239+0000","last_unstale":"2024-09-16T00:58:46.809268+0000","last_undegraded":"2024-09-16T00:58:46.809268+0000","last_fullsized":"2024-09-16T00:58:46.809268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809152+0000","last_change":"2024-09-16T00:58:36.513160+0000","last_active":"2024-09-16T00:58:46.809152+0000","last_peered":"2024-09-16T00:58:46.809152+0000","last_clean":"2024-09-16T00:58:46.809152+0000","last_became_active":"2024-09-16T00:58:36.512523+0000","last_became_peered":"2024-09-16T00:58:36.512523+0000","last_unstale":"2024-09-16T00:58:46.809152+0000","last_undegraded":"2024-09-16T00:58:46.809152+0000","last_fullsized":"2024-09-16T00:58:46.809152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:20.934937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808812+0000","last_change":"2024-09-16T00:58:36.516416+0000","last_active":"2024-09-16T00:58:46.808812+0000","last_peered":"2024-09-16T00:58:46.808812+0000","last_clean":"2024-09-16T00:58:46.808812+0000","last_became_active":"2024-09-16T00:58:36.516121+0000","last_became_peered":"2024-09-16T00:58:36.516121+0000","last_unstale":"2024-09-16T00:58:46.808812+0000","last_undegraded":"2024-09-16T00:58:46.808812+0000","last_fullsized":"2024-09-16T00:58:46.808812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:28.848616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962177+0000","last_change":"2024-09-16T00:58:36.510854+0000","last_active":"2024-09-16T00:58:46.962177+0000","last_peered":"2024-09-16T00:58:46.962177+0000","last_clean":"2024-09-16T00:58:46.962177+0000","last_became_active":"2024-09-16T00:58:36.510505+0000","last_became_peered":"2024-09-16T00:58:36.510505+0000","last_unstale":"2024-09-16T00:58:46.962177+0000","last_undegraded":"2024-09-16T00:58:46.962177+0000","last_fullsized":"2024-09-16T00:58:46.962177+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.699942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559948+0000","last_change":"2024-09-16T00:58:36.509016+0000","last_active":"2024-09-16T00:58:46.559948+0000","last_peered":"2024-09-16T00:58:46.559948+0000","last_clean":"2024-09-16T00:58:46.559948+0000","last_became_active":"2024-09-16T00:58:36.508690+0000","last_became_peered":"2024-09-16T00:58:36.508690+0000","last_unstale":"2024-09-16T00:58:46.559948+0000","last_undegraded":"2024-09-16T00:58:46.559948+0000","last_fullsized":"2024-09-16T00:58:46.559948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:41.425016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810367+0000","last_change":"2024-09-16T00:58:36.511659+0000","last_active":"2024-09-16T00:58:46.810367+0000","last_peered":"2024-09-16T00:58:46.810367+0000","last_clean":"2024-09-16T00:58:46.810367+0000","last_became_active":"2024-09-16T00:58:36.511225+0000","last_became_peered":"2024-09-16T00:58:36.511225+0000","last_unstale":"2024-09-16T00:58:46.810367+0000","last_undegraded":"2024-09-16T00:58:46.810367+0000","last_fullsized":"2024-09-16T00:58:46.810367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:43.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810330+0000","last_change":"2024-09-16T00:58:36.511614+0000","last_active":"2024-09-16T00:58:46.810330+0000","last_peered":"2024-09-16T00:58:46.810330+0000","last_clean":"2024-09-16T00:58:46.810330+0000","last_became_active":"2024-09-16T00:58:36.511304+0000","last_became_peered":"2024-09-16T00:58:36.511304+0000","last_unstale":"2024-09-16T00:58:46.810330+0000","last_undegraded":"2024-09-16T00:58:46.810330+0000","last_fullsized":"2024-09-16T00:58:46.810330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:20.755419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.588337+0000","last_change":"2024-09-16T00:58:36.509399+0000","last_active":"2024-09-16T00:58:46.588337+0000","last_peered":"2024-09-16T00:58:46.588337+0000","last_clean":"2024-09-16T00:58:46.588337+0000","last_became_active":"2024-09-16T00:58:36.509072+0000","last_became_peered":"2024-09-16T00:58:36.509072+0000","last_unstale":"2024-09-16T00:58:46.588337+0000","last_undegraded":"2024-09-16T00:58:46.588337+0000","last_fullsized":"2024-09-16T00:58:46.588337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:29.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559924+0000","last_change":"2024-09-16T00:58:36.506252+0000","last_active":"2024-09-16T00:58:46.559924+0000","last_peered":"2024-09-16T00:58:46.559924+0000","last_clean":"2024-09-16T00:58:46.559924+0000","last_became_active":"2024-09-16T00:58:36.505923+0000","last_became_peered":"2024-09-16T00:58:36.505923+0000","last_unstale":"2024-09-16T00:58:46.559924+0000","last_undegraded":"2024-09-16T00:58:46.559924+0000","last_fullsized":"2024-09-16T00:58:46.559924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:05.332472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587918+0000","last_change":"2024-09-16T00:58:36.506598+0000","last_active":"2024-09-16T00:58:46.587918+0000","last_peered":"2024-09-16T00:58:46.587918+0000","last_clean":"2024-09-16T00:58:46.587918+0000","last_became_active":"2024-09-16T00:58:36.506299+0000","last_became_peered":"2024-09-16T00:58:36.506299+0000","last_unstale":"2024-09-16T00:58:46.587918+0000","last_undegraded":"2024-09-16T00:58:46.587918+0000","last_fullsized":"2024-09-16T00:58:46.587918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.327225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809157+0000","last_change":"2024-09-16T00:58:36.517050+0000","last_active":"2024-09-16T00:58:46.809157+0000","last_peered":"2024-09-16T00:58:46.809157+0000","last_clean":"2024-09-16T00:58:46.809157+0000","last_became_active":"2024-09-16T00:58:36.516745+0000","last_became_peered":"2024-09-16T00:58:36.516745+0000","last_unstale":"2024-09-16T00:58:46.809157+0000","last_undegraded":"2024-09-16T00:58:46.809157+0000","last_fullsized":"2024-09-16T00:58:46.809157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:59.981792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559853+0000","last_change":"2024-09-16T00:58:36.512442+0000","last_active":"2024-09-16T00:58:46.559853+0000","last_peered":"2024-09-16T00:58:46.559853+0000","last_clean":"2024-09-16T00:58:46.559853+0000","last_became_active":"2024-09-16T00:58:36.512132+0000","last_became_peered":"2024-09-16T00:58:36.512132+0000","last_unstale":"2024-09-16T00:58:46.559853+0000","last_undegraded":"2024-09-16T00:58:46.559853+0000","last_fullsized":"2024-09-16T00:58:46.559853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:06.511257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809411+0000","last_change":"2024-09-16T00:58:36.519754+0000","last_active":"2024-09-16T00:58:46.809411+0000","last_peered":"2024-09-16T00:58:46.809411+0000","last_clean":"2024-09-16T00:58:46.809411+0000","last_became_active":"2024-09-16T00:58:36.519378+0000","last_became_peered":"2024-09-16T00:58:36.519378+0000","last_unstale":"2024-09-16T00:58:46.809411+0000","last_undegraded":"2024-09-16T00:58:46.809411+0000","last_fullsized":"2024-09-16T00:58:46.809411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:51.076588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810166+0000","last_change":"2024-09-16T00:58:36.504627+0000","last_active":"2024-09-16T00:58:46.810166+0000","last_peered":"2024-09-16T00:58:46.810166+0000","last_clean":"2024-09-16T00:58:46.810166+0000","last_became_active":"2024-09-16T00:58:36.504282+0000","last_became_peered":"2024-09-16T00:58:36.504282+0000","last_unstale":"2024-09-16T00:58:46.810166+0000","last_undegraded":"2024-09-16T00:58:46.810166+0000","last_fullsized":"2024-09-16T00:58:46.810166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.857181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809795+0000","last_change":"2024-09-16T00:58:36.508971+0000","last_active":"2024-09-16T00:58:46.809795+0000","last_peered":"2024-09-16T00:58:46.809795+0000","last_clean":"2024-09-16T00:58:46.809795+0000","last_became_active":"2024-09-16T00:58:36.508631+0000","last_became_peered":"2024-09-16T00:58:36.508631+0000","last_unstale":"2024-09-16T00:58:46.809795+0000","last_undegraded":"2024-09-16T00:58:46.809795+0000","last_fullsized":"2024-09-16T00:58:46.809795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:17.092613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810108+0000","last_change":"2024-09-16T00:58:36.517255+0000","last_active":"2024-09-16T00:58:46.810108+0000","last_peered":"2024-09-16T00:58:46.810108+0000","last_clean":"2024-09-16T00:58:46.810108+0000","last_became_active":"2024-09-16T00:58:36.516957+0000","last_became_peered":"2024-09-16T00:58:36.516957+0000","last_unstale":"2024-09-16T00:58:46.810108+0000","last_undegraded":"2024-09-16T00:58:46.810108+0000","last_fullsized":"2024-09-16T00:58:46.810108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:34.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808524+0000","last_change":"2024-09-16T00:58:36.516429+0000","last_active":"2024-09-16T00:58:46.808524+0000","last_peered":"2024-09-16T00:58:46.808524+0000","last_clean":"2024-09-16T00:58:46.808524+0000","last_became_active":"2024-09-16T00:58:36.516111+0000","last_became_peered":"2024-09-16T00:58:36.516111+0000","last_unstale":"2024-09-16T00:58:46.808524+0000","last_undegraded":"2024-09-16T00:58:46.808524+0000","last_fullsized":"2024-09-16T00:58:46.808524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:06.120653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962014+0000","last_change":"2024-09-16T00:58:36.512873+0000","last_active":"2024-09-16T00:58:46.962014+0000","last_peered":"2024-09-16T00:58:46.962014+0000","last_clean":"2024-09-16T00:58:46.962014+0000","last_became_active":"2024-09-16T00:58:36.511761+0000","last_became_peered":"2024-09-16T00:58:36.511761+0000","last_unstale":"2024-09-16T00:58:46.962014+0000","last_undegraded":"2024-09-16T00:58:46.962014+0000","last_fullsized":"2024-09-16T00:58:46.962014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:51.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962049+0000","last_change":"2024-09-16T00:58:36.511585+0000","last_active":"2024-09-16T00:58:46.962049+0000","last_peered":"2024-09-16T00:58:46.962049+0000","last_clean":"2024-09-16T00:58:46.962049+0000","last_became_active":"2024-09-16T00:58:36.510479+0000","last_became_peered":"2024-09-16T00:58:36.510479+0000","last_unstale":"2024-09-16T00:58:46.962049+0000","last_undegraded":"2024-09-16T00:58:46.962049+0000","last_fullsized":"2024-09-16T00:58:46.962049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:58.017132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559946+0000","last_change":"2024-09-16T00:58:36.508263+0000","last_active":"2024-09-16T00:58:46.559946+0000","last_peered":"2024-09-16T00:58:46.559946+0000","last_clean":"2024-09-16T00:58:46.559946+0000","last_became_active":"2024-09-16T00:58:36.507979+0000","last_became_peered":"2024-09-16T00:58:36.507979+0000","last_unstale":"2024-09-16T00:58:46.559946+0000","last_undegraded":"2024-09-16T00:58:46.559946+0000","last_fullsized":"2024-09-16T00:58:46.559946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:07.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560922+0000","last_change":"2024-09-16T00:58:36.514981+0000","last_active":"2024-09-16T00:58:46.560922+0000","last_peered":"2024-09-16T00:58:46.560922+0000","last_clean":"2024-09-16T00:58:46.560922+0000","last_became_active":"2024-09-16T00:58:36.510433+0000","last_became_peered":"2024-09-16T00:58:36.510433+0000","last_unstale":"2024-09-16T00:58:46.560922+0000","last_undegraded":"2024-09-16T00:58:46.560922+0000","last_fullsized":"2024-09-16T00:58:46.560922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:10.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809969+0000","last_change":"2024-09-16T00:58:36.521336+0000","last_active":"2024-09-16T00:58:46.809969+0000","last_peered":"2024-09-16T00:58:46.809969+0000","last_clean":"2024-09-16T00:58:46.809969+0000","last_became_active":"2024-09-16T00:58:36.521026+0000","last_became_peered":"2024-09-16T00:58:36.521026+0000","last_unstale":"2024-09-16T00:58:46.809969+0000","last_undegraded":"2024-09-16T00:58:46.809969+0000","last_fullsized":"2024-09-16T00:58:46.809969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:29.409024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810878+0000","last_change":"2024-09-16T00:58:36.518724+0000","last_active":"2024-09-16T00:58:46.810878+0000","last_peered":"2024-09-16T00:58:46.810878+0000","last_clean":"2024-09-16T00:58:46.810878+0000","last_became_active":"2024-09-16T00:58:36.518428+0000","last_became_peered":"2024-09-16T00:58:36.518428+0000","last_unstale":"2024-09-16T00:58:46.810878+0000","last_undegraded":"2024-09-16T00:58:46.810878+0000","last_fullsized":"2024-09-16T00:58:46.810878+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:06.486299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810248+0000","last_change":"2024-09-16T00:58:36.514347+0000","last_active":"2024-09-16T00:58:46.810248+0000","last_peered":"2024-09-16T00:58:46.810248+0000","last_clean":"2024-09-16T00:58:46.810248+0000","last_became_active":"2024-09-16T00:58:36.512243+0000","last_became_peered":"2024-09-16T00:58:36.512243+0000","last_unstale":"2024-09-16T00:58:46.810248+0000","last_undegraded":"2024-09-16T00:58:46.810248+0000","last_fullsized":"2024-09-16T00:58:46.810248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.289541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587777+0000","last_change":"2024-09-16T00:58:36.507649+0000","last_active":"2024-09-16T00:58:46.587777+0000","last_peered":"2024-09-16T00:58:46.587777+0000","last_clean":"2024-09-16T00:58:46.587777+0000","last_became_active":"2024-09-16T00:58:36.507319+0000","last_became_peered":"2024-09-16T00:58:36.507319+0000","last_unstale":"2024-09-16T00:58:46.587777+0000","last_undegraded":"2024-09-16T00:58:46.587777+0000","last_fullsized":"2024-09-16T00:58:46.587777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:39.425444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808908+0000","last_change":"2024-09-16T00:58:36.516797+0000","last_active":"2024-09-16T00:58:46.808908+0000","last_peered":"2024-09-16T00:58:46.808908+0000","last_clean":"2024-09-16T00:58:46.808908+0000","last_became_active":"2024-09-16T00:58:36.516480+0000","last_became_peered":"2024-09-16T00:58:36.516480+0000","last_unstale":"2024-09-16T00:58:46.808908+0000","last_undegraded":"2024-09-16T00:58:46.808908+0000","last_fullsized":"2024-09-16T00:58:46.808908+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:55.262528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810409+0000","last_change":"2024-09-16T00:58:36.517973+0000","last_active":"2024-09-16T00:58:46.810409+0000","last_peered":"2024-09-16T00:58:46.810409+0000","last_clean":"2024-09-16T00:58:46.810409+0000","last_became_active":"2024-09-16T00:58:36.517634+0000","last_became_peered":"2024-09-16T00:58:36.517634+0000","last_unstale":"2024-09-16T00:58:46.810409+0000","last_undegraded":"2024-09-16T00:58:46.810409+0000","last_fullsized":"2024-09-16T00:58:46.810409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:19.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809065+0000","last_change":"2024-09-16T00:58:36.507643+0000","last_active":"2024-09-16T00:58:46.809065+0000","last_peered":"2024-09-16T00:58:46.809065+0000","last_clean":"2024-09-16T00:58:46.809065+0000","last_became_active":"2024-09-16T00:58:36.507263+0000","last_became_peered":"2024-09-16T00:58:36.507263+0000","last_unstale":"2024-09-16T00:58:46.809065+0000","last_undegraded":"2024-09-16T00:58:46.809065+0000","last_fullsized":"2024-09-16T00:58:46.809065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:24.317490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560864+0000","last_change":"2024-09-16T00:58:36.508798+0000","last_active":"2024-09-16T00:58:46.560864+0000","last_peered":"2024-09-16T00:58:46.560864+0000","last_clean":"2024-09-16T00:58:46.560864+0000","last_became_active":"2024-09-16T00:58:36.508490+0000","last_became_peered":"2024-09-16T00:58:36.508490+0000","last_unstale":"2024-09-16T00:58:46.560864+0000","last_undegraded":"2024-09-16T00:58:46.560864+0000","last_fullsized":"2024-09-16T00:58:46.560864+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:44.282270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962370+0000","last_change":"2024-09-16T00:58:36.519065+0000","last_active":"2024-09-16T00:58:46.962370+0000","last_peered":"2024-09-16T00:58:46.962370+0000","last_clean":"2024-09-16T00:58:46.962370+0000","last_became_active":"2024-09-16T00:58:36.518708+0000","last_became_peered":"2024-09-16T00:58:36.518708+0000","last_unstale":"2024-09-16T00:58:46.962370+0000","last_undegraded":"2024-09-16T00:58:46.962370+0000","last_fullsized":"2024-09-16T00:58:46.962370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:10.290341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962272+0000","last_change":"2024-09-16T00:58:36.513018+0000","last_active":"2024-09-16T00:58:46.962272+0000","last_peered":"2024-09-16T00:58:46.962272+0000","last_clean":"2024-09-16T00:58:46.962272+0000","last_became_active":"2024-09-16T00:58:36.511730+0000","last_became_peered":"2024-09-16T00:58:36.511730+0000","last_unstale":"2024-09-16T00:58:46.962272+0000","last_undegraded":"2024-09-16T00:58:46.962272+0000","last_fullsized":"2024-09-16T00:58:46.962272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:20.852121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810006+0000","last_change":"2024-09-16T00:58:36.518265+0000","last_active":"2024-09-16T00:58:46.810006+0000","last_peered":"2024-09-16T00:58:46.810006+0000","last_clean":"2024-09-16T00:58:46.810006+0000","last_became_active":"2024-09-16T00:58:36.517906+0000","last_became_peered":"2024-09-16T00:58:36.517906+0000","last_unstale":"2024-09-16T00:58:46.810006+0000","last_undegraded":"2024-09-16T00:58:46.810006+0000","last_fullsized":"2024-09-16T00:58:46.810006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.255849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58714,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":158,"num_read_kb":149,"num_write":238,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":176142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282150,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612632,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":475643,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841564,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1081344,"data_stored":1113965,"data_compressed":53530,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":479276,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":475558,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462956,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1071664,"data_compressed":53530,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":470684,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":1067246,"data_compressed":53530,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":474758,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":470392,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1019904,"data_stored":524226,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":523613,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":472533,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T00:59:37.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T00:59:37.661 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:38.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:37 smithi012 ceph-mon[31197]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:59:38.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:37 smithi119 ceph-mon[35049]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:59:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 -- 172.21.15.12:0/3193541286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec1036e0 msgr2=0x7f27ec107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 --2- 172.21.15.12:0/3193541286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec1036e0 0x7f27ec107b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009930 tx=0x7f27e002a420 comp rx=0 tx=0).stop 2024-09-16T00:59:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 -- 172.21.15.12:0/3193541286 shutdown_connections 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 --2- 172.21.15.12:0/3193541286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec1082a0 0x7f27ec10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 --2- 172.21.15.12:0/3193541286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec1036e0 0x7f27ec107b90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 --2- 172.21.15.12:0/3193541286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27ec102d30 0x7f27ec103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 -- 172.21.15.12:0/3193541286 >> 172.21.15.12:0/3193541286 conn(0x7f27ec0fc7d0 msgr2=0x7f27ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 -- 172.21.15.12:0/3193541286 shutdown_connections 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 -- 172.21.15.12:0/3193541286 wait complete. 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 Processor -- start 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 -- start start 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.141+0000 7f27f3d53640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec102d30 0x7f27ec1a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f3d53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec1036e0 0x7f27ec1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f3d53640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27ec1082a0 0x7f27ec19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f3d53640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1120c0 con 0x7f27ec1036e0 2024-09-16T00:59:38.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f3d53640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec111f40 con 0x7f27ec1082a0 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f3d53640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec112240 con 0x7f27ec102d30 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f12ee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec1036e0 0x7f27ec1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f12ee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec1036e0 0x7f27ec1a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43792/0 (socket says 172.21.15.12:43792) 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f12ee640 1 -- 172.21.15.12:0/2184186138 learned_addr learned my addr 172.21.15.12:0/2184186138 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f1aef640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec102d30 0x7f27ec1a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f22f0640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27ec1082a0 0x7f27ec19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f12ee640 1 -- 172.21.15.12:0/2184186138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec102d30 msgr2=0x7f27ec1a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f12ee640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec102d30 0x7f27ec1a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f12ee640 1 -- 172.21.15.12:0/2184186138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27ec1082a0 msgr2=0x7f27ec19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f12ee640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27ec1082a0 0x7f27ec19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f12ee640 1 -- 172.21.15.12:0/2184186138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec19aec0 con 0x7f27ec1036e0 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f12ee640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec1036e0 0x7f27ec1a0ac0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f27e0005940 tx=0x7f27e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27eaffd640 1 -- 172.21.15.12:0/2184186138 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e003f030 con 0x7f27ec1036e0 2024-09-16T00:59:38.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f3d53640 1 -- 172.21.15.12:0/2184186138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ec19b150 con 0x7f27ec1036e0 2024-09-16T00:59:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27eaffd640 1 -- 172.21.15.12:0/2184186138 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27e0003ce0 con 0x7f27ec1036e0 2024-09-16T00:59:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27eaffd640 1 -- 172.21.15.12:0/2184186138 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0035070 con 0x7f27ec1036e0 2024-09-16T00:59:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.142+0000 7f27f3d53640 1 -- 172.21.15.12:0/2184186138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ec1a7330 con 0x7f27ec1036e0 2024-09-16T00:59:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.143+0000 7f27f3d53640 1 -- 172.21.15.12:0/2184186138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ec06a850 con 0x7f27ec1036e0 2024-09-16T00:59:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.145+0000 7f27eaffd640 1 -- 172.21.15.12:0/2184186138 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f27e0042030 con 0x7f27ec1036e0 2024-09-16T00:59:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.145+0000 7f27eaffd640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f27d40a32d0 0x7f27d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.145+0000 7f27f1aef640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f27d40a32d0 0x7f27d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.145+0000 7f27eaffd640 1 -- 172.21.15.12:0/2184186138 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f27e00f05b0 con 0x7f27ec1036e0 2024-09-16T00:59:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.146+0000 7f27f1aef640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f27d40a32d0 0x7f27d40a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f27dc005c40 tx=0x7f27dc00a780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:38.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.149+0000 7f27eaffd640 1 -- 172.21.15.12:0/2184186138 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27e00bced0 con 0x7f27ec1036e0 2024-09-16T00:59:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:37 smithi098 ceph-mon[35346]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:59:38.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.322+0000 7f27f3d53640 1 -- 172.21.15.12:0/2184186138 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27ec062630 con 0x7f27d40a32d0 2024-09-16T00:59:38.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.331+0000 7f27eaffd640 1 -- 172.21.15.12:0/2184186138 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340654 (secure 0 0 0) 0x7f27ec062630 con 0x7f27d40a32d0 2024-09-16T00:59:38.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:59:38.336 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-16T00:59:38.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 -- 172.21.15.12:0/2184186138 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f27d40a32d0 msgr2=0x7f27d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:38.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f27d40a32d0 0x7f27d40a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f27dc005c40 tx=0x7f27dc00a780 comp rx=0 tx=0).stop 2024-09-16T00:59:38.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 -- 172.21.15.12:0/2184186138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec1036e0 msgr2=0x7f27ec1a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec1036e0 0x7f27ec1a0ac0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f27e0005940 tx=0x7f27e00042f0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 -- 172.21.15.12:0/2184186138 shutdown_connections 2024-09-16T00:59:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f27d40a32d0 0x7f27d40a5790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27ec1082a0 0x7f27ec19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27ec1036e0 0x7f27ec1a0ac0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 --2- 172.21.15.12:0/2184186138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ec102d30 0x7f27ec1a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 -- 172.21.15.12:0/2184186138 >> 172.21.15.12:0/2184186138 conn(0x7f27ec0fc7d0 msgr2=0x7f27ec0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 -- 172.21.15.12:0/2184186138 shutdown_connections 2024-09-16T00:59:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:38.334+0000 7f27f3d53640 1 -- 172.21.15.12:0/2184186138 wait complete. 2024-09-16T00:59:39.016 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:38 smithi012 ceph-mon[31197]: pgmap v312: 129 pgs: 129 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-16T00:59:39.046 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-16T00:59:36.903834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649316,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":294,"num_read_kb":258,"num_write":421,"num_write_kb":3067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369128,"kb_used_data":11560,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572696,"statfs":{"total":1151940427776,"available":1151562440704,"internally_reserved":0,"allocated":11837440,"data_stored":7628088,"data_compressed":319413,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42080,"num_objects":3,"num_object_clones":0,"num_object_copies":11,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":103,"num_write":28,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003474"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:32.604941+0000","last_change":"2024-09-16T00:58:34.473346+0000","last_active":"2024-09-16T00:59:32.604941+0000","last_peered":"2024-09-16T00:59:32.604941+0000","last_clean":"2024-09-16T00:59:32.604941+0000","last_became_active":"2024-09-16T00:58:34.472992+0000","last_became_peered":"2024-09-16T00:58:34.472992+0000","last_unstale":"2024-09-16T00:59:32.604941+0000","last_undegraded":"2024-09-16T00:59:32.604941+0000","last_fullsized":"2024-09-16T00:59:32.604941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:47.064421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.588202+0000","last_change":"2024-09-16T00:58:36.507955+0000","last_active":"2024-09-16T00:58:46.588202+0000","last_peered":"2024-09-16T00:58:46.588202+0000","last_clean":"2024-09-16T00:58:46.588202+0000","last_became_active":"2024-09-16T00:58:36.507660+0000","last_became_peered":"2024-09-16T00:58:36.507660+0000","last_unstale":"2024-09-16T00:58:46.588202+0000","last_undegraded":"2024-09-16T00:58:46.588202+0000","last_fullsized":"2024-09-16T00:58:46.588202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:05.408460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808783+0000","last_change":"2024-09-16T00:58:43.620365+0000","last_active":"2024-09-16T00:58:46.808783+0000","last_peered":"2024-09-16T00:58:46.808783+0000","last_clean":"2024-09-16T00:58:46.808783+0000","last_became_active":"2024-09-16T00:58:43.619976+0000","last_became_peered":"2024-09-16T00:58:43.619976+0000","last_unstale":"2024-09-16T00:58:46.808783+0000","last_undegraded":"2024-09-16T00:58:46.808783+0000","last_fullsized":"2024-09-16T00:58:46.808783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:37.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.588422+0000","last_change":"2024-09-16T00:58:34.829549+0000","last_active":"2024-09-16T00:58:46.588422+0000","last_peered":"2024-09-16T00:58:46.588422+0000","last_clean":"2024-09-16T00:58:46.588422+0000","last_became_active":"2024-09-16T00:58:34.829180+0000","last_became_peered":"2024-09-16T00:58:34.829180+0000","last_unstale":"2024-09-16T00:58:46.588422+0000","last_undegraded":"2024-09-16T00:58:46.588422+0000","last_fullsized":"2024-09-16T00:58:46.588422+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:40.731288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962477+0000","last_change":"2024-09-16T00:58:36.517190+0000","last_active":"2024-09-16T00:58:46.962477+0000","last_peered":"2024-09-16T00:58:46.962477+0000","last_clean":"2024-09-16T00:58:46.962477+0000","last_became_active":"2024-09-16T00:58:36.516877+0000","last_became_peered":"2024-09-16T00:58:36.516877+0000","last_unstale":"2024-09-16T00:58:46.962477+0000","last_undegraded":"2024-09-16T00:58:46.962477+0000","last_fullsized":"2024-09-16T00:58:46.962477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.408011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560281+0000","last_change":"2024-09-16T00:58:43.617071+0000","last_active":"2024-09-16T00:58:46.560281+0000","last_peered":"2024-09-16T00:58:46.560281+0000","last_clean":"2024-09-16T00:58:46.560281+0000","last_became_active":"2024-09-16T00:58:43.616637+0000","last_became_peered":"2024-09-16T00:58:43.616637+0000","last_unstale":"2024-09-16T00:58:46.560281+0000","last_undegraded":"2024-09-16T00:58:46.560281+0000","last_fullsized":"2024-09-16T00:58:46.560281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:08.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.586267+0000","last_change":"2024-09-16T00:58:34.472375+0000","last_active":"2024-09-16T00:59:21.586267+0000","last_peered":"2024-09-16T00:59:21.586267+0000","last_clean":"2024-09-16T00:59:21.586267+0000","last_became_active":"2024-09-16T00:58:34.471990+0000","last_became_peered":"2024-09-16T00:58:34.471990+0000","last_unstale":"2024-09-16T00:59:21.586267+0000","last_undegraded":"2024-09-16T00:59:21.586267+0000","last_fullsized":"2024-09-16T00:59:21.586267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:15.746005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809287+0000","last_change":"2024-09-16T00:58:36.513747+0000","last_active":"2024-09-16T00:58:46.809287+0000","last_peered":"2024-09-16T00:58:46.809287+0000","last_clean":"2024-09-16T00:58:46.809287+0000","last_became_active":"2024-09-16T00:58:36.512635+0000","last_became_peered":"2024-09-16T00:58:36.512635+0000","last_unstale":"2024-09-16T00:58:46.809287+0000","last_undegraded":"2024-09-16T00:58:46.809287+0000","last_fullsized":"2024-09-16T00:58:46.809287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:39.014961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560583+0000","last_change":"2024-09-16T00:58:43.609355+0000","last_active":"2024-09-16T00:58:46.560583+0000","last_peered":"2024-09-16T00:58:46.560583+0000","last_clean":"2024-09-16T00:58:46.560583+0000","last_became_active":"2024-09-16T00:58:43.608892+0000","last_became_peered":"2024-09-16T00:58:43.608892+0000","last_unstale":"2024-09-16T00:58:46.560583+0000","last_undegraded":"2024-09-16T00:58:46.560583+0000","last_fullsized":"2024-09-16T00:58:46.560583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:20.718163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.586022+0000","last_change":"2024-09-16T00:58:34.469650+0000","last_active":"2024-09-16T00:59:21.586022+0000","last_peered":"2024-09-16T00:59:21.586022+0000","last_clean":"2024-09-16T00:59:21.586022+0000","last_became_active":"2024-09-16T00:58:34.468939+0000","last_became_peered":"2024-09-16T00:58:34.468939+0000","last_unstale":"2024-09-16T00:59:21.586022+0000","last_undegraded":"2024-09-16T00:59:21.586022+0000","last_fullsized":"2024-09-16T00:59:21.586022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:34.511111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560471+0000","last_change":"2024-09-16T00:58:36.518113+0000","last_active":"2024-09-16T00:58:46.560471+0000","last_peered":"2024-09-16T00:58:46.560471+0000","last_clean":"2024-09-16T00:58:46.560471+0000","last_became_active":"2024-09-16T00:58:36.517812+0000","last_became_peered":"2024-09-16T00:58:36.517812+0000","last_unstale":"2024-09-16T00:58:46.560471+0000","last_undegraded":"2024-09-16T00:58:46.560471+0000","last_fullsized":"2024-09-16T00:58:46.560471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:45.204894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560484+0000","last_change":"2024-09-16T00:58:43.612479+0000","last_active":"2024-09-16T00:58:46.560484+0000","last_peered":"2024-09-16T00:58:46.560484+0000","last_clean":"2024-09-16T00:58:46.560484+0000","last_became_active":"2024-09-16T00:58:43.612001+0000","last_became_peered":"2024-09-16T00:58:43.612001+0000","last_unstale":"2024-09-16T00:58:46.560484+0000","last_undegraded":"2024-09-16T00:58:46.560484+0000","last_fullsized":"2024-09-16T00:58:46.560484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:33.056052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809202+0000","last_change":"2024-09-16T00:58:36.519407+0000","last_active":"2024-09-16T00:58:46.809202+0000","last_peered":"2024-09-16T00:58:46.809202+0000","last_clean":"2024-09-16T00:58:46.809202+0000","last_became_active":"2024-09-16T00:58:36.519108+0000","last_became_peered":"2024-09-16T00:58:36.519108+0000","last_unstale":"2024-09-16T00:58:46.809202+0000","last_undegraded":"2024-09-16T00:58:46.809202+0000","last_fullsized":"2024-09-16T00:58:46.809202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:28.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:18.750854+0000","last_change":"2024-09-16T00:58:34.472295+0000","last_active":"2024-09-16T00:59:18.750854+0000","last_peered":"2024-09-16T00:59:18.750854+0000","last_clean":"2024-09-16T00:59:18.750854+0000","last_became_active":"2024-09-16T00:58:34.471968+0000","last_became_peered":"2024-09-16T00:58:34.471968+0000","last_unstale":"2024-09-16T00:59:18.750854+0000","last_undegraded":"2024-09-16T00:59:18.750854+0000","last_fullsized":"2024-09-16T00:59:18.750854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:44.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560784+0000","last_change":"2024-09-16T00:58:43.615870+0000","last_active":"2024-09-16T00:58:46.560784+0000","last_peered":"2024-09-16T00:58:46.560784+0000","last_clean":"2024-09-16T00:58:46.560784+0000","last_became_active":"2024-09-16T00:58:43.615116+0000","last_became_peered":"2024-09-16T00:58:43.615116+0000","last_unstale":"2024-09-16T00:58:46.560784+0000","last_undegraded":"2024-09-16T00:58:46.560784+0000","last_fullsized":"2024-09-16T00:58:46.560784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:44.742792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587943+0000","last_change":"2024-09-16T00:58:36.512485+0000","last_active":"2024-09-16T00:58:46.587943+0000","last_peered":"2024-09-16T00:58:46.587943+0000","last_clean":"2024-09-16T00:58:46.587943+0000","last_became_active":"2024-09-16T00:58:36.512175+0000","last_became_peered":"2024-09-16T00:58:36.512175+0000","last_unstale":"2024-09-16T00:58:46.587943+0000","last_undegraded":"2024-09-16T00:58:46.587943+0000","last_fullsized":"2024-09-16T00:58:46.587943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.328409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:20.771286+0000","last_change":"2024-09-16T00:58:34.469225+0000","last_active":"2024-09-16T00:59:20.771286+0000","last_peered":"2024-09-16T00:59:20.771286+0000","last_clean":"2024-09-16T00:59:20.771286+0000","last_became_active":"2024-09-16T00:58:34.468858+0000","last_became_peered":"2024-09-16T00:58:34.468858+0000","last_unstale":"2024-09-16T00:59:20.771286+0000","last_undegraded":"2024-09-16T00:59:20.771286+0000","last_fullsized":"2024-09-16T00:59:20.771286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:45.499471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560753+0000","last_change":"2024-09-16T00:58:43.610265+0000","last_active":"2024-09-16T00:58:46.560753+0000","last_peered":"2024-09-16T00:58:46.560753+0000","last_clean":"2024-09-16T00:58:46.560753+0000","last_became_active":"2024-09-16T00:58:43.609868+0000","last_became_peered":"2024-09-16T00:58:43.609868+0000","last_unstale":"2024-09-16T00:58:46.560753+0000","last_undegraded":"2024-09-16T00:58:46.560753+0000","last_fullsized":"2024-09-16T00:58:46.560753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:54.689332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809368+0000","last_change":"2024-09-16T00:58:36.512801+0000","last_active":"2024-09-16T00:58:46.809368+0000","last_peered":"2024-09-16T00:58:46.809368+0000","last_clean":"2024-09-16T00:58:46.809368+0000","last_became_active":"2024-09-16T00:58:36.512469+0000","last_became_peered":"2024-09-16T00:58:36.512469+0000","last_unstale":"2024-09-16T00:58:46.809368+0000","last_undegraded":"2024-09-16T00:58:46.809368+0000","last_fullsized":"2024-09-16T00:58:46.809368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:57.951743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.582796+0000","last_change":"2024-09-16T00:58:34.471498+0000","last_active":"2024-09-16T00:59:21.582796+0000","last_peered":"2024-09-16T00:59:21.582796+0000","last_clean":"2024-09-16T00:59:21.582796+0000","last_became_active":"2024-09-16T00:58:34.471093+0000","last_became_peered":"2024-09-16T00:58:34.471093+0000","last_unstale":"2024-09-16T00:59:21.582796+0000","last_undegraded":"2024-09-16T00:59:21.582796+0000","last_fullsized":"2024-09-16T00:59:21.582796+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:35.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809828+0000","last_change":"2024-09-16T00:58:43.616376+0000","last_active":"2024-09-16T00:58:46.809828+0000","last_peered":"2024-09-16T00:58:46.809828+0000","last_clean":"2024-09-16T00:58:46.809828+0000","last_became_active":"2024-09-16T00:58:43.616029+0000","last_became_peered":"2024-09-16T00:58:43.616029+0000","last_unstale":"2024-09-16T00:58:46.809828+0000","last_undegraded":"2024-09-16T00:58:46.809828+0000","last_fullsized":"2024-09-16T00:58:46.809828+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:54.776250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808935+0000","last_change":"2024-09-16T00:58:36.506625+0000","last_active":"2024-09-16T00:58:46.808935+0000","last_peered":"2024-09-16T00:58:46.808935+0000","last_clean":"2024-09-16T00:58:46.808935+0000","last_became_active":"2024-09-16T00:58:36.506337+0000","last_became_peered":"2024-09-16T00:58:36.506337+0000","last_unstale":"2024-09-16T00:58:46.808935+0000","last_undegraded":"2024-09-16T00:58:46.808935+0000","last_fullsized":"2024-09-16T00:58:46.808935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:22.080165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:18.750817+0000","last_change":"2024-09-16T00:58:34.831309+0000","last_active":"2024-09-16T00:59:18.750817+0000","last_peered":"2024-09-16T00:59:18.750817+0000","last_clean":"2024-09-16T00:59:18.750817+0000","last_became_active":"2024-09-16T00:58:34.830980+0000","last_became_peered":"2024-09-16T00:58:34.830980+0000","last_unstale":"2024-09-16T00:59:18.750817+0000","last_undegraded":"2024-09-16T00:59:18.750817+0000","last_fullsized":"2024-09-16T00:59:18.750817+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:30.405426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560718+0000","last_change":"2024-09-16T00:58:43.609399+0000","last_active":"2024-09-16T00:58:46.560718+0000","last_peered":"2024-09-16T00:58:46.560718+0000","last_clean":"2024-09-16T00:58:46.560718+0000","last_became_active":"2024-09-16T00:58:43.608988+0000","last_became_peered":"2024-09-16T00:58:43.608988+0000","last_unstale":"2024-09-16T00:58:46.560718+0000","last_undegraded":"2024-09-16T00:58:46.560718+0000","last_fullsized":"2024-09-16T00:58:46.560718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.500071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962403+0000","last_change":"2024-09-16T00:58:36.515930+0000","last_active":"2024-09-16T00:58:46.962403+0000","last_peered":"2024-09-16T00:58:46.962403+0000","last_clean":"2024-09-16T00:58:46.962403+0000","last_became_active":"2024-09-16T00:58:36.515625+0000","last_became_peered":"2024-09-16T00:58:36.515625+0000","last_unstale":"2024-09-16T00:58:46.962403+0000","last_undegraded":"2024-09-16T00:58:46.962403+0000","last_fullsized":"2024-09-16T00:58:46.962403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:55.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.584254+0000","last_change":"2024-09-16T00:58:34.508686+0000","last_active":"2024-09-16T00:59:21.584254+0000","last_peered":"2024-09-16T00:59:21.584254+0000","last_clean":"2024-09-16T00:59:21.584254+0000","last_became_active":"2024-09-16T00:58:34.508284+0000","last_became_peered":"2024-09-16T00:58:34.508284+0000","last_unstale":"2024-09-16T00:59:21.584254+0000","last_undegraded":"2024-09-16T00:59:21.584254+0000","last_fullsized":"2024-09-16T00:59:21.584254+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:47.545949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808967+0000","last_change":"2024-09-16T00:58:43.615852+0000","last_active":"2024-09-16T00:58:46.808967+0000","last_peered":"2024-09-16T00:58:46.808967+0000","last_clean":"2024-09-16T00:58:46.808967+0000","last_became_active":"2024-09-16T00:58:43.615474+0000","last_became_peered":"2024-09-16T00:58:43.615474+0000","last_unstale":"2024-09-16T00:58:46.808967+0000","last_undegraded":"2024-09-16T00:58:46.808967+0000","last_fullsized":"2024-09-16T00:58:46.808967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:39.596924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.588333+0000","last_change":"2024-09-16T00:58:36.513820+0000","last_active":"2024-09-16T00:58:46.588333+0000","last_peered":"2024-09-16T00:58:46.588333+0000","last_clean":"2024-09-16T00:58:46.588333+0000","last_became_active":"2024-09-16T00:58:36.513513+0000","last_became_peered":"2024-09-16T00:58:36.513513+0000","last_unstale":"2024-09-16T00:58:46.588333+0000","last_undegraded":"2024-09-16T00:58:46.588333+0000","last_fullsized":"2024-09-16T00:58:46.588333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:34.584214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'12","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:31.584665+0000","last_change":"2024-09-16T00:58:34.462794+0000","last_active":"2024-09-16T00:59:31.584665+0000","last_peered":"2024-09-16T00:59:31.584665+0000","last_clean":"2024-09-16T00:59:31.584665+0000","last_became_active":"2024-09-16T00:58:34.462471+0000","last_became_peered":"2024-09-16T00:58:34.462471+0000","last_unstale":"2024-09-16T00:59:31.584665+0000","last_undegraded":"2024-09-16T00:59:31.584665+0000","last_fullsized":"2024-09-16T00:59:31.584665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:13.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587794+0000","last_change":"2024-09-16T00:58:43.607718+0000","last_active":"2024-09-16T00:58:46.587794+0000","last_peered":"2024-09-16T00:58:46.587794+0000","last_clean":"2024-09-16T00:58:46.587794+0000","last_became_active":"2024-09-16T00:58:43.607347+0000","last_became_peered":"2024-09-16T00:58:43.607347+0000","last_unstale":"2024-09-16T00:58:46.587794+0000","last_undegraded":"2024-09-16T00:58:46.587794+0000","last_fullsized":"2024-09-16T00:58:46.587794+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:12.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560021+0000","last_change":"2024-09-16T00:58:36.507161+0000","last_active":"2024-09-16T00:58:46.560021+0000","last_peered":"2024-09-16T00:58:46.560021+0000","last_clean":"2024-09-16T00:58:46.560021+0000","last_became_active":"2024-09-16T00:58:36.504062+0000","last_became_peered":"2024-09-16T00:58:36.504062+0000","last_unstale":"2024-09-16T00:58:46.560021+0000","last_undegraded":"2024-09-16T00:58:46.560021+0000","last_fullsized":"2024-09-16T00:58:46.560021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.572614+0000","last_change":"2024-09-16T00:58:34.829848+0000","last_active":"2024-09-16T00:59:21.572614+0000","last_peered":"2024-09-16T00:59:21.572614+0000","last_clean":"2024-09-16T00:59:21.572614+0000","last_became_active":"2024-09-16T00:58:34.829439+0000","last_became_peered":"2024-09-16T00:58:34.829439+0000","last_unstale":"2024-09-16T00:59:21.572614+0000","last_undegraded":"2024-09-16T00:59:21.572614+0000","last_fullsized":"2024-09-16T00:59:21.572614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:06.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809128+0000","last_change":"2024-09-16T00:58:43.618334+0000","last_active":"2024-09-16T00:58:46.809128+0000","last_peered":"2024-09-16T00:58:46.809128+0000","last_clean":"2024-09-16T00:58:46.809128+0000","last_became_active":"2024-09-16T00:58:43.617810+0000","last_became_peered":"2024-09-16T00:58:43.617810+0000","last_unstale":"2024-09-16T00:58:46.809128+0000","last_undegraded":"2024-09-16T00:58:46.809128+0000","last_fullsized":"2024-09-16T00:58:46.809128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:58.202973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810579+0000","last_change":"2024-09-16T00:58:36.509025+0000","last_active":"2024-09-16T00:58:46.810579+0000","last_peered":"2024-09-16T00:58:46.810579+0000","last_clean":"2024-09-16T00:58:46.810579+0000","last_became_active":"2024-09-16T00:58:36.508660+0000","last_became_peered":"2024-09-16T00:58:36.508660+0000","last_unstale":"2024-09-16T00:58:46.810579+0000","last_undegraded":"2024-09-16T00:58:46.810579+0000","last_fullsized":"2024-09-16T00:58:46.810579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:01.433486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809783+0000","last_change":"2024-09-16T00:58:34.829899+0000","last_active":"2024-09-16T00:58:46.809783+0000","last_peered":"2024-09-16T00:58:46.809783+0000","last_clean":"2024-09-16T00:58:46.809783+0000","last_became_active":"2024-09-16T00:58:34.829546+0000","last_became_peered":"2024-09-16T00:58:34.829546+0000","last_unstale":"2024-09-16T00:58:46.809783+0000","last_undegraded":"2024-09-16T00:58:46.809783+0000","last_fullsized":"2024-09-16T00:58:46.809783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:21.253829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810508+0000","last_change":"2024-09-16T00:58:43.610143+0000","last_active":"2024-09-16T00:58:46.810508+0000","last_peered":"2024-09-16T00:58:46.810508+0000","last_clean":"2024-09-16T00:58:46.810508+0000","last_became_active":"2024-09-16T00:58:43.609739+0000","last_became_peered":"2024-09-16T00:58:43.609739+0000","last_unstale":"2024-09-16T00:58:46.810508+0000","last_undegraded":"2024-09-16T00:58:46.810508+0000","last_fullsized":"2024-09-16T00:58:46.810508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:28.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810522+0000","last_change":"2024-09-16T00:58:36.520423+0000","last_active":"2024-09-16T00:58:46.810522+0000","last_peered":"2024-09-16T00:58:46.810522+0000","last_clean":"2024-09-16T00:58:46.810522+0000","last_became_active":"2024-09-16T00:58:36.520117+0000","last_became_peered":"2024-09-16T00:58:36.520117+0000","last_unstale":"2024-09-16T00:58:46.810522+0000","last_undegraded":"2024-09-16T00:58:46.810522+0000","last_fullsized":"2024-09-16T00:58:46.810522+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.652142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:35.609014+0000","last_change":"2024-09-16T00:58:34.475161+0000","last_active":"2024-09-16T00:59:35.609014+0000","last_peered":"2024-09-16T00:59:35.609014+0000","last_clean":"2024-09-16T00:59:35.609014+0000","last_became_active":"2024-09-16T00:58:34.474755+0000","last_became_peered":"2024-09-16T00:58:34.474755+0000","last_unstale":"2024-09-16T00:59:35.609014+0000","last_undegraded":"2024-09-16T00:59:35.609014+0000","last_fullsized":"2024-09-16T00:59:35.609014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:12.884466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559896+0000","last_change":"2024-09-16T00:58:43.609042+0000","last_active":"2024-09-16T00:58:46.559896+0000","last_peered":"2024-09-16T00:58:46.559896+0000","last_clean":"2024-09-16T00:58:46.559896+0000","last_became_active":"2024-09-16T00:58:43.608596+0000","last_became_peered":"2024-09-16T00:58:43.608596+0000","last_unstale":"2024-09-16T00:58:46.559896+0000","last_undegraded":"2024-09-16T00:58:46.559896+0000","last_fullsized":"2024-09-16T00:58:46.559896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:47.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560016+0000","last_change":"2024-09-16T00:58:36.509147+0000","last_active":"2024-09-16T00:58:46.560016+0000","last_peered":"2024-09-16T00:58:46.560016+0000","last_clean":"2024-09-16T00:58:46.560016+0000","last_became_active":"2024-09-16T00:58:36.508838+0000","last_became_peered":"2024-09-16T00:58:36.508838+0000","last_unstale":"2024-09-16T00:58:46.560016+0000","last_undegraded":"2024-09-16T00:58:46.560016+0000","last_fullsized":"2024-09-16T00:58:46.560016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:28.870177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:32.591633+0000","last_change":"2024-09-16T00:58:34.829452+0000","last_active":"2024-09-16T00:59:32.591633+0000","last_peered":"2024-09-16T00:59:32.591633+0000","last_clean":"2024-09-16T00:59:32.591633+0000","last_became_active":"2024-09-16T00:58:34.829129+0000","last_became_peered":"2024-09-16T00:58:34.829129+0000","last_unstale":"2024-09-16T00:59:32.591633+0000","last_undegraded":"2024-09-16T00:59:32.591633+0000","last_fullsized":"2024-09-16T00:59:32.591633+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559981+0000","last_change":"2024-09-16T00:58:43.609230+0000","last_active":"2024-09-16T00:58:46.559981+0000","last_peered":"2024-09-16T00:58:46.559981+0000","last_clean":"2024-09-16T00:58:46.559981+0000","last_became_active":"2024-09-16T00:58:43.608879+0000","last_became_peered":"2024-09-16T00:58:43.608879+0000","last_unstale":"2024-09-16T00:58:46.559981+0000","last_undegraded":"2024-09-16T00:58:46.559981+0000","last_fullsized":"2024-09-16T00:58:46.559981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.112878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559551+0000","last_change":"2024-09-16T00:58:36.503412+0000","last_active":"2024-09-16T00:58:46.559551+0000","last_peered":"2024-09-16T00:58:46.559551+0000","last_clean":"2024-09-16T00:58:46.559551+0000","last_became_active":"2024-09-16T00:58:36.503043+0000","last_became_peered":"2024-09-16T00:58:36.503043+0000","last_unstale":"2024-09-16T00:58:46.559551+0000","last_undegraded":"2024-09-16T00:58:46.559551+0000","last_fullsized":"2024-09-16T00:58:46.559551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:18.495669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:19.765899+0000","last_change":"2024-09-16T00:58:34.468460+0000","last_active":"2024-09-16T00:59:19.765899+0000","last_peered":"2024-09-16T00:59:19.765899+0000","last_clean":"2024-09-16T00:59:19.765899+0000","last_became_active":"2024-09-16T00:58:34.468104+0000","last_became_peered":"2024-09-16T00:58:34.468104+0000","last_unstale":"2024-09-16T00:59:19.765899+0000","last_undegraded":"2024-09-16T00:59:19.765899+0000","last_fullsized":"2024-09-16T00:59:19.765899+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:13.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560633+0000","last_change":"2024-09-16T00:58:43.607443+0000","last_active":"2024-09-16T00:58:46.560633+0000","last_peered":"2024-09-16T00:58:46.560633+0000","last_clean":"2024-09-16T00:58:46.560633+0000","last_became_active":"2024-09-16T00:58:43.607019+0000","last_became_peered":"2024-09-16T00:58:43.607019+0000","last_unstale":"2024-09-16T00:58:46.560633+0000","last_undegraded":"2024-09-16T00:58:46.560633+0000","last_fullsized":"2024-09-16T00:58:46.560633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:45.076547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587910+0000","last_change":"2024-09-16T00:58:36.509749+0000","last_active":"2024-09-16T00:58:46.587910+0000","last_peered":"2024-09-16T00:58:46.587910+0000","last_clean":"2024-09-16T00:58:46.587910+0000","last_became_active":"2024-09-16T00:58:36.509411+0000","last_became_peered":"2024-09-16T00:58:36.509411+0000","last_unstale":"2024-09-16T00:58:46.587910+0000","last_undegraded":"2024-09-16T00:58:46.587910+0000","last_fullsized":"2024-09-16T00:58:46.587910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:14.291956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.585623+0000","last_change":"2024-09-16T00:58:34.470190+0000","last_active":"2024-09-16T00:59:21.585623+0000","last_peered":"2024-09-16T00:59:21.585623+0000","last_clean":"2024-09-16T00:59:21.585623+0000","last_became_active":"2024-09-16T00:58:34.469832+0000","last_became_peered":"2024-09-16T00:58:34.469832+0000","last_unstale":"2024-09-16T00:59:21.585623+0000","last_undegraded":"2024-09-16T00:59:21.585623+0000","last_fullsized":"2024-09-16T00:59:21.585623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:03.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808815+0000","last_change":"2024-09-16T00:57:23.502001+0000","last_active":"2024-09-16T00:58:46.808815+0000","last_peered":"2024-09-16T00:58:46.808815+0000","last_clean":"2024-09-16T00:58:46.808815+0000","last_became_active":"2024-09-16T00:57:23.501465+0000","last_became_peered":"2024-09-16T00:57:23.501465+0000","last_unstale":"2024-09-16T00:58:46.808815+0000","last_undegraded":"2024-09-16T00:58:46.808815+0000","last_fullsized":"2024-09-16T00:58:46.808815+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_clean_scrub_stamp":"2024-09-16T00:53:57.344038+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:22.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.845945+0000","last_change":"2024-09-16T00:58:43.609572+0000","last_active":"2024-09-16T00:58:46.845945+0000","last_peered":"2024-09-16T00:58:46.845945+0000","last_clean":"2024-09-16T00:58:46.845945+0000","last_became_active":"2024-09-16T00:58:43.609185+0000","last_became_peered":"2024-09-16T00:58:43.609185+0000","last_unstale":"2024-09-16T00:58:46.845945+0000","last_undegraded":"2024-09-16T00:58:46.845945+0000","last_fullsized":"2024-09-16T00:58:46.845945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.199976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810018+0000","last_change":"2024-09-16T00:58:36.510761+0000","last_active":"2024-09-16T00:58:46.810018+0000","last_peered":"2024-09-16T00:58:46.810018+0000","last_clean":"2024-09-16T00:58:46.810018+0000","last_became_active":"2024-09-16T00:58:36.510456+0000","last_became_peered":"2024-09-16T00:58:36.510456+0000","last_unstale":"2024-09-16T00:58:46.810018+0000","last_undegraded":"2024-09-16T00:58:46.810018+0000","last_fullsized":"2024-09-16T00:58:46.810018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:02.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:35.596091+0000","last_change":"2024-09-16T00:58:34.830238+0000","last_active":"2024-09-16T00:59:35.596091+0000","last_peered":"2024-09-16T00:59:35.596091+0000","last_clean":"2024-09-16T00:59:35.596091+0000","last_became_active":"2024-09-16T00:58:34.829558+0000","last_became_peered":"2024-09-16T00:58:34.829558+0000","last_unstale":"2024-09-16T00:59:35.596091+0000","last_undegraded":"2024-09-16T00:59:35.596091+0000","last_fullsized":"2024-09-16T00:59:35.596091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.347122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809029+0000","last_change":"2024-09-16T00:58:43.613179+0000","last_active":"2024-09-16T00:58:46.809029+0000","last_peered":"2024-09-16T00:58:46.809029+0000","last_clean":"2024-09-16T00:58:46.809029+0000","last_became_active":"2024-09-16T00:58:43.612794+0000","last_became_peered":"2024-09-16T00:58:43.612794+0000","last_unstale":"2024-09-16T00:58:46.809029+0000","last_undegraded":"2024-09-16T00:58:46.809029+0000","last_fullsized":"2024-09-16T00:58:46.809029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:04:24.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809767+0000","last_change":"2024-09-16T00:58:36.512600+0000","last_active":"2024-09-16T00:58:46.809767+0000","last_peered":"2024-09-16T00:58:46.809767+0000","last_clean":"2024-09-16T00:58:46.809767+0000","last_became_active":"2024-09-16T00:58:36.512309+0000","last_became_peered":"2024-09-16T00:58:36.512309+0000","last_unstale":"2024-09-16T00:58:46.809767+0000","last_undegraded":"2024-09-16T00:58:46.809767+0000","last_fullsized":"2024-09-16T00:58:46.809767+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.790755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.571663+0000","last_change":"2024-09-16T00:58:34.471787+0000","last_active":"2024-09-16T00:59:21.571663+0000","last_peered":"2024-09-16T00:59:21.571663+0000","last_clean":"2024-09-16T00:59:21.571663+0000","last_became_active":"2024-09-16T00:58:34.471119+0000","last_became_peered":"2024-09-16T00:58:34.471119+0000","last_unstale":"2024-09-16T00:59:21.571663+0000","last_undegraded":"2024-09-16T00:59:21.571663+0000","last_fullsized":"2024-09-16T00:59:21.571663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:26.121669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962180+0000","last_change":"2024-09-16T00:58:43.609676+0000","last_active":"2024-09-16T00:58:46.962180+0000","last_peered":"2024-09-16T00:58:46.962180+0000","last_clean":"2024-09-16T00:58:46.962180+0000","last_became_active":"2024-09-16T00:58:43.609313+0000","last_became_peered":"2024-09-16T00:58:43.609313+0000","last_unstale":"2024-09-16T00:58:46.962180+0000","last_undegraded":"2024-09-16T00:58:46.962180+0000","last_fullsized":"2024-09-16T00:58:46.962180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:53.339070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810171+0000","last_change":"2024-09-16T00:58:36.514621+0000","last_active":"2024-09-16T00:58:46.810171+0000","last_peered":"2024-09-16T00:58:46.810171+0000","last_clean":"2024-09-16T00:58:46.810171+0000","last_became_active":"2024-09-16T00:58:36.514259+0000","last_became_peered":"2024-09-16T00:58:36.514259+0000","last_unstale":"2024-09-16T00:58:46.810171+0000","last_undegraded":"2024-09-16T00:58:46.810171+0000","last_fullsized":"2024-09-16T00:58:46.810171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:11.411742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.582994+0000","last_change":"2024-09-16T00:58:34.470512+0000","last_active":"2024-09-16T00:59:21.582994+0000","last_peered":"2024-09-16T00:59:21.582994+0000","last_clean":"2024-09-16T00:59:21.582994+0000","last_became_active":"2024-09-16T00:58:34.470140+0000","last_became_peered":"2024-09-16T00:58:34.470140+0000","last_unstale":"2024-09-16T00:59:21.582994+0000","last_undegraded":"2024-09-16T00:59:21.582994+0000","last_fullsized":"2024-09-16T00:59:21.582994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:04.068901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559846+0000","last_change":"2024-09-16T00:58:43.615221+0000","last_active":"2024-09-16T00:58:46.559846+0000","last_peered":"2024-09-16T00:58:46.559846+0000","last_clean":"2024-09-16T00:58:46.559846+0000","last_became_active":"2024-09-16T00:58:43.614820+0000","last_became_peered":"2024-09-16T00:58:43.614820+0000","last_unstale":"2024-09-16T00:58:46.559846+0000","last_undegraded":"2024-09-16T00:58:46.559846+0000","last_fullsized":"2024-09-16T00:58:46.559846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:31.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809637+0000","last_change":"2024-09-16T00:58:36.515470+0000","last_active":"2024-09-16T00:58:46.809637+0000","last_peered":"2024-09-16T00:58:46.809637+0000","last_clean":"2024-09-16T00:58:46.809637+0000","last_became_active":"2024-09-16T00:58:36.515145+0000","last_became_peered":"2024-09-16T00:58:36.515145+0000","last_unstale":"2024-09-16T00:58:46.809637+0000","last_undegraded":"2024-09-16T00:58:46.809637+0000","last_fullsized":"2024-09-16T00:58:46.809637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:10.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:20.760881+0000","last_change":"2024-09-16T00:58:34.464865+0000","last_active":"2024-09-16T00:59:20.760881+0000","last_peered":"2024-09-16T00:59:20.760881+0000","last_clean":"2024-09-16T00:59:20.760881+0000","last_became_active":"2024-09-16T00:58:34.464448+0000","last_became_peered":"2024-09-16T00:58:34.464448+0000","last_unstale":"2024-09-16T00:59:20.760881+0000","last_undegraded":"2024-09-16T00:59:20.760881+0000","last_fullsized":"2024-09-16T00:59:20.760881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:47.454251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560114+0000","last_change":"2024-09-16T00:58:43.610348+0000","last_active":"2024-09-16T00:58:46.560114+0000","last_peered":"2024-09-16T00:58:46.560114+0000","last_clean":"2024-09-16T00:58:46.560114+0000","last_became_active":"2024-09-16T00:58:43.609497+0000","last_became_peered":"2024-09-16T00:58:43.609497+0000","last_unstale":"2024-09-16T00:58:46.560114+0000","last_undegraded":"2024-09-16T00:58:46.560114+0000","last_fullsized":"2024-09-16T00:58:46.560114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:52.931325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560040+0000","last_change":"2024-09-16T00:58:36.517412+0000","last_active":"2024-09-16T00:58:46.560040+0000","last_peered":"2024-09-16T00:58:46.560040+0000","last_clean":"2024-09-16T00:58:46.560040+0000","last_became_active":"2024-09-16T00:58:36.516600+0000","last_became_peered":"2024-09-16T00:58:36.516600+0000","last_unstale":"2024-09-16T00:58:46.560040+0000","last_undegraded":"2024-09-16T00:58:46.560040+0000","last_fullsized":"2024-09-16T00:58:46.560040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:39.445454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.572895+0000","last_change":"2024-09-16T00:58:34.831420+0000","last_active":"2024-09-16T00:59:21.572895+0000","last_peered":"2024-09-16T00:59:21.572895+0000","last_clean":"2024-09-16T00:59:21.572895+0000","last_became_active":"2024-09-16T00:58:34.830991+0000","last_became_peered":"2024-09-16T00:58:34.830991+0000","last_unstale":"2024-09-16T00:59:21.572895+0000","last_undegraded":"2024-09-16T00:59:21.572895+0000","last_fullsized":"2024-09-16T00:59:21.572895+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:13.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560210+0000","last_change":"2024-09-16T00:58:43.611781+0000","last_active":"2024-09-16T00:58:46.560210+0000","last_peered":"2024-09-16T00:58:46.560210+0000","last_clean":"2024-09-16T00:58:46.560210+0000","last_became_active":"2024-09-16T00:58:43.610332+0000","last_became_peered":"2024-09-16T00:58:43.610332+0000","last_unstale":"2024-09-16T00:58:46.560210+0000","last_undegraded":"2024-09-16T00:58:46.560210+0000","last_fullsized":"2024-09-16T00:58:46.560210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:18.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808628+0000","last_change":"2024-09-16T00:58:36.514395+0000","last_active":"2024-09-16T00:58:46.808628+0000","last_peered":"2024-09-16T00:58:46.808628+0000","last_clean":"2024-09-16T00:58:46.808628+0000","last_became_active":"2024-09-16T00:58:36.513570+0000","last_became_peered":"2024-09-16T00:58:36.513570+0000","last_unstale":"2024-09-16T00:58:46.808628+0000","last_undegraded":"2024-09-16T00:58:46.808628+0000","last_fullsized":"2024-09-16T00:58:46.808628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:56.148815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:31.590807+0000","last_change":"2024-09-16T00:58:34.473583+0000","last_active":"2024-09-16T00:59:31.590807+0000","last_peered":"2024-09-16T00:59:31.590807+0000","last_clean":"2024-09-16T00:59:31.590807+0000","last_became_active":"2024-09-16T00:58:34.473259+0000","last_became_peered":"2024-09-16T00:58:34.473259+0000","last_unstale":"2024-09-16T00:59:31.590807+0000","last_undegraded":"2024-09-16T00:59:31.590807+0000","last_fullsized":"2024-09-16T00:59:31.590807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:55.622609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809848+0000","last_change":"2024-09-16T00:58:43.614282+0000","last_active":"2024-09-16T00:58:46.809848+0000","last_peered":"2024-09-16T00:58:46.809848+0000","last_clean":"2024-09-16T00:58:46.809848+0000","last_became_active":"2024-09-16T00:58:43.613873+0000","last_became_peered":"2024-09-16T00:58:43.613873+0000","last_unstale":"2024-09-16T00:58:46.809848+0000","last_undegraded":"2024-09-16T00:58:46.809848+0000","last_fullsized":"2024-09-16T00:58:46.809848+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:57.421234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809388+0000","last_change":"2024-09-16T00:58:36.519735+0000","last_active":"2024-09-16T00:58:46.809388+0000","last_peered":"2024-09-16T00:58:46.809388+0000","last_clean":"2024-09-16T00:58:46.809388+0000","last_became_active":"2024-09-16T00:58:36.519431+0000","last_became_peered":"2024-09-16T00:58:36.519431+0000","last_unstale":"2024-09-16T00:58:46.809388+0000","last_undegraded":"2024-09-16T00:58:46.809388+0000","last_fullsized":"2024-09-16T00:58:46.809388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:05.976023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.585233+0000","last_change":"2024-09-16T00:58:34.470326+0000","last_active":"2024-09-16T00:59:21.585233+0000","last_peered":"2024-09-16T00:59:21.585233+0000","last_clean":"2024-09-16T00:59:21.585233+0000","last_became_active":"2024-09-16T00:58:34.469920+0000","last_became_peered":"2024-09-16T00:58:34.469920+0000","last_unstale":"2024-09-16T00:59:21.585233+0000","last_undegraded":"2024-09-16T00:59:21.585233+0000","last_fullsized":"2024-09-16T00:59:21.585233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:58.718004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809299+0000","last_change":"2024-09-16T00:58:43.616324+0000","last_active":"2024-09-16T00:58:46.809299+0000","last_peered":"2024-09-16T00:58:46.809299+0000","last_clean":"2024-09-16T00:58:46.809299+0000","last_became_active":"2024-09-16T00:58:43.615903+0000","last_became_peered":"2024-09-16T00:58:43.615903+0000","last_unstale":"2024-09-16T00:58:46.809299+0000","last_undegraded":"2024-09-16T00:58:46.809299+0000","last_fullsized":"2024-09-16T00:58:46.809299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.683788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559735+0000","last_change":"2024-09-16T00:58:36.512490+0000","last_active":"2024-09-16T00:58:46.559735+0000","last_peered":"2024-09-16T00:58:46.559735+0000","last_clean":"2024-09-16T00:58:46.559735+0000","last_became_active":"2024-09-16T00:58:36.512167+0000","last_became_peered":"2024-09-16T00:58:36.512167+0000","last_unstale":"2024-09-16T00:58:46.559735+0000","last_undegraded":"2024-09-16T00:58:46.559735+0000","last_fullsized":"2024-09-16T00:58:46.559735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.584948+0000","last_change":"2024-09-16T00:58:34.471603+0000","last_active":"2024-09-16T00:59:21.584948+0000","last_peered":"2024-09-16T00:59:21.584948+0000","last_clean":"2024-09-16T00:59:21.584948+0000","last_became_active":"2024-09-16T00:58:34.471241+0000","last_became_peered":"2024-09-16T00:58:34.471241+0000","last_unstale":"2024-09-16T00:59:21.584948+0000","last_undegraded":"2024-09-16T00:59:21.584948+0000","last_fullsized":"2024-09-16T00:59:21.584948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:33.756759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560595+0000","last_change":"2024-09-16T00:58:43.607428+0000","last_active":"2024-09-16T00:58:46.560595+0000","last_peered":"2024-09-16T00:58:46.560595+0000","last_clean":"2024-09-16T00:58:46.560595+0000","last_became_active":"2024-09-16T00:58:43.606990+0000","last_became_peered":"2024-09-16T00:58:43.606990+0000","last_unstale":"2024-09-16T00:58:46.560595+0000","last_undegraded":"2024-09-16T00:58:46.560595+0000","last_fullsized":"2024-09-16T00:58:46.560595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:52.367384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809424+0000","last_change":"2024-09-16T00:58:36.513967+0000","last_active":"2024-09-16T00:58:46.809424+0000","last_peered":"2024-09-16T00:58:46.809424+0000","last_clean":"2024-09-16T00:58:46.809424+0000","last_became_active":"2024-09-16T00:58:36.513610+0000","last_became_peered":"2024-09-16T00:58:36.513610+0000","last_unstale":"2024-09-16T00:58:46.809424+0000","last_undegraded":"2024-09-16T00:58:46.809424+0000","last_fullsized":"2024-09-16T00:58:46.809424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:22.763430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'31","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:33.595779+0000","last_change":"2024-09-16T00:58:34.471511+0000","last_active":"2024-09-16T00:59:33.595779+0000","last_peered":"2024-09-16T00:59:33.595779+0000","last_clean":"2024-09-16T00:59:33.595779+0000","last_became_active":"2024-09-16T00:58:34.470597+0000","last_became_peered":"2024-09-16T00:58:34.470597+0000","last_unstale":"2024-09-16T00:59:33.595779+0000","last_undegraded":"2024-09-16T00:59:33.595779+0000","last_fullsized":"2024-09-16T00:59:33.595779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.782592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51899,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":67,"num_write":33,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809461+0000","last_change":"2024-09-16T00:58:43.612177+0000","last_active":"2024-09-16T00:58:46.809461+0000","last_peered":"2024-09-16T00:58:46.809461+0000","last_clean":"2024-09-16T00:58:46.809461+0000","last_became_active":"2024-09-16T00:58:43.611801+0000","last_became_peered":"2024-09-16T00:58:43.611801+0000","last_unstale":"2024-09-16T00:58:46.809461+0000","last_undegraded":"2024-09-16T00:58:46.809461+0000","last_fullsized":"2024-09-16T00:58:46.809461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.781429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809467+0000","last_change":"2024-09-16T00:58:36.502231+0000","last_active":"2024-09-16T00:58:46.809467+0000","last_peered":"2024-09-16T00:58:46.809467+0000","last_clean":"2024-09-16T00:58:46.809467+0000","last_became_active":"2024-09-16T00:58:36.501934+0000","last_became_peered":"2024-09-16T00:58:36.501934+0000","last_unstale":"2024-09-16T00:58:46.809467+0000","last_undegraded":"2024-09-16T00:58:46.809467+0000","last_fullsized":"2024-09-16T00:58:46.809467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:29.769186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:20.769468+0000","last_change":"2024-09-16T00:58:34.829872+0000","last_active":"2024-09-16T00:59:20.769468+0000","last_peered":"2024-09-16T00:59:20.769468+0000","last_clean":"2024-09-16T00:59:20.769468+0000","last_became_active":"2024-09-16T00:58:34.829496+0000","last_became_peered":"2024-09-16T00:58:34.829496+0000","last_unstale":"2024-09-16T00:59:20.769468+0000","last_undegraded":"2024-09-16T00:59:20.769468+0000","last_fullsized":"2024-09-16T00:59:20.769468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:47.035177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560841+0000","last_change":"2024-09-16T00:58:43.615560+0000","last_active":"2024-09-16T00:58:46.560841+0000","last_peered":"2024-09-16T00:58:46.560841+0000","last_clean":"2024-09-16T00:58:46.560841+0000","last_became_active":"2024-09-16T00:58:43.615124+0000","last_became_peered":"2024-09-16T00:58:43.615124+0000","last_unstale":"2024-09-16T00:58:46.560841+0000","last_undegraded":"2024-09-16T00:58:46.560841+0000","last_fullsized":"2024-09-16T00:58:46.560841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.455528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962517+0000","last_change":"2024-09-16T00:58:36.514456+0000","last_active":"2024-09-16T00:58:46.962517+0000","last_peered":"2024-09-16T00:58:46.962517+0000","last_clean":"2024-09-16T00:58:46.962517+0000","last_became_active":"2024-09-16T00:58:36.514146+0000","last_became_peered":"2024-09-16T00:58:36.514146+0000","last_unstale":"2024-09-16T00:58:46.962517+0000","last_undegraded":"2024-09-16T00:58:46.962517+0000","last_fullsized":"2024-09-16T00:58:46.962517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:06.760121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.583564+0000","last_change":"2024-09-16T00:58:34.471316+0000","last_active":"2024-09-16T00:59:21.583564+0000","last_peered":"2024-09-16T00:59:21.583564+0000","last_clean":"2024-09-16T00:59:21.583564+0000","last_became_active":"2024-09-16T00:58:34.470991+0000","last_became_peered":"2024-09-16T00:58:34.470991+0000","last_unstale":"2024-09-16T00:59:21.583564+0000","last_undegraded":"2024-09-16T00:59:21.583564+0000","last_fullsized":"2024-09-16T00:59:21.583564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:44.492439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809238+0000","last_change":"2024-09-16T00:58:43.617202+0000","last_active":"2024-09-16T00:58:46.809238+0000","last_peered":"2024-09-16T00:58:46.809238+0000","last_clean":"2024-09-16T00:58:46.809238+0000","last_became_active":"2024-09-16T00:58:43.616824+0000","last_became_peered":"2024-09-16T00:58:43.616824+0000","last_unstale":"2024-09-16T00:58:46.809238+0000","last_undegraded":"2024-09-16T00:58:46.809238+0000","last_fullsized":"2024-09-16T00:58:46.809238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:43.035003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810116+0000","last_change":"2024-09-16T00:58:36.512079+0000","last_active":"2024-09-16T00:58:46.810116+0000","last_peered":"2024-09-16T00:58:46.810116+0000","last_clean":"2024-09-16T00:58:46.810116+0000","last_became_active":"2024-09-16T00:58:36.511220+0000","last_became_peered":"2024-09-16T00:58:36.511220+0000","last_unstale":"2024-09-16T00:58:46.810116+0000","last_undegraded":"2024-09-16T00:58:46.810116+0000","last_fullsized":"2024-09-16T00:58:46.810116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:49.798132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:33.593141+0000","last_change":"2024-09-16T00:58:34.470682+0000","last_active":"2024-09-16T00:59:33.593141+0000","last_peered":"2024-09-16T00:59:33.593141+0000","last_clean":"2024-09-16T00:59:33.593141+0000","last_became_active":"2024-09-16T00:58:34.470323+0000","last_became_peered":"2024-09-16T00:58:34.470323+0000","last_unstale":"2024-09-16T00:59:33.593141+0000","last_undegraded":"2024-09-16T00:59:33.593141+0000","last_fullsized":"2024-09-16T00:59:33.593141+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.361374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587947+0000","last_change":"2024-09-16T00:58:43.608941+0000","last_active":"2024-09-16T00:58:46.587947+0000","last_peered":"2024-09-16T00:58:46.587947+0000","last_clean":"2024-09-16T00:58:46.587947+0000","last_became_active":"2024-09-16T00:58:43.607406+0000","last_became_peered":"2024-09-16T00:58:43.607406+0000","last_unstale":"2024-09-16T00:58:46.587947+0000","last_undegraded":"2024-09-16T00:58:46.587947+0000","last_fullsized":"2024-09-16T00:58:46.587947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:10.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962335+0000","last_change":"2024-09-16T00:58:43.613902+0000","last_active":"2024-09-16T00:58:46.962335+0000","last_peered":"2024-09-16T00:58:46.962335+0000","last_clean":"2024-09-16T00:58:46.962335+0000","last_became_active":"2024-09-16T00:58:43.613530+0000","last_became_peered":"2024-09-16T00:58:43.613530+0000","last_unstale":"2024-09-16T00:58:46.962335+0000","last_undegraded":"2024-09-16T00:58:46.962335+0000","last_fullsized":"2024-09-16T00:58:46.962335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:34.774810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809338+0000","last_change":"2024-09-16T00:58:36.504745+0000","last_active":"2024-09-16T00:58:46.809338+0000","last_peered":"2024-09-16T00:58:46.809338+0000","last_clean":"2024-09-16T00:58:46.809338+0000","last_became_active":"2024-09-16T00:58:36.504400+0000","last_became_peered":"2024-09-16T00:58:36.504400+0000","last_unstale":"2024-09-16T00:58:46.809338+0000","last_undegraded":"2024-09-16T00:58:46.809338+0000","last_fullsized":"2024-09-16T00:58:46.809338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:34.444019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:21.576425+0000","last_change":"2024-09-16T00:58:34.470285+0000","last_active":"2024-09-16T00:59:21.576425+0000","last_peered":"2024-09-16T00:59:21.576425+0000","last_clean":"2024-09-16T00:59:21.576425+0000","last_became_active":"2024-09-16T00:58:34.469948+0000","last_became_peered":"2024-09-16T00:58:34.469948+0000","last_unstale":"2024-09-16T00:59:21.576425+0000","last_undegraded":"2024-09-16T00:59:21.576425+0000","last_fullsized":"2024-09-16T00:59:21.576425+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:28.553863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809844+0000","last_change":"2024-09-16T00:58:43.614818+0000","last_active":"2024-09-16T00:58:46.809844+0000","last_peered":"2024-09-16T00:58:46.809844+0000","last_clean":"2024-09-16T00:58:46.809844+0000","last_became_active":"2024-09-16T00:58:43.614376+0000","last_became_peered":"2024-09-16T00:58:43.614376+0000","last_unstale":"2024-09-16T00:58:46.809844+0000","last_undegraded":"2024-09-16T00:58:46.809844+0000","last_fullsized":"2024-09-16T00:58:46.809844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:41.699930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587872+0000","last_change":"2024-09-16T00:58:36.505127+0000","last_active":"2024-09-16T00:58:46.587872+0000","last_peered":"2024-09-16T00:58:46.587872+0000","last_clean":"2024-09-16T00:58:46.587872+0000","last_became_active":"2024-09-16T00:58:36.504552+0000","last_became_peered":"2024-09-16T00:58:36.504552+0000","last_unstale":"2024-09-16T00:58:46.587872+0000","last_undegraded":"2024-09-16T00:58:46.587872+0000","last_fullsized":"2024-09-16T00:58:46.587872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:48.104109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:19.764899+0000","last_change":"2024-09-16T00:58:34.462231+0000","last_active":"2024-09-16T00:59:19.764899+0000","last_peered":"2024-09-16T00:59:19.764899+0000","last_clean":"2024-09-16T00:59:19.764899+0000","last_became_active":"2024-09-16T00:58:34.461891+0000","last_became_peered":"2024-09-16T00:58:34.461891+0000","last_unstale":"2024-09-16T00:59:19.764899+0000","last_undegraded":"2024-09-16T00:59:19.764899+0000","last_fullsized":"2024-09-16T00:59:19.764899+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.483996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:20.770828+0000","last_change":"2024-09-16T00:58:34.472457+0000","last_active":"2024-09-16T00:59:20.770828+0000","last_peered":"2024-09-16T00:59:20.770828+0000","last_clean":"2024-09-16T00:59:20.770828+0000","last_became_active":"2024-09-16T00:58:34.472084+0000","last_became_peered":"2024-09-16T00:58:34.472084+0000","last_unstale":"2024-09-16T00:59:20.770828+0000","last_undegraded":"2024-09-16T00:59:20.770828+0000","last_fullsized":"2024-09-16T00:59:20.770828+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:08.005195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560409+0000","last_change":"2024-09-16T00:58:36.508791+0000","last_active":"2024-09-16T00:58:46.560409+0000","last_peered":"2024-09-16T00:58:46.560409+0000","last_clean":"2024-09-16T00:58:46.560409+0000","last_became_active":"2024-09-16T00:58:36.508461+0000","last_became_peered":"2024-09-16T00:58:36.508461+0000","last_unstale":"2024-09-16T00:58:46.560409+0000","last_undegraded":"2024-09-16T00:58:46.560409+0000","last_fullsized":"2024-09-16T00:58:46.560409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.938067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809557+0000","last_change":"2024-09-16T00:58:43.620439+0000","last_active":"2024-09-16T00:58:46.809557+0000","last_peered":"2024-09-16T00:58:46.809557+0000","last_clean":"2024-09-16T00:58:46.809557+0000","last_became_active":"2024-09-16T00:58:43.619952+0000","last_became_peered":"2024-09-16T00:58:43.619952+0000","last_unstale":"2024-09-16T00:58:46.809557+0000","last_undegraded":"2024-09-16T00:58:46.809557+0000","last_fullsized":"2024-09-16T00:58:46.809557+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:59:30.589767+0000","last_change":"2024-09-16T00:58:34.473169+0000","last_active":"2024-09-16T00:59:30.589767+0000","last_peered":"2024-09-16T00:59:30.589767+0000","last_clean":"2024-09-16T00:59:30.589767+0000","last_became_active":"2024-09-16T00:58:34.472839+0000","last_became_peered":"2024-09-16T00:58:34.472839+0000","last_unstale":"2024-09-16T00:59:30.589767+0000","last_undegraded":"2024-09-16T00:59:30.589767+0000","last_fullsized":"2024-09-16T00:59:30.589767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:03.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810474+0000","last_change":"2024-09-16T00:58:36.508719+0000","last_active":"2024-09-16T00:58:46.810474+0000","last_peered":"2024-09-16T00:58:46.810474+0000","last_clean":"2024-09-16T00:58:46.810474+0000","last_became_active":"2024-09-16T00:58:36.508427+0000","last_became_peered":"2024-09-16T00:58:36.508427+0000","last_unstale":"2024-09-16T00:58:46.810474+0000","last_undegraded":"2024-09-16T00:58:46.810474+0000","last_fullsized":"2024-09-16T00:58:46.810474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:44.134558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809823+0000","last_change":"2024-09-16T00:58:43.616532+0000","last_active":"2024-09-16T00:58:46.809823+0000","last_peered":"2024-09-16T00:58:46.809823+0000","last_clean":"2024-09-16T00:58:46.809823+0000","last_became_active":"2024-09-16T00:58:43.616146+0000","last_became_peered":"2024-09-16T00:58:43.616146+0000","last_unstale":"2024-09-16T00:58:46.809823+0000","last_undegraded":"2024-09-16T00:58:46.809823+0000","last_fullsized":"2024-09-16T00:58:46.809823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:50.904766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809268+0000","last_change":"2024-09-16T00:58:36.513232+0000","last_active":"2024-09-16T00:58:46.809268+0000","last_peered":"2024-09-16T00:58:46.809268+0000","last_clean":"2024-09-16T00:58:46.809268+0000","last_became_active":"2024-09-16T00:58:36.512239+0000","last_became_peered":"2024-09-16T00:58:36.512239+0000","last_unstale":"2024-09-16T00:58:46.809268+0000","last_undegraded":"2024-09-16T00:58:46.809268+0000","last_fullsized":"2024-09-16T00:58:46.809268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809152+0000","last_change":"2024-09-16T00:58:36.513160+0000","last_active":"2024-09-16T00:58:46.809152+0000","last_peered":"2024-09-16T00:58:46.809152+0000","last_clean":"2024-09-16T00:58:46.809152+0000","last_became_active":"2024-09-16T00:58:36.512523+0000","last_became_peered":"2024-09-16T00:58:36.512523+0000","last_unstale":"2024-09-16T00:58:46.809152+0000","last_undegraded":"2024-09-16T00:58:46.809152+0000","last_fullsized":"2024-09-16T00:58:46.809152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:20.934937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808812+0000","last_change":"2024-09-16T00:58:36.516416+0000","last_active":"2024-09-16T00:58:46.808812+0000","last_peered":"2024-09-16T00:58:46.808812+0000","last_clean":"2024-09-16T00:58:46.808812+0000","last_became_active":"2024-09-16T00:58:36.516121+0000","last_became_peered":"2024-09-16T00:58:36.516121+0000","last_unstale":"2024-09-16T00:58:46.808812+0000","last_undegraded":"2024-09-16T00:58:46.808812+0000","last_fullsized":"2024-09-16T00:58:46.808812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:28.848616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962177+0000","last_change":"2024-09-16T00:58:36.510854+0000","last_active":"2024-09-16T00:58:46.962177+0000","last_peered":"2024-09-16T00:58:46.962177+0000","last_clean":"2024-09-16T00:58:46.962177+0000","last_became_active":"2024-09-16T00:58:36.510505+0000","last_became_peered":"2024-09-16T00:58:36.510505+0000","last_unstale":"2024-09-16T00:58:46.962177+0000","last_undegraded":"2024-09-16T00:58:46.962177+0000","last_fullsized":"2024-09-16T00:58:46.962177+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.699942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559948+0000","last_change":"2024-09-16T00:58:36.509016+0000","last_active":"2024-09-16T00:58:46.559948+0000","last_peered":"2024-09-16T00:58:46.559948+0000","last_clean":"2024-09-16T00:58:46.559948+0000","last_became_active":"2024-09-16T00:58:36.508690+0000","last_became_peered":"2024-09-16T00:58:36.508690+0000","last_unstale":"2024-09-16T00:58:46.559948+0000","last_undegraded":"2024-09-16T00:58:46.559948+0000","last_fullsized":"2024-09-16T00:58:46.559948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:41.425016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810367+0000","last_change":"2024-09-16T00:58:36.511659+0000","last_active":"2024-09-16T00:58:46.810367+0000","last_peered":"2024-09-16T00:58:46.810367+0000","last_clean":"2024-09-16T00:58:46.810367+0000","last_became_active":"2024-09-16T00:58:36.511225+0000","last_became_peered":"2024-09-16T00:58:36.511225+0000","last_unstale":"2024-09-16T00:58:46.810367+0000","last_undegraded":"2024-09-16T00:58:46.810367+0000","last_fullsized":"2024-09-16T00:58:46.810367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:43.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810330+0000","last_change":"2024-09-16T00:58:36.511614+0000","last_active":"2024-09-16T00:58:46.810330+0000","last_peered":"2024-09-16T00:58:46.810330+0000","last_clean":"2024-09-16T00:58:46.810330+0000","last_became_active":"2024-09-16T00:58:36.511304+0000","last_became_peered":"2024-09-16T00:58:36.511304+0000","last_unstale":"2024-09-16T00:58:46.810330+0000","last_undegraded":"2024-09-16T00:58:46.810330+0000","last_fullsized":"2024-09-16T00:58:46.810330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:20.755419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.588337+0000","last_change":"2024-09-16T00:58:36.509399+0000","last_active":"2024-09-16T00:58:46.588337+0000","last_peered":"2024-09-16T00:58:46.588337+0000","last_clean":"2024-09-16T00:58:46.588337+0000","last_became_active":"2024-09-16T00:58:36.509072+0000","last_became_peered":"2024-09-16T00:58:36.509072+0000","last_unstale":"2024-09-16T00:58:46.588337+0000","last_undegraded":"2024-09-16T00:58:46.588337+0000","last_fullsized":"2024-09-16T00:58:46.588337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:29.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559924+0000","last_change":"2024-09-16T00:58:36.506252+0000","last_active":"2024-09-16T00:58:46.559924+0000","last_peered":"2024-09-16T00:58:46.559924+0000","last_clean":"2024-09-16T00:58:46.559924+0000","last_became_active":"2024-09-16T00:58:36.505923+0000","last_became_peered":"2024-09-16T00:58:36.505923+0000","last_unstale":"2024-09-16T00:58:46.559924+0000","last_undegraded":"2024-09-16T00:58:46.559924+0000","last_fullsized":"2024-09-16T00:58:46.559924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:05.332472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587918+0000","last_change":"2024-09-16T00:58:36.506598+0000","last_active":"2024-09-16T00:58:46.587918+0000","last_peered":"2024-09-16T00:58:46.587918+0000","last_clean":"2024-09-16T00:58:46.587918+0000","last_became_active":"2024-09-16T00:58:36.506299+0000","last_became_peered":"2024-09-16T00:58:36.506299+0000","last_unstale":"2024-09-16T00:58:46.587918+0000","last_undegraded":"2024-09-16T00:58:46.587918+0000","last_fullsized":"2024-09-16T00:58:46.587918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.327225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809157+0000","last_change":"2024-09-16T00:58:36.517050+0000","last_active":"2024-09-16T00:58:46.809157+0000","last_peered":"2024-09-16T00:58:46.809157+0000","last_clean":"2024-09-16T00:58:46.809157+0000","last_became_active":"2024-09-16T00:58:36.516745+0000","last_became_peered":"2024-09-16T00:58:36.516745+0000","last_unstale":"2024-09-16T00:58:46.809157+0000","last_undegraded":"2024-09-16T00:58:46.809157+0000","last_fullsized":"2024-09-16T00:58:46.809157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:59.981792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559853+0000","last_change":"2024-09-16T00:58:36.512442+0000","last_active":"2024-09-16T00:58:46.559853+0000","last_peered":"2024-09-16T00:58:46.559853+0000","last_clean":"2024-09-16T00:58:46.559853+0000","last_became_active":"2024-09-16T00:58:36.512132+0000","last_became_peered":"2024-09-16T00:58:36.512132+0000","last_unstale":"2024-09-16T00:58:46.559853+0000","last_undegraded":"2024-09-16T00:58:46.559853+0000","last_fullsized":"2024-09-16T00:58:46.559853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:06.511257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809411+0000","last_change":"2024-09-16T00:58:36.519754+0000","last_active":"2024-09-16T00:58:46.809411+0000","last_peered":"2024-09-16T00:58:46.809411+0000","last_clean":"2024-09-16T00:58:46.809411+0000","last_became_active":"2024-09-16T00:58:36.519378+0000","last_became_peered":"2024-09-16T00:58:36.519378+0000","last_unstale":"2024-09-16T00:58:46.809411+0000","last_undegraded":"2024-09-16T00:58:46.809411+0000","last_fullsized":"2024-09-16T00:58:46.809411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:51.076588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810166+0000","last_change":"2024-09-16T00:58:36.504627+0000","last_active":"2024-09-16T00:58:46.810166+0000","last_peered":"2024-09-16T00:58:46.810166+0000","last_clean":"2024-09-16T00:58:46.810166+0000","last_became_active":"2024-09-16T00:58:36.504282+0000","last_became_peered":"2024-09-16T00:58:36.504282+0000","last_unstale":"2024-09-16T00:58:46.810166+0000","last_undegraded":"2024-09-16T00:58:46.810166+0000","last_fullsized":"2024-09-16T00:58:46.810166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.857181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809795+0000","last_change":"2024-09-16T00:58:36.508971+0000","last_active":"2024-09-16T00:58:46.809795+0000","last_peered":"2024-09-16T00:58:46.809795+0000","last_clean":"2024-09-16T00:58:46.809795+0000","last_became_active":"2024-09-16T00:58:36.508631+0000","last_became_peered":"2024-09-16T00:58:36.508631+0000","last_unstale":"2024-09-16T00:58:46.809795+0000","last_undegraded":"2024-09-16T00:58:46.809795+0000","last_fullsized":"2024-09-16T00:58:46.809795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:17.092613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810108+0000","last_change":"2024-09-16T00:58:36.517255+0000","last_active":"2024-09-16T00:58:46.810108+0000","last_peered":"2024-09-16T00:58:46.810108+0000","last_clean":"2024-09-16T00:58:46.810108+0000","last_became_active":"2024-09-16T00:58:36.516957+0000","last_became_peered":"2024-09-16T00:58:36.516957+0000","last_unstale":"2024-09-16T00:58:46.810108+0000","last_undegraded":"2024-09-16T00:58:46.810108+0000","last_fullsized":"2024-09-16T00:58:46.810108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:34.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808524+0000","last_change":"2024-09-16T00:58:36.516429+0000","last_active":"2024-09-16T00:58:46.808524+0000","last_peered":"2024-09-16T00:58:46.808524+0000","last_clean":"2024-09-16T00:58:46.808524+0000","last_became_active":"2024-09-16T00:58:36.516111+0000","last_became_peered":"2024-09-16T00:58:36.516111+0000","last_unstale":"2024-09-16T00:58:46.808524+0000","last_undegraded":"2024-09-16T00:58:46.808524+0000","last_fullsized":"2024-09-16T00:58:46.808524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:06.120653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962014+0000","last_change":"2024-09-16T00:58:36.512873+0000","last_active":"2024-09-16T00:58:46.962014+0000","last_peered":"2024-09-16T00:58:46.962014+0000","last_clean":"2024-09-16T00:58:46.962014+0000","last_became_active":"2024-09-16T00:58:36.511761+0000","last_became_peered":"2024-09-16T00:58:36.511761+0000","last_unstale":"2024-09-16T00:58:46.962014+0000","last_undegraded":"2024-09-16T00:58:46.962014+0000","last_fullsized":"2024-09-16T00:58:46.962014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:51.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962049+0000","last_change":"2024-09-16T00:58:36.511585+0000","last_active":"2024-09-16T00:58:46.962049+0000","last_peered":"2024-09-16T00:58:46.962049+0000","last_clean":"2024-09-16T00:58:46.962049+0000","last_became_active":"2024-09-16T00:58:36.510479+0000","last_became_peered":"2024-09-16T00:58:36.510479+0000","last_unstale":"2024-09-16T00:58:46.962049+0000","last_undegraded":"2024-09-16T00:58:46.962049+0000","last_fullsized":"2024-09-16T00:58:46.962049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:58.017132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.559946+0000","last_change":"2024-09-16T00:58:36.508263+0000","last_active":"2024-09-16T00:58:46.559946+0000","last_peered":"2024-09-16T00:58:46.559946+0000","last_clean":"2024-09-16T00:58:46.559946+0000","last_became_active":"2024-09-16T00:58:36.507979+0000","last_became_peered":"2024-09-16T00:58:36.507979+0000","last_unstale":"2024-09-16T00:58:46.559946+0000","last_undegraded":"2024-09-16T00:58:46.559946+0000","last_fullsized":"2024-09-16T00:58:46.559946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:07.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560922+0000","last_change":"2024-09-16T00:58:36.514981+0000","last_active":"2024-09-16T00:58:46.560922+0000","last_peered":"2024-09-16T00:58:46.560922+0000","last_clean":"2024-09-16T00:58:46.560922+0000","last_became_active":"2024-09-16T00:58:36.510433+0000","last_became_peered":"2024-09-16T00:58:36.510433+0000","last_unstale":"2024-09-16T00:58:46.560922+0000","last_undegraded":"2024-09-16T00:58:46.560922+0000","last_fullsized":"2024-09-16T00:58:46.560922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:10.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809969+0000","last_change":"2024-09-16T00:58:36.521336+0000","last_active":"2024-09-16T00:58:46.809969+0000","last_peered":"2024-09-16T00:58:46.809969+0000","last_clean":"2024-09-16T00:58:46.809969+0000","last_became_active":"2024-09-16T00:58:36.521026+0000","last_became_peered":"2024-09-16T00:58:36.521026+0000","last_unstale":"2024-09-16T00:58:46.809969+0000","last_undegraded":"2024-09-16T00:58:46.809969+0000","last_fullsized":"2024-09-16T00:58:46.809969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:29.409024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810878+0000","last_change":"2024-09-16T00:58:36.518724+0000","last_active":"2024-09-16T00:58:46.810878+0000","last_peered":"2024-09-16T00:58:46.810878+0000","last_clean":"2024-09-16T00:58:46.810878+0000","last_became_active":"2024-09-16T00:58:36.518428+0000","last_became_peered":"2024-09-16T00:58:36.518428+0000","last_unstale":"2024-09-16T00:58:46.810878+0000","last_undegraded":"2024-09-16T00:58:46.810878+0000","last_fullsized":"2024-09-16T00:58:46.810878+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:06.486299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810248+0000","last_change":"2024-09-16T00:58:36.514347+0000","last_active":"2024-09-16T00:58:46.810248+0000","last_peered":"2024-09-16T00:58:46.810248+0000","last_clean":"2024-09-16T00:58:46.810248+0000","last_became_active":"2024-09-16T00:58:36.512243+0000","last_became_peered":"2024-09-16T00:58:36.512243+0000","last_unstale":"2024-09-16T00:58:46.810248+0000","last_undegraded":"2024-09-16T00:58:46.810248+0000","last_fullsized":"2024-09-16T00:58:46.810248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.289541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.587777+0000","last_change":"2024-09-16T00:58:36.507649+0000","last_active":"2024-09-16T00:58:46.587777+0000","last_peered":"2024-09-16T00:58:46.587777+0000","last_clean":"2024-09-16T00:58:46.587777+0000","last_became_active":"2024-09-16T00:58:36.507319+0000","last_became_peered":"2024-09-16T00:58:36.507319+0000","last_unstale":"2024-09-16T00:58:46.587777+0000","last_undegraded":"2024-09-16T00:58:46.587777+0000","last_fullsized":"2024-09-16T00:58:46.587777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:39.425444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.808908+0000","last_change":"2024-09-16T00:58:36.516797+0000","last_active":"2024-09-16T00:58:46.808908+0000","last_peered":"2024-09-16T00:58:46.808908+0000","last_clean":"2024-09-16T00:58:46.808908+0000","last_became_active":"2024-09-16T00:58:36.516480+0000","last_became_peered":"2024-09-16T00:58:36.516480+0000","last_unstale":"2024-09-16T00:58:46.808908+0000","last_undegraded":"2024-09-16T00:58:46.808908+0000","last_fullsized":"2024-09-16T00:58:46.808908+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:55.262528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810409+0000","last_change":"2024-09-16T00:58:36.517973+0000","last_active":"2024-09-16T00:58:46.810409+0000","last_peered":"2024-09-16T00:58:46.810409+0000","last_clean":"2024-09-16T00:58:46.810409+0000","last_became_active":"2024-09-16T00:58:36.517634+0000","last_became_peered":"2024-09-16T00:58:36.517634+0000","last_unstale":"2024-09-16T00:58:46.810409+0000","last_undegraded":"2024-09-16T00:58:46.810409+0000","last_fullsized":"2024-09-16T00:58:46.810409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:19.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.809065+0000","last_change":"2024-09-16T00:58:36.507643+0000","last_active":"2024-09-16T00:58:46.809065+0000","last_peered":"2024-09-16T00:58:46.809065+0000","last_clean":"2024-09-16T00:58:46.809065+0000","last_became_active":"2024-09-16T00:58:36.507263+0000","last_became_peered":"2024-09-16T00:58:36.507263+0000","last_unstale":"2024-09-16T00:58:46.809065+0000","last_undegraded":"2024-09-16T00:58:46.809065+0000","last_fullsized":"2024-09-16T00:58:46.809065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:24.317490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.560864+0000","last_change":"2024-09-16T00:58:36.508798+0000","last_active":"2024-09-16T00:58:46.560864+0000","last_peered":"2024-09-16T00:58:46.560864+0000","last_clean":"2024-09-16T00:58:46.560864+0000","last_became_active":"2024-09-16T00:58:36.508490+0000","last_became_peered":"2024-09-16T00:58:36.508490+0000","last_unstale":"2024-09-16T00:58:46.560864+0000","last_undegraded":"2024-09-16T00:58:46.560864+0000","last_fullsized":"2024-09-16T00:58:46.560864+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:44.282270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962370+0000","last_change":"2024-09-16T00:58:36.519065+0000","last_active":"2024-09-16T00:58:46.962370+0000","last_peered":"2024-09-16T00:58:46.962370+0000","last_clean":"2024-09-16T00:58:46.962370+0000","last_became_active":"2024-09-16T00:58:36.518708+0000","last_became_peered":"2024-09-16T00:58:36.518708+0000","last_unstale":"2024-09-16T00:58:46.962370+0000","last_undegraded":"2024-09-16T00:58:46.962370+0000","last_fullsized":"2024-09-16T00:58:46.962370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:10.290341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.962272+0000","last_change":"2024-09-16T00:58:36.513018+0000","last_active":"2024-09-16T00:58:46.962272+0000","last_peered":"2024-09-16T00:58:46.962272+0000","last_clean":"2024-09-16T00:58:46.962272+0000","last_became_active":"2024-09-16T00:58:36.511730+0000","last_became_peered":"2024-09-16T00:58:36.511730+0000","last_unstale":"2024-09-16T00:58:46.962272+0000","last_undegraded":"2024-09-16T00:58:46.962272+0000","last_fullsized":"2024-09-16T00:58:46.962272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:20.852121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T00:58:46.810006+0000","last_change":"2024-09-16T00:58:36.518265+0000","last_active":"2024-09-16T00:58:46.810006+0000","last_peered":"2024-09-16T00:58:46.810006+0000","last_clean":"2024-09-16T00:58:46.810006+0000","last_became_active":"2024-09-16T00:58:36.517906+0000","last_became_peered":"2024-09-16T00:58:36.517906+0000","last_unstale":"2024-09-16T00:58:46.810006+0000","last_undegraded":"2024-09-16T00:58:46.810006+0000","last_fullsized":"2024-09-16T00:58:46.810006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.255849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58714,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":168,"num_read_kb":149,"num_write":238,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":184672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282150,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612633,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":475643,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841564,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1081344,"data_stored":1113965,"data_compressed":53530,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":479276,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":475558,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1071664,"data_compressed":53530,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":470684,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":1067246,"data_compressed":53530,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":474758,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247874,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":470392,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":532756,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":523613,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":472533,"data_compressed":17647,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T00:59:39.051 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T00:59:39.052 INFO:tasks.cephadm:Setting up client nodes... 2024-09-16T00:59:39.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-16T00:59:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:38 smithi119 ceph-mon[35049]: pgmap v312: 129 pgs: 129 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-16T00:59:39.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:38 smithi098 ceph-mon[35346]: pgmap v312: 129 pgs: 129 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-16T00:59:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:39.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.837+0000 7fcfa0714640 1 -- 172.21.15.12:0/93263329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf98101cd0 msgr2=0x7fcf98102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:39.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.837+0000 7fcfa0714640 1 --2- 172.21.15.12:0/93263329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf98101cd0 0x7fcf98102150 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009900 tx=0x7fcf8c02a410 comp rx=0 tx=0).stop 2024-09-16T00:59:39.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 -- 172.21.15.12:0/93263329 shutdown_connections 2024-09-16T00:59:39.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 --2- 172.21.15.12:0/93263329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf98102690 0x7fcf98108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:39.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 --2- 172.21.15.12:0/93263329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf98101cd0 0x7fcf98102150 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 --2- 172.21.15.12:0/93263329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf98100ad0 0x7fcf98100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 -- 172.21.15.12:0/93263329 >> 172.21.15.12:0/93263329 conn(0x7fcf980fc280 msgr2=0x7fcf980fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 -- 172.21.15.12:0/93263329 shutdown_connections 2024-09-16T00:59:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 -- 172.21.15.12:0/93263329 wait complete. 2024-09-16T00:59:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 Processor -- start 2024-09-16T00:59:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 -- start start 2024-09-16T00:59:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf98100ad0 0x7fcf98197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf98101cd0 0x7fcf981983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf98102690 0x7fcf9819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810d880 con 0x7fcf98100ad0 2024-09-16T00:59:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810d700 con 0x7fcf98101cd0 2024-09-16T00:59:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcfa0714640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810da00 con 0x7fcf98102690 2024-09-16T00:59:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.838+0000 7fcf9e4b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf98100ad0 0x7fcf98197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9e4b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf98100ad0 0x7fcf98197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43818/0 (socket says 172.21.15.12:43818) 2024-09-16T00:59:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9e4b0640 1 -- 172.21.15.12:0/4252017154 learned_addr learned my addr 172.21.15.12:0/4252017154 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9ecb1640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf98102690 0x7fcf9819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9e4b0640 1 -- 172.21.15.12:0/4252017154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf98102690 msgr2=0x7fcf9819f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9e4b0640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf98102690 0x7fcf9819f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9e4b0640 1 -- 172.21.15.12:0/4252017154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf98101cd0 msgr2=0x7fcf981983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9dcaf640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf98101cd0 0x7fcf981983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9e4b0640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf98101cd0 0x7fcf981983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9e4b0640 1 -- 172.21.15.12:0/4252017154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9819fac0 con 0x7fcf98100ad0 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9ecb1640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf98102690 0x7fcf9819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf9e4b0640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf98100ad0 0x7fcf98197e90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800eaa0 tx=0x7fcf8800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf977fe640 1 -- 172.21.15.12:0/4252017154 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88016070 con 0x7fcf98100ad0 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcfa0714640 1 -- 172.21.15.12:0/4252017154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9819fdb0 con 0x7fcf98100ad0 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf977fe640 1 -- 172.21.15.12:0/4252017154 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf88003e50 con 0x7fcf98100ad0 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcf977fe640 1 -- 172.21.15.12:0/4252017154 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf880116d0 con 0x7fcf98100ad0 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.839+0000 7fcfa0714640 1 -- 172.21.15.12:0/4252017154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf981a0210 con 0x7fcf98100ad0 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.840+0000 7fcfa0714640 1 -- 172.21.15.12:0/4252017154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf98107e80 con 0x7fcf98100ad0 2024-09-16T00:59:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.841+0000 7fcf977fe640 1 -- 172.21.15.12:0/4252017154 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcf88019070 con 0x7fcf98100ad0 2024-09-16T00:59:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.842+0000 7fcf977fe640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf800a3300 0x7fcf800a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.842+0000 7fcf9dcaf640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf800a3300 0x7fcf800a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.842+0000 7fcf977fe640 1 -- 172.21.15.12:0/4252017154 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fcf880cfea0 con 0x7fcf98100ad0 2024-09-16T00:59:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.843+0000 7fcf9dcaf640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf800a3300 0x7fcf800a57c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c031610 tx=0x7fcf8c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:39.846+0000 7fcf977fe640 1 -- 172.21.15.12:0/4252017154 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf8809c7c0 con 0x7fcf98100ad0 2024-09-16T00:59:40.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.091+0000 7fcfa0714640 1 -- 172.21.15.12:0/4252017154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fcf9802d7c0 con 0x7fcf98100ad0 2024-09-16T00:59:40.092 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:39 smithi012 ceph-mon[31197]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:59:40.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.094+0000 7fcf977fe640 1 -- 172.21.15.12:0/4252017154 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fcf8809c0c0 con 0x7fcf98100ad0 2024-09-16T00:59:40.094 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-16T00:59:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD8gudm/2OJBRAA09hzwDx159sVw792vCoDTQ== 2024-09-16T00:59:40.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:39 smithi119 ceph-mon[35049]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:59:40.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 -- 172.21.15.12:0/4252017154 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf800a3300 msgr2=0x7fcf800a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:40.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf800a3300 0x7fcf800a57c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c031610 tx=0x7fcf8c000bc0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 -- 172.21.15.12:0/4252017154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf98100ad0 msgr2=0x7fcf98197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:40.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf98100ad0 0x7fcf98197e90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800eaa0 tx=0x7fcf8800ef60 comp rx=0 tx=0).stop 2024-09-16T00:59:40.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 -- 172.21.15.12:0/4252017154 shutdown_connections 2024-09-16T00:59:40.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcf800a3300 0x7fcf800a57c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf98102690 0x7fcf9819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf98101cd0 0x7fcf981983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 --2- 172.21.15.12:0/4252017154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf98100ad0 0x7fcf98197e90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 -- 172.21.15.12:0/4252017154 >> 172.21.15.12:0/4252017154 conn(0x7fcf980fc280 msgr2=0x7fcf98105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:40.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 -- 172.21.15.12:0/4252017154 shutdown_connections 2024-09-16T00:59:40.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:40.096+0000 7fcfa0714640 1 -- 172.21.15.12:0/4252017154 wait complete. 2024-09-16T00:59:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:39 smithi098 ceph-mon[35346]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:59:40.729 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T00:59:40.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-16T00:59:40.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T00:59:40.767 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T00:59:40.767 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-16T00:59:40.767 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-16T00:59:41.064 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:40 smithi119 ceph-mon[35049]: pgmap v313: 129 pgs: 129 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-16T00:59:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:40 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/4252017154' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T00:59:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:40 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/4252017154' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T00:59:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:40 smithi012 ceph-mon[31197]: pgmap v313: 129 pgs: 129 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-16T00:59:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:40 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/4252017154' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T00:59:41.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:40 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/4252017154' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T00:59:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:40 smithi098 ceph-mon[35346]: pgmap v313: 129 pgs: 129 active+clean; 634 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-16T00:59:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:40 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/4252017154' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T00:59:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:40 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/4252017154' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T00:59:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.545+0000 7fc21d4de640 1 -- 172.21.15.12:0/1310778067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21810c170 msgr2=0x7fc21810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.545+0000 7fc21d4de640 1 --2- 172.21.15.12:0/1310778067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21810c170 0x7fc21810e610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc210009900 tx=0x7fc21002a480 comp rx=0 tx=0).stop 2024-09-16T00:59:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.545+0000 7fc21d4de640 1 -- 172.21.15.12:0/1310778067 shutdown_connections 2024-09-16T00:59:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.545+0000 7fc21d4de640 1 --2- 172.21.15.12:0/1310778067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21810c170 0x7fc21810e610 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.545+0000 7fc21d4de640 1 --2- 172.21.15.12:0/1310778067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc218103660 0x7fc21810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.545+0000 7fc21d4de640 1 --2- 172.21.15.12:0/1310778067 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc218102d40 0x7fc218103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.545+0000 7fc21d4de640 1 -- 172.21.15.12:0/1310778067 >> 172.21.15.12:0/1310778067 conn(0x7fc2180fc7a0 msgr2=0x7fc2180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.545+0000 7fc21d4de640 1 -- 172.21.15.12:0/1310778067 shutdown_connections 2024-09-16T00:59:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.545+0000 7fc21d4de640 1 -- 172.21.15.12:0/1310778067 wait complete. 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc21d4de640 1 Processor -- start 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc21d4de640 1 -- start start 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc21d4de640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc218102d40 0x7fc21819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc21d4de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc218103660 0x7fc21819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc21d4de640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc21810c170 0x7fc21819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc21d4de640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc218111f50 con 0x7fc218103660 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc21d4de640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc218111dd0 con 0x7fc21810c170 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc21d4de640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc2181120d0 con 0x7fc218102d40 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc2167fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc218103660 0x7fc21819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc2167fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc218103660 0x7fc21819abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43836/0 (socket says 172.21.15.12:43836) 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc2167fc640 1 -- 172.21.15.12:0/232112750 learned_addr learned my addr 172.21.15.12:0/232112750 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc216ffd640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc218102d40 0x7fc21819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc2177fe640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc21810c170 0x7fc21819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc2167fc640 1 -- 172.21.15.12:0/232112750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc218102d40 msgr2=0x7fc21819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc2167fc640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc218102d40 0x7fc21819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc2167fc640 1 -- 172.21.15.12:0/232112750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc21810c170 msgr2=0x7fc21819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc2167fc640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc21810c170 0x7fc21819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc2167fc640 1 -- 172.21.15.12:0/232112750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21819f640 con 0x7fc218103660 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc216ffd640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc218102d40 0x7fc21819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.546+0000 7fc2177fe640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc21810c170 0x7fc21819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.547+0000 7fc2167fc640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc218103660 0x7fc21819abd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e9f0 tx=0x7fc20c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.547+0000 7fc1fffff640 1 -- 172.21.15.12:0/232112750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00ccc0 con 0x7fc218103660 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.547+0000 7fc21d4de640 1 -- 172.21.15.12:0/232112750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21819f930 con 0x7fc218103660 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.547+0000 7fc1fffff640 1 -- 172.21.15.12:0/232112750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc20c00ce60 con 0x7fc218103660 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.547+0000 7fc1fffff640 1 -- 172.21.15.12:0/232112750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c010690 con 0x7fc218103660 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.547+0000 7fc21d4de640 1 -- 172.21.15.12:0/232112750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2181a7210 con 0x7fc218103660 2024-09-16T00:59:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.548+0000 7fc21d4de640 1 -- 172.21.15.12:0/232112750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc218103120 con 0x7fc218103660 2024-09-16T00:59:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.549+0000 7fc1fffff640 1 -- 172.21.15.12:0/232112750 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc20c0046c0 con 0x7fc218103660 2024-09-16T00:59:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.550+0000 7fc1fffff640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc2000a32d0 0x7fc2000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.550+0000 7fc216ffd640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc2000a32d0 0x7fc2000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.550+0000 7fc1fffff640 1 -- 172.21.15.12:0/232112750 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fc20c0d0140 con 0x7fc218103660 2024-09-16T00:59:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.551+0000 7fc216ffd640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc2000a32d0 0x7fc2000a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc208005fd0 tx=0x7fc208009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.554+0000 7fc1fffff640 1 -- 172.21.15.12:0/232112750 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc20c09cac0 con 0x7fc218103660 2024-09-16T00:59:41.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.777+0000 7fc21d4de640 1 -- 172.21.15.12:0/232112750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc2181a7440 con 0x7fc218103660 2024-09-16T00:59:41.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.782+0000 7fc1fffff640 1 -- 172.21.15.12:0/232112750 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264047 (secure 0 0 0) 0x7fc20c09c3c0 con 0x7fc218103660 2024-09-16T00:59:41.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:59:41.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 -- 172.21.15.12:0/232112750 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc2000a32d0 msgr2=0x7fc2000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:41.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc2000a32d0 0x7fc2000a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc208005fd0 tx=0x7fc208009520 comp rx=0 tx=0).stop 2024-09-16T00:59:41.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 -- 172.21.15.12:0/232112750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc218103660 msgr2=0x7fc21819abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc218103660 0x7fc21819abd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e9f0 tx=0x7fc20c00eeb0 comp rx=0 tx=0).stop 2024-09-16T00:59:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 -- 172.21.15.12:0/232112750 shutdown_connections 2024-09-16T00:59:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc2000a32d0 0x7fc2000a5790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc21810c170 0x7fc21819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc218103660 0x7fc21819abd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 --2- 172.21.15.12:0/232112750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc218102d40 0x7fc21819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 -- 172.21.15.12:0/232112750 >> 172.21.15.12:0/232112750 conn(0x7fc2180fc7a0 msgr2=0x7fc2181008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 -- 172.21.15.12:0/232112750 shutdown_connections 2024-09-16T00:59:41.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:41.786+0000 7fc21d4de640 1 -- 172.21.15.12:0/232112750 wait complete. 2024-09-16T00:59:42.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:41 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/232112750' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T00:59:42.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:41 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/232112750' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T00:59:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:41 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/232112750' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T00:59:42.509 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2160939611},{"type":"v1","addr":"172.21.15.12:6801","nonce":2160939611}]},"active_addr":"172.21.15.12:6801/2160939611","active_change":"2024-09-16T00:51:42.808954+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.12:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":499860702}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":331692041}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2085088969}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":399505588}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1075414603}]}]} 2024-09-16T00:59:42.514 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-16T00:59:42.514 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-16T00:59:42.514 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:59:42.773 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:43.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:42 smithi119 ceph-mon[35049]: pgmap v314: 129 pgs: 129 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 KiB/s wr, 13 op/s 2024-09-16T00:59:43.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:42 smithi012 ceph-mon[31197]: pgmap v314: 129 pgs: 129 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 KiB/s wr, 13 op/s 2024-09-16T00:59:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:42 smithi098 ceph-mon[35346]: pgmap v314: 129 pgs: 129 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 KiB/s wr, 13 op/s 2024-09-16T00:59:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.239+0000 7f8928dea640 1 -- 172.21.15.12:0/1211872422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8924102d30 msgr2=0x7f8924103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.239+0000 7f8928dea640 1 --2- 172.21.15.12:0/1211872422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8924102d30 0x7f8924103110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8914009930 tx=0x7f891402a420 comp rx=0 tx=0).stop 2024-09-16T00:59:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.239+0000 7f8928dea640 1 -- 172.21.15.12:0/1211872422 shutdown_connections 2024-09-16T00:59:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.239+0000 7f8928dea640 1 --2- 172.21.15.12:0/1211872422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89241082a0 0x7f892410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.239+0000 7f8928dea640 1 --2- 172.21.15.12:0/1211872422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89241036e0 0x7f8924107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.239+0000 7f8928dea640 1 --2- 172.21.15.12:0/1211872422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8924102d30 0x7f8924103110 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.239+0000 7f8928dea640 1 -- 172.21.15.12:0/1211872422 >> 172.21.15.12:0/1211872422 conn(0x7f89240fc7d0 msgr2=0x7f89240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.239+0000 7f8928dea640 1 -- 172.21.15.12:0/1211872422 shutdown_connections 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.239+0000 7f8928dea640 1 -- 172.21.15.12:0/1211872422 wait complete. 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8928dea640 1 Processor -- start 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8928dea640 1 -- start start 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8928dea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8924102d30 0x7f8924100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8928dea640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89241036e0 0x7f8924100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8928dea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89241082a0 0x7f8924101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8928dea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89241120a0 con 0x7f8924102d30 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8928dea640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8924111f20 con 0x7f89241036e0 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8928dea640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8924112220 con 0x7f89241082a0 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f892259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8924102d30 0x7f8924100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f892259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8924102d30 0x7f8924100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43854/0 (socket says 172.21.15.12:43854) 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f892259c640 1 -- 172.21.15.12:0/1278500142 learned_addr learned my addr 172.21.15.12:0/1278500142 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8921d9b640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89241036e0 0x7f8924100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f892259c640 1 -- 172.21.15.12:0/1278500142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89241082a0 msgr2=0x7f8924101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8922d9d640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89241082a0 0x7f8924101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f892259c640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89241082a0 0x7f8924101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f892259c640 1 -- 172.21.15.12:0/1278500142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89241036e0 msgr2=0x7f8924100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f892259c640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89241036e0 0x7f8924100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f892259c640 1 -- 172.21.15.12:0/1278500142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89241a6a80 con 0x7f8924102d30 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8921d9b640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89241036e0 0x7f8924100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.240+0000 7f8922d9d640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89241082a0 0x7f8924101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.241+0000 7f892259c640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8924102d30 0x7f8924100990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8914009230 tx=0x7f8914004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.241+0000 7f89137fe640 1 -- 172.21.15.12:0/1278500142 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891403f030 con 0x7f8924102d30 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.241+0000 7f8928dea640 1 -- 172.21.15.12:0/1278500142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89241a6d10 con 0x7f8924102d30 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.241+0000 7f89137fe640 1 -- 172.21.15.12:0/1278500142 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8914003ad0 con 0x7f8924102d30 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.241+0000 7f89137fe640 1 -- 172.21.15.12:0/1278500142 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914035070 con 0x7f8924102d30 2024-09-16T00:59:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.241+0000 7f8928dea640 1 -- 172.21.15.12:0/1278500142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89241a71e0 con 0x7f8924102d30 2024-09-16T00:59:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.242+0000 7f8928dea640 1 -- 172.21.15.12:0/1278500142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8924103110 con 0x7f8924102d30 2024-09-16T00:59:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.243+0000 7f89137fe640 1 -- 172.21.15.12:0/1278500142 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8914042030 con 0x7f8924102d30 2024-09-16T00:59:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.244+0000 7f89137fe640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f890c0a32d0 0x7f890c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.244+0000 7f8921d9b640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f890c0a32d0 0x7f890c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.244+0000 7f89137fe640 1 -- 172.21.15.12:0/1278500142 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f89140f0210 con 0x7f8924102d30 2024-09-16T00:59:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.244+0000 7f8921d9b640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f890c0a32d0 0x7f890c0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8924102420 tx=0x7f8918005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.247+0000 7f89137fe640 1 -- 172.21.15.12:0/1278500142 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89140bcc30 con 0x7f8924102d30 2024-09-16T00:59:43.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.428+0000 7f8928dea640 1 -- 172.21.15.12:0/1278500142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f892410a2b0 con 0x7f8924102d30 2024-09-16T00:59:43.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.429+0000 7f89137fe640 1 -- 172.21.15.12:0/1278500142 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24189 (secure 0 0 0) 0x7f89140bc530 con 0x7f8924102d30 2024-09-16T00:59:43.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:59:43.431 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T00:58:46.252124+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:59:43.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 -- 172.21.15.12:0/1278500142 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f890c0a32d0 msgr2=0x7f890c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f890c0a32d0 0x7f890c0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8924102420 tx=0x7f8918005e50 comp rx=0 tx=0).stop 2024-09-16T00:59:43.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 -- 172.21.15.12:0/1278500142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8924102d30 msgr2=0x7f8924100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8924102d30 0x7f8924100990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8914009230 tx=0x7f8914004270 comp rx=0 tx=0).stop 2024-09-16T00:59:43.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 -- 172.21.15.12:0/1278500142 shutdown_connections 2024-09-16T00:59:43.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f890c0a32d0 0x7f890c0a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89241082a0 0x7f8924101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89241036e0 0x7f8924100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 --2- 172.21.15.12:0/1278500142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8924102d30 0x7f8924100990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 -- 172.21.15.12:0/1278500142 >> 172.21.15.12:0/1278500142 conn(0x7f89240fc7d0 msgr2=0x7f8924105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:43.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 -- 172.21.15.12:0/1278500142 shutdown_connections 2024-09-16T00:59:43.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:43.432+0000 7f8928dea640 1 -- 172.21.15.12:0/1278500142 wait complete. 2024-09-16T00:59:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-16T00:59:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-16T00:59:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-16T00:59:44.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-16T00:59:44.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-16T00:59:44.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-16T00:59:44.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]}]: dispatch 2024-09-16T00:59:44.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-16T00:59:44.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:43 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-09-16T00:59:44.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:43 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1278500142' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:44.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-16T00:59:44.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-16T00:59:44.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-16T00:59:44.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-16T00:59:44.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-16T00:59:44.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-16T00:59:44.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]}]: dispatch 2024-09-16T00:59:44.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-16T00:59:44.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:43 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-09-16T00:59:44.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:43 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1278500142' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:44.149 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-16T00:59:44.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:59:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-16T00:59:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-16T00:59:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-16T00:59:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-16T00:59:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-16T00:59:44.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-16T00:59:44.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]}]: dispatch 2024-09-16T00:59:44.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-16T00:59:44.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:43 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-09-16T00:59:44.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:43 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1278500142' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:44.409 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:45.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 -- 172.21.15.12:0/1417701916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54c104e80 msgr2=0x7ff54c105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 --2- 172.21.15.12:0/1417701916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54c104e80 0x7ff54c105330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff544009ca0 tx=0x7ff54402a8c0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 -- 172.21.15.12:0/1417701916 shutdown_connections 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 --2- 172.21.15.12:0/1417701916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54c104e80 0x7ff54c105330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 --2- 172.21.15.12:0/1417701916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff54c06a370 0x7ff54c1009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 --2- 172.21.15.12:0/1417701916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff54c069f00 0x7ff54c100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 -- 172.21.15.12:0/1417701916 >> 172.21.15.12:0/1417701916 conn(0x7ff54c077210 msgr2=0x7ff54c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 -- 172.21.15.12:0/1417701916 shutdown_connections 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 -- 172.21.15.12:0/1417701916 wait complete. 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 Processor -- start 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.009+0000 7ff552b00640 1 -- start start 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff552b00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54c069f00 0x7ff54c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff552b00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff54c06a370 0x7ff54c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff552b00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff54c104e80 0x7ff54c19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff552b00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c110e70 con 0x7ff54c069f00 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff552b00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c110cf0 con 0x7ff54c104e80 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff552b00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c110ff0 con 0x7ff54c06a370 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55089c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54c069f00 0x7ff54c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55089c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54c069f00 0x7ff54c19a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43876/0 (socket says 172.21.15.12:43876) 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55089c640 1 -- 172.21.15.12:0/1560058143 learned_addr learned my addr 172.21.15.12:0/1560058143 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff54bfff640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff54c06a370 0x7ff54c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55109d640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff54c104e80 0x7ff54c19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55089c640 1 -- 172.21.15.12:0/1560058143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff54c06a370 msgr2=0x7ff54c19ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55089c640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff54c06a370 0x7ff54c19ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55089c640 1 -- 172.21.15.12:0/1560058143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff54c104e80 msgr2=0x7ff54c19eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55089c640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff54c104e80 0x7ff54c19eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55089c640 1 -- 172.21.15.12:0/1560058143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54c19f580 con 0x7ff54c069f00 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55109d640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff54c104e80 0x7ff54c19eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff55089c640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54c069f00 0x7ff54c19a5d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00c970 tx=0x7ff53c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff549ffb640 1 -- 172.21.15.12:0/1560058143 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c007bb0 con 0x7ff54c069f00 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff549ffb640 1 -- 172.21.15.12:0/1560058143 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff53c007d50 con 0x7ff54c069f00 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff549ffb640 1 -- 172.21.15.12:0/1560058143 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00f450 con 0x7ff54c069f00 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.010+0000 7ff552b00640 1 -- 172.21.15.12:0/1560058143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff54c19f870 con 0x7ff54c069f00 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.011+0000 7ff552b00640 1 -- 172.21.15.12:0/1560058143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff54c1a7150 con 0x7ff54c069f00 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.012+0000 7ff552b00640 1 -- 172.21.15.12:0/1560058143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff54c105330 con 0x7ff54c069f00 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.013+0000 7ff549ffb640 1 -- 172.21.15.12:0/1560058143 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff53c005020 con 0x7ff54c069f00 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.014+0000 7ff549ffb640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5340a32d0 0x7ff5340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.014+0000 7ff54bfff640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5340a32d0 0x7ff5340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.014+0000 7ff549ffb640 1 -- 172.21.15.12:0/1560058143 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7ff53c0cfcd0 con 0x7ff54c069f00 2024-09-16T00:59:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.014+0000 7ff54bfff640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5340a32d0 0x7ff5340a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff540005fd0 tx=0x7ff540005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:45.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.018+0000 7ff549ffb640 1 -- 172.21.15.12:0/1560058143 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff53c014030 con 0x7ff54c069f00 2024-09-16T00:59:45.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-16T00:59:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-16T00:59:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-16T00:59:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-16T00:59:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-16T00:59:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-16T00:59:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-16T00:59:45.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]}]': finished 2024-09-16T00:59:45.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-16T00:59:45.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-16T00:59:45.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:44 smithi119 ceph-mon[35049]: osdmap e86: 12 total, 12 up, 12 in 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]}]': finished 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-16T00:59:45.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:44 smithi012 ceph-mon[31197]: osdmap e86: 12 total, 12 up, 12 in 2024-09-16T00:59:45.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.197+0000 7ff552b00640 1 -- 172.21.15.12:0/1560058143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff54c19b930 con 0x7ff54c069f00 2024-09-16T00:59:45.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.199+0000 7ff549ffb640 1 -- 172.21.15.12:0/1560058143 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24631 (secure 0 0 0) 0x7ff53c09c4f0 con 0x7ff54c069f00 2024-09-16T00:59:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T00:59:45.200 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T00:59:44.825186+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:59:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 -- 172.21.15.12:0/1560058143 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5340a32d0 msgr2=0x7ff5340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5340a32d0 0x7ff5340a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff540005fd0 tx=0x7ff540005850 comp rx=0 tx=0).stop 2024-09-16T00:59:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 -- 172.21.15.12:0/1560058143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54c069f00 msgr2=0x7ff54c19a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54c069f00 0x7ff54c19a5d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00c970 tx=0x7ff53c00ce30 comp rx=0 tx=0).stop 2024-09-16T00:59:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 -- 172.21.15.12:0/1560058143 shutdown_connections 2024-09-16T00:59:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5340a32d0 0x7ff5340a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff54c104e80 0x7ff54c19eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff54c06a370 0x7ff54c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 --2- 172.21.15.12:0/1560058143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54c069f00 0x7ff54c19a5d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 -- 172.21.15.12:0/1560058143 >> 172.21.15.12:0/1560058143 conn(0x7ff54c077210 msgr2=0x7ff54c10d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:45.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 -- 172.21.15.12:0/1560058143 shutdown_connections 2024-09-16T00:59:45.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:45.201+0000 7ff552b00640 1 -- 172.21.15.12:0/1560058143 wait complete. 2024-09-16T00:59:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-16T00:59:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-16T00:59:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-16T00:59:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-16T00:59:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-16T00:59:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-16T00:59:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-16T00:59:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]}]': finished 2024-09-16T00:59:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-16T00:59:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-16T00:59:45.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:44 smithi098 ceph-mon[35346]: osdmap e86: 12 total, 12 up, 12 in 2024-09-16T00:59:45.854 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-16T00:59:45.854 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-16T00:59:45.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-16T00:59:45.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-16T00:59:45.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-16T00:59:45.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-16T00:59:45.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-16T00:59:45.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-16T00:59:45.857 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-16T00:59:45.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-16T00:59:45.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-16T00:59:45.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-16T00:59:46.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:45 smithi119 ceph-mon[35049]: osdmap e87: 12 total, 12 up, 12 in 2024-09-16T00:59:46.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:45 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1560058143' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:46.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:45 smithi012 ceph-mon[31197]: osdmap e87: 12 total, 12 up, 12 in 2024-09-16T00:59:46.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:45 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1560058143' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:45 smithi098 ceph-mon[35346]: osdmap e87: 12 total, 12 up, 12 in 2024-09-16T00:59:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:45 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1560058143' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:46.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:46 smithi012 ceph-mon[31197]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-16T00:59:46.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:46 smithi012 ceph-mon[31197]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-16T00:59:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.051+0000 7f551c476640 1 -- 172.21.15.12:0/4186340023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5514101420 msgr2=0x7f551410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.051+0000 7f551c476640 1 --2- 172.21.15.12:0/4186340023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5514101420 0x7f551410d950 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f550c009cd0 tx=0x7f550c02a8e0 comp rx=0 tx=0).stop 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.051+0000 7f551c476640 1 -- 172.21.15.12:0/4186340023 shutdown_connections 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.051+0000 7f551c476640 1 --2- 172.21.15.12:0/4186340023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5514101420 0x7f551410d950 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.051+0000 7f551c476640 1 --2- 172.21.15.12:0/4186340023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5514100a80 0x7f5514100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.051+0000 7f551c476640 1 --2- 172.21.15.12:0/4186340023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5514106a80 0x7f5514106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.051+0000 7f551c476640 1 -- 172.21.15.12:0/4186340023 >> 172.21.15.12:0/4186340023 conn(0x7f55140fc7a0 msgr2=0x7f55140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.051+0000 7f551c476640 1 -- 172.21.15.12:0/4186340023 shutdown_connections 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.051+0000 7f551c476640 1 -- 172.21.15.12:0/4186340023 wait complete. 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f551c476640 1 Processor -- start 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f551c476640 1 -- start start 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f551c476640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5514100a80 0x7f5514199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f551c476640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5514101420 0x7f55141998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f551c476640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5514106a80 0x7f5514199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f551c476640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5514110ed0 con 0x7f5514101420 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f551c476640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5514110d50 con 0x7f5514100a80 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f551c476640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5514111050 con 0x7f5514106a80 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f5519a11640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5514101420 0x7f55141998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f5519a11640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5514101420 0x7f55141998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55042/0 (socket says 172.21.15.12:55042) 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f5519a11640 1 -- 172.21.15.12:0/42324289 learned_addr learned my addr 172.21.15.12:0/42324289 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f551a212640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5514100a80 0x7f5514199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f551aa13640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5514106a80 0x7f5514199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f5519a11640 1 -- 172.21.15.12:0/42324289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5514106a80 msgr2=0x7f5514199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f5519a11640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5514106a80 0x7f5514199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f5519a11640 1 -- 172.21.15.12:0/42324289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5514100a80 msgr2=0x7f5514199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f5519a11640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5514100a80 0x7f5514199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:47.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f5519a11640 1 -- 172.21.15.12:0/42324289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55141a4770 con 0x7f5514101420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.052+0000 7f5519a11640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5514101420 0x7f55141998b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f550400e9f0 tx=0x7f550400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.053+0000 7f550b7fe640 1 -- 172.21.15.12:0/42324289 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550400cd80 con 0x7f5514101420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.053+0000 7f550b7fe640 1 -- 172.21.15.12:0/42324289 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5504010910 con 0x7f5514101420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.053+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55141a4a60 con 0x7f5514101420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.053+0000 7f550b7fe640 1 -- 172.21.15.12:0/42324289 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504018990 con 0x7f5514101420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.053+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55141a4fa0 con 0x7f5514101420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.053+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f55140628c0 con 0x7f5514101420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.055+0000 7f550b7fe640 1 -- 172.21.15.12:0/42324289 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5504010ac0 con 0x7f5514101420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.055+0000 7f550b7fe640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55000a32d0 0x7f55000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.056+0000 7f551a212640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55000a32d0 0x7f55000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.056+0000 7f550b7fe640 1 -- 172.21.15.12:0/42324289 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f55040d0810 con 0x7f5514101420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.056+0000 7f550b7fe640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] conn(0x7f55000ae420 0x7f55000b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.056+0000 7f550b7fe640 1 -- 172.21.15.12:0/42324289 --> [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5504022e50 con 0x7f55000ae420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.056+0000 7f550b7fe640 1 -- 172.21.15.12:0/42324289 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f55040d0c60 con 0x7f5514101420 2024-09-16T00:59:47.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.056+0000 7f551a212640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55000a32d0 0x7f55000a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5510009b50 tx=0x7f5510005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:47.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.056+0000 7f551aa13640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] conn(0x7f55000ae420 0x7f55000b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:47.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.056+0000 7f551aa13640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] conn(0x7f55000ae420 0x7f55000b08c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:47.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.057+0000 7f550b7fe640 1 -- 172.21.15.12:0/42324289 <== osd.11 v2:172.21.15.119:6824/4062307393 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5504022e50 con 0x7f55000ae420 2024-09-16T00:59:47.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.071+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 --> [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5514062cc0 con 0x7f55000ae420 2024-09-16T00:59:47.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.071+0000 7f550b7fe640 1 -- 172.21.15.12:0/42324289 <== osd.11 v2:172.21.15.119:6824/4062307393 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5514062cc0 con 0x7f55000ae420 2024-09-16T00:59:47.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 >> [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] conn(0x7f55000ae420 msgr2=0x7f55000b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:47.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551c476640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] conn(0x7f55000ae420 0x7f55000b08c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:47.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55000a32d0 msgr2=0x7f55000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:47.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551c476640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55000a32d0 0x7f55000a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5510009b50 tx=0x7f5510005f90 comp rx=0 tx=0).stop 2024-09-16T00:59:47.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5514101420 msgr2=0x7f55141998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:47.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551c476640 1 --2- 172.21.15.12:0/42324289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5514101420 0x7f55141998b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f550400e9f0 tx=0x7f550400eeb0 comp rx=0 tx=0).stop 2024-09-16T00:59:47.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551aa13640 1 -- 172.21.15.12:0/42324289 reap_dead start 2024-09-16T00:59:47.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 shutdown_connections 2024-09-16T00:59:47.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 >> 172.21.15.12:0/42324289 conn(0x7f55140fc7a0 msgr2=0x7f55140fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:47.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 shutdown_connections 2024-09-16T00:59:47.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:47.072+0000 7f551c476640 1 -- 172.21.15.12:0/42324289 wait complete. 2024-09-16T00:59:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:46 smithi119 ceph-mon[35049]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-16T00:59:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:46 smithi119 ceph-mon[35049]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-16T00:59:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:46 smithi098 ceph-mon[35346]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-16T00:59:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:46 smithi098 ceph-mon[35346]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-16T00:59:47.747 INFO:teuthology.orchestra.run.smithi012.stdout:313532612636 2024-09-16T00:59:47.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-16T00:59:47.824 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:47.824 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:47.824 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:47.829 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:47.829 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.613+0000 7fcef3c6c640 1 -- 172.21.15.12:0/3823516874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceec101420 msgr2=0x7fceec10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.613+0000 7fcef3c6c640 1 --2- 172.21.15.12:0/3823516874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceec101420 0x7fceec10d950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009cd0 tx=0x7fcee402a8e0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.613+0000 7fcef3c6c640 1 -- 172.21.15.12:0/3823516874 shutdown_connections 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.613+0000 7fcef3c6c640 1 --2- 172.21.15.12:0/3823516874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceec101420 0x7fceec10d950 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.613+0000 7fcef3c6c640 1 --2- 172.21.15.12:0/3823516874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec100a80 0x7fceec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.613+0000 7fcef3c6c640 1 --2- 172.21.15.12:0/3823516874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceec106a80 0x7fceec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.613+0000 7fcef3c6c640 1 -- 172.21.15.12:0/3823516874 >> 172.21.15.12:0/3823516874 conn(0x7fceec0fc7a0 msgr2=0x7fceec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.613+0000 7fcef3c6c640 1 -- 172.21.15.12:0/3823516874 shutdown_connections 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.613+0000 7fcef3c6c640 1 -- 172.21.15.12:0/3823516874 wait complete. 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef3c6c640 1 Processor -- start 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef3c6c640 1 -- start start 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef3c6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceec100a80 0x7fceec0fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef3c6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceec101420 0x7fceec0fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef3c6c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec106a80 0x7fceec0fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef3c6c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fceec110f20 con 0x7fceec100a80 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef3c6c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fceec110da0 con 0x7fceec101420 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef3c6c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fceec1110a0 con 0x7fceec106a80 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef1a08640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceec100a80 0x7fceec0fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef1a08640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceec100a80 0x7fceec0fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55054/0 (socket says 172.21.15.12:55054) 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef1a08640 1 -- 172.21.15.12:0/2593470934 learned_addr learned my addr 172.21.15.12:0/2593470934 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef2209640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec106a80 0x7fceec0fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.614+0000 7fcef1207640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceec101420 0x7fceec0fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcef1a08640 1 -- 172.21.15.12:0/2593470934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec106a80 msgr2=0x7fceec0fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcef1a08640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceec106a80 0x7fceec0fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcef1a08640 1 -- 172.21.15.12:0/2593470934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceec101420 msgr2=0x7fceec0fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcef1a08640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceec101420 0x7fceec0fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcef1a08640 1 -- 172.21.15.12:0/2593470934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec1a6a20 con 0x7fceec100a80 2024-09-16T00:59:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcef1a08640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceec100a80 0x7fceec0fcde0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcee800b4a0 tx=0x7fcee800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcee2ffd640 1 -- 172.21.15.12:0/2593470934 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8014070 con 0x7fceec100a80 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceec1a6d10 con 0x7fceec100a80 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcee2ffd640 1 -- 172.21.15.12:0/2593470934 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcee8010af0 con 0x7fceec100a80 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcee2ffd640 1 -- 172.21.15.12:0/2593470934 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8017d10 con 0x7fceec100a80 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.615+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceec1a71f0 con 0x7fceec100a80 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.616+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fceec0628c0 con 0x7fceec100a80 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.617+0000 7fcee2ffd640 1 -- 172.21.15.12:0/2593470934 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcee8017070 con 0x7fceec100a80 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.618+0000 7fcee2ffd640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fced80a32d0 0x7fced80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.618+0000 7fcef1207640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fced80a32d0 0x7fced80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.618+0000 7fcee2ffd640 1 -- 172.21.15.12:0/2593470934 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fcee80cf430 con 0x7fceec100a80 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.618+0000 7fcee2ffd640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] conn(0x7fced80ae420 0x7fced80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.618+0000 7fcee2ffd640 1 -- 172.21.15.12:0/2593470934 --> [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcee800dec0 con 0x7fced80ae420 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.618+0000 7fcee2ffd640 1 -- 172.21.15.12:0/2593470934 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fcee80cf880 con 0x7fceec100a80 2024-09-16T00:59:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.618+0000 7fcef1207640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fced80a32d0 0x7fced80a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fceec0fe870 tx=0x7fcedc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.618+0000 7fcef2209640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] conn(0x7fced80ae420 0x7fced80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.619+0000 7fcef2209640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] conn(0x7fced80ae420 0x7fced80b08c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.620+0000 7fcee2ffd640 1 -- 172.21.15.12:0/2593470934 <== osd.8 v2:172.21.15.119:6816/1727447871 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcee800dec0 con 0x7fced80ae420 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.633+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 --> [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fceec062cc0 con 0x7fced80ae420 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.634+0000 7fcee2ffd640 1 -- 172.21.15.12:0/2593470934 <== osd.8 v2:172.21.15.119:6816/1727447871 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fceec062cc0 con 0x7fced80ae420 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 >> [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] conn(0x7fced80ae420 msgr2=0x7fced80b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef3c6c640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] conn(0x7fced80ae420 0x7fced80b08c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fced80a32d0 msgr2=0x7fced80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef3c6c640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fced80a32d0 0x7fced80a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fceec0fe870 tx=0x7fcedc008040 comp rx=0 tx=0).stop 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceec100a80 msgr2=0x7fceec0fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef3c6c640 1 --2- 172.21.15.12:0/2593470934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceec100a80 0x7fceec0fcde0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcee800b4a0 tx=0x7fcee800b960 comp rx=0 tx=0).stop 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef2209640 1 -- 172.21.15.12:0/2593470934 reap_dead start 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 shutdown_connections 2024-09-16T00:59:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 >> 172.21.15.12:0/2593470934 conn(0x7fceec0fc7a0 msgr2=0x7fceec06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:48.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 shutdown_connections 2024-09-16T00:59:48.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.635+0000 7fcef3c6c640 1 -- 172.21.15.12:0/2593470934 wait complete. 2024-09-16T00:59:48.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.822+0000 7f481c993640 1 -- 172.21.15.12:0/2023956407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4818102d40 msgr2=0x7f4818103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.822+0000 7f481c993640 1 --2- 172.21.15.12:0/2023956407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4818102d40 0x7f4818103120 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4808009900 tx=0x7f480802a480 comp rx=0 tx=0).stop 2024-09-16T00:59:48.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.822+0000 7f481c993640 1 -- 172.21.15.12:0/2023956407 shutdown_connections 2024-09-16T00:59:48.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.822+0000 7f481c993640 1 --2- 172.21.15.12:0/2023956407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f481810c170 0x7f481810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.822+0000 7f481c993640 1 --2- 172.21.15.12:0/2023956407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4818103660 0x7f481810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.822+0000 7f481c993640 1 --2- 172.21.15.12:0/2023956407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4818102d40 0x7f4818103120 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.822+0000 7f481c993640 1 -- 172.21.15.12:0/2023956407 >> 172.21.15.12:0/2023956407 conn(0x7f48180fc7a0 msgr2=0x7f48180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:48.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.822+0000 7f481c993640 1 -- 172.21.15.12:0/2023956407 shutdown_connections 2024-09-16T00:59:48.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.822+0000 7f481c993640 1 -- 172.21.15.12:0/2023956407 wait complete. 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f481c993640 1 Processor -- start 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f481c993640 1 -- start start 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f481c993640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4818102d40 0x7f4818198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f481c993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4818103660 0x7f4818198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f481c993640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f481810c170 0x7f481819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f481c993640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4818111f70 con 0x7f4818103660 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f481c993640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4818111df0 con 0x7f4818102d40 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f481c993640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f48181120f0 con 0x7f481810c170 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f4815d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4818103660 0x7f4818198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f4815d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4818103660 0x7f4818198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55068/0 (socket says 172.21.15.12:55068) 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.823+0000 7f4815d9b640 1 -- 172.21.15.12:0/3764798336 learned_addr learned my addr 172.21.15.12:0/3764798336 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f481659c640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4818102d40 0x7f4818198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f4816d9d640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f481810c170 0x7f481819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f4815d9b640 1 -- 172.21.15.12:0/3764798336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f481810c170 msgr2=0x7f481819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f4815d9b640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f481810c170 0x7f481819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f4815d9b640 1 -- 172.21.15.12:0/3764798336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4818102d40 msgr2=0x7f4818198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f4815d9b640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4818102d40 0x7f4818198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f4815d9b640 1 -- 172.21.15.12:0/3764798336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481819d400 con 0x7f4818103660 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f4816d9d640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f481810c170 0x7f481819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f481659c640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4818102d40 0x7f4818198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f4815d9b640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4818103660 0x7f4818198990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f480000c970 tx=0x7f480000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f480f7fe640 1 -- 172.21.15.12:0/3764798336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800007bb0 con 0x7f4818103660 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f480f7fe640 1 -- 172.21.15.12:0/3764798336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4800007d50 con 0x7f4818103660 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481819d6f0 con 0x7f4818103660 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f480f7fe640 1 -- 172.21.15.12:0/3764798336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480000f450 con 0x7f4818103660 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.824+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48181a4fd0 con 0x7f4818103660 2024-09-16T00:59:48.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.825+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4818062940 con 0x7f4818103660 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.826+0000 7f480f7fe640 1 -- 172.21.15.12:0/3764798336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4800004f20 con 0x7f4818103660 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.827+0000 7f480f7fe640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48040a32d0 0x7f48040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.827+0000 7f480f7fe640 1 -- 172.21.15.12:0/3764798336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f48000cff80 con 0x7f4818103660 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.827+0000 7f481659c640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48040a32d0 0x7f48040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.827+0000 7f480f7fe640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] conn(0x7f48040ae420 0x7f48040b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.827+0000 7f480f7fe640 1 -- 172.21.15.12:0/3764798336 --> [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4800012ec0 con 0x7f48040ae420 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.827+0000 7f480f7fe640 1 -- 172.21.15.12:0/3764798336 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f48000d03d0 con 0x7f4818103660 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.827+0000 7f4816d9d640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] conn(0x7f48040ae420 0x7f48040b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.828+0000 7f481659c640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48040a32d0 0x7f48040a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4808000c00 tx=0x7f4808032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.828+0000 7f4816d9d640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] conn(0x7f48040ae420 0x7f48040b08c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:48.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.828+0000 7f480f7fe640 1 -- 172.21.15.12:0/3764798336 <== osd.0 v2:172.21.15.12:6802/363081419 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4800012ec0 con 0x7f48040ae420 2024-09-16T00:59:48.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 --> [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4818062dc0 con 0x7f48040ae420 2024-09-16T00:59:48.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f480f7fe640 1 -- 172.21.15.12:0/3764798336 <== osd.0 v2:172.21.15.12:6802/363081419 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4818062dc0 con 0x7f48040ae420 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] conn(0x7f48040ae420 msgr2=0x7f48040b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f481c993640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] conn(0x7f48040ae420 0x7f48040b08c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48040a32d0 msgr2=0x7f48040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f481c993640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48040a32d0 0x7f48040a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4808000c00 tx=0x7f4808032c70 comp rx=0 tx=0).stop 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4818103660 msgr2=0x7f4818198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f481c993640 1 --2- 172.21.15.12:0/3764798336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4818103660 0x7f4818198990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f480000c970 tx=0x7f480000ce30 comp rx=0 tx=0).stop 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f4816d9d640 1 -- 172.21.15.12:0/3764798336 reap_dead start 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 shutdown_connections 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.843+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 >> 172.21.15.12:0/3764798336 conn(0x7f48180fc7a0 msgr2=0x7f48180fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.844+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 shutdown_connections 2024-09-16T00:59:48.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:48.844+0000 7f481c993640 1 -- 172.21.15.12:0/3764798336 wait complete. 2024-09-16T00:59:48.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:48 smithi012 ceph-mon[31197]: pgmap v319: 129 pgs: 3 peering, 126 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T00:59:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:48 smithi119 ceph-mon[35049]: pgmap v319: 129 pgs: 3 peering, 126 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T00:59:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:48 smithi098 ceph-mon[35346]: pgmap v319: 129 pgs: 3 peering, 126 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T00:59:49.942 INFO:teuthology.orchestra.run.smithi012.stdout:231928234027 2024-09-16T00:59:49.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-16T00:59:50.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.128+0000 7f98161c5640 1 -- 172.21.15.12:0/2147363440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981010c170 msgr2=0x7f981010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.128+0000 7f98161c5640 1 --2- 172.21.15.12:0/2147363440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981010c170 0x7f981010e610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9808009ca0 tx=0x7f980802a950 comp rx=0 tx=0).stop 2024-09-16T00:59:50.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.128+0000 7f98161c5640 1 -- 172.21.15.12:0/2147363440 shutdown_connections 2024-09-16T00:59:50.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.128+0000 7f98161c5640 1 --2- 172.21.15.12:0/2147363440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981010c170 0x7f981010e610 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.128+0000 7f98161c5640 1 --2- 172.21.15.12:0/2147363440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810103660 0x7f981010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.128+0000 7f98161c5640 1 --2- 172.21.15.12:0/2147363440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9810102d40 0x7f9810103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.128+0000 7f98161c5640 1 -- 172.21.15.12:0/2147363440 >> 172.21.15.12:0/2147363440 conn(0x7f98100fc7a0 msgr2=0x7f98100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.128+0000 7f98161c5640 1 -- 172.21.15.12:0/2147363440 shutdown_connections 2024-09-16T00:59:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.128+0000 7f98161c5640 1 -- 172.21.15.12:0/2147363440 wait complete. 2024-09-16T00:59:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.129+0000 7f98161c5640 1 Processor -- start 2024-09-16T00:59:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.129+0000 7f98161c5640 1 -- start start 2024-09-16T00:59:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.129+0000 7f98161c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9810102d40 0x7f98101009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.129+0000 7f98161c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810103660 0x7f9810100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.129+0000 7f98161c5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f981010c170 0x7f9810101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f98161c5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9810111f30 con 0x7f9810102d40 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f98161c5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9810111db0 con 0x7f981010c170 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f98161c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f98101120b0 con 0x7f9810103660 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9810102d40 0x7f98101009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9810102d40 0x7f98101009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55090/0 (socket says 172.21.15.12:55090) 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980f7fe640 1 -- 172.21.15.12:0/2947551004 learned_addr learned my addr 172.21.15.12:0/2947551004 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980ffff640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f981010c170 0x7f9810101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980effd640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810103660 0x7f9810100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980f7fe640 1 -- 172.21.15.12:0/2947551004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810103660 msgr2=0x7f9810100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980f7fe640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9810103660 0x7f9810100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980f7fe640 1 -- 172.21.15.12:0/2947551004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f981010c170 msgr2=0x7f9810101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980f7fe640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f981010c170 0x7f9810101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980f7fe640 1 -- 172.21.15.12:0/2947551004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98101a68a0 con 0x7f9810102d40 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980f7fe640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9810102d40 0x7f98101009a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f980000d950 tx=0x7f980000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f980cff9640 1 -- 172.21.15.12:0/2947551004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800017030 con 0x7f9810102d40 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.130+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98101a6b90 con 0x7f9810102d40 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.131+0000 7f980cff9640 1 -- 172.21.15.12:0/2947551004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9800004020 con 0x7f9810102d40 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.131+0000 7f980cff9640 1 -- 172.21.15.12:0/2947551004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98000047a0 con 0x7f9810102d40 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.131+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98101a7120 con 0x7f9810102d40 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.132+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f98100628c0 con 0x7f9810102d40 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.133+0000 7f980cff9640 1 -- 172.21.15.12:0/2947551004 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f98000041d0 con 0x7f9810102d40 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.133+0000 7f980cff9640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f97f80a32d0 0x7f97f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.133+0000 7f980cff9640 1 -- 172.21.15.12:0/2947551004 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f98000cf710 con 0x7f9810102d40 2024-09-16T00:59:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.133+0000 7f980effd640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f97f80a32d0 0x7f97f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:50.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.134+0000 7f980cff9640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] conn(0x7f97f80ae420 0x7f97f80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:50.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.134+0000 7f980cff9640 1 -- 172.21.15.12:0/2947551004 --> [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97f80b0f90 con 0x7f97f80ae420 2024-09-16T00:59:50.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.134+0000 7f980cff9640 1 -- 172.21.15.12:0/2947551004 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f98000d6050 con 0x7f9810102d40 2024-09-16T00:59:50.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.134+0000 7f980effd640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f97f80a32d0 0x7f97f80a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9810102430 tx=0x7f980400b360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:50.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.134+0000 7f980ffff640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] conn(0x7f97f80ae420 0x7f97f80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:50.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.134+0000 7f980ffff640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] conn(0x7f97f80ae420 0x7f97f80b08c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:50.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.135+0000 7f980cff9640 1 -- 172.21.15.12:0/2947551004 <== osd.2 v2:172.21.15.119:6800/3491429477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97f80b0f90 con 0x7f97f80ae420 2024-09-16T00:59:50.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.149+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 --> [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9810062cf0 con 0x7f97f80ae420 2024-09-16T00:59:50.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.150+0000 7f980cff9640 1 -- 172.21.15.12:0/2947551004 <== osd.2 v2:172.21.15.119:6800/3491429477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9810062cf0 con 0x7f97f80ae420 2024-09-16T00:59:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.150+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 >> [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] conn(0x7f97f80ae420 msgr2=0x7f97f80b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.150+0000 7f98161c5640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] conn(0x7f97f80ae420 0x7f97f80b08c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.151+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f97f80a32d0 msgr2=0x7f97f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.151+0000 7f98161c5640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f97f80a32d0 0x7f97f80a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9810102430 tx=0x7f980400b360 comp rx=0 tx=0).stop 2024-09-16T00:59:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.151+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9810102d40 msgr2=0x7f98101009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.151+0000 7f98161c5640 1 --2- 172.21.15.12:0/2947551004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9810102d40 0x7f98101009a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f980000d950 tx=0x7f980000de10 comp rx=0 tx=0).stop 2024-09-16T00:59:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.151+0000 7f980ffff640 1 -- 172.21.15.12:0/2947551004 reap_dead start 2024-09-16T00:59:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.151+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 shutdown_connections 2024-09-16T00:59:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.151+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 >> 172.21.15.12:0/2947551004 conn(0x7f98100fc7a0 msgr2=0x7f98100fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.151+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 shutdown_connections 2024-09-16T00:59:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.151+0000 7f98161c5640 1 -- 172.21.15.12:0/2947551004 wait complete. 2024-09-16T00:59:50.389 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 -- 172.21.15.12:0/156143508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b81036e0 msgr2=0x7f29b8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 --2- 172.21.15.12:0/156143508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b81036e0 0x7f29b8107b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009930 tx=0x7f29ac02a420 comp rx=0 tx=0).stop 2024-09-16T00:59:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 -- 172.21.15.12:0/156143508 shutdown_connections 2024-09-16T00:59:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 --2- 172.21.15.12:0/156143508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29b81082a0 0x7f29b810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 --2- 172.21.15.12:0/156143508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b81036e0 0x7f29b8107b90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 --2- 172.21.15.12:0/156143508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b8102d30 0x7f29b8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 -- 172.21.15.12:0/156143508 >> 172.21.15.12:0/156143508 conn(0x7f29b80fc7d0 msgr2=0x7f29b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 -- 172.21.15.12:0/156143508 shutdown_connections 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 -- 172.21.15.12:0/156143508 wait complete. 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 Processor -- start 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.837+0000 7f29bed3d640 1 -- start start 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bed3d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8102d30 0x7f29b8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bed3d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29b81036e0 0x7f29b8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bed3d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b81082a0 0x7f29b8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bed3d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81120a0 con 0x7f29b8102d30 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bed3d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8111f20 con 0x7f29b81036e0 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bed3d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8112220 con 0x7f29b81082a0 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bcad9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8102d30 0x7f29b8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bcad9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8102d30 0x7f29b8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55110/0 (socket says 172.21.15.12:55110) 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bcad9640 1 -- 172.21.15.12:0/1821352960 learned_addr learned my addr 172.21.15.12:0/1821352960 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bd2da640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b81082a0 0x7f29b8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29b7fff640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29b81036e0 0x7f29b8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bcad9640 1 -- 172.21.15.12:0/1821352960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b81082a0 msgr2=0x7f29b8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bcad9640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b81082a0 0x7f29b8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bcad9640 1 -- 172.21.15.12:0/1821352960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29b81036e0 msgr2=0x7f29b8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bcad9640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29b81036e0 0x7f29b8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bcad9640 1 -- 172.21.15.12:0/1821352960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b81a6aa0 con 0x7f29b8102d30 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29b7fff640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29b81036e0 0x7f29b8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bcad9640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8102d30 0x7f29b8100990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f29a800d770 tx=0x7f29a800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29b5ffb640 1 -- 172.21.15.12:0/1821352960 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8017070 con 0x7f29b8102d30 2024-09-16T00:59:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29b5ffb640 1 -- 172.21.15.12:0/1821352960 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29a8005500 con 0x7f29b8102d30 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b81a6d90 con 0x7f29b8102d30 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.838+0000 7f29b5ffb640 1 -- 172.21.15.12:0/1821352960 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8004e00 con 0x7f29b8102d30 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.839+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b81a7270 con 0x7f29b8102d30 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.840+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29b80628c0 con 0x7f29b8102d30 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.841+0000 7f29b5ffb640 1 -- 172.21.15.12:0/1821352960 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f29a8004fa0 con 0x7f29b8102d30 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.841+0000 7f29b5ffb640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29a00a3350 0x7f29a00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.842+0000 7f29b7fff640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29a00a3350 0x7f29a00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.842+0000 7f29b5ffb640 1 -- 172.21.15.12:0/1821352960 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f29a80cfc20 con 0x7f29b8102d30 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.842+0000 7f29b5ffb640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] conn(0x7f29a00ae4a0 0x7f29a00b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.842+0000 7f29b5ffb640 1 -- 172.21.15.12:0/1821352960 --> [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29a8001d30 con 0x7f29a00ae4a0 2024-09-16T00:59:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.842+0000 7f29b5ffb640 1 -- 172.21.15.12:0/1821352960 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f29a80cffd0 con 0x7f29b8102d30 2024-09-16T00:59:50.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.842+0000 7f29b7fff640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29a00a3350 0x7f29a00a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29ac02a940 tx=0x7f29ac032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:50.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.842+0000 7f29bd2da640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] conn(0x7f29a00ae4a0 0x7f29a00b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:50.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.843+0000 7f29bd2da640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] conn(0x7f29a00ae4a0 0x7f29a00b0940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:50.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.843+0000 7f29b5ffb640 1 -- 172.21.15.12:0/1821352960 <== osd.1 v2:172.21.15.98:6800/1011366493 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29a8001d30 con 0x7f29a00ae4a0 2024-09-16T00:59:50.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.857+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 --> [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29b8062cc0 con 0x7f29a00ae4a0 2024-09-16T00:59:50.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.858+0000 7f29b5ffb640 1 -- 172.21.15.12:0/1821352960 <== osd.1 v2:172.21.15.98:6800/1011366493 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f29b8062cc0 con 0x7f29a00ae4a0 2024-09-16T00:59:50.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.858+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 >> [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] conn(0x7f29a00ae4a0 msgr2=0x7f29a00b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.858+0000 7f29bed3d640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] conn(0x7f29a00ae4a0 0x7f29a00b0940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.859+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29a00a3350 msgr2=0x7f29a00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.859+0000 7f29bed3d640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f29a00a3350 0x7f29a00a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29ac02a940 tx=0x7f29ac032c70 comp rx=0 tx=0).stop 2024-09-16T00:59:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.859+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8102d30 msgr2=0x7f29b8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.859+0000 7f29bed3d640 1 --2- 172.21.15.12:0/1821352960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8102d30 0x7f29b8100990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f29a800d770 tx=0x7f29a800dc30 comp rx=0 tx=0).stop 2024-09-16T00:59:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.859+0000 7f29bd2da640 1 -- 172.21.15.12:0/1821352960 reap_dead start 2024-09-16T00:59:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.859+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 shutdown_connections 2024-09-16T00:59:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.859+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 >> 172.21.15.12:0/1821352960 conn(0x7f29b80fc7d0 msgr2=0x7f29b8105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.859+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 shutdown_connections 2024-09-16T00:59:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:50.859+0000 7f29bed3d640 1 -- 172.21.15.12:0/1821352960 wait complete. 2024-09-16T00:59:51.095 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:50 smithi012 ceph-mon[31197]: pgmap v320: 129 pgs: 3 peering, 126 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T00:59:51.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:50 smithi098 ceph-mon[35346]: pgmap v320: 129 pgs: 3 peering, 126 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T00:59:51.333 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:51.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:50 smithi119 ceph-mon[35049]: pgmap v320: 129 pgs: 3 peering, 126 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T00:59:51.793 INFO:teuthology.orchestra.run.smithi012.stdout:34359738452 2024-09-16T00:59:51.794 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-16T00:59:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.963+0000 7fc4fec29640 1 -- 172.21.15.12:0/3262040497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4f8100e20 msgr2=0x7fc4f8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.963+0000 7fc4fec29640 1 --2- 172.21.15.12:0/3262040497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4f8100e20 0x7fc4f8101200 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009900 tx=0x7fc4ec02a480 comp rx=0 tx=0).stop 2024-09-16T00:59:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.963+0000 7fc4fec29640 1 -- 172.21.15.12:0/3262040497 shutdown_connections 2024-09-16T00:59:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.963+0000 7fc4fec29640 1 --2- 172.21.15.12:0/3262040497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4f8102ef0 0x7fc4f810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.963+0000 7fc4fec29640 1 --2- 172.21.15.12:0/3262040497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8102570 0x7fc4f81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.963+0000 7fc4fec29640 1 --2- 172.21.15.12:0/3262040497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4f8100e20 0x7fc4f8101200 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.963+0000 7fc4fec29640 1 -- 172.21.15.12:0/3262040497 >> 172.21.15.12:0/3262040497 conn(0x7fc4f80fc7d0 msgr2=0x7fc4f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.963+0000 7fc4fec29640 1 -- 172.21.15.12:0/3262040497 shutdown_connections 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.963+0000 7fc4fec29640 1 -- 172.21.15.12:0/3262040497 wait complete. 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.964+0000 7fc4fec29640 1 Processor -- start 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.964+0000 7fc4fec29640 1 -- start start 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.964+0000 7fc4fec29640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4f8100e20 0x7fc4f8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.964+0000 7fc4fec29640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8102570 0x7fc4f81997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.964+0000 7fc4fec29640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4f8102ef0 0x7fc4f81a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.964+0000 7fc4fec29640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f8110f50 con 0x7fc4f8100e20 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.964+0000 7fc4fec29640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f8110dd0 con 0x7fc4f8102ef0 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.964+0000 7fc4fec29640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81110d0 con 0x7fc4f8102570 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fc9c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4f8100e20 0x7fc4f8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fc9c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4f8100e20 0x7fc4f8199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55126/0 (socket says 172.21.15.12:55126) 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fc9c5640 1 -- 172.21.15.12:0/1892190056 learned_addr learned my addr 172.21.15.12:0/1892190056 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fd1c6640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4f8102ef0 0x7fc4f81a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4f7fff640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8102570 0x7fc4f81997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fc9c5640 1 -- 172.21.15.12:0/1892190056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8102570 msgr2=0x7fc4f81997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fc9c5640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4f8102570 0x7fc4f81997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fc9c5640 1 -- 172.21.15.12:0/1892190056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4f8102ef0 msgr2=0x7fc4f81a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fc9c5640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4f8102ef0 0x7fc4f81a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fc9c5640 1 -- 172.21.15.12:0/1892190056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f81a4840 con 0x7fc4f8100e20 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fc9c5640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4f8100e20 0x7fc4f8199280 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec006010 tx=0x7fc4ec003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/1892190056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec03f070 con 0x7fc4f8100e20 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f81a4a10 con 0x7fc4f8100e20 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.965+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/1892190056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4ec031c30 con 0x7fc4f8100e20 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.966+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/1892190056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec035030 con 0x7fc4f8100e20 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.966+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f81a4ec0 con 0x7fc4f8100e20 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.967+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4f8107220 con 0x7fc4f8100e20 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.968+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/1892190056 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc4ec042070 con 0x7fc4f8100e20 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.969+0000 7fc4f5ffb640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4e80a32d0 0x7fc4e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.969+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/1892190056 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fc4ec0f0ed0 con 0x7fc4f8100e20 2024-09-16T00:59:51.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.969+0000 7fc4f7fff640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4e80a32d0 0x7fc4e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:51.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.969+0000 7fc4f5ffb640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] conn(0x7fc4e80ae420 0x7fc4e80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:51.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.969+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/1892190056 --> [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4ec037ec0 con 0x7fc4e80ae420 2024-09-16T00:59:51.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.969+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/1892190056 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc4ec0f1280 con 0x7fc4f8100e20 2024-09-16T00:59:51.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.969+0000 7fc4f7fff640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4e80a32d0 0x7fc4e80a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4005e10 tx=0x7fc4e4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:51.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.969+0000 7fc4fd1c6640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] conn(0x7fc4e80ae420 0x7fc4e80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:51.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.970+0000 7fc4fd1c6640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] conn(0x7fc4e80ae420 0x7fc4e80b08c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:51.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.971+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/1892190056 <== osd.10 v2:172.21.15.98:6824/4044449416 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4ec037ec0 con 0x7fc4e80ae420 2024-09-16T00:59:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.985+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 --> [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc4f81021b0 con 0x7fc4e80ae420 2024-09-16T00:59:51.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.985+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/1892190056 <== osd.10 v2:172.21.15.98:6824/4044449416 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc4f81021b0 con 0x7fc4e80ae420 2024-09-16T00:59:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 >> [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] conn(0x7fc4e80ae420 msgr2=0x7fc4e80b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fec29640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] conn(0x7fc4e80ae420 0x7fc4e80b08c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4e80a32d0 msgr2=0x7fc4e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fec29640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4e80a32d0 0x7fc4e80a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4005e10 tx=0x7fc4e4005da0 comp rx=0 tx=0).stop 2024-09-16T00:59:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4f8100e20 msgr2=0x7fc4f8199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fec29640 1 --2- 172.21.15.12:0/1892190056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4f8100e20 0x7fc4f8199280 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec006010 tx=0x7fc4ec003c10 comp rx=0 tx=0).stop 2024-09-16T00:59:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fd1c6640 1 -- 172.21.15.12:0/1892190056 reap_dead start 2024-09-16T00:59:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 shutdown_connections 2024-09-16T00:59:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 >> 172.21.15.12:0/1892190056 conn(0x7fc4f80fc7d0 msgr2=0x7fc4f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 shutdown_connections 2024-09-16T00:59:51.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:51.986+0000 7fc4fec29640 1 -- 172.21.15.12:0/1892190056 wait complete. 2024-09-16T00:59:52.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:51 smithi012 ceph-mon[31197]: Health check update: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-16T00:59:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:51 smithi098 ceph-mon[35346]: Health check update: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-16T00:59:52.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:51 smithi119 ceph-mon[35049]: Health check update: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-16T00:59:52.771 INFO:teuthology.orchestra.run.smithi012.stdout:283467841568 2024-09-16T00:59:52.771 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-16T00:59:53.006 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:52 smithi012 ceph-mon[31197]: pgmap v321: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 10 op/s; 83 B/s, 0 objects/s recovering 2024-09-16T00:59:53.007 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:52 smithi012 ceph-mon[31197]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-16T00:59:53.007 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:52 smithi012 ceph-mon[31197]: Cluster is now healthy 2024-09-16T00:59:53.128 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:53.128 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:53.129 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:52 smithi098 ceph-mon[35346]: pgmap v321: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 10 op/s; 83 B/s, 0 objects/s recovering 2024-09-16T00:59:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:52 smithi098 ceph-mon[35346]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-16T00:59:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:52 smithi098 ceph-mon[35346]: Cluster is now healthy 2024-09-16T00:59:53.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:52 smithi119 ceph-mon[35049]: pgmap v321: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 10 op/s; 83 B/s, 0 objects/s recovering 2024-09-16T00:59:53.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:52 smithi119 ceph-mon[35049]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-16T00:59:53.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:52 smithi119 ceph-mon[35049]: Cluster is now healthy 2024-09-16T00:59:53.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.358+0000 7fd6f7a23640 1 -- 172.21.15.12:0/3962974187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f0101280 msgr2=0x7fd6f010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.358+0000 7fd6f7a23640 1 --2- 172.21.15.12:0/3962974187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f0101280 0x7fd6f010df40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009900 tx=0x7fd6e002a410 comp rx=0 tx=0).stop 2024-09-16T00:59:53.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.358+0000 7fd6f7a23640 1 -- 172.21.15.12:0/3962974187 shutdown_connections 2024-09-16T00:59:53.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.358+0000 7fd6f7a23640 1 --2- 172.21.15.12:0/3962974187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6f010e480 0x7fd6f0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.358+0000 7fd6f7a23640 1 --2- 172.21.15.12:0/3962974187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f0101280 0x7fd6f010df40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.358+0000 7fd6f7a23640 1 --2- 172.21.15.12:0/3962974187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6f01008d0 0x7fd6f0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.358+0000 7fd6f7a23640 1 -- 172.21.15.12:0/3962974187 >> 172.21.15.12:0/3962974187 conn(0x7fd6f00fc7a0 msgr2=0x7fd6f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.358+0000 7fd6f7a23640 1 -- 172.21.15.12:0/3962974187 shutdown_connections 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.358+0000 7fd6f7a23640 1 -- 172.21.15.12:0/3962974187 wait complete. 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.358+0000 7fd6f7a23640 1 Processor -- start 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f7a23640 1 -- start start 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f7a23640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6f01008d0 0x7fd6f019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f7a23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f0101280 0x7fd6f019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f7a23640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6f010e480 0x7fd6f019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f7a23640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f01141a0 con 0x7fd6f0101280 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f7a23640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0114020 con 0x7fd6f01008d0 2024-09-16T00:59:53.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f7a23640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0114320 con 0x7fd6f010e480 2024-09-16T00:59:53.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f4fbe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f0101280 0x7fd6f019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:53.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f4fbe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f0101280 0x7fd6f019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55134/0 (socket says 172.21.15.12:55134) 2024-09-16T00:59:53.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f4fbe640 1 -- 172.21.15.12:0/2832473476 learned_addr learned my addr 172.21.15.12:0/2832473476 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:53.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f57bf640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6f01008d0 0x7fd6f019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:53.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f5fc0640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6f010e480 0x7fd6f019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:53.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f4fbe640 1 -- 172.21.15.12:0/2832473476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6f010e480 msgr2=0x7fd6f019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f4fbe640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6f010e480 0x7fd6f019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f4fbe640 1 -- 172.21.15.12:0/2832473476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6f01008d0 msgr2=0x7fd6f019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f4fbe640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6f01008d0 0x7fd6f019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f4fbe640 1 -- 172.21.15.12:0/2832473476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f019f670 con 0x7fd6f0101280 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f5fc0640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6f010e480 0x7fd6f019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.359+0000 7fd6f4fbe640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f0101280 0x7fd6f019ac00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006010 tx=0x7fd6e0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.360+0000 7fd6e67fc640 1 -- 172.21.15.12:0/2832473476 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e003f030 con 0x7fd6f0101280 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.360+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f019f900 con 0x7fd6f0101280 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.360+0000 7fd6e67fc640 1 -- 172.21.15.12:0/2832473476 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6e0004440 con 0x7fd6f0101280 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.360+0000 7fd6e67fc640 1 -- 172.21.15.12:0/2832473476 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0035070 con 0x7fd6f0101280 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.360+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f01a7240 con 0x7fd6f0101280 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.360+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6f0062980 con 0x7fd6f0101280 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.362+0000 7fd6e67fc640 1 -- 172.21.15.12:0/2832473476 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd6e0042030 con 0x7fd6f0101280 2024-09-16T00:59:53.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.362+0000 7fd6e67fc640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd6dc0a32d0 0x7fd6dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:53.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.363+0000 7fd6e67fc640 1 -- 172.21.15.12:0/2832473476 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fd6e00f0a40 con 0x7fd6f0101280 2024-09-16T00:59:53.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.363+0000 7fd6f57bf640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd6dc0a32d0 0x7fd6dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:53.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.363+0000 7fd6e67fc640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] conn(0x7fd6dc0ae420 0x7fd6dc0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:53.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.363+0000 7fd6e67fc640 1 -- 172.21.15.12:0/2832473476 --> [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6dc0b0f90 con 0x7fd6dc0ae420 2024-09-16T00:59:53.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.363+0000 7fd6e67fc640 1 -- 172.21.15.12:0/2832473476 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fd6e00f0e90 con 0x7fd6f0101280 2024-09-16T00:59:53.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.363+0000 7fd6f5fc0640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] conn(0x7fd6dc0ae420 0x7fd6dc0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:53.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.363+0000 7fd6f57bf640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd6dc0a32d0 0x7fd6dc0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009bd0 tx=0x7fd6ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:53.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.363+0000 7fd6f5fc0640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] conn(0x7fd6dc0ae420 0x7fd6dc0b08c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:53.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.364+0000 7fd6e67fc640 1 -- 172.21.15.12:0/2832473476 <== osd.3 v2:172.21.15.12:6810/1376341190 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6dc0b0f90 con 0x7fd6dc0ae420 2024-09-16T00:59:53.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.378+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 --> [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd6f0062d80 con 0x7fd6dc0ae420 2024-09-16T00:59:53.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.378+0000 7fd6e67fc640 1 -- 172.21.15.12:0/2832473476 <== osd.3 v2:172.21.15.12:6810/1376341190 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd6f0062d80 con 0x7fd6dc0ae420 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.378+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] conn(0x7fd6dc0ae420 msgr2=0x7fd6dc0b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.379+0000 7fd6f7a23640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] conn(0x7fd6dc0ae420 0x7fd6dc0b08c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.379+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd6dc0a32d0 msgr2=0x7fd6dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.379+0000 7fd6f7a23640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd6dc0a32d0 0x7fd6dc0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009bd0 tx=0x7fd6ec005f90 comp rx=0 tx=0).stop 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.379+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f0101280 msgr2=0x7fd6f019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.379+0000 7fd6f7a23640 1 --2- 172.21.15.12:0/2832473476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f0101280 0x7fd6f019ac00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006010 tx=0x7fd6e0004040 comp rx=0 tx=0).stop 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.379+0000 7fd6f5fc0640 1 -- 172.21.15.12:0/2832473476 reap_dead start 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.379+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 shutdown_connections 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.379+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 >> 172.21.15.12:0/2832473476 conn(0x7fd6f00fc7a0 msgr2=0x7fd6f00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.379+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 shutdown_connections 2024-09-16T00:59:53.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:53.379+0000 7fd6f7a23640 1 -- 172.21.15.12:0/2832473476 wait complete. 2024-09-16T00:59:54.396 INFO:teuthology.orchestra.run.smithi012.stdout:98784247878 2024-09-16T00:59:54.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-16T00:59:54.815 INFO:teuthology.orchestra.run.smithi012.stdout:51539607631 2024-09-16T00:59:54.815 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-16T00:59:55.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:54 smithi012 ceph-mon[31197]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 563 B/s wr, 11 op/s; 73 B/s, 0 objects/s recovering 2024-09-16T00:59:55.148 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:54 smithi119 ceph-mon[35049]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 563 B/s wr, 11 op/s; 73 B/s, 0 objects/s recovering 2024-09-16T00:59:55.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:54 smithi098 ceph-mon[35346]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 563 B/s wr, 11 op/s; 73 B/s, 0 objects/s recovering 2024-09-16T00:59:55.279 INFO:teuthology.orchestra.run.smithi012.stdout:73014444106 2024-09-16T00:59:55.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-16T00:59:55.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.602+0000 7fc07e742640 1 -- 172.21.15.12:0/1019315259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc078101280 msgr2=0x7fc07810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:55.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.602+0000 7fc07e742640 1 --2- 172.21.15.12:0/1019315259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc078101280 0x7fc07810df40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc060009900 tx=0x7fc06002a410 comp rx=0 tx=0).stop 2024-09-16T00:59:55.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 -- 172.21.15.12:0/1019315259 shutdown_connections 2024-09-16T00:59:55.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 --2- 172.21.15.12:0/1019315259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc07810e480 0x7fc078110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:55.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 --2- 172.21.15.12:0/1019315259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc078101280 0x7fc07810df40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:55.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 --2- 172.21.15.12:0/1019315259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0781008d0 0x7fc078100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:55.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 -- 172.21.15.12:0/1019315259 >> 172.21.15.12:0/1019315259 conn(0x7fc0780fc7a0 msgr2=0x7fc0780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 -- 172.21.15.12:0/1019315259 shutdown_connections 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 -- 172.21.15.12:0/1019315259 wait complete. 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 Processor -- start 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 -- start start 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0781008d0 0x7fc07819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc078101280 0x7fc07819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc07810e480 0x7fc07819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc0781141b0 con 0x7fc078101280 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc078114030 con 0x7fc07810e480 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.603+0000 7fc07e742640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc078114330 con 0x7fc0781008d0 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc06ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc078101280 0x7fc07819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc06ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc078101280 0x7fc07819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55174/0 (socket says 172.21.15.12:55174) 2024-09-16T00:59:55.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc06ffff640 1 -- 172.21.15.12:0/1125206893 learned_addr learned my addr 172.21.15.12:0/1125206893 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc077fff640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0781008d0 0x7fc07819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc07ccdf640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc07810e480 0x7fc07819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc06ffff640 1 -- 172.21.15.12:0/1125206893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0781008d0 msgr2=0x7fc07819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc06ffff640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0781008d0 0x7fc07819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc06ffff640 1 -- 172.21.15.12:0/1125206893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc07810e480 msgr2=0x7fc07819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc06ffff640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc07810e480 0x7fc07819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc06ffff640 1 -- 172.21.15.12:0/1125206893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07819f6a0 con 0x7fc078101280 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc077fff640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0781008d0 0x7fc07819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc07ccdf640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc07810e480 0x7fc07819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc06ffff640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc078101280 0x7fc07819ac30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc060006010 tx=0x7fc0600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc075ffb640 1 -- 172.21.15.12:0/1125206893 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06003f030 con 0x7fc078101280 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc075ffb640 1 -- 172.21.15.12:0/1125206893 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc060003ce0 con 0x7fc078101280 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07819f930 con 0x7fc078101280 2024-09-16T00:59:55.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc075ffb640 1 -- 172.21.15.12:0/1125206893 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060035070 con 0x7fc078101280 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.604+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0781a7270 con 0x7fc078101280 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.605+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc078062980 con 0x7fc078101280 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.606+0000 7fc075ffb640 1 -- 172.21.15.12:0/1125206893 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc060042030 con 0x7fc078101280 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.607+0000 7fc075ffb640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0640a3350 0x7fc0640a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.607+0000 7fc077fff640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0640a3350 0x7fc0640a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.607+0000 7fc075ffb640 1 -- 172.21.15.12:0/1125206893 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fc0600f09f0 con 0x7fc078101280 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.607+0000 7fc075ffb640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] conn(0x7fc0640ae4a0 0x7fc0640b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.607+0000 7fc075ffb640 1 -- 172.21.15.12:0/1125206893 --> [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc060036e90 con 0x7fc0640ae4a0 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.607+0000 7fc075ffb640 1 -- 172.21.15.12:0/1125206893 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc0600f0da0 con 0x7fc078101280 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.608+0000 7fc077fff640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0640a3350 0x7fc0640a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc068009c20 tx=0x7fc068005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.608+0000 7fc07ccdf640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] conn(0x7fc0640ae4a0 0x7fc0640b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.608+0000 7fc07ccdf640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] conn(0x7fc0640ae4a0 0x7fc0640b0940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.610+0000 7fc075ffb640 1 -- 172.21.15.12:0/1125206893 <== osd.4 v2:172.21.15.98:6808/4152065816 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc060036e90 con 0x7fc0640ae4a0 2024-09-16T00:59:55.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.625+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 --> [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc078062d80 con 0x7fc0640ae4a0 2024-09-16T00:59:55.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.625+0000 7fc075ffb640 1 -- 172.21.15.12:0/1125206893 <== osd.4 v2:172.21.15.98:6808/4152065816 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc078062d80 con 0x7fc0640ae4a0 2024-09-16T00:59:55.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.625+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 >> [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] conn(0x7fc0640ae4a0 msgr2=0x7fc0640b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:55.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.625+0000 7fc07e742640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] conn(0x7fc0640ae4a0 0x7fc0640b0940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:55.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.625+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0640a3350 msgr2=0x7fc0640a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:55.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.625+0000 7fc07e742640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0640a3350 0x7fc0640a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc068009c20 tx=0x7fc068005f90 comp rx=0 tx=0).stop 2024-09-16T00:59:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.625+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc078101280 msgr2=0x7fc07819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.625+0000 7fc07e742640 1 --2- 172.21.15.12:0/1125206893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc078101280 0x7fc07819ac30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc060006010 tx=0x7fc0600042f0 comp rx=0 tx=0).stop 2024-09-16T00:59:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.626+0000 7fc07ccdf640 1 -- 172.21.15.12:0/1125206893 reap_dead start 2024-09-16T00:59:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.626+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 shutdown_connections 2024-09-16T00:59:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.626+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 >> 172.21.15.12:0/1125206893 conn(0x7fc0780fc7a0 msgr2=0x7fc0780feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.626+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 shutdown_connections 2024-09-16T00:59:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.626+0000 7fc07e742640 1 -- 172.21.15.12:0/1125206893 wait complete. 2024-09-16T00:59:56.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.118+0000 7f33c03c9640 1 -- 172.21.15.12:0/1865241025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b8101280 msgr2=0x7f33b810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:56.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.118+0000 7f33c03c9640 1 --2- 172.21.15.12:0/1865241025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b8101280 0x7f33b810df40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009900 tx=0x7f33a802a410 comp rx=0 tx=0).stop 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.118+0000 7f33c03c9640 1 -- 172.21.15.12:0/1865241025 shutdown_connections 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.118+0000 7f33c03c9640 1 --2- 172.21.15.12:0/1865241025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33b810e480 0x7f33b8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.118+0000 7f33c03c9640 1 --2- 172.21.15.12:0/1865241025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b8101280 0x7f33b810df40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.118+0000 7f33c03c9640 1 --2- 172.21.15.12:0/1865241025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b81008d0 0x7f33b8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.118+0000 7f33c03c9640 1 -- 172.21.15.12:0/1865241025 >> 172.21.15.12:0/1865241025 conn(0x7f33b80fc7a0 msgr2=0x7f33b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.118+0000 7f33c03c9640 1 -- 172.21.15.12:0/1865241025 shutdown_connections 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.118+0000 7f33c03c9640 1 -- 172.21.15.12:0/1865241025 wait complete. 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33c03c9640 1 Processor -- start 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33c03c9640 1 -- start start 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33c03c9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b81008d0 0x7f33b819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33c03c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33b8101280 0x7f33b819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33c03c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b810e480 0x7f33b819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33c03c9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33b81141e0 con 0x7f33b810e480 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33c03c9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f33b8114060 con 0x7f33b81008d0 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33c03c9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f33b8114360 con 0x7f33b8101280 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33be966640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b810e480 0x7f33b819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33be966640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b810e480 0x7f33b819ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55186/0 (socket says 172.21.15.12:55186) 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33be966640 1 -- 172.21.15.12:0/762057097 learned_addr learned my addr 172.21.15.12:0/762057097 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33be165640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b81008d0 0x7f33b819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33bd964640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33b8101280 0x7f33b819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33be966640 1 -- 172.21.15.12:0/762057097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33b8101280 msgr2=0x7f33b819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33be966640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33b8101280 0x7f33b819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33be966640 1 -- 172.21.15.12:0/762057097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b81008d0 msgr2=0x7f33b819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33be966640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b81008d0 0x7f33b819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33be966640 1 -- 172.21.15.12:0/762057097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b819f650 con 0x7f33b810e480 2024-09-16T00:59:56.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.119+0000 7f33bd964640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33b8101280 0x7f33b819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.120+0000 7f33be966640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b810e480 0x7f33b819ef70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f33b000b9e0 tx=0x7f33b000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.120+0000 7f33af7fe640 1 -- 172.21.15.12:0/762057097 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0019070 con 0x7f33b810e480 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.120+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b819f940 con 0x7f33b810e480 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.120+0000 7f33af7fe640 1 -- 172.21.15.12:0/762057097 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33b0014440 con 0x7f33b810e480 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.120+0000 7f33af7fe640 1 -- 172.21.15.12:0/762057097 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b00125a0 con 0x7f33b810e480 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.120+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b81a7220 con 0x7f33b810e480 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.121+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33b810f9e0 con 0x7f33b810e480 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.122+0000 7f33af7fe640 1 -- 172.21.15.12:0/762057097 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f33b001c070 con 0x7f33b810e480 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.123+0000 7f33af7fe640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33a40a32d0 0x7f33a40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.123+0000 7f33be165640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33a40a32d0 0x7f33a40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.123+0000 7f33af7fe640 1 -- 172.21.15.12:0/762057097 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f33b00cfa80 con 0x7f33b810e480 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.123+0000 7f33af7fe640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] conn(0x7f33a40ae420 0x7f33a40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.123+0000 7f33af7fe640 1 -- 172.21.15.12:0/762057097 --> [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33b000fec0 con 0x7f33a40ae420 2024-09-16T00:59:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.123+0000 7f33af7fe640 1 -- 172.21.15.12:0/762057097 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f33b00cfed0 con 0x7f33b810e480 2024-09-16T00:59:56.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.123+0000 7f33be165640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33a40a32d0 0x7f33a40a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f33b400abe0 tx=0x7f33b400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:56.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.123+0000 7f33bd964640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] conn(0x7f33a40ae420 0x7f33a40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:56.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.124+0000 7f33bd964640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] conn(0x7f33a40ae420 0x7f33a40b08c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:56.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.125+0000 7f33af7fe640 1 -- 172.21.15.12:0/762057097 <== osd.7 v2:172.21.15.98:6816/4018048637 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f33b000fec0 con 0x7f33a40ae420 2024-09-16T00:59:56.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.139+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 --> [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f33b806b070 con 0x7f33a40ae420 2024-09-16T00:59:56.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.139+0000 7f33af7fe640 1 -- 172.21.15.12:0/762057097 <== osd.7 v2:172.21.15.98:6816/4018048637 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f33b806b070 con 0x7f33a40ae420 2024-09-16T00:59:56.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 >> [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] conn(0x7f33a40ae420 msgr2=0x7f33a40b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:56.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33c03c9640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] conn(0x7f33a40ae420 0x7f33a40b08c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:56.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33a40a32d0 msgr2=0x7f33a40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:56.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33c03c9640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f33a40a32d0 0x7f33a40a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f33b400abe0 tx=0x7f33b400a2d0 comp rx=0 tx=0).stop 2024-09-16T00:59:56.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b810e480 msgr2=0x7f33b819ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:56.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33c03c9640 1 --2- 172.21.15.12:0/762057097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b810e480 0x7f33b819ef70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f33b000b9e0 tx=0x7f33b000bde0 comp rx=0 tx=0).stop 2024-09-16T00:59:56.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33be966640 1 -- 172.21.15.12:0/762057097 reap_dead start 2024-09-16T00:59:56.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 shutdown_connections 2024-09-16T00:59:56.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 >> 172.21.15.12:0/762057097 conn(0x7f33b80fc7a0 msgr2=0x7f33b80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:56.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 shutdown_connections 2024-09-16T00:59:56.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:56.140+0000 7f33c03c9640 1 -- 172.21.15.12:0/762057097 wait complete. 2024-09-16T00:59:57.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.501+0000 7ff64b547640 1 -- 172.21.15.12:0/3659229181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff644100a80 msgr2=0x7ff644100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.501+0000 7ff64b547640 1 --2- 172.21.15.12:0/3659229181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff644100a80 0x7ff644100ee0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff634009930 tx=0x7ff63402a420 comp rx=0 tx=0).stop 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 -- 172.21.15.12:0/3659229181 shutdown_connections 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 --2- 172.21.15.12:0/3659229181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff644101420 0x7ff64410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 --2- 172.21.15.12:0/3659229181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff644100a80 0x7ff644100ee0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 --2- 172.21.15.12:0/3659229181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff644106a80 0x7ff644106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 -- 172.21.15.12:0/3659229181 >> 172.21.15.12:0/3659229181 conn(0x7ff6440fc7a0 msgr2=0x7ff6440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 -- 172.21.15.12:0/3659229181 shutdown_connections 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 -- 172.21.15.12:0/3659229181 wait complete. 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 Processor -- start 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 -- start start 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff644100a80 0x7ff64419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:57.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.502+0000 7ff64b547640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff644101420 0x7ff64419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff64b547640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff644106a80 0x7ff64419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff64b547640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff644110e80 con 0x7ff644101420 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff64b547640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff644110d00 con 0x7ff644106a80 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff64b547640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff644111000 con 0x7ff644100a80 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff648ae2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff644101420 0x7ff64419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff648ae2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff644101420 0x7ff64419abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55148/0 (socket says 172.21.15.12:55148) 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff648ae2640 1 -- 172.21.15.12:0/440851354 learned_addr learned my addr 172.21.15.12:0/440851354 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff6492e3640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff644100a80 0x7ff64419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff649ae4640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff644106a80 0x7ff64419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff648ae2640 1 -- 172.21.15.12:0/440851354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff644100a80 msgr2=0x7ff64419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff648ae2640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff644100a80 0x7ff64419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff648ae2640 1 -- 172.21.15.12:0/440851354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff644106a80 msgr2=0x7ff64419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff648ae2640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff644106a80 0x7ff64419ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff648ae2640 1 -- 172.21.15.12:0/440851354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64419f630 con 0x7ff644101420 2024-09-16T00:59:57.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff648ae2640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff644101420 0x7ff64419abc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff634009230 tx=0x7ff634004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:57.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff63a7fc640 1 -- 172.21.15.12:0/440851354 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63403f030 con 0x7ff644101420 2024-09-16T00:59:57.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff63a7fc640 1 -- 172.21.15.12:0/440851354 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff634003ad0 con 0x7ff644101420 2024-09-16T00:59:57.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff63a7fc640 1 -- 172.21.15.12:0/440851354 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634035070 con 0x7ff644101420 2024-09-16T00:59:57.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.503+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64419f8c0 con 0x7ff644101420 2024-09-16T00:59:57.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.504+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6441a7200 con 0x7ff644101420 2024-09-16T00:59:57.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.504+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff64406b240 con 0x7ff644101420 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.506+0000 7ff63a7fc640 1 -- 172.21.15.12:0/440851354 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff634042030 con 0x7ff644101420 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.506+0000 7ff63a7fc640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6300a3350 0x7ff6300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.506+0000 7ff63a7fc640 1 -- 172.21.15.12:0/440851354 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7ff6340f0780 con 0x7ff644101420 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.506+0000 7ff6492e3640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6300a3350 0x7ff6300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.507+0000 7ff63a7fc640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] conn(0x7ff6300ae4a0 0x7ff6300b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.507+0000 7ff63a7fc640 1 -- 172.21.15.12:0/440851354 --> [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff63403be50 con 0x7ff6300ae4a0 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.507+0000 7ff63a7fc640 1 -- 172.21.15.12:0/440851354 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7ff6340f0bd0 con 0x7ff644101420 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.507+0000 7ff6492e3640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6300a3350 0x7ff6300a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff640009b50 tx=0x7ff640005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.507+0000 7ff649ae4640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] conn(0x7ff6300ae4a0 0x7ff6300b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.507+0000 7ff649ae4640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] conn(0x7ff6300ae4a0 0x7ff6300b0940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.508+0000 7ff63a7fc640 1 -- 172.21.15.12:0/440851354 <== osd.5 v2:172.21.15.119:6808/2310752755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff63403be50 con 0x7ff6300ae4a0 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.523+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 --> [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff6441021c0 con 0x7ff6300ae4a0 2024-09-16T00:59:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff63a7fc640 1 -- 172.21.15.12:0/440851354 <== osd.5 v2:172.21.15.119:6808/2310752755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff6441021c0 con 0x7ff6300ae4a0 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 >> [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] conn(0x7ff6300ae4a0 msgr2=0x7ff6300b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff64b547640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] conn(0x7ff6300ae4a0 0x7ff6300b0940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6300a3350 msgr2=0x7ff6300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff64b547640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6300a3350 0x7ff6300a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff640009b50 tx=0x7ff640005f90 comp rx=0 tx=0).stop 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff644101420 msgr2=0x7ff64419abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff64b547640 1 --2- 172.21.15.12:0/440851354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff644101420 0x7ff64419abc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff634009230 tx=0x7ff634004270 comp rx=0 tx=0).stop 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff649ae4640 1 -- 172.21.15.12:0/440851354 reap_dead start 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 shutdown_connections 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 >> 172.21.15.12:0/440851354 conn(0x7ff6440fc7a0 msgr2=0x7ff64406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 shutdown_connections 2024-09-16T00:59:57.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:55.524+0000 7ff64b547640 1 -- 172.21.15.12:0/440851354 wait complete. 2024-09-16T00:59:57.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:56 smithi012 ceph-mon[31197]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 66 B/s, 0 objects/s recovering 2024-09-16T00:59:57.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:56 smithi098 ceph-mon[35346]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 66 B/s, 0 objects/s recovering 2024-09-16T00:59:57.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:56 smithi119 ceph-mon[35049]: pgmap v323: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 66 B/s, 0 objects/s recovering 2024-09-16T00:59:57.597 INFO:teuthology.orchestra.run.smithi012.stdout:150323855419 2024-09-16T00:59:57.597 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-16T00:59:58.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.983+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/3795350033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c38100a80 msgr2=0x7f6c38100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.983+0000 7f6c3fbc3640 1 --2- 172.21.15.12:0/3795350033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c38100a80 0x7f6c38100ee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009930 tx=0x7f6c2802a420 comp rx=0 tx=0).stop 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.983+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/3795350033 shutdown_connections 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.983+0000 7f6c3fbc3640 1 --2- 172.21.15.12:0/3795350033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c38101420 0x7f6c3810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.983+0000 7f6c3fbc3640 1 --2- 172.21.15.12:0/3795350033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c38100a80 0x7f6c38100ee0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.983+0000 7f6c3fbc3640 1 --2- 172.21.15.12:0/3795350033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c38106a80 0x7f6c38106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.983+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/3795350033 >> 172.21.15.12:0/3795350033 conn(0x7f6c380fc7a0 msgr2=0x7f6c380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.983+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/3795350033 shutdown_connections 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.983+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/3795350033 wait complete. 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3fbc3640 1 Processor -- start 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3fbc3640 1 -- start start 2024-09-16T00:59:58.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3fbc3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c38100a80 0x7f6c380fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3fbc3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c38101420 0x7f6c380fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3fbc3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c38106a80 0x7f6c380fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3fbc3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38110f20 con 0x7f6c38100a80 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3fbc3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38110da0 con 0x7f6c38106a80 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3fbc3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381110a0 con 0x7f6c38101420 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3d95f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c38100a80 0x7f6c380fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3d95f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c38100a80 0x7f6c380fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45108/0 (socket says 172.21.15.12:45108) 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3d95f640 1 -- 172.21.15.12:0/2659997238 learned_addr learned my addr 172.21.15.12:0/2659997238 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3e160640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c38106a80 0x7f6c380fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3d15e640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c38101420 0x7f6c380fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3d95f640 1 -- 172.21.15.12:0/2659997238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c38101420 msgr2=0x7f6c380fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3d95f640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c38101420 0x7f6c380fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3d95f640 1 -- 172.21.15.12:0/2659997238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c38106a80 msgr2=0x7f6c380fd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:58.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3d95f640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c38106a80 0x7f6c380fd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.984+0000 7f6c3d95f640 1 -- 172.21.15.12:0/2659997238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c381a6af0 con 0x7f6c38100a80 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.985+0000 7f6c3d15e640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c38101420 0x7f6c380fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.985+0000 7f6c3e160640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c38106a80 0x7f6c380fd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.985+0000 7f6c3d95f640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c38100a80 0x7f6c380fce50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400b4a0 tx=0x7f6c3400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.985+0000 7f6c2effd640 1 -- 172.21.15.12:0/2659997238 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34014070 con 0x7f6c38100a80 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.985+0000 7f6c2effd640 1 -- 172.21.15.12:0/2659997238 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c34010af0 con 0x7f6c38100a80 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.985+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c381a6de0 con 0x7f6c38100a80 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.985+0000 7f6c2effd640 1 -- 172.21.15.12:0/2659997238 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34017d10 con 0x7f6c38100a80 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.985+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c381a7240 con 0x7f6c38100a80 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.986+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c38062900 con 0x7f6c38100a80 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.987+0000 7f6c2effd640 1 -- 172.21.15.12:0/2659997238 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6c34017070 con 0x7f6c38100a80 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.988+0000 7f6c2effd640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c240a3350 0x7f6c240a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:58.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.988+0000 7f6c3d15e640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c240a3350 0x7f6c240a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:58.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.988+0000 7f6c2effd640 1 -- 172.21.15.12:0/2659997238 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f6c340cf500 con 0x7f6c38100a80 2024-09-16T00:59:58.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.988+0000 7f6c2effd640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] conn(0x7f6c240ae4a0 0x7f6c240b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:58.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.988+0000 7f6c2effd640 1 -- 172.21.15.12:0/2659997238 --> [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c240b1010 con 0x7f6c240ae4a0 2024-09-16T00:59:58.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.988+0000 7f6c2effd640 1 -- 172.21.15.12:0/2659997238 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f6c340cf8b0 con 0x7f6c38100a80 2024-09-16T00:59:58.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.988+0000 7f6c3e160640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] conn(0x7f6c240ae4a0 0x7f6c240b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:58.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.989+0000 7f6c3d15e640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c240a3350 0x7f6c240a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c28000c00 tx=0x7f6c28005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:58.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.989+0000 7f6c3e160640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] conn(0x7f6c240ae4a0 0x7f6c240b0940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:58.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:57.990+0000 7f6c2effd640 1 -- 172.21.15.12:0/2659997238 <== osd.9 v2:172.21.15.12:6826/646713448 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c240b1010 con 0x7f6c240ae4a0 2024-09-16T00:59:58.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.003+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 --> [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c38062d30 con 0x7f6c240ae4a0 2024-09-16T00:59:58.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.003+0000 7f6c2effd640 1 -- 172.21.15.12:0/2659997238 <== osd.9 v2:172.21.15.12:6826/646713448 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6c38062d30 con 0x7f6c240ae4a0 2024-09-16T00:59:58.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] conn(0x7f6c240ae4a0 msgr2=0x7f6c240b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:58.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3fbc3640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] conn(0x7f6c240ae4a0 0x7f6c240b0940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:58.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c240a3350 msgr2=0x7f6c240a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:58.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3fbc3640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c240a3350 0x7f6c240a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c28000c00 tx=0x7f6c28005a20 comp rx=0 tx=0).stop 2024-09-16T00:59:58.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c38100a80 msgr2=0x7f6c380fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:58.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3fbc3640 1 --2- 172.21.15.12:0/2659997238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c38100a80 0x7f6c380fce50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400b4a0 tx=0x7f6c3400b960 comp rx=0 tx=0).stop 2024-09-16T00:59:58.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3e160640 1 -- 172.21.15.12:0/2659997238 reap_dead start 2024-09-16T00:59:58.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 shutdown_connections 2024-09-16T00:59:58.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 >> 172.21.15.12:0/2659997238 conn(0x7f6c380fc7a0 msgr2=0x7f6c3806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:58.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 shutdown_connections 2024-09-16T00:59:58.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:58.004+0000 7f6c3fbc3640 1 -- 172.21.15.12:0/2659997238 wait complete. 2024-09-16T00:59:58.020 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:58.700 INFO:teuthology.orchestra.run.smithi012.stdout:128849018945 2024-09-16T00:59:58.700 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-16T00:59:59.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 00:59:58 smithi012 ceph-mon[31197]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 55 B/s, 0 objects/s recovering 2024-09-16T00:59:59.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 00:59:58 smithi098 ceph-mon[35346]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 55 B/s, 0 objects/s recovering 2024-09-16T00:59:59.256 INFO:teuthology.orchestra.run.smithi012.stdout:261993005096 2024-09-16T00:59:59.256 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-16T00:59:59.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 00:59:58 smithi119 ceph-mon[35049]: pgmap v324: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 55 B/s, 0 objects/s recovering 2024-09-16T00:59:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.440+0000 7fc93dea7640 1 -- 172.21.15.12:0/3667596894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938106f20 msgr2=0x7fc93810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.440+0000 7fc93dea7640 1 --2- 172.21.15.12:0/3667596894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938106f20 0x7fc93810eaa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc930009ca0 tx=0x7fc93002a8c0 comp rx=0 tx=0).stop 2024-09-16T00:59:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.440+0000 7fc93dea7640 1 -- 172.21.15.12:0/3667596894 shutdown_connections 2024-09-16T00:59:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.440+0000 7fc93dea7640 1 --2- 172.21.15.12:0/3667596894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938106f20 0x7fc93810eaa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.440+0000 7fc93dea7640 1 --2- 172.21.15.12:0/3667596894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9381027a0 0x7fc9381067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.440+0000 7fc93dea7640 1 --2- 172.21.15.12:0/3667596894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc938101df0 0x7fc9381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.440+0000 7fc93dea7640 1 -- 172.21.15.12:0/3667596894 >> 172.21.15.12:0/3667596894 conn(0x7fc9380fd8f0 msgr2=0x7fc9380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.440+0000 7fc93dea7640 1 -- 172.21.15.12:0/3667596894 shutdown_connections 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.440+0000 7fc93dea7640 1 -- 172.21.15.12:0/3667596894 wait complete. 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc93dea7640 1 Processor -- start 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc93dea7640 1 -- start start 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc93dea7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc938101df0 0x7fc9380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc93dea7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9381027a0 0x7fc938074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc93dea7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938106f20 0x7fc938074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc93dea7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc938111f80 con 0x7fc938106f20 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc93dea7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc938111e00 con 0x7fc9381027a0 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc93dea7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc938112100 con 0x7fc938101df0 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc937fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938106f20 0x7fc938074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc937fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938106f20 0x7fc938074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45128/0 (socket says 172.21.15.12:45128) 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.441+0000 7fc937fff640 1 -- 172.21.15.12:0/3136860689 learned_addr learned my addr 172.21.15.12:0/3136860689 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc9377fe640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc938101df0 0x7fc9380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc936ffd640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9381027a0 0x7fc938074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc937fff640 1 -- 172.21.15.12:0/3136860689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc938101df0 msgr2=0x7fc9380744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc937fff640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc938101df0 0x7fc9380744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc937fff640 1 -- 172.21.15.12:0/3136860689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9381027a0 msgr2=0x7fc938074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc937fff640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9381027a0 0x7fc938074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc937fff640 1 -- 172.21.15.12:0/3136860689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9381a68a0 con 0x7fc938106f20 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc9377fe640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc938101df0 0x7fc9380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc936ffd640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9381027a0 0x7fc938074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc937fff640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938106f20 0x7fc938074f70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc930031a20 tx=0x7fc930031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc934ff9640 1 -- 172.21.15.12:0/3136860689 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc930003c30 con 0x7fc938106f20 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc934ff9640 1 -- 172.21.15.12:0/3136860689 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc930003dd0 con 0x7fc938106f20 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9381a6b30 con 0x7fc938106f20 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc934ff9640 1 -- 172.21.15.12:0/3136860689 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93002fc40 con 0x7fc938106f20 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.442+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9381a7070 con 0x7fc938106f20 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.443+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc938062880 con 0x7fc938106f20 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.445+0000 7fc934ff9640 1 -- 172.21.15.12:0/3136860689 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc930004050 con 0x7fc938106f20 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.445+0000 7fc934ff9640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9200a32d0 0x7fc9200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.446+0000 7fc934ff9640 1 -- 172.21.15.12:0/3136860689 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fc9300f1160 con 0x7fc938106f20 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.446+0000 7fc9377fe640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9200a32d0 0x7fc9200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.446+0000 7fc934ff9640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] conn(0x7fc9200ae420 0x7fc9200b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.446+0000 7fc934ff9640 1 -- 172.21.15.12:0/3136860689 --> [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc93004fea0 con 0x7fc9200ae420 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.446+0000 7fc934ff9640 1 -- 172.21.15.12:0/3136860689 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc9300f15b0 con 0x7fc938106f20 2024-09-16T00:59:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.446+0000 7fc936ffd640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] conn(0x7fc9200ae420 0x7fc9200b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.446+0000 7fc9377fe640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9200a32d0 0x7fc9200a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc928009fc0 tx=0x7fc928005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.447+0000 7fc936ffd640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] conn(0x7fc9200ae420 0x7fc9200b08c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.448+0000 7fc934ff9640 1 -- 172.21.15.12:0/3136860689 <== osd.6 v2:172.21.15.12:6818/2023873518 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc93004fea0 con 0x7fc9200ae420 2024-09-16T00:59:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.462+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 --> [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc938062d00 con 0x7fc9200ae420 2024-09-16T00:59:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.462+0000 7fc934ff9640 1 -- 172.21.15.12:0/3136860689 <== osd.6 v2:172.21.15.12:6818/2023873518 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc938062d00 con 0x7fc9200ae420 2024-09-16T00:59:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] conn(0x7fc9200ae420 msgr2=0x7fc9200b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc93dea7640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] conn(0x7fc9200ae420 0x7fc9200b08c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9200a32d0 msgr2=0x7fc9200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc93dea7640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9200a32d0 0x7fc9200a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc928009fc0 tx=0x7fc928005f90 comp rx=0 tx=0).stop 2024-09-16T00:59:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938106f20 msgr2=0x7fc938074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc93dea7640 1 --2- 172.21.15.12:0/3136860689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938106f20 0x7fc938074f70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc930031a20 tx=0x7fc930031a50 comp rx=0 tx=0).stop 2024-09-16T00:59:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc937fff640 1 -- 172.21.15.12:0/3136860689 reap_dead start 2024-09-16T00:59:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 shutdown_connections 2024-09-16T00:59:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 >> 172.21.15.12:0/3136860689 conn(0x7fc9380fd8f0 msgr2=0x7fc9380febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 shutdown_connections 2024-09-16T00:59:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T00:59:59.463+0000 7fc93dea7640 1 -- 172.21.15.12:0/3136860689 wait complete. 2024-09-16T01:00:00.335 INFO:teuthology.orchestra.run.smithi012.stdout:180388626488 2024-09-16T01:00:00.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-16T01:00:00.770 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:00.770 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:00.812 INFO:teuthology.orchestra.run.smithi012.stdout:201863462961 2024-09-16T01:00:00.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-16T01:00:01.058 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:00 smithi012 ceph-mon[31197]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 55 B/s, 0 objects/s recovering 2024-09-16T01:00:01.058 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:00 smithi012 ceph-mon[31197]: overall HEALTH_OK 2024-09-16T01:00:01.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:00 smithi098 ceph-mon[35346]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 55 B/s, 0 objects/s recovering 2024-09-16T01:00:01.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:00 smithi098 ceph-mon[35346]: overall HEALTH_OK 2024-09-16T01:00:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.240+0000 7f3d6fac1640 1 -- 172.21.15.12:0/1097552926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d681082a0 msgr2=0x7f3d6810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.240+0000 7f3d6fac1640 1 --2- 172.21.15.12:0/1097552926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d681082a0 0x7f3d6810ec40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009930 tx=0x7f3d6002a440 comp rx=0 tx=0).stop 2024-09-16T01:00:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.241+0000 7f3d6fac1640 1 -- 172.21.15.12:0/1097552926 shutdown_connections 2024-09-16T01:00:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.241+0000 7f3d6fac1640 1 --2- 172.21.15.12:0/1097552926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d681082a0 0x7f3d6810ec40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.241+0000 7f3d6fac1640 1 --2- 172.21.15.12:0/1097552926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d681036e0 0x7f3d68107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.241+0000 7f3d6fac1640 1 --2- 172.21.15.12:0/1097552926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d68102d30 0x7f3d68103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.241+0000 7f3d6fac1640 1 -- 172.21.15.12:0/1097552926 >> 172.21.15.12:0/1097552926 conn(0x7f3d680fc7d0 msgr2=0x7f3d680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.242+0000 7f3d6fac1640 1 -- 172.21.15.12:0/1097552926 shutdown_connections 2024-09-16T01:00:01.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.244+0000 7f3d6fac1640 1 -- 172.21.15.12:0/1097552926 wait complete. 2024-09-16T01:00:01.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.245+0000 7f3d6fac1640 1 Processor -- start 2024-09-16T01:00:01.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.246+0000 7f3d6fac1640 1 -- start start 2024-09-16T01:00:01.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.247+0000 7f3d6fac1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d68102d30 0x7f3d681983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:01.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.247+0000 7f3d6fac1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d681036e0 0x7f3d681988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.247+0000 7f3d6fac1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d681082a0 0x7f3d6819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.247+0000 7f3d6fac1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3d68112130 con 0x7f3d68102d30 2024-09-16T01:00:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.247+0000 7f3d6fac1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d68111fb0 con 0x7f3d681036e0 2024-09-16T01:00:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.247+0000 7f3d6fac1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d681122b0 con 0x7f3d681082a0 2024-09-16T01:00:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.247+0000 7f3d6d85d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d68102d30 0x7f3d681983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.247+0000 7f3d6d85d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d68102d30 0x7f3d681983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45134/0 (socket says 172.21.15.12:45134) 2024-09-16T01:00:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.247+0000 7f3d6d85d640 1 -- 172.21.15.12:0/3169435828 learned_addr learned my addr 172.21.15.12:0/3169435828 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.247+0000 7f3d6d05c640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d681036e0 0x7f3d681988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.248+0000 7f3d6d85d640 1 -- 172.21.15.12:0/3169435828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d681082a0 msgr2=0x7f3d6819cc80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:00:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.248+0000 7f3d6d85d640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d681082a0 0x7f3d6819cc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.248+0000 7f3d6d85d640 1 -- 172.21.15.12:0/3169435828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d681036e0 msgr2=0x7f3d681988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.248+0000 7f3d6d85d640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d681036e0 0x7f3d681988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.248+0000 7f3d6d85d640 1 -- 172.21.15.12:0/3169435828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6819d360 con 0x7f3d68102d30 2024-09-16T01:00:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.248+0000 7f3d6d05c640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d681036e0 0x7f3d681988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.248+0000 7f3d6d85d640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d68102d30 0x7f3d681983b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d58007ea0 tx=0x7f3d58007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.248+0000 7f3d66ffd640 1 -- 172.21.15.12:0/3169435828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58004b20 con 0x7f3d68102d30 2024-09-16T01:00:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.249+0000 7f3d66ffd640 1 -- 172.21.15.12:0/3169435828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d58004cc0 con 0x7f3d68102d30 2024-09-16T01:00:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.249+0000 7f3d66ffd640 1 -- 172.21.15.12:0/3169435828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d580055d0 con 0x7f3d68102d30 2024-09-16T01:00:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.249+0000 7f3d6fac1640 1 -- 172.21.15.12:0/3169435828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6819d650 con 0x7f3d68102d30 2024-09-16T01:00:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.249+0000 7f3d6fac1640 1 -- 172.21.15.12:0/3169435828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d681008c0 con 0x7f3d68102d30 2024-09-16T01:00:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.253+0000 7f3d66ffd640 1 -- 172.21.15.12:0/3169435828 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3d58005770 con 0x7f3d68102d30 2024-09-16T01:00:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.254+0000 7f3d66ffd640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d500a34a0 0x7f3d500a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.255+0000 7f3d66ffd640 1 -- 172.21.15.12:0/3169435828 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f3d580d3f30 con 0x7f3d68102d30 2024-09-16T01:00:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.255+0000 7f3d6d05c640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d500a34a0 0x7f3d500a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.256+0000 7f3d6d05c640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d500a34a0 0x7f3d500a5960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3d680fddf0 tx=0x7f3d5c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.257+0000 7f3d6fac1640 1 -- 172.21.15.12:0/3169435828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6806a850 con 0x7f3d68102d30 2024-09-16T01:00:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.265+0000 7f3d66ffd640 1 -- 172.21.15.12:0/3169435828 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d580551b0 con 0x7f3d68102d30 2024-09-16T01:00:01.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:00 smithi119 ceph-mon[35049]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 55 B/s, 0 objects/s recovering 2024-09-16T01:00:01.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:00 smithi119 ceph-mon[35049]: overall HEALTH_OK 2024-09-16T01:00:01.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.461+0000 7f3d6fac1640 1 -- 172.21.15.12:0/3169435828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3d68100be0 con 0x7f3d68102d30 2024-09-16T01:00:01.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.461+0000 7f3d66ffd640 1 -- 172.21.15.12:0/3169435828 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d580a0860 con 0x7f3d68102d30 2024-09-16T01:00:01.463 INFO:teuthology.orchestra.run.smithi012.stdout:34359738454 2024-09-16T01:00:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.463+0000 7f3d6fac1640 1 -- 172.21.15.12:0/3169435828 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d500a34a0 msgr2=0x7f3d500a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.463+0000 7f3d6fac1640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d500a34a0 0x7f3d500a5960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3d680fddf0 tx=0x7f3d5c008040 comp rx=0 tx=0).stop 2024-09-16T01:00:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.463+0000 7f3d6fac1640 1 -- 172.21.15.12:0/3169435828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d68102d30 msgr2=0x7f3d681983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.463+0000 7f3d6fac1640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d68102d30 0x7f3d681983b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d58007ea0 tx=0x7f3d58007f90 comp rx=0 tx=0).stop 2024-09-16T01:00:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.463+0000 7f3d6fac1640 1 -- 172.21.15.12:0/3169435828 shutdown_connections 2024-09-16T01:00:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.463+0000 7f3d6fac1640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d500a34a0 0x7f3d500a5960 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.463+0000 7f3d6fac1640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d681082a0 0x7f3d6819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.463+0000 7f3d6fac1640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d681036e0 0x7f3d681988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.463+0000 7f3d6fac1640 1 --2- 172.21.15.12:0/3169435828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d68102d30 0x7f3d681983b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.463+0000 7f3d6fac1640 1 -- 172.21.15.12:0/3169435828 >> 172.21.15.12:0/3169435828 conn(0x7f3d680fc7d0 msgr2=0x7f3d680fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.464+0000 7f3d6fac1640 1 -- 172.21.15.12:0/3169435828 shutdown_connections 2024-09-16T01:00:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:01.464+0000 7f3d6fac1640 1 -- 172.21.15.12:0/3169435828 wait complete. 2024-09-16T01:00:02.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:01 smithi012 ceph-mon[31197]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 55 B/s, 0 objects/s recovering 2024-09-16T01:00:02.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:01 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3169435828' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T01:00:02.196 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738452 got 34359738454 for osd.0 2024-09-16T01:00:02.196 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:01 smithi098 ceph-mon[35346]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 55 B/s, 0 objects/s recovering 2024-09-16T01:00:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:01 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3169435828' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T01:00:02.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:01 smithi119 ceph-mon[35049]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 55 B/s, 0 objects/s recovering 2024-09-16T01:00:02.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:01 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3169435828' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T01:00:02.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.371+0000 7f5ea1936640 1 -- 172.21.15.12:0/1089700953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e9c102790 msgr2=0x7f5e9c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:02.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.371+0000 7f5ea1936640 1 --2- 172.21.15.12:0/1089700953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e9c102790 0x7f5e9c1067e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009900 tx=0x7f5e8402a410 comp rx=0 tx=0).stop 2024-09-16T01:00:02.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.371+0000 7f5ea1936640 1 -- 172.21.15.12:0/1089700953 shutdown_connections 2024-09-16T01:00:02.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.371+0000 7f5ea1936640 1 --2- 172.21.15.12:0/1089700953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9c106f10 0x7f5e9c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.371+0000 7f5ea1936640 1 --2- 172.21.15.12:0/1089700953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e9c102790 0x7f5e9c1067e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.371+0000 7f5ea1936640 1 --2- 172.21.15.12:0/1089700953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e9c101de0 0x7f5e9c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.371+0000 7f5ea1936640 1 -- 172.21.15.12:0/1089700953 >> 172.21.15.12:0/1089700953 conn(0x7f5e9c0fd8c0 msgr2=0x7f5e9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.371+0000 7f5ea1936640 1 -- 172.21.15.12:0/1089700953 shutdown_connections 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.371+0000 7f5ea1936640 1 -- 172.21.15.12:0/1089700953 wait complete. 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.372+0000 7f5ea1936640 1 Processor -- start 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.372+0000 7f5ea1936640 1 -- start start 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5ea1936640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e9c101de0 0x7f5e9c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5ea1936640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e9c102790 0x7f5e9c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5ea1936640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9c106f10 0x7f5e9c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5ea1936640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c111f70 con 0x7f5e9c101de0 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5ea1936640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c111df0 con 0x7f5e9c102790 2024-09-16T01:00:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5ea1936640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c1120f0 con 0x7f5e9c106f10 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e9affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e9c101de0 0x7f5e9c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e9affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e9c101de0 0x7f5e9c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45146/0 (socket says 172.21.15.12:45146) 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e9affd640 1 -- 172.21.15.12:0/807757112 learned_addr learned my addr 172.21.15.12:0/807757112 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e93fff640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e9c102790 0x7f5e9c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e9b7fe640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9c106f10 0x7f5e9c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e9affd640 1 -- 172.21.15.12:0/807757112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9c106f10 msgr2=0x7f5e9c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e9affd640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9c106f10 0x7f5e9c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e9affd640 1 -- 172.21.15.12:0/807757112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e9c102790 msgr2=0x7f5e9c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e9affd640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e9c102790 0x7f5e9c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e9affd640 1 -- 172.21.15.12:0/807757112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9c19d3e0 con 0x7f5e9c101de0 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5e9affd640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e9c101de0 0x7f5e9c198430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00d950 tx=0x7f5e8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5ea0934640 1 -- 172.21.15.12:0/807757112 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c017070 con 0x7f5e9c101de0 2024-09-16T01:00:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5ea0934640 1 -- 172.21.15.12:0/807757112 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e8c009c30 con 0x7f5e9c101de0 2024-09-16T01:00:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5ea0934640 1 -- 172.21.15.12:0/807757112 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00f6b0 con 0x7f5e9c101de0 2024-09-16T01:00:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.373+0000 7f5ea1936640 1 -- 172.21.15.12:0/807757112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9c19d6d0 con 0x7f5e9c101de0 2024-09-16T01:00:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.374+0000 7f5ea1936640 1 -- 172.21.15.12:0/807757112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9c1a4fb0 con 0x7f5e9c101de0 2024-09-16T01:00:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.375+0000 7f5ea1936640 1 -- 172.21.15.12:0/807757112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e9c1021c0 con 0x7f5e9c101de0 2024-09-16T01:00:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.376+0000 7f5ea0934640 1 -- 172.21.15.12:0/807757112 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5e8c0109d0 con 0x7f5e9c101de0 2024-09-16T01:00:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.377+0000 7f5ea0934640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5e880a3350 0x7f5e880a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.377+0000 7f5ea0934640 1 -- 172.21.15.12:0/807757112 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f5e8c0cf980 con 0x7f5e9c101de0 2024-09-16T01:00:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.377+0000 7f5e93fff640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5e880a3350 0x7f5e880a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.377+0000 7f5e93fff640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5e880a3350 0x7f5e880a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009230 tx=0x7f5e840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.381+0000 7f5ea0934640 1 -- 172.21.15.12:0/807757112 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e8c009de0 con 0x7f5e9c101de0 2024-09-16T01:00:02.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.563+0000 7f5ea1936640 1 -- 172.21.15.12:0/807757112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f5e9c10a0f0 con 0x7f5e9c101de0 2024-09-16T01:00:02.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.564+0000 7f5ea0934640 1 -- 172.21.15.12:0/807757112 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5e8c09bb50 con 0x7f5e9c101de0 2024-09-16T01:00:02.566 INFO:teuthology.orchestra.run.smithi012.stdout:283467841570 2024-09-16T01:00:02.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 -- 172.21.15.12:0/807757112 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5e880a3350 msgr2=0x7f5e880a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5e880a3350 0x7f5e880a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009230 tx=0x7f5e840058d0 comp rx=0 tx=0).stop 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 -- 172.21.15.12:0/807757112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e9c101de0 msgr2=0x7f5e9c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e9c101de0 0x7f5e9c198430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00d950 tx=0x7f5e8c00de10 comp rx=0 tx=0).stop 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 -- 172.21.15.12:0/807757112 shutdown_connections 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5e880a3350 0x7f5e880a5810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e9c106f10 0x7f5e9c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e9c102790 0x7f5e9c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 --2- 172.21.15.12:0/807757112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e9c101de0 0x7f5e9c198430 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 -- 172.21.15.12:0/807757112 >> 172.21.15.12:0/807757112 conn(0x7f5e9c0fd8c0 msgr2=0x7f5e9c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 -- 172.21.15.12:0/807757112 shutdown_connections 2024-09-16T01:00:02.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.566+0000 7f5ea1936640 1 -- 172.21.15.12:0/807757112 wait complete. 2024-09-16T01:00:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:02 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/807757112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-16T01:00:03.260 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:02 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/807757112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-16T01:00:03.289 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841568 got 283467841570 for osd.10 2024-09-16T01:00:03.289 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:03.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:02 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/807757112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.711+0000 7f024822e640 1 -- 172.21.15.12:0/1262731365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240102ef0 msgr2=0x7f024010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.711+0000 7f024822e640 1 --2- 172.21.15.12:0/1262731365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240102ef0 0x7f024010da40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0238009ca0 tx=0x7f023802a950 comp rx=0 tx=0).stop 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 -- 172.21.15.12:0/1262731365 shutdown_connections 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 --2- 172.21.15.12:0/1262731365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240102ef0 0x7f024010da40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 --2- 172.21.15.12:0/1262731365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0240102570 0x7f02401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 --2- 172.21.15.12:0/1262731365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0240100e20 0x7f0240101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 -- 172.21.15.12:0/1262731365 >> 172.21.15.12:0/1262731365 conn(0x7f02400fc7d0 msgr2=0x7f02400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 -- 172.21.15.12:0/1262731365 shutdown_connections 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 -- 172.21.15.12:0/1262731365 wait complete. 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 Processor -- start 2024-09-16T01:00:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 -- start start 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0240100e20 0x7f0240198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0240102570 0x7f02401989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.712+0000 7f024822e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240102ef0 0x7f024019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f024822e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0240110f80 con 0x7f0240102ef0 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f024822e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0240110e00 con 0x7f0240102570 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f024822e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0240111100 con 0x7f0240100e20 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f02467cb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240102ef0 0x7f024019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f02467cb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240102ef0 0x7f024019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45170/0 (socket says 172.21.15.12:45170) 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f02467cb640 1 -- 172.21.15.12:0/731316713 learned_addr learned my addr 172.21.15.12:0/731316713 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f0245fca640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0240100e20 0x7f0240198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f02457c9640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0240102570 0x7f02401989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f02467cb640 1 -- 172.21.15.12:0/731316713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0240100e20 msgr2=0x7f0240198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:03.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f02467cb640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0240100e20 0x7f0240198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f02467cb640 1 -- 172.21.15.12:0/731316713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0240102570 msgr2=0x7f02401989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f02467cb640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0240102570 0x7f02401989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f02467cb640 1 -- 172.21.15.12:0/731316713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024019d440 con 0x7f0240102ef0 2024-09-16T01:00:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f02467cb640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240102ef0 0x7f024019cd60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f023802ae70 tx=0x7f023802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f0236ffd640 1 -- 172.21.15.12:0/731316713 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238034040 con 0x7f0240102ef0 2024-09-16T01:00:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f0236ffd640 1 -- 172.21.15.12:0/731316713 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0238030920 con 0x7f0240102ef0 2024-09-16T01:00:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f024822e640 1 -- 172.21.15.12:0/731316713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024019d6d0 con 0x7f0240102ef0 2024-09-16T01:00:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.713+0000 7f0236ffd640 1 -- 172.21.15.12:0/731316713 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238045480 con 0x7f0240102ef0 2024-09-16T01:00:03.455 INFO:teuthology.orchestra.run.smithi012.stdout:231928234030 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.714+0000 7f024822e640 1 -- 172.21.15.12:0/731316713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02401a5010 con 0x7f0240102ef0 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.715+0000 7f024822e640 1 -- 172.21.15.12:0/731316713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0240101200 con 0x7f0240102ef0 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.717+0000 7f0236ffd640 1 -- 172.21.15.12:0/731316713 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0238037020 con 0x7f0240102ef0 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.717+0000 7f0236ffd640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f022c0a3350 0x7f022c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.717+0000 7f0245fca640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f022c0a3350 0x7f022c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.717+0000 7f0236ffd640 1 -- 172.21.15.12:0/731316713 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f02380f0cd0 con 0x7f0240102ef0 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.718+0000 7f0245fca640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f022c0a3350 0x7f022c0a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f023c0058c0 tx=0x7f023c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.720+0000 7f0236ffd640 1 -- 172.21.15.12:0/731316713 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f02380811b0 con 0x7f0240102ef0 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.903+0000 7f024822e640 1 -- 172.21.15.12:0/731316713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f02401997f0 con 0x7f0240102ef0 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.904+0000 7f0236ffd640 1 -- 172.21.15.12:0/731316713 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f02401997f0 con 0x7f0240102ef0 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 -- 172.21.15.12:0/731316713 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f022c0a3350 msgr2=0x7f022c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f022c0a3350 0x7f022c0a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f023c0058c0 tx=0x7f023c00a250 comp rx=0 tx=0).stop 2024-09-16T01:00:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 -- 172.21.15.12:0/731316713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240102ef0 msgr2=0x7f024019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:03.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240102ef0 0x7f024019cd60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f023802ae70 tx=0x7f023802f5d0 comp rx=0 tx=0).stop 2024-09-16T01:00:03.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 -- 172.21.15.12:0/731316713 shutdown_connections 2024-09-16T01:00:03.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f022c0a3350 0x7f022c0a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:03.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0240102ef0 0x7f024019cd60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:03.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0240102570 0x7f02401989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:03.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 --2- 172.21.15.12:0/731316713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0240100e20 0x7f0240198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:03.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 -- 172.21.15.12:0/731316713 >> 172.21.15.12:0/731316713 conn(0x7f02400fc7d0 msgr2=0x7f024006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:03.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 -- 172.21.15.12:0/731316713 shutdown_connections 2024-09-16T01:00:03.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:02.906+0000 7f024822e640 1 -- 172.21.15.12:0/731316713 wait complete. 2024-09-16T01:00:04.100 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:03 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/731316713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-16T01:00:04.100 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:03 smithi012 ceph-mon[31197]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:04.138 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234027 got 231928234030 for osd.8 2024-09-16T01:00:04.138 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:03 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/731316713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-16T01:00:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:03 smithi098 ceph-mon[35346]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:04.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:03 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/731316713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-16T01:00:04.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:03 smithi119 ceph-mon[35049]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.931+0000 7f7233a6b640 1 -- 172.21.15.12:0/2378089237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f722c100480 msgr2=0x7f722c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.931+0000 7f7233a6b640 1 --2- 172.21.15.12:0/2378089237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f722c100480 0x7f722c100860 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7228009900 tx=0x7f722802a410 comp rx=0 tx=0).stop 2024-09-16T01:00:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.931+0000 7f7233a6b640 1 -- 172.21.15.12:0/2378089237 shutdown_connections 2024-09-16T01:00:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.931+0000 7f7233a6b640 1 --2- 172.21.15.12:0/2378089237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1055b0 0x7f722c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.931+0000 7f7233a6b640 1 --2- 172.21.15.12:0/2378089237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c100e30 0x7f722c104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.931+0000 7f7233a6b640 1 --2- 172.21.15.12:0/2378089237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f722c100480 0x7f722c100860 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.931+0000 7f7233a6b640 1 -- 172.21.15.12:0/2378089237 >> 172.21.15.12:0/2378089237 conn(0x7f722c077210 msgr2=0x7f722c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.932+0000 7f7233a6b640 1 -- 172.21.15.12:0/2378089237 shutdown_connections 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.932+0000 7f7233a6b640 1 -- 172.21.15.12:0/2378089237 wait complete. 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.932+0000 7f7233a6b640 1 Processor -- start 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.932+0000 7f7233a6b640 1 -- start start 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7233a6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f722c100480 0x7f722c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7233a6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c100e30 0x7f722c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7233a6b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1055b0 0x7f722c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7233a6b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10fd60 con 0x7f722c100480 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7233a6b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10fbe0 con 0x7f722c100e30 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7233a6b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10fee0 con 0x7f722c1055b0 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7231807640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f722c100480 0x7f722c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7231807640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f722c100480 0x7f722c19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45190/0 (socket says 172.21.15.12:45190) 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7231807640 1 -- 172.21.15.12:0/1236676805 learned_addr learned my addr 172.21.15.12:0/1236676805 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7231006640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c100e30 0x7f722c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7232008640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1055b0 0x7f722c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7231807640 1 -- 172.21.15.12:0/1236676805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1055b0 msgr2=0x7f722c19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7231807640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1055b0 0x7f722c19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7231807640 1 -- 172.21.15.12:0/1236676805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c100e30 msgr2=0x7f722c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7231807640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c100e30 0x7f722c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7231807640 1 -- 172.21.15.12:0/1236676805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c19f650 con 0x7f722c100480 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7231807640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f722c100480 0x7f722c19a6a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7228006010 tx=0x7f72280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7222ffd640 1 -- 172.21.15.12:0/1236676805 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722803f030 con 0x7f722c100480 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7222ffd640 1 -- 172.21.15.12:0/1236676805 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7228003ce0 con 0x7f722c100480 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7233a6b640 1 -- 172.21.15.12:0/1236676805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722c19f8e0 con 0x7f722c100480 2024-09-16T01:00:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.933+0000 7f7222ffd640 1 -- 172.21.15.12:0/1236676805 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228035070 con 0x7f722c100480 2024-09-16T01:00:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.934+0000 7f7233a6b640 1 -- 172.21.15.12:0/1236676805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722c1a7220 con 0x7f722c100480 2024-09-16T01:00:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.935+0000 7f7233a6b640 1 -- 172.21.15.12:0/1236676805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f722c101960 con 0x7f722c100480 2024-09-16T01:00:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.936+0000 7f7222ffd640 1 -- 172.21.15.12:0/1236676805 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7228042030 con 0x7f722c100480 2024-09-16T01:00:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.936+0000 7f7222ffd640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f72180a32d0 0x7f72180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.937+0000 7f7231006640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f72180a32d0 0x7f72180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.937+0000 7f7222ffd640 1 -- 172.21.15.12:0/1236676805 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f72280f0700 con 0x7f722c100480 2024-09-16T01:00:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.937+0000 7f7231006640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f72180a32d0 0x7f72180a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f722c10d580 tx=0x7f721c00b490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:04.939+0000 7f7222ffd640 1 -- 172.21.15.12:0/1236676805 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72280bd040 con 0x7f722c100480 2024-09-16T01:00:05.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.118+0000 7f7233a6b640 1 -- 172.21.15.12:0/1236676805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f722c1a73f0 con 0x7f722c100480 2024-09-16T01:00:05.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.118+0000 7f7222ffd640 1 -- 172.21.15.12:0/1236676805 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f72280bc940 con 0x7f722c100480 2024-09-16T01:00:05.120 INFO:teuthology.orchestra.run.smithi012.stdout:51539607634 2024-09-16T01:00:05.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.120+0000 7f7233a6b640 1 -- 172.21.15.12:0/1236676805 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f72180a32d0 msgr2=0x7f72180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.120+0000 7f7233a6b640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f72180a32d0 0x7f72180a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f722c10d580 tx=0x7f721c00b490 comp rx=0 tx=0).stop 2024-09-16T01:00:05.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.120+0000 7f7233a6b640 1 -- 172.21.15.12:0/1236676805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f722c100480 msgr2=0x7f722c19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.120+0000 7f7233a6b640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f722c100480 0x7f722c19a6a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7228006010 tx=0x7f72280042f0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.120+0000 7f7233a6b640 1 -- 172.21.15.12:0/1236676805 shutdown_connections 2024-09-16T01:00:05.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.120+0000 7f7233a6b640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f72180a32d0 0x7f72180a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.120+0000 7f7233a6b640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1055b0 0x7f722c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.120+0000 7f7233a6b640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f722c100e30 0x7f722c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.120+0000 7f7233a6b640 1 --2- 172.21.15.12:0/1236676805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f722c100480 0x7f722c19a6a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.120+0000 7f7233a6b640 1 -- 172.21.15.12:0/1236676805 >> 172.21.15.12:0/1236676805 conn(0x7f722c077210 msgr2=0x7f722c103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:05.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.121+0000 7f7233a6b640 1 -- 172.21.15.12:0/1236676805 shutdown_connections 2024-09-16T01:00:05.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.121+0000 7f7233a6b640 1 -- 172.21.15.12:0/1236676805 wait complete. 2024-09-16T01:00:05.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.161+0000 7f166d4b7640 1 -- 172.21.15.12:0/862444008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16681027c0 msgr2=0x7f1668106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.161+0000 7f166d4b7640 1 --2- 172.21.15.12:0/862444008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16681027c0 0x7f1668106810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1650009900 tx=0x7f165002a410 comp rx=0 tx=0).stop 2024-09-16T01:00:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.161+0000 7f166d4b7640 1 -- 172.21.15.12:0/862444008 shutdown_connections 2024-09-16T01:00:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.161+0000 7f166d4b7640 1 --2- 172.21.15.12:0/862444008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1668106f40 0x7f166810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.161+0000 7f166d4b7640 1 --2- 172.21.15.12:0/862444008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16681027c0 0x7f1668106810 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.161+0000 7f166d4b7640 1 --2- 172.21.15.12:0/862444008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668101e10 0x7f16681021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.161+0000 7f166d4b7640 1 -- 172.21.15.12:0/862444008 >> 172.21.15.12:0/862444008 conn(0x7f16680fd8d0 msgr2=0x7f16680ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.161+0000 7f166d4b7640 1 -- 172.21.15.12:0/862444008 shutdown_connections 2024-09-16T01:00:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.161+0000 7f166d4b7640 1 -- 172.21.15.12:0/862444008 wait complete. 2024-09-16T01:00:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f166d4b7640 1 Processor -- start 2024-09-16T01:00:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f166d4b7640 1 -- start start 2024-09-16T01:00:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f166d4b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1668101e10 0x7f16680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f166d4b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16681027c0 0x7f1668074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f166d4b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f40 0x7f1668074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f166d4b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1668111fc0 con 0x7f16681027c0 2024-09-16T01:00:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f166d4b7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1668111e40 con 0x7f1668106f40 2024-09-16T01:00:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f166d4b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1668112140 con 0x7f1668101e10 2024-09-16T01:00:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f16667fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16681027c0 0x7f1668074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f16667fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16681027c0 0x7f1668074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45222/0 (socket says 172.21.15.12:45222) 2024-09-16T01:00:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.162+0000 7f16667fc640 1 -- 172.21.15.12:0/61858632 learned_addr learned my addr 172.21.15.12:0/61858632 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f1666ffd640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1668101e10 0x7f16680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f16677fe640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f40 0x7f1668074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f16667fc640 1 -- 172.21.15.12:0/61858632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1668101e10 msgr2=0x7f16680744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f16667fc640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1668101e10 0x7f16680744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f16667fc640 1 -- 172.21.15.12:0/61858632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f40 msgr2=0x7f1668074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f16667fc640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f40 0x7f1668074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f16667fc640 1 -- 172.21.15.12:0/61858632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16681a6960 con 0x7f16681027c0 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f16677fe640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f40 0x7f1668074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f16667fc640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16681027c0 0x7f1668074a30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1650005ab0 tx=0x7f16500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f165ffff640 1 -- 172.21.15.12:0/61858632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165003f030 con 0x7f16681027c0 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f165ffff640 1 -- 172.21.15.12:0/61858632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1650003ce0 con 0x7f16681027c0 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f166d4b7640 1 -- 172.21.15.12:0/61858632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16681a6bf0 con 0x7f16681027c0 2024-09-16T01:00:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f165ffff640 1 -- 172.21.15.12:0/61858632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650035070 con 0x7f16681027c0 2024-09-16T01:00:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.163+0000 7f166d4b7640 1 -- 172.21.15.12:0/61858632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16681a70d0 con 0x7f16681027c0 2024-09-16T01:00:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.164+0000 7f166d4b7640 1 -- 172.21.15.12:0/61858632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16681021f0 con 0x7f16681027c0 2024-09-16T01:00:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.166+0000 7f165ffff640 1 -- 172.21.15.12:0/61858632 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1650042030 con 0x7f16681027c0 2024-09-16T01:00:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.166+0000 7f165ffff640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f16540a32d0 0x7f16540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.166+0000 7f1666ffd640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f16540a32d0 0x7f16540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.166+0000 7f165ffff640 1 -- 172.21.15.12:0/61858632 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f16500f07a0 con 0x7f16681027c0 2024-09-16T01:00:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.167+0000 7f1666ffd640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f16540a32d0 0x7f16540a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f16600058c0 tx=0x7f166000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.170+0000 7f165ffff640 1 -- 172.21.15.12:0/61858632 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16500bd020 con 0x7f16681027c0 2024-09-16T01:00:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.347+0000 7f166d4b7640 1 -- 172.21.15.12:0/61858632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1668109bf0 con 0x7f16681027c0 2024-09-16T01:00:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.347+0000 7f165ffff640 1 -- 172.21.15.12:0/61858632 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f16500bc920 con 0x7f16681027c0 2024-09-16T01:00:05.349 INFO:teuthology.orchestra.run.smithi012.stdout:98784247880 2024-09-16T01:00:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 -- 172.21.15.12:0/61858632 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f16540a32d0 msgr2=0x7f16540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f16540a32d0 0x7f16540a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f16600058c0 tx=0x7f166000a4c0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 -- 172.21.15.12:0/61858632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16681027c0 msgr2=0x7f1668074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16681027c0 0x7f1668074a30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1650005ab0 tx=0x7f16500042f0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 -- 172.21.15.12:0/61858632 shutdown_connections 2024-09-16T01:00:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f16540a32d0 0x7f16540a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f40 0x7f1668074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16681027c0 0x7f1668074a30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 --2- 172.21.15.12:0/61858632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1668101e10 0x7f16680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 -- 172.21.15.12:0/61858632 >> 172.21.15.12:0/61858632 conn(0x7f16680fd8d0 msgr2=0x7f16680fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 -- 172.21.15.12:0/61858632 shutdown_connections 2024-09-16T01:00:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:05.349+0000 7f166d4b7640 1 -- 172.21.15.12:0/61858632 wait complete. 2024-09-16T01:00:06.114 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607631 got 51539607634 for osd.1 2024-09-16T01:00:06.114 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:06.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:05 smithi012 ceph-mon[31197]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9 op/s 2024-09-16T01:00:06.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1236676805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T01:00:06.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/61858632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T01:00:06.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.260+0000 7f83a1ad9640 1 -- 172.21.15.12:0/3476092487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c101420 msgr2=0x7f839c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:06.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.260+0000 7f83a1ad9640 1 --2- 172.21.15.12:0/3476092487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c101420 0x7f839c10d950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8394009cd0 tx=0x7f839402a8e0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.260+0000 7f83a1ad9640 1 -- 172.21.15.12:0/3476092487 shutdown_connections 2024-09-16T01:00:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.260+0000 7f83a1ad9640 1 --2- 172.21.15.12:0/3476092487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c101420 0x7f839c10d950 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.260+0000 7f83a1ad9640 1 --2- 172.21.15.12:0/3476092487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f839c100a80 0x7f839c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.260+0000 7f83a1ad9640 1 --2- 172.21.15.12:0/3476092487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839c106a80 0x7f839c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.260+0000 7f83a1ad9640 1 -- 172.21.15.12:0/3476092487 >> 172.21.15.12:0/3476092487 conn(0x7f839c0fc7a0 msgr2=0x7f839c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.260+0000 7f83a1ad9640 1 -- 172.21.15.12:0/3476092487 shutdown_connections 2024-09-16T01:00:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.260+0000 7f83a1ad9640 1 -- 172.21.15.12:0/3476092487 wait complete. 2024-09-16T01:00:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.261+0000 7f83a1ad9640 1 Processor -- start 2024-09-16T01:00:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.261+0000 7f83a1ad9640 1 -- start start 2024-09-16T01:00:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.261+0000 7f83a1ad9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c100a80 0x7f839c1972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.261+0000 7f83a1ad9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839c101420 0x7f839c1977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.261+0000 7f83a1ad9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f839c106a80 0x7f839c19bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.261+0000 7f83a1ad9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f839c110e80 con 0x7f839c100a80 2024-09-16T01:00:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.261+0000 7f83a1ad9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f839c110d00 con 0x7f839c106a80 2024-09-16T01:00:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.261+0000 7f83a1ad9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f839c111000 con 0x7f839c101420 2024-09-16T01:00:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c100a80 0x7f839c1972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c100a80 0x7f839c1972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58662/0 (socket says 172.21.15.12:58662) 2024-09-16T01:00:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839b7fe640 1 -- 172.21.15.12:0/2062688925 learned_addr learned my addr 172.21.15.12:0/2062688925 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839bfff640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f839c106a80 0x7f839c19bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839affd640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839c101420 0x7f839c1977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839b7fe640 1 -- 172.21.15.12:0/2062688925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839c101420 msgr2=0x7f839c1977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839b7fe640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839c101420 0x7f839c1977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839b7fe640 1 -- 172.21.15.12:0/2062688925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f839c106a80 msgr2=0x7f839c19bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839b7fe640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f839c106a80 0x7f839c19bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839b7fe640 1 -- 172.21.15.12:0/2062688925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c19c250 con 0x7f839c100a80 2024-09-16T01:00:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839bfff640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f839c106a80 0x7f839c19bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839affd640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839c101420 0x7f839c1977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f839b7fe640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c100a80 0x7f839c1972a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f838c00d770 tx=0x7f838c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f8398ff9640 1 -- 172.21.15.12:0/2062688925 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c017070 con 0x7f839c100a80 2024-09-16T01:00:06.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f83a1ad9640 1 -- 172.21.15.12:0/2062688925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c19c540 con 0x7f839c100a80 2024-09-16T01:00:06.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f8398ff9640 1 -- 172.21.15.12:0/2062688925 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f838c005500 con 0x7f839c100a80 2024-09-16T01:00:06.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f8398ff9640 1 -- 172.21.15.12:0/2062688925 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c004e00 con 0x7f839c100a80 2024-09-16T01:00:06.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.262+0000 7f83a1ad9640 1 -- 172.21.15.12:0/2062688925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c1a3e20 con 0x7f839c100a80 2024-09-16T01:00:06.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.263+0000 7f83a1ad9640 1 -- 172.21.15.12:0/2062688925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c100ee0 con 0x7f839c100a80 2024-09-16T01:00:06.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.264+0000 7f8398ff9640 1 -- 172.21.15.12:0/2062688925 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f838c004fa0 con 0x7f839c100a80 2024-09-16T01:00:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.265+0000 7f8398ff9640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83840a32d0 0x7f83840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.265+0000 7f839affd640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83840a32d0 0x7f83840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.265+0000 7f8398ff9640 1 -- 172.21.15.12:0/2062688925 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f838c0cf8b0 con 0x7f839c100a80 2024-09-16T01:00:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.266+0000 7f839affd640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83840a32d0 0x7f83840a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f839c0fecc0 tx=0x7f839000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.269+0000 7f8398ff9640 1 -- 172.21.15.12:0/2062688925 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f838c09c130 con 0x7f839c100a80 2024-09-16T01:00:06.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:05 smithi119 ceph-mon[35049]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9 op/s 2024-09-16T01:00:06.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:05 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1236676805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T01:00:06.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:05 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/61858632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T01:00:06.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.447+0000 7f83a1ad9640 1 -- 172.21.15.12:0/2062688925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f839c1a3ff0 con 0x7f839c100a80 2024-09-16T01:00:06.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.447+0000 7f8398ff9640 1 -- 172.21.15.12:0/2062688925 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f838c09ba30 con 0x7f839c100a80 2024-09-16T01:00:06.450 INFO:teuthology.orchestra.run.smithi012.stdout:313532612639 2024-09-16T01:00:06.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 -- 172.21.15.12:0/2062688925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83840a32d0 msgr2=0x7f83840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:06.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83840a32d0 0x7f83840a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f839c0fecc0 tx=0x7f839000a5c0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 -- 172.21.15.12:0/2062688925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c100a80 msgr2=0x7f839c1972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:06.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c100a80 0x7f839c1972a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f838c00d770 tx=0x7f838c00dc30 comp rx=0 tx=0).stop 2024-09-16T01:00:06.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 -- 172.21.15.12:0/2062688925 shutdown_connections 2024-09-16T01:00:06.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83840a32d0 0x7f83840a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f839c106a80 0x7f839c19bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f839c101420 0x7f839c1977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 --2- 172.21.15.12:0/2062688925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c100a80 0x7f839c1972a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:06.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 -- 172.21.15.12:0/2062688925 >> 172.21.15.12:0/2062688925 conn(0x7f839c0fc7a0 msgr2=0x7f839c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:06.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 -- 172.21.15.12:0/2062688925 shutdown_connections 2024-09-16T01:00:06.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:06.450+0000 7f83a1ad9640 1 -- 172.21.15.12:0/2062688925 wait complete. 2024-09-16T01:00:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:05 smithi098 ceph-mon[35346]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9 op/s 2024-09-16T01:00:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:05 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1236676805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T01:00:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:05 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/61858632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T01:00:06.805 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:06.805 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:06.806 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:06.810 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:07.261 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:06 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2062688925' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-16T01:00:07.303 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247878 got 98784247880 for osd.3 2024-09-16T01:00:07.304 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:07.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:06 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2062688925' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-16T01:00:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:06 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2062688925' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-16T01:00:08.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:07 smithi012 ceph-mon[31197]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:08.181 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612636 got 313532612639 for osd.11 2024-09-16T01:00:08.182 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:08.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:07 smithi119 ceph-mon[35049]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:08.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:07 smithi098 ceph-mon[35346]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:08.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.730+0000 7ff58ef7a640 1 -- 172.21.15.12:0/2734824125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff588101de0 msgr2=0x7ff5881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:08.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.730+0000 7ff58ef7a640 1 --2- 172.21.15.12:0/2734824125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff588101de0 0x7ff5881021c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009900 tx=0x7ff57c02a410 comp rx=0 tx=0).stop 2024-09-16T01:00:08.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.730+0000 7ff58ef7a640 1 -- 172.21.15.12:0/2734824125 shutdown_connections 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.730+0000 7ff58ef7a640 1 --2- 172.21.15.12:0/2734824125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff588106f10 0x7ff58810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.730+0000 7ff58ef7a640 1 --2- 172.21.15.12:0/2734824125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff588102790 0x7ff5881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.730+0000 7ff58ef7a640 1 --2- 172.21.15.12:0/2734824125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff588101de0 0x7ff5881021c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.730+0000 7ff58ef7a640 1 -- 172.21.15.12:0/2734824125 >> 172.21.15.12:0/2734824125 conn(0x7ff5880fd8c0 msgr2=0x7ff5880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.730+0000 7ff58ef7a640 1 -- 172.21.15.12:0/2734824125 shutdown_connections 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.730+0000 7ff58ef7a640 1 -- 172.21.15.12:0/2734824125 wait complete. 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.731+0000 7ff58ef7a640 1 Processor -- start 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.731+0000 7ff58ef7a640 1 -- start start 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.731+0000 7ff58ef7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff588101de0 0x7ff5881984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.731+0000 7ff58ef7a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff588102790 0x7ff5881989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.731+0000 7ff58ef7a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff588106f10 0x7ff58819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.731+0000 7ff58ef7a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff588111f80 con 0x7ff588106f10 2024-09-16T01:00:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.731+0000 7ff58ef7a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff588111e00 con 0x7ff588101de0 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58ef7a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff588112100 con 0x7ff588102790 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58d517640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff588106f10 0x7ff58819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58d517640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff588106f10 0x7ff58819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58708/0 (socket says 172.21.15.12:58708) 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58d517640 1 -- 172.21.15.12:0/1301727679 learned_addr learned my addr 172.21.15.12:0/1301727679 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58cd16640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff588101de0 0x7ff5881984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff587fff640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff588102790 0x7ff5881989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58d517640 1 -- 172.21.15.12:0/1301727679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff588102790 msgr2=0x7ff5881989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58d517640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff588102790 0x7ff5881989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58d517640 1 -- 172.21.15.12:0/1301727679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff588101de0 msgr2=0x7ff5881984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58d517640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff588101de0 0x7ff5881984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58d517640 1 -- 172.21.15.12:0/1301727679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58819d450 con 0x7ff588106f10 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58d517640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff588106f10 0x7ff58819cd70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff58000eaa0 tx=0x7ff58000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff585ffb640 1 -- 172.21.15.12:0/1301727679 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58000cdb0 con 0x7ff588106f10 2024-09-16T01:00:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff585ffb640 1 -- 172.21.15.12:0/1301727679 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff580005020 con 0x7ff588106f10 2024-09-16T01:00:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff58ef7a640 1 -- 172.21.15.12:0/1301727679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58819d740 con 0x7ff588106f10 2024-09-16T01:00:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.732+0000 7ff585ffb640 1 -- 172.21.15.12:0/1301727679 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5800116b0 con 0x7ff588106f10 2024-09-16T01:00:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.733+0000 7ff58ef7a640 1 -- 172.21.15.12:0/1301727679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5881a5020 con 0x7ff588106f10 2024-09-16T01:00:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.734+0000 7ff58ef7a640 1 -- 172.21.15.12:0/1301727679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5881021c0 con 0x7ff588106f10 2024-09-16T01:00:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.735+0000 7ff585ffb640 1 -- 172.21.15.12:0/1301727679 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff580005560 con 0x7ff588106f10 2024-09-16T01:00:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.736+0000 7ff585ffb640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5780a32d0 0x7ff5780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.736+0000 7ff58cd16640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5780a32d0 0x7ff5780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.736+0000 7ff585ffb640 1 -- 172.21.15.12:0/1301727679 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7ff5800cff80 con 0x7ff588106f10 2024-09-16T01:00:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.736+0000 7ff58cd16640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5780a32d0 0x7ff5780a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff57c000c00 tx=0x7ff57c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.740+0000 7ff585ffb640 1 -- 172.21.15.12:0/1301727679 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff580016030 con 0x7ff588106f10 2024-09-16T01:00:08.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.922+0000 7ff58ef7a640 1 -- 172.21.15.12:0/1301727679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff588109b60 con 0x7ff588106f10 2024-09-16T01:00:08.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.923+0000 7ff585ffb640 1 -- 172.21.15.12:0/1301727679 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff58009c150 con 0x7ff588106f10 2024-09-16T01:00:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:128849018947 2024-09-16T01:00:08.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 -- 172.21.15.12:0/1301727679 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5780a32d0 msgr2=0x7ff5780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:08.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5780a32d0 0x7ff5780a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff57c000c00 tx=0x7ff57c005b50 comp rx=0 tx=0).stop 2024-09-16T01:00:08.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 -- 172.21.15.12:0/1301727679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff588106f10 msgr2=0x7ff58819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:08.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff588106f10 0x7ff58819cd70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff58000eaa0 tx=0x7ff58000ef60 comp rx=0 tx=0).stop 2024-09-16T01:00:08.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 -- 172.21.15.12:0/1301727679 shutdown_connections 2024-09-16T01:00:08.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff5780a32d0 0x7ff5780a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff588106f10 0x7ff58819cd70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff588102790 0x7ff5881989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 --2- 172.21.15.12:0/1301727679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff588101de0 0x7ff5881984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 -- 172.21.15.12:0/1301727679 >> 172.21.15.12:0/1301727679 conn(0x7ff5880fd8c0 msgr2=0x7ff5880fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:08.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 -- 172.21.15.12:0/1301727679 shutdown_connections 2024-09-16T01:00:08.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.925+0000 7ff58ef7a640 1 -- 172.21.15.12:0/1301727679 wait complete. 2024-09-16T01:00:08.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.942+0000 7f99830b2640 1 -- 172.21.15.12:0/1408051586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f997c1036e0 msgr2=0x7f997c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:08.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.942+0000 7f99830b2640 1 --2- 172.21.15.12:0/1408051586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f997c1036e0 0x7f997c107b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9968009930 tx=0x7f996802a420 comp rx=0 tx=0).stop 2024-09-16T01:00:08.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.942+0000 7f99830b2640 1 -- 172.21.15.12:0/1408051586 shutdown_connections 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.942+0000 7f99830b2640 1 --2- 172.21.15.12:0/1408051586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1082a0 0x7f997c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.942+0000 7f99830b2640 1 --2- 172.21.15.12:0/1408051586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f997c1036e0 0x7f997c107b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.942+0000 7f99830b2640 1 --2- 172.21.15.12:0/1408051586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f997c102d30 0x7f997c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.942+0000 7f99830b2640 1 -- 172.21.15.12:0/1408051586 >> 172.21.15.12:0/1408051586 conn(0x7f997c0fc7d0 msgr2=0x7f997c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.942+0000 7f99830b2640 1 -- 172.21.15.12:0/1408051586 shutdown_connections 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.942+0000 7f99830b2640 1 -- 172.21.15.12:0/1408051586 wait complete. 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f99830b2640 1 Processor -- start 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f99830b2640 1 -- start start 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f99830b2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f997c102d30 0x7f997c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f99830b2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1036e0 0x7f997c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f99830b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f997c1082a0 0x7f997c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f99830b2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f997c1120a0 con 0x7f997c1082a0 2024-09-16T01:00:08.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f99830b2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f997c111f20 con 0x7f997c102d30 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f99830b2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f997c112220 con 0x7f997c1036e0 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f998164f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f997c1082a0 0x7f997c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f998164f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f997c1082a0 0x7f997c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58726/0 (socket says 172.21.15.12:58726) 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f998164f640 1 -- 172.21.15.12:0/1744053657 learned_addr learned my addr 172.21.15.12:0/1744053657 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f997bfff640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1036e0 0x7f997c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.943+0000 7f9980e4e640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f997c102d30 0x7f997c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f998164f640 1 -- 172.21.15.12:0/1744053657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1036e0 msgr2=0x7f997c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f998164f640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1036e0 0x7f997c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f998164f640 1 -- 172.21.15.12:0/1744053657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f997c102d30 msgr2=0x7f997c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f998164f640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f997c102d30 0x7f997c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:08.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f998164f640 1 -- 172.21.15.12:0/1744053657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997c19d5f0 con 0x7f997c1082a0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f998164f640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f997c1082a0 0x7f997c19cf10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f997400eb10 tx=0x7f997400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f9979ffb640 1 -- 172.21.15.12:0/1744053657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974004b20 con 0x7f997c1082a0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f99830b2640 1 -- 172.21.15.12:0/1744053657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997c19d8e0 con 0x7f997c1082a0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f9979ffb640 1 -- 172.21.15.12:0/1744053657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9974004cc0 con 0x7f997c1082a0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f9979ffb640 1 -- 172.21.15.12:0/1744053657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974010760 con 0x7f997c1082a0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.944+0000 7f99830b2640 1 -- 172.21.15.12:0/1744053657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f997c1008c0 con 0x7f997c1082a0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.946+0000 7f99830b2640 1 -- 172.21.15.12:0/1744053657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f997c103110 con 0x7f997c1082a0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.947+0000 7f9979ffb640 1 -- 172.21.15.12:0/1744053657 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9974005020 con 0x7f997c1082a0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.947+0000 7f9979ffb640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f996c0a3350 0x7f996c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.947+0000 7f9979ffb640 1 -- 172.21.15.12:0/1744053657 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f99740d02f0 con 0x7f997c1082a0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.947+0000 7f9980e4e640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f996c0a3350 0x7f996c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.948+0000 7f9980e4e640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f996c0a3350 0x7f996c0a5810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9970005d00 tx=0x7f997000f820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:08.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.952+0000 7f9979ffb640 1 -- 172.21.15.12:0/1744053657 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f997409cc10 con 0x7f997c1082a0 2024-09-16T01:00:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.136+0000 7f99830b2640 1 -- 172.21.15.12:0/1744053657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f997c10a2b0 con 0x7f997c1082a0 2024-09-16T01:00:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.137+0000 7f9979ffb640 1 -- 172.21.15.12:0/1744053657 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f997409c510 con 0x7f997c1082a0 2024-09-16T01:00:09.139 INFO:teuthology.orchestra.run.smithi012.stdout:150323855422 2024-09-16T01:00:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 -- 172.21.15.12:0/1744053657 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f996c0a3350 msgr2=0x7f996c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f996c0a3350 0x7f996c0a5810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9970005d00 tx=0x7f997000f820 comp rx=0 tx=0).stop 2024-09-16T01:00:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 -- 172.21.15.12:0/1744053657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f997c1082a0 msgr2=0x7f997c19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f997c1082a0 0x7f997c19cf10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f997400eb10 tx=0x7f997400c2d0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 -- 172.21.15.12:0/1744053657 shutdown_connections 2024-09-16T01:00:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f996c0a3350 0x7f996c0a5810 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f997c1082a0 0x7f997c19cf10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1036e0 0x7f997c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 --2- 172.21.15.12:0/1744053657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f997c102d30 0x7f997c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 -- 172.21.15.12:0/1744053657 >> 172.21.15.12:0/1744053657 conn(0x7f997c0fc7d0 msgr2=0x7f997c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:09.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 -- 172.21.15.12:0/1744053657 shutdown_connections 2024-09-16T01:00:09.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:09.139+0000 7f99830b2640 1 -- 172.21.15.12:0/1744053657 wait complete. 2024-09-16T01:00:09.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:08 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1035749430' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-16T01:00:09.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:08 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1301727679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T01:00:09.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:08 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1035749430' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-16T01:00:09.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:08 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1301727679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T01:00:09.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:08 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1035749430' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-16T01:00:09.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:08 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1301727679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.397+0000 7fb37a709640 1 -- 172.21.15.12:0/687801988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb37410c170 msgr2=0x7fb37410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.397+0000 7fb37a709640 1 --2- 172.21.15.12:0/687801988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb37410c170 0x7fb37410e610 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009ca0 tx=0x7fb36c02a950 comp rx=0 tx=0).stop 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.397+0000 7fb37a709640 1 -- 172.21.15.12:0/687801988 shutdown_connections 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.397+0000 7fb37a709640 1 --2- 172.21.15.12:0/687801988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb37410c170 0x7fb37410e610 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.397+0000 7fb37a709640 1 --2- 172.21.15.12:0/687801988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb374103660 0x7fb37410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.397+0000 7fb37a709640 1 --2- 172.21.15.12:0/687801988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb374102d40 0x7fb374103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.397+0000 7fb37a709640 1 -- 172.21.15.12:0/687801988 >> 172.21.15.12:0/687801988 conn(0x7fb3740fc7a0 msgr2=0x7fb3740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.397+0000 7fb37a709640 1 -- 172.21.15.12:0/687801988 shutdown_connections 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.398+0000 7fb37a709640 1 -- 172.21.15.12:0/687801988 wait complete. 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.398+0000 7fb37a709640 1 Processor -- start 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.398+0000 7fb37a709640 1 -- start start 2024-09-16T01:00:09.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.398+0000 7fb37a709640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb374102d40 0x7fb374198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.398+0000 7fb37a709640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb374103660 0x7fb374198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.398+0000 7fb37a709640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb37410c170 0x7fb37419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.398+0000 7fb37a709640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb374111f50 con 0x7fb37410c170 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.398+0000 7fb37a709640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb374111dd0 con 0x7fb374102d40 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.398+0000 7fb37a709640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb3741120d0 con 0x7fb374103660 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb378ca6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb37410c170 0x7fb37419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb378ca6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb37410c170 0x7fb37419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58684/0 (socket says 172.21.15.12:58684) 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb378ca6640 1 -- 172.21.15.12:0/1035749430 learned_addr learned my addr 172.21.15.12:0/1035749430 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb3737fe640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb374103660 0x7fb374198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb373fff640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb374102d40 0x7fb374198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb378ca6640 1 -- 172.21.15.12:0/1035749430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb374103660 msgr2=0x7fb374198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb378ca6640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb374103660 0x7fb374198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb378ca6640 1 -- 172.21.15.12:0/1035749430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb374102d40 msgr2=0x7fb374198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb378ca6640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb374102d40 0x7fb374198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb378ca6640 1 -- 172.21.15.12:0/1035749430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37419d3b0 con 0x7fb37410c170 2024-09-16T01:00:09.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb378ca6640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb37410c170 0x7fb37419ccd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb36c02ae70 tx=0x7fb36c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:09.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb3717fa640 1 -- 172.21.15.12:0/1035749430 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c034040 con 0x7fb37410c170 2024-09-16T01:00:09.475 INFO:teuthology.orchestra.run.smithi012.stdout:261993005098 2024-09-16T01:00:09.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb3717fa640 1 -- 172.21.15.12:0/1035749430 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb36c030920 con 0x7fb37410c170 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb37a709640 1 -- 172.21.15.12:0/1035749430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37419d640 con 0x7fb37410c170 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb3717fa640 1 -- 172.21.15.12:0/1035749430 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c045480 con 0x7fb37410c170 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.399+0000 7fb37a709640 1 -- 172.21.15.12:0/1035749430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3741a4f80 con 0x7fb37410c170 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.400+0000 7fb37a709640 1 -- 172.21.15.12:0/1035749430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb374103120 con 0x7fb37410c170 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.402+0000 7fb3717fa640 1 -- 172.21.15.12:0/1035749430 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb36c037020 con 0x7fb37410c170 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.403+0000 7fb3717fa640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb35c0a3350 0x7fb35c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.403+0000 7fb373fff640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb35c0a3350 0x7fb35c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.403+0000 7fb3717fa640 1 -- 172.21.15.12:0/1035749430 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fb36c0f0d10 con 0x7fb37410c170 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.403+0000 7fb373fff640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb35c0a3350 0x7fb35c0a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb364005d00 tx=0x7fb36400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.408+0000 7fb3717fa640 1 -- 172.21.15.12:0/1035749430 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb36c0811b0 con 0x7fb37410c170 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.602+0000 7fb37a709640 1 -- 172.21.15.12:0/1035749430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fb374199760 con 0x7fb37410c170 2024-09-16T01:00:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.603+0000 7fb3717fa640 1 -- 172.21.15.12:0/1035749430 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb374199760 con 0x7fb37410c170 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 -- 172.21.15.12:0/1035749430 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb35c0a3350 msgr2=0x7fb35c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb35c0a3350 0x7fb35c0a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb364005d00 tx=0x7fb36400b410 comp rx=0 tx=0).stop 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 -- 172.21.15.12:0/1035749430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb37410c170 msgr2=0x7fb37419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb37410c170 0x7fb37419ccd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb36c02ae70 tx=0x7fb36c02f5b0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 -- 172.21.15.12:0/1035749430 shutdown_connections 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb35c0a3350 0x7fb35c0a5810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb37410c170 0x7fb37419ccd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb374103660 0x7fb374198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 --2- 172.21.15.12:0/1035749430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb374102d40 0x7fb374198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 -- 172.21.15.12:0/1035749430 >> 172.21.15.12:0/1035749430 conn(0x7fb3740fc7a0 msgr2=0x7fb3740fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 -- 172.21.15.12:0/1035749430 shutdown_connections 2024-09-16T01:00:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:08.605+0000 7fb37a709640 1 -- 172.21.15.12:0/1035749430 wait complete. 2024-09-16T01:00:10.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:09 smithi012 ceph-mon[31197]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:10.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:09 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1744053657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T01:00:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:10.209 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005096 got 261993005098 for osd.9 2024-09-16T01:00:10.209 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:10.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:09 smithi119 ceph-mon[35049]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:10.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:09 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1744053657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T01:00:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:09 smithi098 ceph-mon[35346]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:10.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:09 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1744053657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T01:00:10.734 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855419 got 150323855422 for osd.5 2024-09-16T01:00:10.734 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:11.141 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018945 got 128849018947 for osd.4 2024-09-16T01:00:11.141 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:11.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.807+0000 7ff65e99f640 1 -- 172.21.15.12:0/546893723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff658101270 msgr2=0x7ff65810d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.807+0000 7ff65e99f640 1 --2- 172.21.15.12:0/546893723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff658101270 0x7ff65810d7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff650009cd0 tx=0x7ff65002a8e0 comp rx=0 tx=0).stop 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.807+0000 7ff65e99f640 1 -- 172.21.15.12:0/546893723 shutdown_connections 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.807+0000 7ff65e99f640 1 --2- 172.21.15.12:0/546893723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff658101270 0x7ff65810d7a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.807+0000 7ff65e99f640 1 --2- 172.21.15.12:0/546893723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6581008d0 0x7ff658100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.807+0000 7ff65e99f640 1 --2- 172.21.15.12:0/546893723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6581068d0 0x7ff658106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.807+0000 7ff65e99f640 1 -- 172.21.15.12:0/546893723 >> 172.21.15.12:0/546893723 conn(0x7ff6580fc610 msgr2=0x7ff6580fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.807+0000 7ff65e99f640 1 -- 172.21.15.12:0/546893723 shutdown_connections 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.807+0000 7ff65e99f640 1 -- 172.21.15.12:0/546893723 wait complete. 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.808+0000 7ff65e99f640 1 Processor -- start 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.808+0000 7ff65e99f640 1 -- start start 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.808+0000 7ff65e99f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6581008d0 0x7ff6581024a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.808+0000 7ff65e99f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff658101270 0x7ff6581029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.808+0000 7ff65e99f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6581068d0 0x7ff658102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.808+0000 7ff65e99f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff658110cd0 con 0x7ff658101270 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.808+0000 7ff65e99f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff658110b50 con 0x7ff6581008d0 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.808+0000 7ff65e99f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff658110e50 con 0x7ff6581068d0 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.808+0000 7ff65d19c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff658101270 0x7ff6581029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65d19c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff658101270 0x7ff6581029e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58742/0 (socket says 172.21.15.12:58742) 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65d19c640 1 -- 172.21.15.12:0/2711510804 learned_addr learned my addr 172.21.15.12:0/2711510804 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65e19e640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6581068d0 0x7ff658102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65d99d640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6581008d0 0x7ff6581024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65d19c640 1 -- 172.21.15.12:0/2711510804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6581068d0 msgr2=0x7ff658102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65d19c640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6581068d0 0x7ff658102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65d19c640 1 -- 172.21.15.12:0/2711510804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6581008d0 msgr2=0x7ff6581024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65d19c640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6581008d0 0x7ff6581024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:11.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65d19c640 1 -- 172.21.15.12:0/2711510804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6581a6710 con 0x7ff658101270 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65d99d640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6581008d0 0x7ff6581024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65d19c640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff658101270 0x7ff6581029e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff64800d950 tx=0x7ff64800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff64effd640 1 -- 172.21.15.12:0/2711510804 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648017070 con 0x7ff658101270 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff64effd640 1 -- 172.21.15.12:0/2711510804 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff648009c30 con 0x7ff658101270 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65e99f640 1 -- 172.21.15.12:0/2711510804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6581a6a00 con 0x7ff658101270 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff64effd640 1 -- 172.21.15.12:0/2711510804 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64800f6b0 con 0x7ff658101270 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.809+0000 7ff65e99f640 1 -- 172.21.15.12:0/2711510804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6581a6f40 con 0x7ff658101270 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.810+0000 7ff65e99f640 1 -- 172.21.15.12:0/2711510804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff658100d30 con 0x7ff658101270 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.812+0000 7ff64effd640 1 -- 172.21.15.12:0/2711510804 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff6480109d0 con 0x7ff658101270 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.812+0000 7ff64effd640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6440a32d0 0x7ff6440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.812+0000 7ff64effd640 1 -- 172.21.15.12:0/2711510804 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7ff6480cfac0 con 0x7ff658101270 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.812+0000 7ff65d99d640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6440a32d0 0x7ff6440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.813+0000 7ff65d99d640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6440a32d0 0x7ff6440a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff654009ab0 tx=0x7ff6540094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:11.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.816+0000 7ff64effd640 1 -- 172.21.15.12:0/2711510804 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff648009de0 con 0x7ff658101270 2024-09-16T01:00:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.996+0000 7ff65e99f640 1 -- 172.21.15.12:0/2711510804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff6581039d0 con 0x7ff658101270 2024-09-16T01:00:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.996+0000 7ff64effd640 1 -- 172.21.15.12:0/2711510804 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff64809c340 con 0x7ff658101270 2024-09-16T01:00:11.998 INFO:teuthology.orchestra.run.smithi012.stdout:180388626490 2024-09-16T01:00:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 -- 172.21.15.12:0/2711510804 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6440a32d0 msgr2=0x7ff6440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6440a32d0 0x7ff6440a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff654009ab0 tx=0x7ff6540094b0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 -- 172.21.15.12:0/2711510804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff658101270 msgr2=0x7ff6581029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff658101270 0x7ff6581029e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff64800d950 tx=0x7ff64800de10 comp rx=0 tx=0).stop 2024-09-16T01:00:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 -- 172.21.15.12:0/2711510804 shutdown_connections 2024-09-16T01:00:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff6440a32d0 0x7ff6440a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6581068d0 0x7ff658102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff658101270 0x7ff6581029e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 --2- 172.21.15.12:0/2711510804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6581008d0 0x7ff6581024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 -- 172.21.15.12:0/2711510804 >> 172.21.15.12:0/2711510804 conn(0x7ff6580fc610 msgr2=0x7ff65806a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 -- 172.21.15.12:0/2711510804 shutdown_connections 2024-09-16T01:00:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:11.999+0000 7ff65e99f640 1 -- 172.21.15.12:0/2711510804 wait complete. 2024-09-16T01:00:12.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.019+0000 7f6dbac37640 1 -- 172.21.15.12:0/3259559446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db41036e0 msgr2=0x7f6db4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:12.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.019+0000 7f6dbac37640 1 --2- 172.21.15.12:0/3259559446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db41036e0 0x7f6db4107b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009930 tx=0x7f6da002a420 comp rx=0 tx=0).stop 2024-09-16T01:00:12.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.019+0000 7f6dbac37640 1 -- 172.21.15.12:0/3259559446 shutdown_connections 2024-09-16T01:00:12.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.019+0000 7f6dbac37640 1 --2- 172.21.15.12:0/3259559446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db41082a0 0x7f6db410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.019+0000 7f6dbac37640 1 --2- 172.21.15.12:0/3259559446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db41036e0 0x7f6db4107b90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.019+0000 7f6dbac37640 1 --2- 172.21.15.12:0/3259559446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db4102d30 0x7f6db4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.019+0000 7f6dbac37640 1 -- 172.21.15.12:0/3259559446 >> 172.21.15.12:0/3259559446 conn(0x7f6db40fc7d0 msgr2=0x7f6db40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:12.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.019+0000 7f6dbac37640 1 -- 172.21.15.12:0/3259559446 shutdown_connections 2024-09-16T01:00:12.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.019+0000 7f6dbac37640 1 -- 172.21.15.12:0/3259559446 wait complete. 2024-09-16T01:00:12.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6dbac37640 1 Processor -- start 2024-09-16T01:00:12.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6dbac37640 1 -- start start 2024-09-16T01:00:12.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6dbac37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4102d30 0x7f6db4198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:12.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6dbac37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db41036e0 0x7f6db4198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:12.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6dbac37640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db41082a0 0x7f6db419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:12.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6dbac37640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6db41120a0 con 0x7f6db41036e0 2024-09-16T01:00:12.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6dbac37640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4111f20 con 0x7f6db4102d30 2024-09-16T01:00:12.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6dbac37640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4112220 con 0x7f6db41082a0 2024-09-16T01:00:12.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6db3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db41036e0 0x7f6db4198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:12.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6db3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db41036e0 0x7f6db4198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58760/0 (socket says 172.21.15.12:58760) 2024-09-16T01:00:12.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.020+0000 7f6db3fff640 1 -- 172.21.15.12:0/2492426014 learned_addr learned my addr 172.21.15.12:0/2492426014 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:12.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db89d3640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4102d30 0x7f6db4198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db91d4640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db41082a0 0x7f6db419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db3fff640 1 -- 172.21.15.12:0/2492426014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db41082a0 msgr2=0x7f6db419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db3fff640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db41082a0 0x7f6db419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db3fff640 1 -- 172.21.15.12:0/2492426014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4102d30 msgr2=0x7f6db4198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db3fff640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4102d30 0x7f6db4198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db3fff640 1 -- 172.21.15.12:0/2492426014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db419d510 con 0x7f6db41036e0 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db3fff640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db41036e0 0x7f6db4198aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6da0005940 tx=0x7f6da00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db1ffb640 1 -- 172.21.15.12:0/2492426014 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da003f030 con 0x7f6db41036e0 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db1ffb640 1 -- 172.21.15.12:0/2492426014 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da0003ce0 con 0x7f6db41036e0 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6dbac37640 1 -- 172.21.15.12:0/2492426014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db419d7a0 con 0x7f6db41036e0 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.021+0000 7f6db1ffb640 1 -- 172.21.15.12:0/2492426014 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0035070 con 0x7f6db41036e0 2024-09-16T01:00:12.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.022+0000 7f6dbac37640 1 -- 172.21.15.12:0/2492426014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db41a50e0 con 0x7f6db41036e0 2024-09-16T01:00:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.023+0000 7f6dbac37640 1 -- 172.21.15.12:0/2492426014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db406a850 con 0x7f6db41036e0 2024-09-16T01:00:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.024+0000 7f6db1ffb640 1 -- 172.21.15.12:0/2492426014 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6da0042030 con 0x7f6db41036e0 2024-09-16T01:00:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.025+0000 7f6db1ffb640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6da40a32d0 0x7f6da40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.025+0000 7f6db1ffb640 1 -- 172.21.15.12:0/2492426014 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f6da00f0340 con 0x7f6db41036e0 2024-09-16T01:00:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.025+0000 7f6db89d3640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6da40a32d0 0x7f6da40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.026+0000 7f6db89d3640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6da40a32d0 0x7f6da40a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6da800abe0 tx=0x7f6da800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:12.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.033+0000 7f6db1ffb640 1 -- 172.21.15.12:0/2492426014 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6da00bcb60 con 0x7f6db41036e0 2024-09-16T01:00:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.213+0000 7f6dbac37640 1 -- 172.21.15.12:0/2492426014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6db41998c0 con 0x7f6db41036e0 2024-09-16T01:00:12.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.214+0000 7f6db1ffb640 1 -- 172.21.15.12:0/2492426014 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6da00bc460 con 0x7f6db41036e0 2024-09-16T01:00:12.216 INFO:teuthology.orchestra.run.smithi012.stdout:73014444110 2024-09-16T01:00:12.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 -- 172.21.15.12:0/2492426014 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6da40a32d0 msgr2=0x7f6da40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:12.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6da40a32d0 0x7f6da40a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6da800abe0 tx=0x7f6da800a2d0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 -- 172.21.15.12:0/2492426014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db41036e0 msgr2=0x7f6db4198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:12.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db41036e0 0x7f6db4198aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6da0005940 tx=0x7f6da00042f0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 -- 172.21.15.12:0/2492426014 shutdown_connections 2024-09-16T01:00:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6da40a32d0 0x7f6da40a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db41082a0 0x7f6db419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db41036e0 0x7f6db4198aa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 --2- 172.21.15.12:0/2492426014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6db4102d30 0x7f6db4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 -- 172.21.15.12:0/2492426014 >> 172.21.15.12:0/2492426014 conn(0x7f6db40fc7d0 msgr2=0x7f6db4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.216+0000 7f6dbac37640 1 -- 172.21.15.12:0/2492426014 shutdown_connections 2024-09-16T01:00:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:12.217+0000 7f6dbac37640 1 -- 172.21.15.12:0/2492426014 wait complete. 2024-09-16T01:00:12.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:11 smithi012 ceph-mon[31197]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9 op/s 2024-09-16T01:00:12.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:11 smithi119 ceph-mon[35049]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9 op/s 2024-09-16T01:00:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:11 smithi098 ceph-mon[35346]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9 op/s 2024-09-16T01:00:13.008 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444106 got 73014444110 for osd.2 2024-09-16T01:00:13.008 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:13.273 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:12 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2711510804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-16T01:00:13.273 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:12 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2492426014' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T01:00:13.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:12 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2711510804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-16T01:00:13.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:12 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2492426014' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T01:00:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:12 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2711510804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-16T01:00:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:12 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2492426014' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T01:00:13.611 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626488 got 180388626490 for osd.6 2024-09-16T01:00:13.611 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.942+0000 7f5714c1b640 1 -- 172.21.15.12:0/721839563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5710106a80 msgr2=0x7f5710106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.942+0000 7f5714c1b640 1 --2- 172.21.15.12:0/721839563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5710106a80 0x7f5710106e60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5700009930 tx=0x7f570002a420 comp rx=0 tx=0).stop 2024-09-16T01:00:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.942+0000 7f5714c1b640 1 -- 172.21.15.12:0/721839563 shutdown_connections 2024-09-16T01:00:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.942+0000 7f5714c1b640 1 --2- 172.21.15.12:0/721839563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5710101420 0x7f571010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.942+0000 7f5714c1b640 1 --2- 172.21.15.12:0/721839563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5710100a80 0x7f5710100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.942+0000 7f5714c1b640 1 --2- 172.21.15.12:0/721839563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5710106a80 0x7f5710106e60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.942+0000 7f5714c1b640 1 -- 172.21.15.12:0/721839563 >> 172.21.15.12:0/721839563 conn(0x7f57100fc7a0 msgr2=0x7f57100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.942+0000 7f5714c1b640 1 -- 172.21.15.12:0/721839563 shutdown_connections 2024-09-16T01:00:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.942+0000 7f5714c1b640 1 -- 172.21.15.12:0/721839563 wait complete. 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f5714c1b640 1 Processor -- start 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f5714c1b640 1 -- start start 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f5714c1b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5710100a80 0x7f57100fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f5714c1b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5710101420 0x7f57100fd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f5714c1b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5710106a80 0x7f57100fd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f5714c1b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5710110ea0 con 0x7f5710100a80 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f5714c1b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5710110d20 con 0x7f5710106a80 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f5714c1b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5710111020 con 0x7f5710101420 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f570e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5710100a80 0x7f57100fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f570e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5710100a80 0x7f57100fce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58786/0 (socket says 172.21.15.12:58786) 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f570e59c640 1 -- 172.21.15.12:0/2270479436 learned_addr learned my addr 172.21.15.12:0/2270479436 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f570ed9d640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5710106a80 0x7f57100fd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f5707fff640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5710101420 0x7f57100fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f570e59c640 1 -- 172.21.15.12:0/2270479436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5710101420 msgr2=0x7f57100fd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f570e59c640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5710101420 0x7f57100fd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f570e59c640 1 -- 172.21.15.12:0/2270479436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5710106a80 msgr2=0x7f57100fd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f570e59c640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5710106a80 0x7f57100fd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f570e59c640 1 -- 172.21.15.12:0/2270479436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57101a6980 con 0x7f5710100a80 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.943+0000 7f570ed9d640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5710106a80 0x7f57100fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.944+0000 7f570e59c640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5710100a80 0x7f57100fce30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5700009230 tx=0x7f5700004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.944+0000 7f57077fe640 1 -- 172.21.15.12:0/2270479436 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570003f030 con 0x7f5710100a80 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.944+0000 7f57077fe640 1 -- 172.21.15.12:0/2270479436 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5700003ad0 con 0x7f5710100a80 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.944+0000 7f57077fe640 1 -- 172.21.15.12:0/2270479436 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700035070 con 0x7f5710100a80 2024-09-16T01:00:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.944+0000 7f5714c1b640 1 -- 172.21.15.12:0/2270479436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57101a6c10 con 0x7f5710100a80 2024-09-16T01:00:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.944+0000 7f5714c1b640 1 -- 172.21.15.12:0/2270479436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57101a70f0 con 0x7f5710100a80 2024-09-16T01:00:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.945+0000 7f5714c1b640 1 -- 172.21.15.12:0/2270479436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5710100ee0 con 0x7f5710100a80 2024-09-16T01:00:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.946+0000 7f57077fe640 1 -- 172.21.15.12:0/2270479436 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5700042030 con 0x7f5710100a80 2024-09-16T01:00:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.947+0000 7f57077fe640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56fc0a32d0 0x7f56fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.947+0000 7f5707fff640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56fc0a32d0 0x7f56fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.947+0000 7f57077fe640 1 -- 172.21.15.12:0/2270479436 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f57000f0020 con 0x7f5710100a80 2024-09-16T01:00:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.947+0000 7f5707fff640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56fc0a32d0 0x7f56fc0a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f57100fe8c0 tx=0x7f56f8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:13.951+0000 7f57077fe640 1 -- 172.21.15.12:0/2270479436 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57000bc8a0 con 0x7f5710100a80 2024-09-16T01:00:14.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.127+0000 7f5714c1b640 1 -- 172.21.15.12:0/2270479436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5710109a70 con 0x7f5710100a80 2024-09-16T01:00:14.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:13 smithi012 ceph-mon[31197]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:14.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.128+0000 7f57077fe640 1 -- 172.21.15.12:0/2270479436 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f57000bc1a0 con 0x7f5710100a80 2024-09-16T01:00:14.130 INFO:teuthology.orchestra.run.smithi012.stdout:201863462965 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 -- 172.21.15.12:0/2270479436 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56fc0a32d0 msgr2=0x7f56fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56fc0a32d0 0x7f56fc0a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f57100fe8c0 tx=0x7f56f8008040 comp rx=0 tx=0).stop 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 -- 172.21.15.12:0/2270479436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5710100a80 msgr2=0x7f57100fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5710100a80 0x7f57100fce30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5700009230 tx=0x7f5700004270 comp rx=0 tx=0).stop 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 -- 172.21.15.12:0/2270479436 shutdown_connections 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56fc0a32d0 0x7f56fc0a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5710106a80 0x7f57100fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5710101420 0x7f57100fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 --2- 172.21.15.12:0/2270479436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5710100a80 0x7f57100fce30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 -- 172.21.15.12:0/2270479436 >> 172.21.15.12:0/2270479436 conn(0x7f57100fc7a0 msgr2=0x7f571006aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 -- 172.21.15.12:0/2270479436 shutdown_connections 2024-09-16T01:00:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:14.131+0000 7f5714c1b640 1 -- 172.21.15.12:0/2270479436 wait complete. 2024-09-16T01:00:14.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:13 smithi119 ceph-mon[35049]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:14.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:13 smithi098 ceph-mon[35346]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:14.745 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462961 got 201863462965 for osd.7 2024-09-16T01:00:14.745 DEBUG:teuthology.parallel:result is None 2024-09-16T01:00:14.746 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T01:00:14.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:00:15.012 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:15.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:15 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2270479436' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-16T01:00:15.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:15 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2270479436' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-16T01:00:15.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:15 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2270479436' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-16T01:00:15.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.633+0000 7f0175a16640 1 -- 172.21.15.12:0/2409691065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170106f10 msgr2=0x7f017010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.633+0000 7f0175a16640 1 --2- 172.21.15.12:0/2409691065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170106f10 0x7f017010ea90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0168009ca0 tx=0x7f016802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.633+0000 7f0175a16640 1 -- 172.21.15.12:0/2409691065 shutdown_connections 2024-09-16T01:00:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.633+0000 7f0175a16640 1 --2- 172.21.15.12:0/2409691065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170106f10 0x7f017010ea90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.633+0000 7f0175a16640 1 --2- 172.21.15.12:0/2409691065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0170102790 0x7f01701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.633+0000 7f0175a16640 1 --2- 172.21.15.12:0/2409691065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0170101de0 0x7f01701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.633+0000 7f0175a16640 1 -- 172.21.15.12:0/2409691065 >> 172.21.15.12:0/2409691065 conn(0x7f01700fd8c0 msgr2=0x7f01700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.633+0000 7f0175a16640 1 -- 172.21.15.12:0/2409691065 shutdown_connections 2024-09-16T01:00:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.633+0000 7f0175a16640 1 -- 172.21.15.12:0/2409691065 wait complete. 2024-09-16T01:00:15.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f0175a16640 1 Processor -- start 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f0175a16640 1 -- start start 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f0175a16640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0170101de0 0x7f01700744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f0175a16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0170102790 0x7f0170074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f0175a16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170106f10 0x7f0170074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f0175a16640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0170111f70 con 0x7f0170106f10 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f0175a16640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0170111df0 con 0x7f0170102790 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f0175a16640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f01701120f0 con 0x7f0170101de0 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f016f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170106f10 0x7f0170074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f016f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170106f10 0x7f0170074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58794/0 (socket says 172.21.15.12:58794) 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f016f7fe640 1 -- 172.21.15.12:0/2728550857 learned_addr learned my addr 172.21.15.12:0/2728550857 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f016effd640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0170101de0 0x7f01700744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.634+0000 7f0167fff640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0170102790 0x7f0170074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:15.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f016f7fe640 1 -- 172.21.15.12:0/2728550857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0170101de0 msgr2=0x7f01700744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f016f7fe640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0170101de0 0x7f01700744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f016f7fe640 1 -- 172.21.15.12:0/2728550857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0170102790 msgr2=0x7f0170074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f016f7fe640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0170102790 0x7f0170074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f016f7fe640 1 -- 172.21.15.12:0/2728550857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01701a68b0 con 0x7f0170106f10 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f0167fff640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0170102790 0x7f0170074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f016f7fe640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170106f10 0x7f0170074f70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0168031a20 tx=0x7f0168031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f0174a14640 1 -- 172.21.15.12:0/2728550857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168003c30 con 0x7f0170106f10 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f0174a14640 1 -- 172.21.15.12:0/2728550857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0168003dd0 con 0x7f0170106f10 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f0175a16640 1 -- 172.21.15.12:0/2728550857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01701a6b40 con 0x7f0170106f10 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f0174a14640 1 -- 172.21.15.12:0/2728550857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016802fcf0 con 0x7f0170106f10 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.635+0000 7f0175a16640 1 -- 172.21.15.12:0/2728550857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01701a70d0 con 0x7f0170106f10 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.636+0000 7f0175a16640 1 -- 172.21.15.12:0/2728550857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01701021c0 con 0x7f0170106f10 2024-09-16T01:00:15.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.638+0000 7f0174a14640 1 -- 172.21.15.12:0/2728550857 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0168004b40 con 0x7f0170106f10 2024-09-16T01:00:15.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.639+0000 7f0174a14640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f015c0a3350 0x7f015c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:15.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.639+0000 7f016effd640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f015c0a3350 0x7f015c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:15.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.639+0000 7f0174a14640 1 -- 172.21.15.12:0/2728550857 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f01680f1140 con 0x7f0170106f10 2024-09-16T01:00:15.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.640+0000 7f016effd640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f015c0a3350 0x7f015c0a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f01600058c0 tx=0x7f016000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:15.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.642+0000 7f0174a14640 1 -- 172.21.15.12:0/2728550857 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01680bdb60 con 0x7f0170106f10 2024-09-16T01:00:15.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.817+0000 7f0175a16640 1 -- 172.21.15.12:0/2728550857 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0170062630 con 0x7f015c0a3350 2024-09-16T01:00:15.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.829+0000 7f0174a14640 1 -- 172.21.15.12:0/2728550857 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340669 (secure 0 0 0) 0x7f0170062630 con 0x7f015c0a3350 2024-09-16T01:00:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:15.835 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-16T01:00:15.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 -- 172.21.15.12:0/2728550857 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f015c0a3350 msgr2=0x7f015c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f015c0a3350 0x7f015c0a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f01600058c0 tx=0x7f016000a2d0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 -- 172.21.15.12:0/2728550857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170106f10 msgr2=0x7f0170074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170106f10 0x7f0170074f70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0168031a20 tx=0x7f0168031a50 comp rx=0 tx=0).stop 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 -- 172.21.15.12:0/2728550857 shutdown_connections 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f015c0a3350 0x7f015c0a5810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170106f10 0x7f0170074f70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0170102790 0x7f0170074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 --2- 172.21.15.12:0/2728550857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0170101de0 0x7f01700744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 -- 172.21.15.12:0/2728550857 >> 172.21.15.12:0/2728550857 conn(0x7f01700fd8c0 msgr2=0x7f01700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 -- 172.21.15.12:0/2728550857 shutdown_connections 2024-09-16T01:00:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:15.833+0000 7f0175a16640 1 -- 172.21.15.12:0/2728550857 wait complete. 2024-09-16T01:00:16.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:16 smithi012 ceph-mon[31197]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:00:16.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:16 smithi012 ceph-mon[31197]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:16.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:16 smithi119 ceph-mon[35049]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:00:16.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:16 smithi119 ceph-mon[35049]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:16.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:16 smithi098 ceph-mon[35346]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:00:16.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:16 smithi098 ceph-mon[35346]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:16.562 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-16T01:00:14.922787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660901,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":679,"num_read_kb":464,"num_write":429,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369520,"kb_used_data":11876,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572304,"statfs":{"total":1151940427776,"available":1151562039296,"internally_reserved":0,"allocated":12161024,"data_stored":7880621,"data_compressed":391113,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":75,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003577"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:12.872275+0000","last_change":"2024-09-16T00:59:44.862009+0000","last_active":"2024-09-16T01:00:12.872275+0000","last_peered":"2024-09-16T01:00:12.872275+0000","last_clean":"2024-09-16T01:00:12.872275+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:00:12.872275+0000","last_undegraded":"2024-09-16T01:00:12.872275+0000","last_fullsized":"2024-09-16T01:00:12.872275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:11.209907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833664+0000","last_change":"2024-09-16T00:58:36.507955+0000","last_active":"2024-09-16T00:59:44.833664+0000","last_peered":"2024-09-16T00:59:44.833664+0000","last_clean":"2024-09-16T00:59:44.833664+0000","last_became_active":"2024-09-16T00:58:36.507660+0000","last_became_peered":"2024-09-16T00:58:36.507660+0000","last_unstale":"2024-09-16T00:59:44.833664+0000","last_undegraded":"2024-09-16T00:59:44.833664+0000","last_fullsized":"2024-09-16T00:59:44.833664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:05.408460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833334+0000","last_change":"2024-09-16T00:58:43.620365+0000","last_active":"2024-09-16T00:59:44.833334+0000","last_peered":"2024-09-16T00:59:44.833334+0000","last_clean":"2024-09-16T00:59:44.833334+0000","last_became_active":"2024-09-16T00:58:43.619976+0000","last_became_peered":"2024-09-16T00:58:43.619976+0000","last_unstale":"2024-09-16T00:59:44.833334+0000","last_undegraded":"2024-09-16T00:59:44.833334+0000","last_fullsized":"2024-09-16T00:59:44.833334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:37.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833832+0000","last_change":"2024-09-16T00:58:34.829549+0000","last_active":"2024-09-16T00:59:44.833832+0000","last_peered":"2024-09-16T00:59:44.833832+0000","last_clean":"2024-09-16T00:59:44.833832+0000","last_became_active":"2024-09-16T00:58:34.829180+0000","last_became_peered":"2024-09-16T00:58:34.829180+0000","last_unstale":"2024-09-16T00:59:44.833832+0000","last_undegraded":"2024-09-16T00:59:44.833832+0000","last_fullsized":"2024-09-16T00:59:44.833832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:40.731288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829142+0000","last_change":"2024-09-16T00:58:36.517190+0000","last_active":"2024-09-16T00:59:44.829142+0000","last_peered":"2024-09-16T00:59:44.829142+0000","last_clean":"2024-09-16T00:59:44.829142+0000","last_became_active":"2024-09-16T00:58:36.516877+0000","last_became_peered":"2024-09-16T00:58:36.516877+0000","last_unstale":"2024-09-16T00:59:44.829142+0000","last_undegraded":"2024-09-16T00:59:44.829142+0000","last_fullsized":"2024-09-16T00:59:44.829142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.408011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.863832+0000","last_change":"2024-09-16T00:59:44.863832+0000","last_active":"2024-09-16T00:59:44.863832+0000","last_peered":"2024-09-16T00:59:44.863832+0000","last_clean":"2024-09-16T00:59:44.863832+0000","last_became_active":"2024-09-16T00:59:44.863298+0000","last_became_peered":"2024-09-16T00:59:44.863298+0000","last_unstale":"2024-09-16T00:59:44.863832+0000","last_undegraded":"2024-09-16T00:59:44.863832+0000","last_fullsized":"2024-09-16T00:59:44.863832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:55.449728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831649+0000","last_change":"2024-09-16T00:58:34.472375+0000","last_active":"2024-09-16T00:59:44.831649+0000","last_peered":"2024-09-16T00:59:44.831649+0000","last_clean":"2024-09-16T00:59:44.831649+0000","last_became_active":"2024-09-16T00:58:34.471990+0000","last_became_peered":"2024-09-16T00:58:34.471990+0000","last_unstale":"2024-09-16T00:59:44.831649+0000","last_undegraded":"2024-09-16T00:59:44.831649+0000","last_fullsized":"2024-09-16T00:59:44.831649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:15.746005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.095996+0000","last_change":"2024-09-16T00:58:36.513747+0000","last_active":"2024-09-16T00:59:45.095996+0000","last_peered":"2024-09-16T00:59:45.095996+0000","last_clean":"2024-09-16T00:59:45.095996+0000","last_became_active":"2024-09-16T00:58:36.512635+0000","last_became_peered":"2024-09-16T00:58:36.512635+0000","last_unstale":"2024-09-16T00:59:45.095996+0000","last_undegraded":"2024-09-16T00:59:45.095996+0000","last_fullsized":"2024-09-16T00:59:45.095996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:39.014961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833160+0000","last_change":"2024-09-16T00:58:43.609355+0000","last_active":"2024-09-16T00:59:44.833160+0000","last_peered":"2024-09-16T00:59:44.833160+0000","last_clean":"2024-09-16T00:59:44.833160+0000","last_became_active":"2024-09-16T00:58:43.608892+0000","last_became_peered":"2024-09-16T00:58:43.608892+0000","last_unstale":"2024-09-16T00:59:44.833160+0000","last_undegraded":"2024-09-16T00:59:44.833160+0000","last_fullsized":"2024-09-16T00:59:44.833160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:20.718163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831680+0000","last_change":"2024-09-16T00:58:34.469650+0000","last_active":"2024-09-16T00:59:44.831680+0000","last_peered":"2024-09-16T00:59:44.831680+0000","last_clean":"2024-09-16T00:59:44.831680+0000","last_became_active":"2024-09-16T00:58:34.468939+0000","last_became_peered":"2024-09-16T00:58:34.468939+0000","last_unstale":"2024-09-16T00:59:44.831680+0000","last_undegraded":"2024-09-16T00:59:44.831680+0000","last_fullsized":"2024-09-16T00:59:44.831680+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:34.511111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.097454+0000","last_change":"2024-09-16T00:59:45.097454+0000","last_active":"2024-09-16T00:59:45.097454+0000","last_peered":"2024-09-16T00:59:45.097454+0000","last_clean":"2024-09-16T00:59:45.097454+0000","last_became_active":"2024-09-16T00:59:45.096985+0000","last_became_peered":"2024-09-16T00:59:45.096985+0000","last_unstale":"2024-09-16T00:59:45.097454+0000","last_undegraded":"2024-09-16T00:59:45.097454+0000","last_fullsized":"2024-09-16T00:59:45.097454+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:03.247850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832855+0000","last_change":"2024-09-16T00:58:43.612479+0000","last_active":"2024-09-16T00:59:44.832855+0000","last_peered":"2024-09-16T00:59:44.832855+0000","last_clean":"2024-09-16T00:59:44.832855+0000","last_became_active":"2024-09-16T00:58:43.612001+0000","last_became_peered":"2024-09-16T00:58:43.612001+0000","last_unstale":"2024-09-16T00:59:44.832855+0000","last_undegraded":"2024-09-16T00:59:44.832855+0000","last_fullsized":"2024-09-16T00:59:44.832855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:33.056052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832832+0000","last_change":"2024-09-16T00:58:36.519407+0000","last_active":"2024-09-16T00:59:44.832832+0000","last_peered":"2024-09-16T00:59:44.832832+0000","last_clean":"2024-09-16T00:59:44.832832+0000","last_became_active":"2024-09-16T00:58:36.519108+0000","last_became_peered":"2024-09-16T00:58:36.519108+0000","last_unstale":"2024-09-16T00:59:44.832832+0000","last_undegraded":"2024-09-16T00:59:44.832832+0000","last_fullsized":"2024-09-16T00:59:44.832832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:28.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831350+0000","last_change":"2024-09-16T00:58:34.472295+0000","last_active":"2024-09-16T00:59:44.831350+0000","last_peered":"2024-09-16T00:59:44.831350+0000","last_clean":"2024-09-16T00:59:44.831350+0000","last_became_active":"2024-09-16T00:58:34.471968+0000","last_became_peered":"2024-09-16T00:58:34.471968+0000","last_unstale":"2024-09-16T00:59:44.831350+0000","last_undegraded":"2024-09-16T00:59:44.831350+0000","last_fullsized":"2024-09-16T00:59:44.831350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:44.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833441+0000","last_change":"2024-09-16T00:58:43.615870+0000","last_active":"2024-09-16T00:59:44.833441+0000","last_peered":"2024-09-16T00:59:44.833441+0000","last_clean":"2024-09-16T00:59:44.833441+0000","last_became_active":"2024-09-16T00:58:43.615116+0000","last_became_peered":"2024-09-16T00:58:43.615116+0000","last_unstale":"2024-09-16T00:59:44.833441+0000","last_undegraded":"2024-09-16T00:59:44.833441+0000","last_fullsized":"2024-09-16T00:59:44.833441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:44.742792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833558+0000","last_change":"2024-09-16T00:58:36.512485+0000","last_active":"2024-09-16T00:59:44.833558+0000","last_peered":"2024-09-16T00:59:44.833558+0000","last_clean":"2024-09-16T00:59:44.833558+0000","last_became_active":"2024-09-16T00:58:36.512175+0000","last_became_peered":"2024-09-16T00:58:36.512175+0000","last_unstale":"2024-09-16T00:59:44.833558+0000","last_undegraded":"2024-09-16T00:59:44.833558+0000","last_fullsized":"2024-09-16T00:59:44.833558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.328409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.841470+0000","last_change":"2024-09-16T00:59:44.841052+0000","last_active":"2024-09-16T00:59:44.841470+0000","last_peered":"2024-09-16T00:59:44.841470+0000","last_clean":"2024-09-16T00:59:44.841470+0000","last_became_active":"2024-09-16T00:59:44.834033+0000","last_became_peered":"2024-09-16T00:59:44.834033+0000","last_unstale":"2024-09-16T00:59:44.841470+0000","last_undegraded":"2024-09-16T00:59:44.841470+0000","last_fullsized":"2024-09-16T00:59:44.841470+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:09.696435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833009+0000","last_change":"2024-09-16T00:58:43.610265+0000","last_active":"2024-09-16T00:59:44.833009+0000","last_peered":"2024-09-16T00:59:44.833009+0000","last_clean":"2024-09-16T00:59:44.833009+0000","last_became_active":"2024-09-16T00:58:43.609868+0000","last_became_peered":"2024-09-16T00:58:43.609868+0000","last_unstale":"2024-09-16T00:59:44.833009+0000","last_undegraded":"2024-09-16T00:59:44.833009+0000","last_fullsized":"2024-09-16T00:59:44.833009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:54.689332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829676+0000","last_change":"2024-09-16T00:58:36.512801+0000","last_active":"2024-09-16T00:59:44.829676+0000","last_peered":"2024-09-16T00:59:44.829676+0000","last_clean":"2024-09-16T00:59:44.829676+0000","last_became_active":"2024-09-16T00:58:36.512469+0000","last_became_peered":"2024-09-16T00:58:36.512469+0000","last_unstale":"2024-09-16T00:59:44.829676+0000","last_undegraded":"2024-09-16T00:59:44.829676+0000","last_fullsized":"2024-09-16T00:59:44.829676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:57.951743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833213+0000","last_change":"2024-09-16T00:58:34.471498+0000","last_active":"2024-09-16T00:59:44.833213+0000","last_peered":"2024-09-16T00:59:44.833213+0000","last_clean":"2024-09-16T00:59:44.833213+0000","last_became_active":"2024-09-16T00:58:34.471093+0000","last_became_peered":"2024-09-16T00:58:34.471093+0000","last_unstale":"2024-09-16T00:59:44.833213+0000","last_undegraded":"2024-09-16T00:59:44.833213+0000","last_fullsized":"2024-09-16T00:59:44.833213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:35.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831458+0000","last_change":"2024-09-16T00:58:43.616376+0000","last_active":"2024-09-16T00:59:44.831458+0000","last_peered":"2024-09-16T00:59:44.831458+0000","last_clean":"2024-09-16T00:59:44.831458+0000","last_became_active":"2024-09-16T00:58:43.616029+0000","last_became_peered":"2024-09-16T00:58:43.616029+0000","last_unstale":"2024-09-16T00:59:44.831458+0000","last_undegraded":"2024-09-16T00:59:44.831458+0000","last_fullsized":"2024-09-16T00:59:44.831458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:54.776250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830978+0000","last_change":"2024-09-16T00:58:36.506625+0000","last_active":"2024-09-16T00:59:44.830978+0000","last_peered":"2024-09-16T00:59:44.830978+0000","last_clean":"2024-09-16T00:59:44.830978+0000","last_became_active":"2024-09-16T00:58:36.506337+0000","last_became_peered":"2024-09-16T00:58:36.506337+0000","last_unstale":"2024-09-16T00:59:44.830978+0000","last_undegraded":"2024-09-16T00:59:44.830978+0000","last_fullsized":"2024-09-16T00:59:44.830978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:22.080165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.095737+0000","last_change":"2024-09-16T00:58:34.831309+0000","last_active":"2024-09-16T00:59:45.095737+0000","last_peered":"2024-09-16T00:59:45.095737+0000","last_clean":"2024-09-16T00:59:45.095737+0000","last_became_active":"2024-09-16T00:58:34.830980+0000","last_became_peered":"2024-09-16T00:58:34.830980+0000","last_unstale":"2024-09-16T00:59:45.095737+0000","last_undegraded":"2024-09-16T00:59:45.095737+0000","last_fullsized":"2024-09-16T00:59:45.095737+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:30.405426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833939+0000","last_change":"2024-09-16T00:58:43.609399+0000","last_active":"2024-09-16T00:59:44.833939+0000","last_peered":"2024-09-16T00:59:44.833939+0000","last_clean":"2024-09-16T00:59:44.833939+0000","last_became_active":"2024-09-16T00:58:43.608988+0000","last_became_peered":"2024-09-16T00:58:43.608988+0000","last_unstale":"2024-09-16T00:59:44.833939+0000","last_undegraded":"2024-09-16T00:59:44.833939+0000","last_fullsized":"2024-09-16T00:59:44.833939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.500071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828572+0000","last_change":"2024-09-16T00:58:36.515930+0000","last_active":"2024-09-16T00:59:44.828572+0000","last_peered":"2024-09-16T00:59:44.828572+0000","last_clean":"2024-09-16T00:59:44.828572+0000","last_became_active":"2024-09-16T00:58:36.515625+0000","last_became_peered":"2024-09-16T00:58:36.515625+0000","last_unstale":"2024-09-16T00:59:44.828572+0000","last_undegraded":"2024-09-16T00:59:44.828572+0000","last_fullsized":"2024-09-16T00:59:44.828572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:55.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833776+0000","last_change":"2024-09-16T00:58:34.508686+0000","last_active":"2024-09-16T00:59:44.833776+0000","last_peered":"2024-09-16T00:59:44.833776+0000","last_clean":"2024-09-16T00:59:44.833776+0000","last_became_active":"2024-09-16T00:58:34.508284+0000","last_became_peered":"2024-09-16T00:58:34.508284+0000","last_unstale":"2024-09-16T00:59:44.833776+0000","last_undegraded":"2024-09-16T00:59:44.833776+0000","last_fullsized":"2024-09-16T00:59:44.833776+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:47.545949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833514+0000","last_change":"2024-09-16T00:58:43.615852+0000","last_active":"2024-09-16T00:59:44.833514+0000","last_peered":"2024-09-16T00:59:44.833514+0000","last_clean":"2024-09-16T00:59:44.833514+0000","last_became_active":"2024-09-16T00:58:43.615474+0000","last_became_peered":"2024-09-16T00:58:43.615474+0000","last_unstale":"2024-09-16T00:59:44.833514+0000","last_undegraded":"2024-09-16T00:59:44.833514+0000","last_fullsized":"2024-09-16T00:59:44.833514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:39.596924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833862+0000","last_change":"2024-09-16T00:58:36.513820+0000","last_active":"2024-09-16T00:59:44.833862+0000","last_peered":"2024-09-16T00:59:44.833862+0000","last_clean":"2024-09-16T00:59:44.833862+0000","last_became_active":"2024-09-16T00:58:36.513513+0000","last_became_peered":"2024-09-16T00:58:36.513513+0000","last_unstale":"2024-09-16T00:59:44.833862+0000","last_undegraded":"2024-09-16T00:59:44.833862+0000","last_fullsized":"2024-09-16T00:59:44.833862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:34.584214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'14","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831630+0000","last_change":"2024-09-16T00:58:34.462794+0000","last_active":"2024-09-16T00:59:44.831630+0000","last_peered":"2024-09-16T00:59:44.831630+0000","last_clean":"2024-09-16T00:59:44.831630+0000","last_became_active":"2024-09-16T00:58:34.462471+0000","last_became_peered":"2024-09-16T00:58:34.462471+0000","last_unstale":"2024-09-16T00:59:44.831630+0000","last_undegraded":"2024-09-16T00:59:44.831630+0000","last_fullsized":"2024-09-16T00:59:44.831630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:13.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832722+0000","last_change":"2024-09-16T00:58:43.607718+0000","last_active":"2024-09-16T00:59:44.832722+0000","last_peered":"2024-09-16T00:59:44.832722+0000","last_clean":"2024-09-16T00:59:44.832722+0000","last_became_active":"2024-09-16T00:58:43.607347+0000","last_became_peered":"2024-09-16T00:58:43.607347+0000","last_unstale":"2024-09-16T00:59:44.832722+0000","last_undegraded":"2024-09-16T00:59:44.832722+0000","last_fullsized":"2024-09-16T00:59:44.832722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:12.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862979+0000","last_change":"2024-09-16T00:58:36.507161+0000","last_active":"2024-09-16T00:59:44.862979+0000","last_peered":"2024-09-16T00:59:44.862979+0000","last_clean":"2024-09-16T00:59:44.862979+0000","last_became_active":"2024-09-16T00:58:36.504062+0000","last_became_peered":"2024-09-16T00:58:36.504062+0000","last_unstale":"2024-09-16T00:59:44.862979+0000","last_undegraded":"2024-09-16T00:59:44.862979+0000","last_fullsized":"2024-09-16T00:59:44.862979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831736+0000","last_change":"2024-09-16T00:58:34.829848+0000","last_active":"2024-09-16T00:59:44.831736+0000","last_peered":"2024-09-16T00:59:44.831736+0000","last_clean":"2024-09-16T00:59:44.831736+0000","last_became_active":"2024-09-16T00:58:34.829439+0000","last_became_peered":"2024-09-16T00:58:34.829439+0000","last_unstale":"2024-09-16T00:59:44.831736+0000","last_undegraded":"2024-09-16T00:59:44.831736+0000","last_fullsized":"2024-09-16T00:59:44.831736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:06.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829843+0000","last_change":"2024-09-16T00:58:43.618334+0000","last_active":"2024-09-16T00:59:44.829843+0000","last_peered":"2024-09-16T00:59:44.829843+0000","last_clean":"2024-09-16T00:59:44.829843+0000","last_became_active":"2024-09-16T00:58:43.617810+0000","last_became_peered":"2024-09-16T00:58:43.617810+0000","last_unstale":"2024-09-16T00:59:44.829843+0000","last_undegraded":"2024-09-16T00:59:44.829843+0000","last_fullsized":"2024-09-16T00:59:44.829843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:58.202973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829291+0000","last_change":"2024-09-16T00:58:36.509025+0000","last_active":"2024-09-16T00:59:44.829291+0000","last_peered":"2024-09-16T00:59:44.829291+0000","last_clean":"2024-09-16T00:59:44.829291+0000","last_became_active":"2024-09-16T00:58:36.508660+0000","last_became_peered":"2024-09-16T00:58:36.508660+0000","last_unstale":"2024-09-16T00:59:44.829291+0000","last_undegraded":"2024-09-16T00:59:44.829291+0000","last_fullsized":"2024-09-16T00:59:44.829291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:01.433486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831086+0000","last_change":"2024-09-16T00:58:34.829899+0000","last_active":"2024-09-16T00:59:44.831086+0000","last_peered":"2024-09-16T00:59:44.831086+0000","last_clean":"2024-09-16T00:59:44.831086+0000","last_became_active":"2024-09-16T00:58:34.829546+0000","last_became_peered":"2024-09-16T00:58:34.829546+0000","last_unstale":"2024-09-16T00:59:44.831086+0000","last_undegraded":"2024-09-16T00:59:44.831086+0000","last_fullsized":"2024-09-16T00:59:44.831086+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:21.253829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831350+0000","last_change":"2024-09-16T00:58:43.610143+0000","last_active":"2024-09-16T00:59:44.831350+0000","last_peered":"2024-09-16T00:59:44.831350+0000","last_clean":"2024-09-16T00:59:44.831350+0000","last_became_active":"2024-09-16T00:58:43.609739+0000","last_became_peered":"2024-09-16T00:58:43.609739+0000","last_unstale":"2024-09-16T00:59:44.831350+0000","last_undegraded":"2024-09-16T00:59:44.831350+0000","last_fullsized":"2024-09-16T00:59:44.831350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:28.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829372+0000","last_change":"2024-09-16T00:58:36.520423+0000","last_active":"2024-09-16T00:59:44.829372+0000","last_peered":"2024-09-16T00:59:44.829372+0000","last_clean":"2024-09-16T00:59:44.829372+0000","last_became_active":"2024-09-16T00:58:36.520117+0000","last_became_peered":"2024-09-16T00:58:36.520117+0000","last_unstale":"2024-09-16T00:59:44.829372+0000","last_undegraded":"2024-09-16T00:59:44.829372+0000","last_fullsized":"2024-09-16T00:59:44.829372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.652142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":88,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:09.868980+0000","last_change":"2024-09-16T00:58:34.475161+0000","last_active":"2024-09-16T01:00:09.868980+0000","last_peered":"2024-09-16T01:00:09.868980+0000","last_clean":"2024-09-16T01:00:09.868980+0000","last_became_active":"2024-09-16T00:58:34.474755+0000","last_became_peered":"2024-09-16T00:58:34.474755+0000","last_unstale":"2024-09-16T01:00:09.868980+0000","last_undegraded":"2024-09-16T01:00:09.868980+0000","last_fullsized":"2024-09-16T01:00:09.868980+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:12.884466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862825+0000","last_change":"2024-09-16T00:58:43.609042+0000","last_active":"2024-09-16T00:59:44.862825+0000","last_peered":"2024-09-16T00:59:44.862825+0000","last_clean":"2024-09-16T00:59:44.862825+0000","last_became_active":"2024-09-16T00:58:43.608596+0000","last_became_peered":"2024-09-16T00:58:43.608596+0000","last_unstale":"2024-09-16T00:59:44.862825+0000","last_undegraded":"2024-09-16T00:59:44.862825+0000","last_fullsized":"2024-09-16T00:59:44.862825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:47.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.838583+0000","last_change":"2024-09-16T00:59:44.838583+0000","last_active":"2024-09-16T00:59:44.838583+0000","last_peered":"2024-09-16T00:59:44.838583+0000","last_clean":"2024-09-16T00:59:44.838583+0000","last_became_active":"2024-09-16T00:59:44.838221+0000","last_became_peered":"2024-09-16T00:59:44.838221+0000","last_unstale":"2024-09-16T00:59:44.838583+0000","last_undegraded":"2024-09-16T00:59:44.838583+0000","last_fullsized":"2024-09-16T00:59:44.838583+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:27.562118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":92,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:12.664961+0000","last_change":"2024-09-16T00:58:34.829452+0000","last_active":"2024-09-16T01:00:12.664961+0000","last_peered":"2024-09-16T01:00:12.664961+0000","last_clean":"2024-09-16T01:00:12.664961+0000","last_became_active":"2024-09-16T00:58:34.829129+0000","last_became_peered":"2024-09-16T00:58:34.829129+0000","last_unstale":"2024-09-16T01:00:12.664961+0000","last_undegraded":"2024-09-16T01:00:12.664961+0000","last_fullsized":"2024-09-16T01:00:12.664961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.863071+0000","last_change":"2024-09-16T00:58:43.609230+0000","last_active":"2024-09-16T00:59:44.863071+0000","last_peered":"2024-09-16T00:59:44.863071+0000","last_clean":"2024-09-16T00:59:44.863071+0000","last_became_active":"2024-09-16T00:58:43.608879+0000","last_became_peered":"2024-09-16T00:58:43.608879+0000","last_unstale":"2024-09-16T00:59:44.863071+0000","last_undegraded":"2024-09-16T00:59:44.863071+0000","last_fullsized":"2024-09-16T00:59:44.863071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.112878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862250+0000","last_change":"2024-09-16T00:58:36.503412+0000","last_active":"2024-09-16T00:59:44.862250+0000","last_peered":"2024-09-16T00:59:44.862250+0000","last_clean":"2024-09-16T00:59:44.862250+0000","last_became_active":"2024-09-16T00:58:36.503043+0000","last_became_peered":"2024-09-16T00:58:36.503043+0000","last_unstale":"2024-09-16T00:59:44.862250+0000","last_undegraded":"2024-09-16T00:59:44.862250+0000","last_fullsized":"2024-09-16T00:59:44.862250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:18.495669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832541+0000","last_change":"2024-09-16T00:58:34.468460+0000","last_active":"2024-09-16T00:59:44.832541+0000","last_peered":"2024-09-16T00:59:44.832541+0000","last_clean":"2024-09-16T00:59:44.832541+0000","last_became_active":"2024-09-16T00:58:34.468104+0000","last_became_peered":"2024-09-16T00:58:34.468104+0000","last_unstale":"2024-09-16T00:59:44.832541+0000","last_undegraded":"2024-09-16T00:59:44.832541+0000","last_fullsized":"2024-09-16T00:59:44.832541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:13.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.864073+0000","last_change":"2024-09-16T00:59:44.863609+0000","last_active":"2024-09-16T00:59:44.864073+0000","last_peered":"2024-09-16T00:59:44.864073+0000","last_clean":"2024-09-16T00:59:44.864073+0000","last_became_active":"2024-09-16T00:59:44.863152+0000","last_became_peered":"2024-09-16T00:59:44.863152+0000","last_unstale":"2024-09-16T00:59:44.864073+0000","last_undegraded":"2024-09-16T00:59:44.864073+0000","last_fullsized":"2024-09-16T00:59:44.864073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:51.312612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833323+0000","last_change":"2024-09-16T00:58:36.509749+0000","last_active":"2024-09-16T00:59:44.833323+0000","last_peered":"2024-09-16T00:59:44.833323+0000","last_clean":"2024-09-16T00:59:44.833323+0000","last_became_active":"2024-09-16T00:58:36.509411+0000","last_became_peered":"2024-09-16T00:58:36.509411+0000","last_unstale":"2024-09-16T00:59:44.833323+0000","last_undegraded":"2024-09-16T00:59:44.833323+0000","last_fullsized":"2024-09-16T00:59:44.833323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:14.291956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833745+0000","last_change":"2024-09-16T00:58:34.470190+0000","last_active":"2024-09-16T00:59:44.833745+0000","last_peered":"2024-09-16T00:59:44.833745+0000","last_clean":"2024-09-16T00:59:44.833745+0000","last_became_active":"2024-09-16T00:58:34.469832+0000","last_became_peered":"2024-09-16T00:58:34.469832+0000","last_unstale":"2024-09-16T00:59:44.833745+0000","last_undegraded":"2024-09-16T00:59:44.833745+0000","last_fullsized":"2024-09-16T00:59:44.833745+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:03.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":346,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834120+0000","last_change":"2024-09-16T00:57:23.502001+0000","last_active":"2024-09-16T00:59:44.834120+0000","last_peered":"2024-09-16T00:59:44.834120+0000","last_clean":"2024-09-16T00:59:44.834120+0000","last_became_active":"2024-09-16T00:57:23.501465+0000","last_became_peered":"2024-09-16T00:57:23.501465+0000","last_unstale":"2024-09-16T00:59:44.834120+0000","last_undegraded":"2024-09-16T00:59:44.834120+0000","last_fullsized":"2024-09-16T00:59:44.834120+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_clean_scrub_stamp":"2024-09-16T00:53:57.344038+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:22.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833406+0000","last_change":"2024-09-16T00:58:43.609572+0000","last_active":"2024-09-16T00:59:44.833406+0000","last_peered":"2024-09-16T00:59:44.833406+0000","last_clean":"2024-09-16T00:59:44.833406+0000","last_became_active":"2024-09-16T00:58:43.609185+0000","last_became_peered":"2024-09-16T00:58:43.609185+0000","last_unstale":"2024-09-16T00:59:44.833406+0000","last_undegraded":"2024-09-16T00:59:44.833406+0000","last_fullsized":"2024-09-16T00:59:44.833406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.199976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833834+0000","last_change":"2024-09-16T00:58:36.510761+0000","last_active":"2024-09-16T00:59:44.833834+0000","last_peered":"2024-09-16T00:59:44.833834+0000","last_clean":"2024-09-16T00:59:44.833834+0000","last_became_active":"2024-09-16T00:58:36.510456+0000","last_became_peered":"2024-09-16T00:58:36.510456+0000","last_unstale":"2024-09-16T00:59:44.833834+0000","last_undegraded":"2024-09-16T00:59:44.833834+0000","last_fullsized":"2024-09-16T00:59:44.833834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:02.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":94,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:10.651311+0000","last_change":"2024-09-16T00:58:34.830238+0000","last_active":"2024-09-16T01:00:10.651311+0000","last_peered":"2024-09-16T01:00:10.651311+0000","last_clean":"2024-09-16T01:00:10.651311+0000","last_became_active":"2024-09-16T00:58:34.829558+0000","last_became_peered":"2024-09-16T00:58:34.829558+0000","last_unstale":"2024-09-16T01:00:10.651311+0000","last_undegraded":"2024-09-16T01:00:10.651311+0000","last_fullsized":"2024-09-16T01:00:10.651311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.347122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.095766+0000","last_change":"2024-09-16T00:58:43.613179+0000","last_active":"2024-09-16T00:59:45.095766+0000","last_peered":"2024-09-16T00:59:45.095766+0000","last_clean":"2024-09-16T00:59:45.095766+0000","last_became_active":"2024-09-16T00:58:43.612794+0000","last_became_peered":"2024-09-16T00:58:43.612794+0000","last_unstale":"2024-09-16T00:59:45.095766+0000","last_undegraded":"2024-09-16T00:59:45.095766+0000","last_fullsized":"2024-09-16T00:59:45.095766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:04:24.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833228+0000","last_change":"2024-09-16T00:58:36.512600+0000","last_active":"2024-09-16T00:59:44.833228+0000","last_peered":"2024-09-16T00:59:44.833228+0000","last_clean":"2024-09-16T00:59:44.833228+0000","last_became_active":"2024-09-16T00:58:36.512309+0000","last_became_peered":"2024-09-16T00:58:36.512309+0000","last_unstale":"2024-09-16T00:59:44.833228+0000","last_undegraded":"2024-09-16T00:59:44.833228+0000","last_fullsized":"2024-09-16T00:59:44.833228+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.790755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.836569+0000","last_change":"2024-09-16T00:58:34.471787+0000","last_active":"2024-09-16T00:59:44.836569+0000","last_peered":"2024-09-16T00:59:44.836569+0000","last_clean":"2024-09-16T00:59:44.836569+0000","last_became_active":"2024-09-16T00:58:34.471119+0000","last_became_peered":"2024-09-16T00:58:34.471119+0000","last_unstale":"2024-09-16T00:59:44.836569+0000","last_undegraded":"2024-09-16T00:59:44.836569+0000","last_fullsized":"2024-09-16T00:59:44.836569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:26.121669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828655+0000","last_change":"2024-09-16T00:58:43.609676+0000","last_active":"2024-09-16T00:59:44.828655+0000","last_peered":"2024-09-16T00:59:44.828655+0000","last_clean":"2024-09-16T00:59:44.828655+0000","last_became_active":"2024-09-16T00:58:43.609313+0000","last_became_peered":"2024-09-16T00:58:43.609313+0000","last_unstale":"2024-09-16T00:59:44.828655+0000","last_undegraded":"2024-09-16T00:59:44.828655+0000","last_fullsized":"2024-09-16T00:59:44.828655+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:53.339070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833389+0000","last_change":"2024-09-16T00:58:36.514621+0000","last_active":"2024-09-16T00:59:44.833389+0000","last_peered":"2024-09-16T00:59:44.833389+0000","last_clean":"2024-09-16T00:59:44.833389+0000","last_became_active":"2024-09-16T00:58:36.514259+0000","last_became_peered":"2024-09-16T00:58:36.514259+0000","last_unstale":"2024-09-16T00:59:44.833389+0000","last_undegraded":"2024-09-16T00:59:44.833389+0000","last_fullsized":"2024-09-16T00:59:44.833389+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:11.411742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.863077+0000","last_change":"2024-09-16T00:58:34.470512+0000","last_active":"2024-09-16T00:59:44.863077+0000","last_peered":"2024-09-16T00:59:44.863077+0000","last_clean":"2024-09-16T00:59:44.863077+0000","last_became_active":"2024-09-16T00:58:34.470140+0000","last_became_peered":"2024-09-16T00:58:34.470140+0000","last_unstale":"2024-09-16T00:59:44.863077+0000","last_undegraded":"2024-09-16T00:59:44.863077+0000","last_fullsized":"2024-09-16T00:59:44.863077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:04.068901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835631+0000","last_change":"2024-09-16T00:58:43.615221+0000","last_active":"2024-09-16T00:59:44.835631+0000","last_peered":"2024-09-16T00:59:44.835631+0000","last_clean":"2024-09-16T00:59:44.835631+0000","last_became_active":"2024-09-16T00:58:43.614820+0000","last_became_peered":"2024-09-16T00:58:43.614820+0000","last_unstale":"2024-09-16T00:59:44.835631+0000","last_undegraded":"2024-09-16T00:59:44.835631+0000","last_fullsized":"2024-09-16T00:59:44.835631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:31.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830458+0000","last_change":"2024-09-16T00:58:36.515470+0000","last_active":"2024-09-16T00:59:44.830458+0000","last_peered":"2024-09-16T00:59:44.830458+0000","last_clean":"2024-09-16T00:59:44.830458+0000","last_became_active":"2024-09-16T00:58:36.515145+0000","last_became_peered":"2024-09-16T00:58:36.515145+0000","last_unstale":"2024-09-16T00:59:44.830458+0000","last_undegraded":"2024-09-16T00:59:44.830458+0000","last_fullsized":"2024-09-16T00:59:44.830458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:10.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832581+0000","last_change":"2024-09-16T00:58:34.464865+0000","last_active":"2024-09-16T00:59:44.832581+0000","last_peered":"2024-09-16T00:59:44.832581+0000","last_clean":"2024-09-16T00:59:44.832581+0000","last_became_active":"2024-09-16T00:58:34.464448+0000","last_became_peered":"2024-09-16T00:58:34.464448+0000","last_unstale":"2024-09-16T00:59:44.832581+0000","last_undegraded":"2024-09-16T00:59:44.832581+0000","last_fullsized":"2024-09-16T00:59:44.832581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:47.454251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835500+0000","last_change":"2024-09-16T00:58:43.610348+0000","last_active":"2024-09-16T00:59:44.835500+0000","last_peered":"2024-09-16T00:59:44.835500+0000","last_clean":"2024-09-16T00:59:44.835500+0000","last_became_active":"2024-09-16T00:58:43.609497+0000","last_became_peered":"2024-09-16T00:58:43.609497+0000","last_unstale":"2024-09-16T00:59:44.835500+0000","last_undegraded":"2024-09-16T00:59:44.835500+0000","last_fullsized":"2024-09-16T00:59:44.835500+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:52.931325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835647+0000","last_change":"2024-09-16T00:58:36.517412+0000","last_active":"2024-09-16T00:59:44.835647+0000","last_peered":"2024-09-16T00:59:44.835647+0000","last_clean":"2024-09-16T00:59:44.835647+0000","last_became_active":"2024-09-16T00:58:36.516600+0000","last_became_peered":"2024-09-16T00:58:36.516600+0000","last_unstale":"2024-09-16T00:59:44.835647+0000","last_undegraded":"2024-09-16T00:59:44.835647+0000","last_fullsized":"2024-09-16T00:59:44.835647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:39.445454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831042+0000","last_change":"2024-09-16T00:58:34.831420+0000","last_active":"2024-09-16T00:59:44.831042+0000","last_peered":"2024-09-16T00:59:44.831042+0000","last_clean":"2024-09-16T00:59:44.831042+0000","last_became_active":"2024-09-16T00:58:34.830991+0000","last_became_peered":"2024-09-16T00:58:34.830991+0000","last_unstale":"2024-09-16T00:59:44.831042+0000","last_undegraded":"2024-09-16T00:59:44.831042+0000","last_fullsized":"2024-09-16T00:59:44.831042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:13.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.863007+0000","last_change":"2024-09-16T00:58:43.611781+0000","last_active":"2024-09-16T00:59:44.863007+0000","last_peered":"2024-09-16T00:59:44.863007+0000","last_clean":"2024-09-16T00:59:44.863007+0000","last_became_active":"2024-09-16T00:58:43.610332+0000","last_became_peered":"2024-09-16T00:58:43.610332+0000","last_unstale":"2024-09-16T00:59:44.863007+0000","last_undegraded":"2024-09-16T00:59:44.863007+0000","last_fullsized":"2024-09-16T00:59:44.863007+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:18.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832394+0000","last_change":"2024-09-16T00:58:36.514395+0000","last_active":"2024-09-16T00:59:44.832394+0000","last_peered":"2024-09-16T00:59:44.832394+0000","last_clean":"2024-09-16T00:59:44.832394+0000","last_became_active":"2024-09-16T00:58:36.513570+0000","last_became_peered":"2024-09-16T00:58:36.513570+0000","last_unstale":"2024-09-16T00:59:44.832394+0000","last_undegraded":"2024-09-16T00:59:44.832394+0000","last_fullsized":"2024-09-16T00:59:44.832394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:56.148815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":93,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:11.664197+0000","last_change":"2024-09-16T00:58:34.473583+0000","last_active":"2024-09-16T01:00:11.664197+0000","last_peered":"2024-09-16T01:00:11.664197+0000","last_clean":"2024-09-16T01:00:11.664197+0000","last_became_active":"2024-09-16T00:58:34.473259+0000","last_became_peered":"2024-09-16T00:58:34.473259+0000","last_unstale":"2024-09-16T01:00:11.664197+0000","last_undegraded":"2024-09-16T01:00:11.664197+0000","last_fullsized":"2024-09-16T01:00:11.664197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:55.622609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.836049+0000","last_change":"2024-09-16T00:59:44.835446+0000","last_active":"2024-09-16T00:59:44.836049+0000","last_peered":"2024-09-16T00:59:44.836049+0000","last_clean":"2024-09-16T00:59:44.836049+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T00:59:44.836049+0000","last_undegraded":"2024-09-16T00:59:44.836049+0000","last_fullsized":"2024-09-16T00:59:44.836049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:41.254621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.863645+0000","last_change":"2024-09-16T00:59:44.863645+0000","last_active":"2024-09-16T00:59:44.863645+0000","last_peered":"2024-09-16T00:59:44.863645+0000","last_clean":"2024-09-16T00:59:44.863645+0000","last_became_active":"2024-09-16T00:59:44.863207+0000","last_became_peered":"2024-09-16T00:59:44.863207+0000","last_unstale":"2024-09-16T00:59:44.863645+0000","last_undegraded":"2024-09-16T00:59:44.863645+0000","last_fullsized":"2024-09-16T00:59:44.863645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:27.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835817+0000","last_change":"2024-09-16T00:58:34.470326+0000","last_active":"2024-09-16T00:59:44.835817+0000","last_peered":"2024-09-16T00:59:44.835817+0000","last_clean":"2024-09-16T00:59:44.835817+0000","last_became_active":"2024-09-16T00:58:34.469920+0000","last_became_peered":"2024-09-16T00:58:34.469920+0000","last_unstale":"2024-09-16T00:59:44.835817+0000","last_undegraded":"2024-09-16T00:59:44.835817+0000","last_fullsized":"2024-09-16T00:59:44.835817+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:58.718004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830095+0000","last_change":"2024-09-16T00:58:43.616324+0000","last_active":"2024-09-16T00:59:44.830095+0000","last_peered":"2024-09-16T00:59:44.830095+0000","last_clean":"2024-09-16T00:59:44.830095+0000","last_became_active":"2024-09-16T00:58:43.615903+0000","last_became_peered":"2024-09-16T00:58:43.615903+0000","last_unstale":"2024-09-16T00:59:44.830095+0000","last_undegraded":"2024-09-16T00:59:44.830095+0000","last_fullsized":"2024-09-16T00:59:44.830095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.683788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862525+0000","last_change":"2024-09-16T00:58:36.512490+0000","last_active":"2024-09-16T00:59:44.862525+0000","last_peered":"2024-09-16T00:59:44.862525+0000","last_clean":"2024-09-16T00:59:44.862525+0000","last_became_active":"2024-09-16T00:58:36.512167+0000","last_became_peered":"2024-09-16T00:58:36.512167+0000","last_unstale":"2024-09-16T00:59:44.862525+0000","last_undegraded":"2024-09-16T00:59:44.862525+0000","last_fullsized":"2024-09-16T00:59:44.862525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834025+0000","last_change":"2024-09-16T00:58:34.471603+0000","last_active":"2024-09-16T00:59:44.834025+0000","last_peered":"2024-09-16T00:59:44.834025+0000","last_clean":"2024-09-16T00:59:44.834025+0000","last_became_active":"2024-09-16T00:58:34.471241+0000","last_became_peered":"2024-09-16T00:58:34.471241+0000","last_unstale":"2024-09-16T00:59:44.834025+0000","last_undegraded":"2024-09-16T00:59:44.834025+0000","last_fullsized":"2024-09-16T00:59:44.834025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:33.756759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835898+0000","last_change":"2024-09-16T00:58:43.607428+0000","last_active":"2024-09-16T00:59:44.835898+0000","last_peered":"2024-09-16T00:59:44.835898+0000","last_clean":"2024-09-16T00:59:44.835898+0000","last_became_active":"2024-09-16T00:58:43.606990+0000","last_became_peered":"2024-09-16T00:58:43.606990+0000","last_unstale":"2024-09-16T00:59:44.835898+0000","last_undegraded":"2024-09-16T00:59:44.835898+0000","last_fullsized":"2024-09-16T00:59:44.835898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:52.367384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831440+0000","last_change":"2024-09-16T00:58:36.513967+0000","last_active":"2024-09-16T00:59:44.831440+0000","last_peered":"2024-09-16T00:59:44.831440+0000","last_clean":"2024-09-16T00:59:44.831440+0000","last_became_active":"2024-09-16T00:58:36.513610+0000","last_became_peered":"2024-09-16T00:58:36.513610+0000","last_unstale":"2024-09-16T00:59:44.831440+0000","last_undegraded":"2024-09-16T00:59:44.831440+0000","last_fullsized":"2024-09-16T00:59:44.831440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:22.763430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":183,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:13.655363+0000","last_change":"2024-09-16T00:58:34.471511+0000","last_active":"2024-09-16T01:00:13.655363+0000","last_peered":"2024-09-16T01:00:13.655363+0000","last_clean":"2024-09-16T01:00:13.655363+0000","last_became_active":"2024-09-16T00:58:34.470597+0000","last_became_peered":"2024-09-16T00:58:34.470597+0000","last_unstale":"2024-09-16T01:00:13.655363+0000","last_undegraded":"2024-09-16T01:00:13.655363+0000","last_fullsized":"2024-09-16T01:00:13.655363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.782592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63484,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":119,"num_write":37,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830877+0000","last_change":"2024-09-16T00:58:43.612177+0000","last_active":"2024-09-16T00:59:44.830877+0000","last_peered":"2024-09-16T00:59:44.830877+0000","last_clean":"2024-09-16T00:59:44.830877+0000","last_became_active":"2024-09-16T00:58:43.611801+0000","last_became_peered":"2024-09-16T00:58:43.611801+0000","last_unstale":"2024-09-16T00:59:44.830877+0000","last_undegraded":"2024-09-16T00:59:44.830877+0000","last_fullsized":"2024-09-16T00:59:44.830877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.781429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.096086+0000","last_change":"2024-09-16T00:58:36.502231+0000","last_active":"2024-09-16T00:59:45.096086+0000","last_peered":"2024-09-16T00:59:45.096086+0000","last_clean":"2024-09-16T00:59:45.096086+0000","last_became_active":"2024-09-16T00:58:36.501934+0000","last_became_peered":"2024-09-16T00:58:36.501934+0000","last_unstale":"2024-09-16T00:59:45.096086+0000","last_undegraded":"2024-09-16T00:59:45.096086+0000","last_fullsized":"2024-09-16T00:59:45.096086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:29.769186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.836470+0000","last_change":"2024-09-16T00:58:34.829872+0000","last_active":"2024-09-16T00:59:44.836470+0000","last_peered":"2024-09-16T00:59:44.836470+0000","last_clean":"2024-09-16T00:59:44.836470+0000","last_became_active":"2024-09-16T00:58:34.829496+0000","last_became_peered":"2024-09-16T00:58:34.829496+0000","last_unstale":"2024-09-16T00:59:44.836470+0000","last_undegraded":"2024-09-16T00:59:44.836470+0000","last_fullsized":"2024-09-16T00:59:44.836470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:47.035177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833562+0000","last_change":"2024-09-16T00:58:43.615560+0000","last_active":"2024-09-16T00:59:44.833562+0000","last_peered":"2024-09-16T00:59:44.833562+0000","last_clean":"2024-09-16T00:59:44.833562+0000","last_became_active":"2024-09-16T00:58:43.615124+0000","last_became_peered":"2024-09-16T00:58:43.615124+0000","last_unstale":"2024-09-16T00:59:44.833562+0000","last_undegraded":"2024-09-16T00:59:44.833562+0000","last_fullsized":"2024-09-16T00:59:44.833562+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.455528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829190+0000","last_change":"2024-09-16T00:58:36.514456+0000","last_active":"2024-09-16T00:59:44.829190+0000","last_peered":"2024-09-16T00:59:44.829190+0000","last_clean":"2024-09-16T00:59:44.829190+0000","last_became_active":"2024-09-16T00:58:36.514146+0000","last_became_peered":"2024-09-16T00:58:36.514146+0000","last_unstale":"2024-09-16T00:59:44.829190+0000","last_undegraded":"2024-09-16T00:59:44.829190+0000","last_fullsized":"2024-09-16T00:59:44.829190+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:06.760121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833531+0000","last_change":"2024-09-16T00:58:34.471316+0000","last_active":"2024-09-16T00:59:44.833531+0000","last_peered":"2024-09-16T00:59:44.833531+0000","last_clean":"2024-09-16T00:59:44.833531+0000","last_became_active":"2024-09-16T00:58:34.470991+0000","last_became_peered":"2024-09-16T00:58:34.470991+0000","last_unstale":"2024-09-16T00:59:44.833531+0000","last_undegraded":"2024-09-16T00:59:44.833531+0000","last_fullsized":"2024-09-16T00:59:44.833531+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:44.492439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831061+0000","last_change":"2024-09-16T00:58:43.617202+0000","last_active":"2024-09-16T00:59:44.831061+0000","last_peered":"2024-09-16T00:59:44.831061+0000","last_clean":"2024-09-16T00:59:44.831061+0000","last_became_active":"2024-09-16T00:58:43.616824+0000","last_became_peered":"2024-09-16T00:58:43.616824+0000","last_unstale":"2024-09-16T00:59:44.831061+0000","last_undegraded":"2024-09-16T00:59:44.831061+0000","last_fullsized":"2024-09-16T00:59:44.831061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:43.035003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.096268+0000","last_change":"2024-09-16T00:58:36.512079+0000","last_active":"2024-09-16T00:59:45.096268+0000","last_peered":"2024-09-16T00:59:45.096268+0000","last_clean":"2024-09-16T00:59:45.096268+0000","last_became_active":"2024-09-16T00:58:36.511220+0000","last_became_peered":"2024-09-16T00:58:36.511220+0000","last_unstale":"2024-09-16T00:59:45.096268+0000","last_undegraded":"2024-09-16T00:59:45.096268+0000","last_fullsized":"2024-09-16T00:59:45.096268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:49.798132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:13.655312+0000","last_change":"2024-09-16T00:58:34.470682+0000","last_active":"2024-09-16T01:00:13.655312+0000","last_peered":"2024-09-16T01:00:13.655312+0000","last_clean":"2024-09-16T01:00:13.655312+0000","last_became_active":"2024-09-16T00:58:34.470323+0000","last_became_peered":"2024-09-16T00:58:34.470323+0000","last_unstale":"2024-09-16T01:00:13.655312+0000","last_undegraded":"2024-09-16T01:00:13.655312+0000","last_fullsized":"2024-09-16T01:00:13.655312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.361374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833027+0000","last_change":"2024-09-16T00:58:43.608941+0000","last_active":"2024-09-16T00:59:44.833027+0000","last_peered":"2024-09-16T00:59:44.833027+0000","last_clean":"2024-09-16T00:59:44.833027+0000","last_became_active":"2024-09-16T00:58:43.607406+0000","last_became_peered":"2024-09-16T00:58:43.607406+0000","last_unstale":"2024-09-16T00:59:44.833027+0000","last_undegraded":"2024-09-16T00:59:44.833027+0000","last_fullsized":"2024-09-16T00:59:44.833027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:10.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828419+0000","last_change":"2024-09-16T00:58:43.613902+0000","last_active":"2024-09-16T00:59:44.828419+0000","last_peered":"2024-09-16T00:59:44.828419+0000","last_clean":"2024-09-16T00:59:44.828419+0000","last_became_active":"2024-09-16T00:58:43.613530+0000","last_became_peered":"2024-09-16T00:58:43.613530+0000","last_unstale":"2024-09-16T00:59:44.828419+0000","last_undegraded":"2024-09-16T00:59:44.828419+0000","last_fullsized":"2024-09-16T00:59:44.828419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:34.774810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830714+0000","last_change":"2024-09-16T00:58:36.504745+0000","last_active":"2024-09-16T00:59:44.830714+0000","last_peered":"2024-09-16T00:59:44.830714+0000","last_clean":"2024-09-16T00:59:44.830714+0000","last_became_active":"2024-09-16T00:58:36.504400+0000","last_became_peered":"2024-09-16T00:58:36.504400+0000","last_unstale":"2024-09-16T00:59:44.830714+0000","last_undegraded":"2024-09-16T00:59:44.830714+0000","last_fullsized":"2024-09-16T00:59:44.830714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:34.444019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.836025+0000","last_change":"2024-09-16T00:58:34.470285+0000","last_active":"2024-09-16T00:59:44.836025+0000","last_peered":"2024-09-16T00:59:44.836025+0000","last_clean":"2024-09-16T00:59:44.836025+0000","last_became_active":"2024-09-16T00:58:34.469948+0000","last_became_peered":"2024-09-16T00:58:34.469948+0000","last_unstale":"2024-09-16T00:59:44.836025+0000","last_undegraded":"2024-09-16T00:59:44.836025+0000","last_fullsized":"2024-09-16T00:59:44.836025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:28.553863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830158+0000","last_change":"2024-09-16T00:58:43.614818+0000","last_active":"2024-09-16T00:59:44.830158+0000","last_peered":"2024-09-16T00:59:44.830158+0000","last_clean":"2024-09-16T00:59:44.830158+0000","last_became_active":"2024-09-16T00:58:43.614376+0000","last_became_peered":"2024-09-16T00:58:43.614376+0000","last_unstale":"2024-09-16T00:59:44.830158+0000","last_undegraded":"2024-09-16T00:59:44.830158+0000","last_fullsized":"2024-09-16T00:59:44.830158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:41.699930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832932+0000","last_change":"2024-09-16T00:58:36.505127+0000","last_active":"2024-09-16T00:59:44.832932+0000","last_peered":"2024-09-16T00:59:44.832932+0000","last_clean":"2024-09-16T00:59:44.832932+0000","last_became_active":"2024-09-16T00:58:36.504552+0000","last_became_peered":"2024-09-16T00:58:36.504552+0000","last_unstale":"2024-09-16T00:59:44.832932+0000","last_undegraded":"2024-09-16T00:59:44.832932+0000","last_fullsized":"2024-09-16T00:59:44.832932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:48.104109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862357+0000","last_change":"2024-09-16T00:58:34.462231+0000","last_active":"2024-09-16T00:59:44.862357+0000","last_peered":"2024-09-16T00:59:44.862357+0000","last_clean":"2024-09-16T00:59:44.862357+0000","last_became_active":"2024-09-16T00:58:34.461891+0000","last_became_peered":"2024-09-16T00:58:34.461891+0000","last_unstale":"2024-09-16T00:59:44.862357+0000","last_undegraded":"2024-09-16T00:59:44.862357+0000","last_fullsized":"2024-09-16T00:59:44.862357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.483996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829229+0000","last_change":"2024-09-16T00:58:34.472457+0000","last_active":"2024-09-16T00:59:44.829229+0000","last_peered":"2024-09-16T00:59:44.829229+0000","last_clean":"2024-09-16T00:59:44.829229+0000","last_became_active":"2024-09-16T00:58:34.472084+0000","last_became_peered":"2024-09-16T00:58:34.472084+0000","last_unstale":"2024-09-16T00:59:44.829229+0000","last_undegraded":"2024-09-16T00:59:44.829229+0000","last_fullsized":"2024-09-16T00:59:44.829229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:08.005195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835940+0000","last_change":"2024-09-16T00:58:36.508791+0000","last_active":"2024-09-16T00:59:44.835940+0000","last_peered":"2024-09-16T00:59:44.835940+0000","last_clean":"2024-09-16T00:59:44.835940+0000","last_became_active":"2024-09-16T00:58:36.508461+0000","last_became_peered":"2024-09-16T00:58:36.508461+0000","last_unstale":"2024-09-16T00:59:44.835940+0000","last_undegraded":"2024-09-16T00:59:44.835940+0000","last_fullsized":"2024-09-16T00:59:44.835940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.938067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834089+0000","last_change":"2024-09-16T00:58:43.620439+0000","last_active":"2024-09-16T00:59:44.834089+0000","last_peered":"2024-09-16T00:59:44.834089+0000","last_clean":"2024-09-16T00:59:44.834089+0000","last_became_active":"2024-09-16T00:58:43.619952+0000","last_became_peered":"2024-09-16T00:58:43.619952+0000","last_unstale":"2024-09-16T00:59:44.834089+0000","last_undegraded":"2024-09-16T00:59:44.834089+0000","last_fullsized":"2024-09-16T00:59:44.834089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":92,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:10.651487+0000","last_change":"2024-09-16T00:58:34.473169+0000","last_active":"2024-09-16T01:00:10.651487+0000","last_peered":"2024-09-16T01:00:10.651487+0000","last_clean":"2024-09-16T01:00:10.651487+0000","last_became_active":"2024-09-16T00:58:34.472839+0000","last_became_peered":"2024-09-16T00:58:34.472839+0000","last_unstale":"2024-09-16T01:00:10.651487+0000","last_undegraded":"2024-09-16T01:00:10.651487+0000","last_fullsized":"2024-09-16T01:00:10.651487+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:03.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832395+0000","last_change":"2024-09-16T00:58:36.508719+0000","last_active":"2024-09-16T00:59:44.832395+0000","last_peered":"2024-09-16T00:59:44.832395+0000","last_clean":"2024-09-16T00:59:44.832395+0000","last_became_active":"2024-09-16T00:58:36.508427+0000","last_became_peered":"2024-09-16T00:58:36.508427+0000","last_unstale":"2024-09-16T00:59:44.832395+0000","last_undegraded":"2024-09-16T00:59:44.832395+0000","last_fullsized":"2024-09-16T00:59:44.832395+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:44.134558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834157+0000","last_change":"2024-09-16T00:58:43.616532+0000","last_active":"2024-09-16T00:59:44.834157+0000","last_peered":"2024-09-16T00:59:44.834157+0000","last_clean":"2024-09-16T00:59:44.834157+0000","last_became_active":"2024-09-16T00:58:43.616146+0000","last_became_peered":"2024-09-16T00:58:43.616146+0000","last_unstale":"2024-09-16T00:59:44.834157+0000","last_undegraded":"2024-09-16T00:59:44.834157+0000","last_fullsized":"2024-09-16T00:59:44.834157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:50.904766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829603+0000","last_change":"2024-09-16T00:58:36.513232+0000","last_active":"2024-09-16T00:59:44.829603+0000","last_peered":"2024-09-16T00:59:44.829603+0000","last_clean":"2024-09-16T00:59:44.829603+0000","last_became_active":"2024-09-16T00:58:36.512239+0000","last_became_peered":"2024-09-16T00:58:36.512239+0000","last_unstale":"2024-09-16T00:59:44.829603+0000","last_undegraded":"2024-09-16T00:59:44.829603+0000","last_fullsized":"2024-09-16T00:59:44.829603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833739+0000","last_change":"2024-09-16T00:58:36.513160+0000","last_active":"2024-09-16T00:59:44.833739+0000","last_peered":"2024-09-16T00:59:44.833739+0000","last_clean":"2024-09-16T00:59:44.833739+0000","last_became_active":"2024-09-16T00:58:36.512523+0000","last_became_peered":"2024-09-16T00:58:36.512523+0000","last_unstale":"2024-09-16T00:59:44.833739+0000","last_undegraded":"2024-09-16T00:59:44.833739+0000","last_fullsized":"2024-09-16T00:59:44.833739+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:20.934937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833294+0000","last_change":"2024-09-16T00:58:36.516416+0000","last_active":"2024-09-16T00:59:44.833294+0000","last_peered":"2024-09-16T00:59:44.833294+0000","last_clean":"2024-09-16T00:59:44.833294+0000","last_became_active":"2024-09-16T00:58:36.516121+0000","last_became_peered":"2024-09-16T00:58:36.516121+0000","last_unstale":"2024-09-16T00:59:44.833294+0000","last_undegraded":"2024-09-16T00:59:44.833294+0000","last_fullsized":"2024-09-16T00:59:44.833294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:28.848616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828700+0000","last_change":"2024-09-16T00:58:36.510854+0000","last_active":"2024-09-16T00:59:44.828700+0000","last_peered":"2024-09-16T00:59:44.828700+0000","last_clean":"2024-09-16T00:59:44.828700+0000","last_became_active":"2024-09-16T00:58:36.510505+0000","last_became_peered":"2024-09-16T00:58:36.510505+0000","last_unstale":"2024-09-16T00:59:44.828700+0000","last_undegraded":"2024-09-16T00:59:44.828700+0000","last_fullsized":"2024-09-16T00:59:44.828700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.699942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862941+0000","last_change":"2024-09-16T00:58:36.509016+0000","last_active":"2024-09-16T00:59:44.862941+0000","last_peered":"2024-09-16T00:59:44.862941+0000","last_clean":"2024-09-16T00:59:44.862941+0000","last_became_active":"2024-09-16T00:58:36.508690+0000","last_became_peered":"2024-09-16T00:58:36.508690+0000","last_unstale":"2024-09-16T00:59:44.862941+0000","last_undegraded":"2024-09-16T00:59:44.862941+0000","last_fullsized":"2024-09-16T00:59:44.862941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:41.425016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830557+0000","last_change":"2024-09-16T00:58:36.511659+0000","last_active":"2024-09-16T00:59:44.830557+0000","last_peered":"2024-09-16T00:59:44.830557+0000","last_clean":"2024-09-16T00:59:44.830557+0000","last_became_active":"2024-09-16T00:58:36.511225+0000","last_became_peered":"2024-09-16T00:58:36.511225+0000","last_unstale":"2024-09-16T00:59:44.830557+0000","last_undegraded":"2024-09-16T00:59:44.830557+0000","last_fullsized":"2024-09-16T00:59:44.830557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:43.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834361+0000","last_change":"2024-09-16T00:58:36.511614+0000","last_active":"2024-09-16T00:59:44.834361+0000","last_peered":"2024-09-16T00:59:44.834361+0000","last_clean":"2024-09-16T00:59:44.834361+0000","last_became_active":"2024-09-16T00:58:36.511304+0000","last_became_peered":"2024-09-16T00:58:36.511304+0000","last_unstale":"2024-09-16T00:59:44.834361+0000","last_undegraded":"2024-09-16T00:59:44.834361+0000","last_fullsized":"2024-09-16T00:59:44.834361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:20.755419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833783+0000","last_change":"2024-09-16T00:58:36.509399+0000","last_active":"2024-09-16T00:59:44.833783+0000","last_peered":"2024-09-16T00:59:44.833783+0000","last_clean":"2024-09-16T00:59:44.833783+0000","last_became_active":"2024-09-16T00:58:36.509072+0000","last_became_peered":"2024-09-16T00:58:36.509072+0000","last_unstale":"2024-09-16T00:59:44.833783+0000","last_undegraded":"2024-09-16T00:59:44.833783+0000","last_fullsized":"2024-09-16T00:59:44.833783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:29.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835835+0000","last_change":"2024-09-16T00:58:36.506252+0000","last_active":"2024-09-16T00:59:44.835835+0000","last_peered":"2024-09-16T00:59:44.835835+0000","last_clean":"2024-09-16T00:59:44.835835+0000","last_became_active":"2024-09-16T00:58:36.505923+0000","last_became_peered":"2024-09-16T00:58:36.505923+0000","last_unstale":"2024-09-16T00:59:44.835835+0000","last_undegraded":"2024-09-16T00:59:44.835835+0000","last_fullsized":"2024-09-16T00:59:44.835835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:05.332472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833151+0000","last_change":"2024-09-16T00:58:36.506598+0000","last_active":"2024-09-16T00:59:44.833151+0000","last_peered":"2024-09-16T00:59:44.833151+0000","last_clean":"2024-09-16T00:59:44.833151+0000","last_became_active":"2024-09-16T00:58:36.506299+0000","last_became_peered":"2024-09-16T00:58:36.506299+0000","last_unstale":"2024-09-16T00:59:44.833151+0000","last_undegraded":"2024-09-16T00:59:44.833151+0000","last_fullsized":"2024-09-16T00:59:44.833151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.327225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.095942+0000","last_change":"2024-09-16T00:58:36.517050+0000","last_active":"2024-09-16T00:59:45.095942+0000","last_peered":"2024-09-16T00:59:45.095942+0000","last_clean":"2024-09-16T00:59:45.095942+0000","last_became_active":"2024-09-16T00:58:36.516745+0000","last_became_peered":"2024-09-16T00:58:36.516745+0000","last_unstale":"2024-09-16T00:59:45.095942+0000","last_undegraded":"2024-09-16T00:59:45.095942+0000","last_fullsized":"2024-09-16T00:59:45.095942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:59.981792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862573+0000","last_change":"2024-09-16T00:58:36.512442+0000","last_active":"2024-09-16T00:59:44.862573+0000","last_peered":"2024-09-16T00:59:44.862573+0000","last_clean":"2024-09-16T00:59:44.862573+0000","last_became_active":"2024-09-16T00:58:36.512132+0000","last_became_peered":"2024-09-16T00:58:36.512132+0000","last_unstale":"2024-09-16T00:59:44.862573+0000","last_undegraded":"2024-09-16T00:59:44.862573+0000","last_fullsized":"2024-09-16T00:59:44.862573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:06.511257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829974+0000","last_change":"2024-09-16T00:58:36.519754+0000","last_active":"2024-09-16T00:59:44.829974+0000","last_peered":"2024-09-16T00:59:44.829974+0000","last_clean":"2024-09-16T00:59:44.829974+0000","last_became_active":"2024-09-16T00:58:36.519378+0000","last_became_peered":"2024-09-16T00:58:36.519378+0000","last_unstale":"2024-09-16T00:59:44.829974+0000","last_undegraded":"2024-09-16T00:59:44.829974+0000","last_fullsized":"2024-09-16T00:59:44.829974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:51.076588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834579+0000","last_change":"2024-09-16T00:58:36.504627+0000","last_active":"2024-09-16T00:59:44.834579+0000","last_peered":"2024-09-16T00:59:44.834579+0000","last_clean":"2024-09-16T00:59:44.834579+0000","last_became_active":"2024-09-16T00:58:36.504282+0000","last_became_peered":"2024-09-16T00:58:36.504282+0000","last_unstale":"2024-09-16T00:59:44.834579+0000","last_undegraded":"2024-09-16T00:59:44.834579+0000","last_fullsized":"2024-09-16T00:59:44.834579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.857181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831462+0000","last_change":"2024-09-16T00:58:36.508971+0000","last_active":"2024-09-16T00:59:44.831462+0000","last_peered":"2024-09-16T00:59:44.831462+0000","last_clean":"2024-09-16T00:59:44.831462+0000","last_became_active":"2024-09-16T00:58:36.508631+0000","last_became_peered":"2024-09-16T00:58:36.508631+0000","last_unstale":"2024-09-16T00:59:44.831462+0000","last_undegraded":"2024-09-16T00:59:44.831462+0000","last_fullsized":"2024-09-16T00:59:44.831462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:17.092613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830465+0000","last_change":"2024-09-16T00:58:36.517255+0000","last_active":"2024-09-16T00:59:44.830465+0000","last_peered":"2024-09-16T00:59:44.830465+0000","last_clean":"2024-09-16T00:59:44.830465+0000","last_became_active":"2024-09-16T00:58:36.516957+0000","last_became_peered":"2024-09-16T00:58:36.516957+0000","last_unstale":"2024-09-16T00:59:44.830465+0000","last_undegraded":"2024-09-16T00:59:44.830465+0000","last_fullsized":"2024-09-16T00:59:44.830465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:34.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.095619+0000","last_change":"2024-09-16T00:58:36.516429+0000","last_active":"2024-09-16T00:59:45.095619+0000","last_peered":"2024-09-16T00:59:45.095619+0000","last_clean":"2024-09-16T00:59:45.095619+0000","last_became_active":"2024-09-16T00:58:36.516111+0000","last_became_peered":"2024-09-16T00:58:36.516111+0000","last_unstale":"2024-09-16T00:59:45.095619+0000","last_undegraded":"2024-09-16T00:59:45.095619+0000","last_fullsized":"2024-09-16T00:59:45.095619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:06.120653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828384+0000","last_change":"2024-09-16T00:58:36.512873+0000","last_active":"2024-09-16T00:59:44.828384+0000","last_peered":"2024-09-16T00:59:44.828384+0000","last_clean":"2024-09-16T00:59:44.828384+0000","last_became_active":"2024-09-16T00:58:36.511761+0000","last_became_peered":"2024-09-16T00:58:36.511761+0000","last_unstale":"2024-09-16T00:59:44.828384+0000","last_undegraded":"2024-09-16T00:59:44.828384+0000","last_fullsized":"2024-09-16T00:59:44.828384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:51.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828492+0000","last_change":"2024-09-16T00:58:36.511585+0000","last_active":"2024-09-16T00:59:44.828492+0000","last_peered":"2024-09-16T00:59:44.828492+0000","last_clean":"2024-09-16T00:59:44.828492+0000","last_became_active":"2024-09-16T00:58:36.510479+0000","last_became_peered":"2024-09-16T00:58:36.510479+0000","last_unstale":"2024-09-16T00:59:44.828492+0000","last_undegraded":"2024-09-16T00:59:44.828492+0000","last_fullsized":"2024-09-16T00:59:44.828492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:58.017132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862523+0000","last_change":"2024-09-16T00:58:36.508263+0000","last_active":"2024-09-16T00:59:44.862523+0000","last_peered":"2024-09-16T00:59:44.862523+0000","last_clean":"2024-09-16T00:59:44.862523+0000","last_became_active":"2024-09-16T00:58:36.507979+0000","last_became_peered":"2024-09-16T00:58:36.507979+0000","last_unstale":"2024-09-16T00:59:44.862523+0000","last_undegraded":"2024-09-16T00:59:44.862523+0000","last_fullsized":"2024-09-16T00:59:44.862523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:07.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833564+0000","last_change":"2024-09-16T00:58:36.514981+0000","last_active":"2024-09-16T00:59:44.833564+0000","last_peered":"2024-09-16T00:59:44.833564+0000","last_clean":"2024-09-16T00:59:44.833564+0000","last_became_active":"2024-09-16T00:58:36.510433+0000","last_became_peered":"2024-09-16T00:58:36.510433+0000","last_unstale":"2024-09-16T00:59:44.833564+0000","last_undegraded":"2024-09-16T00:59:44.833564+0000","last_fullsized":"2024-09-16T00:59:44.833564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:10.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833562+0000","last_change":"2024-09-16T00:58:36.521336+0000","last_active":"2024-09-16T00:59:44.833562+0000","last_peered":"2024-09-16T00:59:44.833562+0000","last_clean":"2024-09-16T00:59:44.833562+0000","last_became_active":"2024-09-16T00:58:36.521026+0000","last_became_peered":"2024-09-16T00:58:36.521026+0000","last_unstale":"2024-09-16T00:59:44.833562+0000","last_undegraded":"2024-09-16T00:59:44.833562+0000","last_fullsized":"2024-09-16T00:59:44.833562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:29.409024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829711+0000","last_change":"2024-09-16T00:58:36.518724+0000","last_active":"2024-09-16T00:59:44.829711+0000","last_peered":"2024-09-16T00:59:44.829711+0000","last_clean":"2024-09-16T00:59:44.829711+0000","last_became_active":"2024-09-16T00:58:36.518428+0000","last_became_peered":"2024-09-16T00:58:36.518428+0000","last_unstale":"2024-09-16T00:59:44.829711+0000","last_undegraded":"2024-09-16T00:59:44.829711+0000","last_fullsized":"2024-09-16T00:59:44.829711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:06.486299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.096401+0000","last_change":"2024-09-16T00:58:36.514347+0000","last_active":"2024-09-16T00:59:45.096401+0000","last_peered":"2024-09-16T00:59:45.096401+0000","last_clean":"2024-09-16T00:59:45.096401+0000","last_became_active":"2024-09-16T00:58:36.512243+0000","last_became_peered":"2024-09-16T00:58:36.512243+0000","last_unstale":"2024-09-16T00:59:45.096401+0000","last_undegraded":"2024-09-16T00:59:45.096401+0000","last_fullsized":"2024-09-16T00:59:45.096401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.289541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.837828+0000","last_change":"2024-09-16T00:59:44.837828+0000","last_active":"2024-09-16T00:59:44.837828+0000","last_peered":"2024-09-16T00:59:44.837828+0000","last_clean":"2024-09-16T00:59:44.837828+0000","last_became_active":"2024-09-16T00:59:44.837486+0000","last_became_peered":"2024-09-16T00:59:44.837486+0000","last_unstale":"2024-09-16T00:59:44.837828+0000","last_undegraded":"2024-09-16T00:59:44.837828+0000","last_fullsized":"2024-09-16T00:59:44.837828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:46.914056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832571+0000","last_change":"2024-09-16T00:58:36.516797+0000","last_active":"2024-09-16T00:59:44.832571+0000","last_peered":"2024-09-16T00:59:44.832571+0000","last_clean":"2024-09-16T00:59:44.832571+0000","last_became_active":"2024-09-16T00:58:36.516480+0000","last_became_peered":"2024-09-16T00:58:36.516480+0000","last_unstale":"2024-09-16T00:59:44.832571+0000","last_undegraded":"2024-09-16T00:59:44.832571+0000","last_fullsized":"2024-09-16T00:59:44.832571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:55.262528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829196+0000","last_change":"2024-09-16T00:58:36.517973+0000","last_active":"2024-09-16T00:59:44.829196+0000","last_peered":"2024-09-16T00:59:44.829196+0000","last_clean":"2024-09-16T00:59:44.829196+0000","last_became_active":"2024-09-16T00:58:36.517634+0000","last_became_peered":"2024-09-16T00:58:36.517634+0000","last_unstale":"2024-09-16T00:59:44.829196+0000","last_undegraded":"2024-09-16T00:59:44.829196+0000","last_fullsized":"2024-09-16T00:59:44.829196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:19.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831181+0000","last_change":"2024-09-16T00:58:36.507643+0000","last_active":"2024-09-16T00:59:44.831181+0000","last_peered":"2024-09-16T00:59:44.831181+0000","last_clean":"2024-09-16T00:59:44.831181+0000","last_became_active":"2024-09-16T00:58:36.507263+0000","last_became_peered":"2024-09-16T00:58:36.507263+0000","last_unstale":"2024-09-16T00:59:44.831181+0000","last_undegraded":"2024-09-16T00:59:44.831181+0000","last_fullsized":"2024-09-16T00:59:44.831181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:24.317490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833460+0000","last_change":"2024-09-16T00:58:36.508798+0000","last_active":"2024-09-16T00:59:44.833460+0000","last_peered":"2024-09-16T00:59:44.833460+0000","last_clean":"2024-09-16T00:59:44.833460+0000","last_became_active":"2024-09-16T00:58:36.508490+0000","last_became_peered":"2024-09-16T00:58:36.508490+0000","last_unstale":"2024-09-16T00:59:44.833460+0000","last_undegraded":"2024-09-16T00:59:44.833460+0000","last_fullsized":"2024-09-16T00:59:44.833460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:44.282270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828876+0000","last_change":"2024-09-16T00:58:36.519065+0000","last_active":"2024-09-16T00:59:44.828876+0000","last_peered":"2024-09-16T00:59:44.828876+0000","last_clean":"2024-09-16T00:59:44.828876+0000","last_became_active":"2024-09-16T00:58:36.518708+0000","last_became_peered":"2024-09-16T00:58:36.518708+0000","last_unstale":"2024-09-16T00:59:44.828876+0000","last_undegraded":"2024-09-16T00:59:44.828876+0000","last_fullsized":"2024-09-16T00:59:44.828876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:10.290341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828516+0000","last_change":"2024-09-16T00:58:36.513018+0000","last_active":"2024-09-16T00:59:44.828516+0000","last_peered":"2024-09-16T00:59:44.828516+0000","last_clean":"2024-09-16T00:59:44.828516+0000","last_became_active":"2024-09-16T00:58:36.511730+0000","last_became_peered":"2024-09-16T00:58:36.511730+0000","last_unstale":"2024-09-16T00:59:44.828516+0000","last_undegraded":"2024-09-16T00:59:44.828516+0000","last_fullsized":"2024-09-16T00:59:44.828516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:20.852121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830645+0000","last_change":"2024-09-16T00:58:36.518265+0000","last_active":"2024-09-16T00:59:44.830645+0000","last_peered":"2024-09-16T00:59:44.830645+0000","last_clean":"2024-09-16T00:59:44.830645+0000","last_became_active":"2024-09-16T00:58:36.517906+0000","last_became_peered":"2024-09-16T00:58:36.517906+0000","last_unstale":"2024-09-16T00:59:44.830645+0000","last_undegraded":"2024-09-16T00:59:44.830645+0000","last_fullsized":"2024-09-16T00:59:44.830645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.255849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70299,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":553,"num_read_kb":355,"num_write":246,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":210897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282150,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612641,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":966656,"data_stored":494502,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841573,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1118208,"data_stored":1144409,"data_compressed":59505,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":995328,"data_stored":498135,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":493745,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":1090523,"data_compressed":59505,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":489543,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":1086105,"data_compressed":59505,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":494289,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":978944,"data_stored":489251,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1056768,"data_stored":554670,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1036288,"data_stored":554057,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":991232,"data_stored":491392,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:00:16.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:00:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.302+0000 7f797b710640 1 -- 172.21.15.12:0/1274622389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7974106a80 msgr2=0x7f7974106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.302+0000 7f797b710640 1 --2- 172.21.15.12:0/1274622389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7974106a80 0x7f7974106e60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7970009930 tx=0x7f797002a420 comp rx=0 tx=0).stop 2024-09-16T01:00:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.302+0000 7f797b710640 1 -- 172.21.15.12:0/1274622389 shutdown_connections 2024-09-16T01:00:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.302+0000 7f797b710640 1 --2- 172.21.15.12:0/1274622389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7974101420 0x7f797410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.302+0000 7f797b710640 1 --2- 172.21.15.12:0/1274622389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7974100a80 0x7f7974100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.302+0000 7f797b710640 1 --2- 172.21.15.12:0/1274622389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7974106a80 0x7f7974106e60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.302+0000 7f797b710640 1 -- 172.21.15.12:0/1274622389 >> 172.21.15.12:0/1274622389 conn(0x7f79740fc7a0 msgr2=0x7f79740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.302+0000 7f797b710640 1 -- 172.21.15.12:0/1274622389 shutdown_connections 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.302+0000 7f797b710640 1 -- 172.21.15.12:0/1274622389 wait complete. 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f797b710640 1 Processor -- start 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f797b710640 1 -- start start 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f797b710640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7974100a80 0x7f7974198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f797b710640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7974101420 0x7f79741989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f797b710640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7974106a80 0x7f797419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f797b710640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7974110e80 con 0x7f7974106a80 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f797b710640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7974110d00 con 0x7f7974100a80 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f797b710640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7974111000 con 0x7f7974101420 2024-09-16T01:00:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f7979cad640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7974106a80 0x7f797419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f7979cad640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7974106a80 0x7f797419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41130/0 (socket says 172.21.15.12:41130) 2024-09-16T01:00:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f7979cad640 1 -- 172.21.15.12:0/1252558809 learned_addr learned my addr 172.21.15.12:0/1252558809 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f7978cab640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7974101420 0x7f79741989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f79794ac640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7974100a80 0x7f7974198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f7979cad640 1 -- 172.21.15.12:0/1252558809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7974101420 msgr2=0x7f79741989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f7979cad640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7974101420 0x7f79741989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f7979cad640 1 -- 172.21.15.12:0/1252558809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7974100a80 msgr2=0x7f7974198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f7979cad640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7974100a80 0x7f7974198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.303+0000 7f7979cad640 1 -- 172.21.15.12:0/1252558809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797419d410 con 0x7f7974106a80 2024-09-16T01:00:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.304+0000 7f79794ac640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7974100a80 0x7f7974198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.304+0000 7f7979cad640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7974106a80 0x7f797419cd30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f796c00eaa0 tx=0x7f796c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.304+0000 7f796a7fc640 1 -- 172.21.15.12:0/1252558809 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c00cdb0 con 0x7f7974106a80 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.304+0000 7f797b710640 1 -- 172.21.15.12:0/1252558809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797419d700 con 0x7f7974106a80 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.304+0000 7f796a7fc640 1 -- 172.21.15.12:0/1252558809 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f796c005020 con 0x7f7974106a80 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.304+0000 7f796a7fc640 1 -- 172.21.15.12:0/1252558809 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c0116b0 con 0x7f7974106a80 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.304+0000 7f797b710640 1 -- 172.21.15.12:0/1252558809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79741a4fe0 con 0x7f7974106a80 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.305+0000 7f797b710640 1 -- 172.21.15.12:0/1252558809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7974100ee0 con 0x7f7974106a80 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.306+0000 7f796a7fc640 1 -- 172.21.15.12:0/1252558809 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f796c005560 con 0x7f7974106a80 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.307+0000 7f796a7fc640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79600a32d0 0x7f79600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.307+0000 7f796a7fc640 1 -- 172.21.15.12:0/1252558809 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f796c0d0400 con 0x7f7974106a80 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.307+0000 7f79794ac640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79600a32d0 0x7f79600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.307+0000 7f79794ac640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79600a32d0 0x7f79600a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7970000c00 tx=0x7f7970032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.310+0000 7f796a7fc640 1 -- 172.21.15.12:0/1252558809 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f796c016030 con 0x7f7974106a80 2024-09-16T01:00:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.483+0000 7f797b710640 1 -- 172.21.15.12:0/1252558809 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7974062630 con 0x7f79600a32d0 2024-09-16T01:00:17.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.491+0000 7f796a7fc640 1 -- 172.21.15.12:0/1252558809 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340669 (secure 0 0 0) 0x7f7974062630 con 0x7f79600a32d0 2024-09-16T01:00:17.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-16T01:00:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 -- 172.21.15.12:0/1252558809 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79600a32d0 msgr2=0x7f79600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79600a32d0 0x7f79600a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7970000c00 tx=0x7f7970032c70 comp rx=0 tx=0).stop 2024-09-16T01:00:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 -- 172.21.15.12:0/1252558809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7974106a80 msgr2=0x7f797419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7974106a80 0x7f797419cd30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f796c00eaa0 tx=0x7f796c00ef60 comp rx=0 tx=0).stop 2024-09-16T01:00:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 -- 172.21.15.12:0/1252558809 shutdown_connections 2024-09-16T01:00:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79600a32d0 0x7f79600a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7974106a80 0x7f797419cd30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7974101420 0x7f79741989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 --2- 172.21.15.12:0/1252558809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7974100a80 0x7f7974198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 -- 172.21.15.12:0/1252558809 >> 172.21.15.12:0/1252558809 conn(0x7f79740fc7a0 msgr2=0x7f797406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 -- 172.21.15.12:0/1252558809 shutdown_connections 2024-09-16T01:00:17.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:17.495+0000 7f797b710640 1 -- 172.21.15.12:0/1252558809 wait complete. 2024-09-16T01:00:18.175 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:18 smithi012 ceph-mon[31197]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:18.175 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:18 smithi012 ceph-mon[31197]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:18.208 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-16T01:00:16.923293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660901,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":689,"num_read_kb":464,"num_write":429,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369520,"kb_used_data":11876,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572304,"statfs":{"total":1151940427776,"available":1151562039296,"internally_reserved":0,"allocated":12161024,"data_stored":7880621,"data_compressed":391113,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003548"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:12.872275+0000","last_change":"2024-09-16T00:59:44.862009+0000","last_active":"2024-09-16T01:00:12.872275+0000","last_peered":"2024-09-16T01:00:12.872275+0000","last_clean":"2024-09-16T01:00:12.872275+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:00:12.872275+0000","last_undegraded":"2024-09-16T01:00:12.872275+0000","last_fullsized":"2024-09-16T01:00:12.872275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:11.209907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833664+0000","last_change":"2024-09-16T00:58:36.507955+0000","last_active":"2024-09-16T00:59:44.833664+0000","last_peered":"2024-09-16T00:59:44.833664+0000","last_clean":"2024-09-16T00:59:44.833664+0000","last_became_active":"2024-09-16T00:58:36.507660+0000","last_became_peered":"2024-09-16T00:58:36.507660+0000","last_unstale":"2024-09-16T00:59:44.833664+0000","last_undegraded":"2024-09-16T00:59:44.833664+0000","last_fullsized":"2024-09-16T00:59:44.833664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:05.408460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833334+0000","last_change":"2024-09-16T00:58:43.620365+0000","last_active":"2024-09-16T00:59:44.833334+0000","last_peered":"2024-09-16T00:59:44.833334+0000","last_clean":"2024-09-16T00:59:44.833334+0000","last_became_active":"2024-09-16T00:58:43.619976+0000","last_became_peered":"2024-09-16T00:58:43.619976+0000","last_unstale":"2024-09-16T00:59:44.833334+0000","last_undegraded":"2024-09-16T00:59:44.833334+0000","last_fullsized":"2024-09-16T00:59:44.833334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:37.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833832+0000","last_change":"2024-09-16T00:58:34.829549+0000","last_active":"2024-09-16T00:59:44.833832+0000","last_peered":"2024-09-16T00:59:44.833832+0000","last_clean":"2024-09-16T00:59:44.833832+0000","last_became_active":"2024-09-16T00:58:34.829180+0000","last_became_peered":"2024-09-16T00:58:34.829180+0000","last_unstale":"2024-09-16T00:59:44.833832+0000","last_undegraded":"2024-09-16T00:59:44.833832+0000","last_fullsized":"2024-09-16T00:59:44.833832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:40.731288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829142+0000","last_change":"2024-09-16T00:58:36.517190+0000","last_active":"2024-09-16T00:59:44.829142+0000","last_peered":"2024-09-16T00:59:44.829142+0000","last_clean":"2024-09-16T00:59:44.829142+0000","last_became_active":"2024-09-16T00:58:36.516877+0000","last_became_peered":"2024-09-16T00:58:36.516877+0000","last_unstale":"2024-09-16T00:59:44.829142+0000","last_undegraded":"2024-09-16T00:59:44.829142+0000","last_fullsized":"2024-09-16T00:59:44.829142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.408011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.863832+0000","last_change":"2024-09-16T00:59:44.863832+0000","last_active":"2024-09-16T00:59:44.863832+0000","last_peered":"2024-09-16T00:59:44.863832+0000","last_clean":"2024-09-16T00:59:44.863832+0000","last_became_active":"2024-09-16T00:59:44.863298+0000","last_became_peered":"2024-09-16T00:59:44.863298+0000","last_unstale":"2024-09-16T00:59:44.863832+0000","last_undegraded":"2024-09-16T00:59:44.863832+0000","last_fullsized":"2024-09-16T00:59:44.863832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:55.449728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831649+0000","last_change":"2024-09-16T00:58:34.472375+0000","last_active":"2024-09-16T00:59:44.831649+0000","last_peered":"2024-09-16T00:59:44.831649+0000","last_clean":"2024-09-16T00:59:44.831649+0000","last_became_active":"2024-09-16T00:58:34.471990+0000","last_became_peered":"2024-09-16T00:58:34.471990+0000","last_unstale":"2024-09-16T00:59:44.831649+0000","last_undegraded":"2024-09-16T00:59:44.831649+0000","last_fullsized":"2024-09-16T00:59:44.831649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:15.746005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.095996+0000","last_change":"2024-09-16T00:58:36.513747+0000","last_active":"2024-09-16T00:59:45.095996+0000","last_peered":"2024-09-16T00:59:45.095996+0000","last_clean":"2024-09-16T00:59:45.095996+0000","last_became_active":"2024-09-16T00:58:36.512635+0000","last_became_peered":"2024-09-16T00:58:36.512635+0000","last_unstale":"2024-09-16T00:59:45.095996+0000","last_undegraded":"2024-09-16T00:59:45.095996+0000","last_fullsized":"2024-09-16T00:59:45.095996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:39.014961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833160+0000","last_change":"2024-09-16T00:58:43.609355+0000","last_active":"2024-09-16T00:59:44.833160+0000","last_peered":"2024-09-16T00:59:44.833160+0000","last_clean":"2024-09-16T00:59:44.833160+0000","last_became_active":"2024-09-16T00:58:43.608892+0000","last_became_peered":"2024-09-16T00:58:43.608892+0000","last_unstale":"2024-09-16T00:59:44.833160+0000","last_undegraded":"2024-09-16T00:59:44.833160+0000","last_fullsized":"2024-09-16T00:59:44.833160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:20.718163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831680+0000","last_change":"2024-09-16T00:58:34.469650+0000","last_active":"2024-09-16T00:59:44.831680+0000","last_peered":"2024-09-16T00:59:44.831680+0000","last_clean":"2024-09-16T00:59:44.831680+0000","last_became_active":"2024-09-16T00:58:34.468939+0000","last_became_peered":"2024-09-16T00:58:34.468939+0000","last_unstale":"2024-09-16T00:59:44.831680+0000","last_undegraded":"2024-09-16T00:59:44.831680+0000","last_fullsized":"2024-09-16T00:59:44.831680+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:34.511111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.097454+0000","last_change":"2024-09-16T00:59:45.097454+0000","last_active":"2024-09-16T00:59:45.097454+0000","last_peered":"2024-09-16T00:59:45.097454+0000","last_clean":"2024-09-16T00:59:45.097454+0000","last_became_active":"2024-09-16T00:59:45.096985+0000","last_became_peered":"2024-09-16T00:59:45.096985+0000","last_unstale":"2024-09-16T00:59:45.097454+0000","last_undegraded":"2024-09-16T00:59:45.097454+0000","last_fullsized":"2024-09-16T00:59:45.097454+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:03.247850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832855+0000","last_change":"2024-09-16T00:58:43.612479+0000","last_active":"2024-09-16T00:59:44.832855+0000","last_peered":"2024-09-16T00:59:44.832855+0000","last_clean":"2024-09-16T00:59:44.832855+0000","last_became_active":"2024-09-16T00:58:43.612001+0000","last_became_peered":"2024-09-16T00:58:43.612001+0000","last_unstale":"2024-09-16T00:59:44.832855+0000","last_undegraded":"2024-09-16T00:59:44.832855+0000","last_fullsized":"2024-09-16T00:59:44.832855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:33.056052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832832+0000","last_change":"2024-09-16T00:58:36.519407+0000","last_active":"2024-09-16T00:59:44.832832+0000","last_peered":"2024-09-16T00:59:44.832832+0000","last_clean":"2024-09-16T00:59:44.832832+0000","last_became_active":"2024-09-16T00:58:36.519108+0000","last_became_peered":"2024-09-16T00:58:36.519108+0000","last_unstale":"2024-09-16T00:59:44.832832+0000","last_undegraded":"2024-09-16T00:59:44.832832+0000","last_fullsized":"2024-09-16T00:59:44.832832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:28.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831350+0000","last_change":"2024-09-16T00:58:34.472295+0000","last_active":"2024-09-16T00:59:44.831350+0000","last_peered":"2024-09-16T00:59:44.831350+0000","last_clean":"2024-09-16T00:59:44.831350+0000","last_became_active":"2024-09-16T00:58:34.471968+0000","last_became_peered":"2024-09-16T00:58:34.471968+0000","last_unstale":"2024-09-16T00:59:44.831350+0000","last_undegraded":"2024-09-16T00:59:44.831350+0000","last_fullsized":"2024-09-16T00:59:44.831350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:44.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833441+0000","last_change":"2024-09-16T00:58:43.615870+0000","last_active":"2024-09-16T00:59:44.833441+0000","last_peered":"2024-09-16T00:59:44.833441+0000","last_clean":"2024-09-16T00:59:44.833441+0000","last_became_active":"2024-09-16T00:58:43.615116+0000","last_became_peered":"2024-09-16T00:58:43.615116+0000","last_unstale":"2024-09-16T00:59:44.833441+0000","last_undegraded":"2024-09-16T00:59:44.833441+0000","last_fullsized":"2024-09-16T00:59:44.833441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:44.742792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833558+0000","last_change":"2024-09-16T00:58:36.512485+0000","last_active":"2024-09-16T00:59:44.833558+0000","last_peered":"2024-09-16T00:59:44.833558+0000","last_clean":"2024-09-16T00:59:44.833558+0000","last_became_active":"2024-09-16T00:58:36.512175+0000","last_became_peered":"2024-09-16T00:58:36.512175+0000","last_unstale":"2024-09-16T00:59:44.833558+0000","last_undegraded":"2024-09-16T00:59:44.833558+0000","last_fullsized":"2024-09-16T00:59:44.833558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.328409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.841470+0000","last_change":"2024-09-16T00:59:44.841052+0000","last_active":"2024-09-16T00:59:44.841470+0000","last_peered":"2024-09-16T00:59:44.841470+0000","last_clean":"2024-09-16T00:59:44.841470+0000","last_became_active":"2024-09-16T00:59:44.834033+0000","last_became_peered":"2024-09-16T00:59:44.834033+0000","last_unstale":"2024-09-16T00:59:44.841470+0000","last_undegraded":"2024-09-16T00:59:44.841470+0000","last_fullsized":"2024-09-16T00:59:44.841470+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:09.696435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833009+0000","last_change":"2024-09-16T00:58:43.610265+0000","last_active":"2024-09-16T00:59:44.833009+0000","last_peered":"2024-09-16T00:59:44.833009+0000","last_clean":"2024-09-16T00:59:44.833009+0000","last_became_active":"2024-09-16T00:58:43.609868+0000","last_became_peered":"2024-09-16T00:58:43.609868+0000","last_unstale":"2024-09-16T00:59:44.833009+0000","last_undegraded":"2024-09-16T00:59:44.833009+0000","last_fullsized":"2024-09-16T00:59:44.833009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:54.689332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829676+0000","last_change":"2024-09-16T00:58:36.512801+0000","last_active":"2024-09-16T00:59:44.829676+0000","last_peered":"2024-09-16T00:59:44.829676+0000","last_clean":"2024-09-16T00:59:44.829676+0000","last_became_active":"2024-09-16T00:58:36.512469+0000","last_became_peered":"2024-09-16T00:58:36.512469+0000","last_unstale":"2024-09-16T00:59:44.829676+0000","last_undegraded":"2024-09-16T00:59:44.829676+0000","last_fullsized":"2024-09-16T00:59:44.829676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:57.951743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833213+0000","last_change":"2024-09-16T00:58:34.471498+0000","last_active":"2024-09-16T00:59:44.833213+0000","last_peered":"2024-09-16T00:59:44.833213+0000","last_clean":"2024-09-16T00:59:44.833213+0000","last_became_active":"2024-09-16T00:58:34.471093+0000","last_became_peered":"2024-09-16T00:58:34.471093+0000","last_unstale":"2024-09-16T00:59:44.833213+0000","last_undegraded":"2024-09-16T00:59:44.833213+0000","last_fullsized":"2024-09-16T00:59:44.833213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:35.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831458+0000","last_change":"2024-09-16T00:58:43.616376+0000","last_active":"2024-09-16T00:59:44.831458+0000","last_peered":"2024-09-16T00:59:44.831458+0000","last_clean":"2024-09-16T00:59:44.831458+0000","last_became_active":"2024-09-16T00:58:43.616029+0000","last_became_peered":"2024-09-16T00:58:43.616029+0000","last_unstale":"2024-09-16T00:59:44.831458+0000","last_undegraded":"2024-09-16T00:59:44.831458+0000","last_fullsized":"2024-09-16T00:59:44.831458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:54.776250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830978+0000","last_change":"2024-09-16T00:58:36.506625+0000","last_active":"2024-09-16T00:59:44.830978+0000","last_peered":"2024-09-16T00:59:44.830978+0000","last_clean":"2024-09-16T00:59:44.830978+0000","last_became_active":"2024-09-16T00:58:36.506337+0000","last_became_peered":"2024-09-16T00:58:36.506337+0000","last_unstale":"2024-09-16T00:59:44.830978+0000","last_undegraded":"2024-09-16T00:59:44.830978+0000","last_fullsized":"2024-09-16T00:59:44.830978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:22.080165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.095737+0000","last_change":"2024-09-16T00:58:34.831309+0000","last_active":"2024-09-16T00:59:45.095737+0000","last_peered":"2024-09-16T00:59:45.095737+0000","last_clean":"2024-09-16T00:59:45.095737+0000","last_became_active":"2024-09-16T00:58:34.830980+0000","last_became_peered":"2024-09-16T00:58:34.830980+0000","last_unstale":"2024-09-16T00:59:45.095737+0000","last_undegraded":"2024-09-16T00:59:45.095737+0000","last_fullsized":"2024-09-16T00:59:45.095737+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:30.405426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833939+0000","last_change":"2024-09-16T00:58:43.609399+0000","last_active":"2024-09-16T00:59:44.833939+0000","last_peered":"2024-09-16T00:59:44.833939+0000","last_clean":"2024-09-16T00:59:44.833939+0000","last_became_active":"2024-09-16T00:58:43.608988+0000","last_became_peered":"2024-09-16T00:58:43.608988+0000","last_unstale":"2024-09-16T00:59:44.833939+0000","last_undegraded":"2024-09-16T00:59:44.833939+0000","last_fullsized":"2024-09-16T00:59:44.833939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.500071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828572+0000","last_change":"2024-09-16T00:58:36.515930+0000","last_active":"2024-09-16T00:59:44.828572+0000","last_peered":"2024-09-16T00:59:44.828572+0000","last_clean":"2024-09-16T00:59:44.828572+0000","last_became_active":"2024-09-16T00:58:36.515625+0000","last_became_peered":"2024-09-16T00:58:36.515625+0000","last_unstale":"2024-09-16T00:59:44.828572+0000","last_undegraded":"2024-09-16T00:59:44.828572+0000","last_fullsized":"2024-09-16T00:59:44.828572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:55.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833776+0000","last_change":"2024-09-16T00:58:34.508686+0000","last_active":"2024-09-16T00:59:44.833776+0000","last_peered":"2024-09-16T00:59:44.833776+0000","last_clean":"2024-09-16T00:59:44.833776+0000","last_became_active":"2024-09-16T00:58:34.508284+0000","last_became_peered":"2024-09-16T00:58:34.508284+0000","last_unstale":"2024-09-16T00:59:44.833776+0000","last_undegraded":"2024-09-16T00:59:44.833776+0000","last_fullsized":"2024-09-16T00:59:44.833776+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:47.545949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833514+0000","last_change":"2024-09-16T00:58:43.615852+0000","last_active":"2024-09-16T00:59:44.833514+0000","last_peered":"2024-09-16T00:59:44.833514+0000","last_clean":"2024-09-16T00:59:44.833514+0000","last_became_active":"2024-09-16T00:58:43.615474+0000","last_became_peered":"2024-09-16T00:58:43.615474+0000","last_unstale":"2024-09-16T00:59:44.833514+0000","last_undegraded":"2024-09-16T00:59:44.833514+0000","last_fullsized":"2024-09-16T00:59:44.833514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:39.596924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833862+0000","last_change":"2024-09-16T00:58:36.513820+0000","last_active":"2024-09-16T00:59:44.833862+0000","last_peered":"2024-09-16T00:59:44.833862+0000","last_clean":"2024-09-16T00:59:44.833862+0000","last_became_active":"2024-09-16T00:58:36.513513+0000","last_became_peered":"2024-09-16T00:58:36.513513+0000","last_unstale":"2024-09-16T00:59:44.833862+0000","last_undegraded":"2024-09-16T00:59:44.833862+0000","last_fullsized":"2024-09-16T00:59:44.833862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:34.584214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'14","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831630+0000","last_change":"2024-09-16T00:58:34.462794+0000","last_active":"2024-09-16T00:59:44.831630+0000","last_peered":"2024-09-16T00:59:44.831630+0000","last_clean":"2024-09-16T00:59:44.831630+0000","last_became_active":"2024-09-16T00:58:34.462471+0000","last_became_peered":"2024-09-16T00:58:34.462471+0000","last_unstale":"2024-09-16T00:59:44.831630+0000","last_undegraded":"2024-09-16T00:59:44.831630+0000","last_fullsized":"2024-09-16T00:59:44.831630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:13.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832722+0000","last_change":"2024-09-16T00:58:43.607718+0000","last_active":"2024-09-16T00:59:44.832722+0000","last_peered":"2024-09-16T00:59:44.832722+0000","last_clean":"2024-09-16T00:59:44.832722+0000","last_became_active":"2024-09-16T00:58:43.607347+0000","last_became_peered":"2024-09-16T00:58:43.607347+0000","last_unstale":"2024-09-16T00:59:44.832722+0000","last_undegraded":"2024-09-16T00:59:44.832722+0000","last_fullsized":"2024-09-16T00:59:44.832722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:12.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862979+0000","last_change":"2024-09-16T00:58:36.507161+0000","last_active":"2024-09-16T00:59:44.862979+0000","last_peered":"2024-09-16T00:59:44.862979+0000","last_clean":"2024-09-16T00:59:44.862979+0000","last_became_active":"2024-09-16T00:58:36.504062+0000","last_became_peered":"2024-09-16T00:58:36.504062+0000","last_unstale":"2024-09-16T00:59:44.862979+0000","last_undegraded":"2024-09-16T00:59:44.862979+0000","last_fullsized":"2024-09-16T00:59:44.862979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831736+0000","last_change":"2024-09-16T00:58:34.829848+0000","last_active":"2024-09-16T00:59:44.831736+0000","last_peered":"2024-09-16T00:59:44.831736+0000","last_clean":"2024-09-16T00:59:44.831736+0000","last_became_active":"2024-09-16T00:58:34.829439+0000","last_became_peered":"2024-09-16T00:58:34.829439+0000","last_unstale":"2024-09-16T00:59:44.831736+0000","last_undegraded":"2024-09-16T00:59:44.831736+0000","last_fullsized":"2024-09-16T00:59:44.831736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:06.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829843+0000","last_change":"2024-09-16T00:58:43.618334+0000","last_active":"2024-09-16T00:59:44.829843+0000","last_peered":"2024-09-16T00:59:44.829843+0000","last_clean":"2024-09-16T00:59:44.829843+0000","last_became_active":"2024-09-16T00:58:43.617810+0000","last_became_peered":"2024-09-16T00:58:43.617810+0000","last_unstale":"2024-09-16T00:59:44.829843+0000","last_undegraded":"2024-09-16T00:59:44.829843+0000","last_fullsized":"2024-09-16T00:59:44.829843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:58.202973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829291+0000","last_change":"2024-09-16T00:58:36.509025+0000","last_active":"2024-09-16T00:59:44.829291+0000","last_peered":"2024-09-16T00:59:44.829291+0000","last_clean":"2024-09-16T00:59:44.829291+0000","last_became_active":"2024-09-16T00:58:36.508660+0000","last_became_peered":"2024-09-16T00:58:36.508660+0000","last_unstale":"2024-09-16T00:59:44.829291+0000","last_undegraded":"2024-09-16T00:59:44.829291+0000","last_fullsized":"2024-09-16T00:59:44.829291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:01.433486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831086+0000","last_change":"2024-09-16T00:58:34.829899+0000","last_active":"2024-09-16T00:59:44.831086+0000","last_peered":"2024-09-16T00:59:44.831086+0000","last_clean":"2024-09-16T00:59:44.831086+0000","last_became_active":"2024-09-16T00:58:34.829546+0000","last_became_peered":"2024-09-16T00:58:34.829546+0000","last_unstale":"2024-09-16T00:59:44.831086+0000","last_undegraded":"2024-09-16T00:59:44.831086+0000","last_fullsized":"2024-09-16T00:59:44.831086+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:21.253829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831350+0000","last_change":"2024-09-16T00:58:43.610143+0000","last_active":"2024-09-16T00:59:44.831350+0000","last_peered":"2024-09-16T00:59:44.831350+0000","last_clean":"2024-09-16T00:59:44.831350+0000","last_became_active":"2024-09-16T00:58:43.609739+0000","last_became_peered":"2024-09-16T00:58:43.609739+0000","last_unstale":"2024-09-16T00:59:44.831350+0000","last_undegraded":"2024-09-16T00:59:44.831350+0000","last_fullsized":"2024-09-16T00:59:44.831350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:28.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829372+0000","last_change":"2024-09-16T00:58:36.520423+0000","last_active":"2024-09-16T00:59:44.829372+0000","last_peered":"2024-09-16T00:59:44.829372+0000","last_clean":"2024-09-16T00:59:44.829372+0000","last_became_active":"2024-09-16T00:58:36.520117+0000","last_became_peered":"2024-09-16T00:58:36.520117+0000","last_unstale":"2024-09-16T00:59:44.829372+0000","last_undegraded":"2024-09-16T00:59:44.829372+0000","last_fullsized":"2024-09-16T00:59:44.829372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.652142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":93,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:14.875497+0000","last_change":"2024-09-16T00:58:34.475161+0000","last_active":"2024-09-16T01:00:14.875497+0000","last_peered":"2024-09-16T01:00:14.875497+0000","last_clean":"2024-09-16T01:00:14.875497+0000","last_became_active":"2024-09-16T00:58:34.474755+0000","last_became_peered":"2024-09-16T00:58:34.474755+0000","last_unstale":"2024-09-16T01:00:14.875497+0000","last_undegraded":"2024-09-16T01:00:14.875497+0000","last_fullsized":"2024-09-16T01:00:14.875497+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:12.884466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862825+0000","last_change":"2024-09-16T00:58:43.609042+0000","last_active":"2024-09-16T00:59:44.862825+0000","last_peered":"2024-09-16T00:59:44.862825+0000","last_clean":"2024-09-16T00:59:44.862825+0000","last_became_active":"2024-09-16T00:58:43.608596+0000","last_became_peered":"2024-09-16T00:58:43.608596+0000","last_unstale":"2024-09-16T00:59:44.862825+0000","last_undegraded":"2024-09-16T00:59:44.862825+0000","last_fullsized":"2024-09-16T00:59:44.862825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:47.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.838583+0000","last_change":"2024-09-16T00:59:44.838583+0000","last_active":"2024-09-16T00:59:44.838583+0000","last_peered":"2024-09-16T00:59:44.838583+0000","last_clean":"2024-09-16T00:59:44.838583+0000","last_became_active":"2024-09-16T00:59:44.838221+0000","last_became_peered":"2024-09-16T00:59:44.838221+0000","last_unstale":"2024-09-16T00:59:44.838583+0000","last_undegraded":"2024-09-16T00:59:44.838583+0000","last_fullsized":"2024-09-16T00:59:44.838583+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:27.562118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":92,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:12.664961+0000","last_change":"2024-09-16T00:58:34.829452+0000","last_active":"2024-09-16T01:00:12.664961+0000","last_peered":"2024-09-16T01:00:12.664961+0000","last_clean":"2024-09-16T01:00:12.664961+0000","last_became_active":"2024-09-16T00:58:34.829129+0000","last_became_peered":"2024-09-16T00:58:34.829129+0000","last_unstale":"2024-09-16T01:00:12.664961+0000","last_undegraded":"2024-09-16T01:00:12.664961+0000","last_fullsized":"2024-09-16T01:00:12.664961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.863071+0000","last_change":"2024-09-16T00:58:43.609230+0000","last_active":"2024-09-16T00:59:44.863071+0000","last_peered":"2024-09-16T00:59:44.863071+0000","last_clean":"2024-09-16T00:59:44.863071+0000","last_became_active":"2024-09-16T00:58:43.608879+0000","last_became_peered":"2024-09-16T00:58:43.608879+0000","last_unstale":"2024-09-16T00:59:44.863071+0000","last_undegraded":"2024-09-16T00:59:44.863071+0000","last_fullsized":"2024-09-16T00:59:44.863071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.112878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862250+0000","last_change":"2024-09-16T00:58:36.503412+0000","last_active":"2024-09-16T00:59:44.862250+0000","last_peered":"2024-09-16T00:59:44.862250+0000","last_clean":"2024-09-16T00:59:44.862250+0000","last_became_active":"2024-09-16T00:58:36.503043+0000","last_became_peered":"2024-09-16T00:58:36.503043+0000","last_unstale":"2024-09-16T00:59:44.862250+0000","last_undegraded":"2024-09-16T00:59:44.862250+0000","last_fullsized":"2024-09-16T00:59:44.862250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:18.495669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832541+0000","last_change":"2024-09-16T00:58:34.468460+0000","last_active":"2024-09-16T00:59:44.832541+0000","last_peered":"2024-09-16T00:59:44.832541+0000","last_clean":"2024-09-16T00:59:44.832541+0000","last_became_active":"2024-09-16T00:58:34.468104+0000","last_became_peered":"2024-09-16T00:58:34.468104+0000","last_unstale":"2024-09-16T00:59:44.832541+0000","last_undegraded":"2024-09-16T00:59:44.832541+0000","last_fullsized":"2024-09-16T00:59:44.832541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:13.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.864073+0000","last_change":"2024-09-16T00:59:44.863609+0000","last_active":"2024-09-16T00:59:44.864073+0000","last_peered":"2024-09-16T00:59:44.864073+0000","last_clean":"2024-09-16T00:59:44.864073+0000","last_became_active":"2024-09-16T00:59:44.863152+0000","last_became_peered":"2024-09-16T00:59:44.863152+0000","last_unstale":"2024-09-16T00:59:44.864073+0000","last_undegraded":"2024-09-16T00:59:44.864073+0000","last_fullsized":"2024-09-16T00:59:44.864073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:51.312612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833323+0000","last_change":"2024-09-16T00:58:36.509749+0000","last_active":"2024-09-16T00:59:44.833323+0000","last_peered":"2024-09-16T00:59:44.833323+0000","last_clean":"2024-09-16T00:59:44.833323+0000","last_became_active":"2024-09-16T00:58:36.509411+0000","last_became_peered":"2024-09-16T00:58:36.509411+0000","last_unstale":"2024-09-16T00:59:44.833323+0000","last_undegraded":"2024-09-16T00:59:44.833323+0000","last_fullsized":"2024-09-16T00:59:44.833323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:14.291956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833745+0000","last_change":"2024-09-16T00:58:34.470190+0000","last_active":"2024-09-16T00:59:44.833745+0000","last_peered":"2024-09-16T00:59:44.833745+0000","last_clean":"2024-09-16T00:59:44.833745+0000","last_became_active":"2024-09-16T00:58:34.469832+0000","last_became_peered":"2024-09-16T00:58:34.469832+0000","last_unstale":"2024-09-16T00:59:44.833745+0000","last_undegraded":"2024-09-16T00:59:44.833745+0000","last_fullsized":"2024-09-16T00:59:44.833745+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:03.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":346,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834120+0000","last_change":"2024-09-16T00:57:23.502001+0000","last_active":"2024-09-16T00:59:44.834120+0000","last_peered":"2024-09-16T00:59:44.834120+0000","last_clean":"2024-09-16T00:59:44.834120+0000","last_became_active":"2024-09-16T00:57:23.501465+0000","last_became_peered":"2024-09-16T00:57:23.501465+0000","last_unstale":"2024-09-16T00:59:44.834120+0000","last_undegraded":"2024-09-16T00:59:44.834120+0000","last_fullsized":"2024-09-16T00:59:44.834120+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_clean_scrub_stamp":"2024-09-16T00:53:57.344038+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:22.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833406+0000","last_change":"2024-09-16T00:58:43.609572+0000","last_active":"2024-09-16T00:59:44.833406+0000","last_peered":"2024-09-16T00:59:44.833406+0000","last_clean":"2024-09-16T00:59:44.833406+0000","last_became_active":"2024-09-16T00:58:43.609185+0000","last_became_peered":"2024-09-16T00:58:43.609185+0000","last_unstale":"2024-09-16T00:59:44.833406+0000","last_undegraded":"2024-09-16T00:59:44.833406+0000","last_fullsized":"2024-09-16T00:59:44.833406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.199976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833834+0000","last_change":"2024-09-16T00:58:36.510761+0000","last_active":"2024-09-16T00:59:44.833834+0000","last_peered":"2024-09-16T00:59:44.833834+0000","last_clean":"2024-09-16T00:59:44.833834+0000","last_became_active":"2024-09-16T00:58:36.510456+0000","last_became_peered":"2024-09-16T00:58:36.510456+0000","last_unstale":"2024-09-16T00:59:44.833834+0000","last_undegraded":"2024-09-16T00:59:44.833834+0000","last_fullsized":"2024-09-16T00:59:44.833834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:02.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":99,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:15.659042+0000","last_change":"2024-09-16T00:58:34.830238+0000","last_active":"2024-09-16T01:00:15.659042+0000","last_peered":"2024-09-16T01:00:15.659042+0000","last_clean":"2024-09-16T01:00:15.659042+0000","last_became_active":"2024-09-16T00:58:34.829558+0000","last_became_peered":"2024-09-16T00:58:34.829558+0000","last_unstale":"2024-09-16T01:00:15.659042+0000","last_undegraded":"2024-09-16T01:00:15.659042+0000","last_fullsized":"2024-09-16T01:00:15.659042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.347122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.095766+0000","last_change":"2024-09-16T00:58:43.613179+0000","last_active":"2024-09-16T00:59:45.095766+0000","last_peered":"2024-09-16T00:59:45.095766+0000","last_clean":"2024-09-16T00:59:45.095766+0000","last_became_active":"2024-09-16T00:58:43.612794+0000","last_became_peered":"2024-09-16T00:58:43.612794+0000","last_unstale":"2024-09-16T00:59:45.095766+0000","last_undegraded":"2024-09-16T00:59:45.095766+0000","last_fullsized":"2024-09-16T00:59:45.095766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:04:24.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833228+0000","last_change":"2024-09-16T00:58:36.512600+0000","last_active":"2024-09-16T00:59:44.833228+0000","last_peered":"2024-09-16T00:59:44.833228+0000","last_clean":"2024-09-16T00:59:44.833228+0000","last_became_active":"2024-09-16T00:58:36.512309+0000","last_became_peered":"2024-09-16T00:58:36.512309+0000","last_unstale":"2024-09-16T00:59:44.833228+0000","last_undegraded":"2024-09-16T00:59:44.833228+0000","last_fullsized":"2024-09-16T00:59:44.833228+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.790755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.836569+0000","last_change":"2024-09-16T00:58:34.471787+0000","last_active":"2024-09-16T00:59:44.836569+0000","last_peered":"2024-09-16T00:59:44.836569+0000","last_clean":"2024-09-16T00:59:44.836569+0000","last_became_active":"2024-09-16T00:58:34.471119+0000","last_became_peered":"2024-09-16T00:58:34.471119+0000","last_unstale":"2024-09-16T00:59:44.836569+0000","last_undegraded":"2024-09-16T00:59:44.836569+0000","last_fullsized":"2024-09-16T00:59:44.836569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:26.121669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828655+0000","last_change":"2024-09-16T00:58:43.609676+0000","last_active":"2024-09-16T00:59:44.828655+0000","last_peered":"2024-09-16T00:59:44.828655+0000","last_clean":"2024-09-16T00:59:44.828655+0000","last_became_active":"2024-09-16T00:58:43.609313+0000","last_became_peered":"2024-09-16T00:58:43.609313+0000","last_unstale":"2024-09-16T00:59:44.828655+0000","last_undegraded":"2024-09-16T00:59:44.828655+0000","last_fullsized":"2024-09-16T00:59:44.828655+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:53.339070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833389+0000","last_change":"2024-09-16T00:58:36.514621+0000","last_active":"2024-09-16T00:59:44.833389+0000","last_peered":"2024-09-16T00:59:44.833389+0000","last_clean":"2024-09-16T00:59:44.833389+0000","last_became_active":"2024-09-16T00:58:36.514259+0000","last_became_peered":"2024-09-16T00:58:36.514259+0000","last_unstale":"2024-09-16T00:59:44.833389+0000","last_undegraded":"2024-09-16T00:59:44.833389+0000","last_fullsized":"2024-09-16T00:59:44.833389+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:11.411742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.863077+0000","last_change":"2024-09-16T00:58:34.470512+0000","last_active":"2024-09-16T00:59:44.863077+0000","last_peered":"2024-09-16T00:59:44.863077+0000","last_clean":"2024-09-16T00:59:44.863077+0000","last_became_active":"2024-09-16T00:58:34.470140+0000","last_became_peered":"2024-09-16T00:58:34.470140+0000","last_unstale":"2024-09-16T00:59:44.863077+0000","last_undegraded":"2024-09-16T00:59:44.863077+0000","last_fullsized":"2024-09-16T00:59:44.863077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:04.068901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835631+0000","last_change":"2024-09-16T00:58:43.615221+0000","last_active":"2024-09-16T00:59:44.835631+0000","last_peered":"2024-09-16T00:59:44.835631+0000","last_clean":"2024-09-16T00:59:44.835631+0000","last_became_active":"2024-09-16T00:58:43.614820+0000","last_became_peered":"2024-09-16T00:58:43.614820+0000","last_unstale":"2024-09-16T00:59:44.835631+0000","last_undegraded":"2024-09-16T00:59:44.835631+0000","last_fullsized":"2024-09-16T00:59:44.835631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:31.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830458+0000","last_change":"2024-09-16T00:58:36.515470+0000","last_active":"2024-09-16T00:59:44.830458+0000","last_peered":"2024-09-16T00:59:44.830458+0000","last_clean":"2024-09-16T00:59:44.830458+0000","last_became_active":"2024-09-16T00:58:36.515145+0000","last_became_peered":"2024-09-16T00:58:36.515145+0000","last_unstale":"2024-09-16T00:59:44.830458+0000","last_undegraded":"2024-09-16T00:59:44.830458+0000","last_fullsized":"2024-09-16T00:59:44.830458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:10.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832581+0000","last_change":"2024-09-16T00:58:34.464865+0000","last_active":"2024-09-16T00:59:44.832581+0000","last_peered":"2024-09-16T00:59:44.832581+0000","last_clean":"2024-09-16T00:59:44.832581+0000","last_became_active":"2024-09-16T00:58:34.464448+0000","last_became_peered":"2024-09-16T00:58:34.464448+0000","last_unstale":"2024-09-16T00:59:44.832581+0000","last_undegraded":"2024-09-16T00:59:44.832581+0000","last_fullsized":"2024-09-16T00:59:44.832581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:47.454251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835500+0000","last_change":"2024-09-16T00:58:43.610348+0000","last_active":"2024-09-16T00:59:44.835500+0000","last_peered":"2024-09-16T00:59:44.835500+0000","last_clean":"2024-09-16T00:59:44.835500+0000","last_became_active":"2024-09-16T00:58:43.609497+0000","last_became_peered":"2024-09-16T00:58:43.609497+0000","last_unstale":"2024-09-16T00:59:44.835500+0000","last_undegraded":"2024-09-16T00:59:44.835500+0000","last_fullsized":"2024-09-16T00:59:44.835500+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:52.931325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835647+0000","last_change":"2024-09-16T00:58:36.517412+0000","last_active":"2024-09-16T00:59:44.835647+0000","last_peered":"2024-09-16T00:59:44.835647+0000","last_clean":"2024-09-16T00:59:44.835647+0000","last_became_active":"2024-09-16T00:58:36.516600+0000","last_became_peered":"2024-09-16T00:58:36.516600+0000","last_unstale":"2024-09-16T00:59:44.835647+0000","last_undegraded":"2024-09-16T00:59:44.835647+0000","last_fullsized":"2024-09-16T00:59:44.835647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:39.445454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831042+0000","last_change":"2024-09-16T00:58:34.831420+0000","last_active":"2024-09-16T00:59:44.831042+0000","last_peered":"2024-09-16T00:59:44.831042+0000","last_clean":"2024-09-16T00:59:44.831042+0000","last_became_active":"2024-09-16T00:58:34.830991+0000","last_became_peered":"2024-09-16T00:58:34.830991+0000","last_unstale":"2024-09-16T00:59:44.831042+0000","last_undegraded":"2024-09-16T00:59:44.831042+0000","last_fullsized":"2024-09-16T00:59:44.831042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:13.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.863007+0000","last_change":"2024-09-16T00:58:43.611781+0000","last_active":"2024-09-16T00:59:44.863007+0000","last_peered":"2024-09-16T00:59:44.863007+0000","last_clean":"2024-09-16T00:59:44.863007+0000","last_became_active":"2024-09-16T00:58:43.610332+0000","last_became_peered":"2024-09-16T00:58:43.610332+0000","last_unstale":"2024-09-16T00:59:44.863007+0000","last_undegraded":"2024-09-16T00:59:44.863007+0000","last_fullsized":"2024-09-16T00:59:44.863007+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:18.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832394+0000","last_change":"2024-09-16T00:58:36.514395+0000","last_active":"2024-09-16T00:59:44.832394+0000","last_peered":"2024-09-16T00:59:44.832394+0000","last_clean":"2024-09-16T00:59:44.832394+0000","last_became_active":"2024-09-16T00:58:36.513570+0000","last_became_peered":"2024-09-16T00:58:36.513570+0000","last_unstale":"2024-09-16T00:59:44.832394+0000","last_undegraded":"2024-09-16T00:59:44.832394+0000","last_fullsized":"2024-09-16T00:59:44.832394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:56.148815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":93,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:11.664197+0000","last_change":"2024-09-16T00:58:34.473583+0000","last_active":"2024-09-16T01:00:11.664197+0000","last_peered":"2024-09-16T01:00:11.664197+0000","last_clean":"2024-09-16T01:00:11.664197+0000","last_became_active":"2024-09-16T00:58:34.473259+0000","last_became_peered":"2024-09-16T00:58:34.473259+0000","last_unstale":"2024-09-16T01:00:11.664197+0000","last_undegraded":"2024-09-16T01:00:11.664197+0000","last_fullsized":"2024-09-16T01:00:11.664197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:55.622609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.836049+0000","last_change":"2024-09-16T00:59:44.835446+0000","last_active":"2024-09-16T00:59:44.836049+0000","last_peered":"2024-09-16T00:59:44.836049+0000","last_clean":"2024-09-16T00:59:44.836049+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T00:59:44.836049+0000","last_undegraded":"2024-09-16T00:59:44.836049+0000","last_fullsized":"2024-09-16T00:59:44.836049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:41.254621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.863645+0000","last_change":"2024-09-16T00:59:44.863645+0000","last_active":"2024-09-16T00:59:44.863645+0000","last_peered":"2024-09-16T00:59:44.863645+0000","last_clean":"2024-09-16T00:59:44.863645+0000","last_became_active":"2024-09-16T00:59:44.863207+0000","last_became_peered":"2024-09-16T00:59:44.863207+0000","last_unstale":"2024-09-16T00:59:44.863645+0000","last_undegraded":"2024-09-16T00:59:44.863645+0000","last_fullsized":"2024-09-16T00:59:44.863645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:27.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835817+0000","last_change":"2024-09-16T00:58:34.470326+0000","last_active":"2024-09-16T00:59:44.835817+0000","last_peered":"2024-09-16T00:59:44.835817+0000","last_clean":"2024-09-16T00:59:44.835817+0000","last_became_active":"2024-09-16T00:58:34.469920+0000","last_became_peered":"2024-09-16T00:58:34.469920+0000","last_unstale":"2024-09-16T00:59:44.835817+0000","last_undegraded":"2024-09-16T00:59:44.835817+0000","last_fullsized":"2024-09-16T00:59:44.835817+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:58.718004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830095+0000","last_change":"2024-09-16T00:58:43.616324+0000","last_active":"2024-09-16T00:59:44.830095+0000","last_peered":"2024-09-16T00:59:44.830095+0000","last_clean":"2024-09-16T00:59:44.830095+0000","last_became_active":"2024-09-16T00:58:43.615903+0000","last_became_peered":"2024-09-16T00:58:43.615903+0000","last_unstale":"2024-09-16T00:59:44.830095+0000","last_undegraded":"2024-09-16T00:59:44.830095+0000","last_fullsized":"2024-09-16T00:59:44.830095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.683788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862525+0000","last_change":"2024-09-16T00:58:36.512490+0000","last_active":"2024-09-16T00:59:44.862525+0000","last_peered":"2024-09-16T00:59:44.862525+0000","last_clean":"2024-09-16T00:59:44.862525+0000","last_became_active":"2024-09-16T00:58:36.512167+0000","last_became_peered":"2024-09-16T00:58:36.512167+0000","last_unstale":"2024-09-16T00:59:44.862525+0000","last_undegraded":"2024-09-16T00:59:44.862525+0000","last_fullsized":"2024-09-16T00:59:44.862525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834025+0000","last_change":"2024-09-16T00:58:34.471603+0000","last_active":"2024-09-16T00:59:44.834025+0000","last_peered":"2024-09-16T00:59:44.834025+0000","last_clean":"2024-09-16T00:59:44.834025+0000","last_became_active":"2024-09-16T00:58:34.471241+0000","last_became_peered":"2024-09-16T00:58:34.471241+0000","last_unstale":"2024-09-16T00:59:44.834025+0000","last_undegraded":"2024-09-16T00:59:44.834025+0000","last_fullsized":"2024-09-16T00:59:44.834025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:33.756759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835898+0000","last_change":"2024-09-16T00:58:43.607428+0000","last_active":"2024-09-16T00:59:44.835898+0000","last_peered":"2024-09-16T00:59:44.835898+0000","last_clean":"2024-09-16T00:59:44.835898+0000","last_became_active":"2024-09-16T00:58:43.606990+0000","last_became_peered":"2024-09-16T00:58:43.606990+0000","last_unstale":"2024-09-16T00:59:44.835898+0000","last_undegraded":"2024-09-16T00:59:44.835898+0000","last_fullsized":"2024-09-16T00:59:44.835898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:52.367384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831440+0000","last_change":"2024-09-16T00:58:36.513967+0000","last_active":"2024-09-16T00:59:44.831440+0000","last_peered":"2024-09-16T00:59:44.831440+0000","last_clean":"2024-09-16T00:59:44.831440+0000","last_became_active":"2024-09-16T00:58:36.513610+0000","last_became_peered":"2024-09-16T00:58:36.513610+0000","last_unstale":"2024-09-16T00:59:44.831440+0000","last_undegraded":"2024-09-16T00:59:44.831440+0000","last_fullsized":"2024-09-16T00:59:44.831440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:22.763430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":183,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:13.655363+0000","last_change":"2024-09-16T00:58:34.471511+0000","last_active":"2024-09-16T01:00:13.655363+0000","last_peered":"2024-09-16T01:00:13.655363+0000","last_clean":"2024-09-16T01:00:13.655363+0000","last_became_active":"2024-09-16T00:58:34.470597+0000","last_became_peered":"2024-09-16T00:58:34.470597+0000","last_unstale":"2024-09-16T01:00:13.655363+0000","last_undegraded":"2024-09-16T01:00:13.655363+0000","last_fullsized":"2024-09-16T01:00:13.655363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.782592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63484,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":119,"num_write":37,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830877+0000","last_change":"2024-09-16T00:58:43.612177+0000","last_active":"2024-09-16T00:59:44.830877+0000","last_peered":"2024-09-16T00:59:44.830877+0000","last_clean":"2024-09-16T00:59:44.830877+0000","last_became_active":"2024-09-16T00:58:43.611801+0000","last_became_peered":"2024-09-16T00:58:43.611801+0000","last_unstale":"2024-09-16T00:59:44.830877+0000","last_undegraded":"2024-09-16T00:59:44.830877+0000","last_fullsized":"2024-09-16T00:59:44.830877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.781429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.096086+0000","last_change":"2024-09-16T00:58:36.502231+0000","last_active":"2024-09-16T00:59:45.096086+0000","last_peered":"2024-09-16T00:59:45.096086+0000","last_clean":"2024-09-16T00:59:45.096086+0000","last_became_active":"2024-09-16T00:58:36.501934+0000","last_became_peered":"2024-09-16T00:58:36.501934+0000","last_unstale":"2024-09-16T00:59:45.096086+0000","last_undegraded":"2024-09-16T00:59:45.096086+0000","last_fullsized":"2024-09-16T00:59:45.096086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:29.769186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.836470+0000","last_change":"2024-09-16T00:58:34.829872+0000","last_active":"2024-09-16T00:59:44.836470+0000","last_peered":"2024-09-16T00:59:44.836470+0000","last_clean":"2024-09-16T00:59:44.836470+0000","last_became_active":"2024-09-16T00:58:34.829496+0000","last_became_peered":"2024-09-16T00:58:34.829496+0000","last_unstale":"2024-09-16T00:59:44.836470+0000","last_undegraded":"2024-09-16T00:59:44.836470+0000","last_fullsized":"2024-09-16T00:59:44.836470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:47.035177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833562+0000","last_change":"2024-09-16T00:58:43.615560+0000","last_active":"2024-09-16T00:59:44.833562+0000","last_peered":"2024-09-16T00:59:44.833562+0000","last_clean":"2024-09-16T00:59:44.833562+0000","last_became_active":"2024-09-16T00:58:43.615124+0000","last_became_peered":"2024-09-16T00:58:43.615124+0000","last_unstale":"2024-09-16T00:59:44.833562+0000","last_undegraded":"2024-09-16T00:59:44.833562+0000","last_fullsized":"2024-09-16T00:59:44.833562+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.455528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829190+0000","last_change":"2024-09-16T00:58:36.514456+0000","last_active":"2024-09-16T00:59:44.829190+0000","last_peered":"2024-09-16T00:59:44.829190+0000","last_clean":"2024-09-16T00:59:44.829190+0000","last_became_active":"2024-09-16T00:58:36.514146+0000","last_became_peered":"2024-09-16T00:58:36.514146+0000","last_unstale":"2024-09-16T00:59:44.829190+0000","last_undegraded":"2024-09-16T00:59:44.829190+0000","last_fullsized":"2024-09-16T00:59:44.829190+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:06.760121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833531+0000","last_change":"2024-09-16T00:58:34.471316+0000","last_active":"2024-09-16T00:59:44.833531+0000","last_peered":"2024-09-16T00:59:44.833531+0000","last_clean":"2024-09-16T00:59:44.833531+0000","last_became_active":"2024-09-16T00:58:34.470991+0000","last_became_peered":"2024-09-16T00:58:34.470991+0000","last_unstale":"2024-09-16T00:59:44.833531+0000","last_undegraded":"2024-09-16T00:59:44.833531+0000","last_fullsized":"2024-09-16T00:59:44.833531+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:44.492439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831061+0000","last_change":"2024-09-16T00:58:43.617202+0000","last_active":"2024-09-16T00:59:44.831061+0000","last_peered":"2024-09-16T00:59:44.831061+0000","last_clean":"2024-09-16T00:59:44.831061+0000","last_became_active":"2024-09-16T00:58:43.616824+0000","last_became_peered":"2024-09-16T00:58:43.616824+0000","last_unstale":"2024-09-16T00:59:44.831061+0000","last_undegraded":"2024-09-16T00:59:44.831061+0000","last_fullsized":"2024-09-16T00:59:44.831061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:43.035003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.096268+0000","last_change":"2024-09-16T00:58:36.512079+0000","last_active":"2024-09-16T00:59:45.096268+0000","last_peered":"2024-09-16T00:59:45.096268+0000","last_clean":"2024-09-16T00:59:45.096268+0000","last_became_active":"2024-09-16T00:58:36.511220+0000","last_became_peered":"2024-09-16T00:58:36.511220+0000","last_unstale":"2024-09-16T00:59:45.096268+0000","last_undegraded":"2024-09-16T00:59:45.096268+0000","last_fullsized":"2024-09-16T00:59:45.096268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:49.798132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:13.655312+0000","last_change":"2024-09-16T00:58:34.470682+0000","last_active":"2024-09-16T01:00:13.655312+0000","last_peered":"2024-09-16T01:00:13.655312+0000","last_clean":"2024-09-16T01:00:13.655312+0000","last_became_active":"2024-09-16T00:58:34.470323+0000","last_became_peered":"2024-09-16T00:58:34.470323+0000","last_unstale":"2024-09-16T01:00:13.655312+0000","last_undegraded":"2024-09-16T01:00:13.655312+0000","last_fullsized":"2024-09-16T01:00:13.655312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.361374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833027+0000","last_change":"2024-09-16T00:58:43.608941+0000","last_active":"2024-09-16T00:59:44.833027+0000","last_peered":"2024-09-16T00:59:44.833027+0000","last_clean":"2024-09-16T00:59:44.833027+0000","last_became_active":"2024-09-16T00:58:43.607406+0000","last_became_peered":"2024-09-16T00:58:43.607406+0000","last_unstale":"2024-09-16T00:59:44.833027+0000","last_undegraded":"2024-09-16T00:59:44.833027+0000","last_fullsized":"2024-09-16T00:59:44.833027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:10.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828419+0000","last_change":"2024-09-16T00:58:43.613902+0000","last_active":"2024-09-16T00:59:44.828419+0000","last_peered":"2024-09-16T00:59:44.828419+0000","last_clean":"2024-09-16T00:59:44.828419+0000","last_became_active":"2024-09-16T00:58:43.613530+0000","last_became_peered":"2024-09-16T00:58:43.613530+0000","last_unstale":"2024-09-16T00:59:44.828419+0000","last_undegraded":"2024-09-16T00:59:44.828419+0000","last_fullsized":"2024-09-16T00:59:44.828419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:34.774810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830714+0000","last_change":"2024-09-16T00:58:36.504745+0000","last_active":"2024-09-16T00:59:44.830714+0000","last_peered":"2024-09-16T00:59:44.830714+0000","last_clean":"2024-09-16T00:59:44.830714+0000","last_became_active":"2024-09-16T00:58:36.504400+0000","last_became_peered":"2024-09-16T00:58:36.504400+0000","last_unstale":"2024-09-16T00:59:44.830714+0000","last_undegraded":"2024-09-16T00:59:44.830714+0000","last_fullsized":"2024-09-16T00:59:44.830714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:34.444019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.836025+0000","last_change":"2024-09-16T00:58:34.470285+0000","last_active":"2024-09-16T00:59:44.836025+0000","last_peered":"2024-09-16T00:59:44.836025+0000","last_clean":"2024-09-16T00:59:44.836025+0000","last_became_active":"2024-09-16T00:58:34.469948+0000","last_became_peered":"2024-09-16T00:58:34.469948+0000","last_unstale":"2024-09-16T00:59:44.836025+0000","last_undegraded":"2024-09-16T00:59:44.836025+0000","last_fullsized":"2024-09-16T00:59:44.836025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:28.553863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830158+0000","last_change":"2024-09-16T00:58:43.614818+0000","last_active":"2024-09-16T00:59:44.830158+0000","last_peered":"2024-09-16T00:59:44.830158+0000","last_clean":"2024-09-16T00:59:44.830158+0000","last_became_active":"2024-09-16T00:58:43.614376+0000","last_became_peered":"2024-09-16T00:58:43.614376+0000","last_unstale":"2024-09-16T00:59:44.830158+0000","last_undegraded":"2024-09-16T00:59:44.830158+0000","last_fullsized":"2024-09-16T00:59:44.830158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:41.699930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832932+0000","last_change":"2024-09-16T00:58:36.505127+0000","last_active":"2024-09-16T00:59:44.832932+0000","last_peered":"2024-09-16T00:59:44.832932+0000","last_clean":"2024-09-16T00:59:44.832932+0000","last_became_active":"2024-09-16T00:58:36.504552+0000","last_became_peered":"2024-09-16T00:58:36.504552+0000","last_unstale":"2024-09-16T00:59:44.832932+0000","last_undegraded":"2024-09-16T00:59:44.832932+0000","last_fullsized":"2024-09-16T00:59:44.832932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:48.104109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862357+0000","last_change":"2024-09-16T00:58:34.462231+0000","last_active":"2024-09-16T00:59:44.862357+0000","last_peered":"2024-09-16T00:59:44.862357+0000","last_clean":"2024-09-16T00:59:44.862357+0000","last_became_active":"2024-09-16T00:58:34.461891+0000","last_became_peered":"2024-09-16T00:58:34.461891+0000","last_unstale":"2024-09-16T00:59:44.862357+0000","last_undegraded":"2024-09-16T00:59:44.862357+0000","last_fullsized":"2024-09-16T00:59:44.862357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.483996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829229+0000","last_change":"2024-09-16T00:58:34.472457+0000","last_active":"2024-09-16T00:59:44.829229+0000","last_peered":"2024-09-16T00:59:44.829229+0000","last_clean":"2024-09-16T00:59:44.829229+0000","last_became_active":"2024-09-16T00:58:34.472084+0000","last_became_peered":"2024-09-16T00:58:34.472084+0000","last_unstale":"2024-09-16T00:59:44.829229+0000","last_undegraded":"2024-09-16T00:59:44.829229+0000","last_fullsized":"2024-09-16T00:59:44.829229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:08.005195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835940+0000","last_change":"2024-09-16T00:58:36.508791+0000","last_active":"2024-09-16T00:59:44.835940+0000","last_peered":"2024-09-16T00:59:44.835940+0000","last_clean":"2024-09-16T00:59:44.835940+0000","last_became_active":"2024-09-16T00:58:36.508461+0000","last_became_peered":"2024-09-16T00:58:36.508461+0000","last_unstale":"2024-09-16T00:59:44.835940+0000","last_undegraded":"2024-09-16T00:59:44.835940+0000","last_fullsized":"2024-09-16T00:59:44.835940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.938067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834089+0000","last_change":"2024-09-16T00:58:43.620439+0000","last_active":"2024-09-16T00:59:44.834089+0000","last_peered":"2024-09-16T00:59:44.834089+0000","last_clean":"2024-09-16T00:59:44.834089+0000","last_became_active":"2024-09-16T00:58:43.619952+0000","last_became_peered":"2024-09-16T00:58:43.619952+0000","last_unstale":"2024-09-16T00:59:44.834089+0000","last_undegraded":"2024-09-16T00:59:44.834089+0000","last_fullsized":"2024-09-16T00:59:44.834089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":92,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:00:10.651487+0000","last_change":"2024-09-16T00:58:34.473169+0000","last_active":"2024-09-16T01:00:10.651487+0000","last_peered":"2024-09-16T01:00:10.651487+0000","last_clean":"2024-09-16T01:00:10.651487+0000","last_became_active":"2024-09-16T00:58:34.472839+0000","last_became_peered":"2024-09-16T00:58:34.472839+0000","last_unstale":"2024-09-16T01:00:10.651487+0000","last_undegraded":"2024-09-16T01:00:10.651487+0000","last_fullsized":"2024-09-16T01:00:10.651487+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:03.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832395+0000","last_change":"2024-09-16T00:58:36.508719+0000","last_active":"2024-09-16T00:59:44.832395+0000","last_peered":"2024-09-16T00:59:44.832395+0000","last_clean":"2024-09-16T00:59:44.832395+0000","last_became_active":"2024-09-16T00:58:36.508427+0000","last_became_peered":"2024-09-16T00:58:36.508427+0000","last_unstale":"2024-09-16T00:59:44.832395+0000","last_undegraded":"2024-09-16T00:59:44.832395+0000","last_fullsized":"2024-09-16T00:59:44.832395+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:44.134558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834157+0000","last_change":"2024-09-16T00:58:43.616532+0000","last_active":"2024-09-16T00:59:44.834157+0000","last_peered":"2024-09-16T00:59:44.834157+0000","last_clean":"2024-09-16T00:59:44.834157+0000","last_became_active":"2024-09-16T00:58:43.616146+0000","last_became_peered":"2024-09-16T00:58:43.616146+0000","last_unstale":"2024-09-16T00:59:44.834157+0000","last_undegraded":"2024-09-16T00:59:44.834157+0000","last_fullsized":"2024-09-16T00:59:44.834157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:50.904766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829603+0000","last_change":"2024-09-16T00:58:36.513232+0000","last_active":"2024-09-16T00:59:44.829603+0000","last_peered":"2024-09-16T00:59:44.829603+0000","last_clean":"2024-09-16T00:59:44.829603+0000","last_became_active":"2024-09-16T00:58:36.512239+0000","last_became_peered":"2024-09-16T00:58:36.512239+0000","last_unstale":"2024-09-16T00:59:44.829603+0000","last_undegraded":"2024-09-16T00:59:44.829603+0000","last_fullsized":"2024-09-16T00:59:44.829603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833739+0000","last_change":"2024-09-16T00:58:36.513160+0000","last_active":"2024-09-16T00:59:44.833739+0000","last_peered":"2024-09-16T00:59:44.833739+0000","last_clean":"2024-09-16T00:59:44.833739+0000","last_became_active":"2024-09-16T00:58:36.512523+0000","last_became_peered":"2024-09-16T00:58:36.512523+0000","last_unstale":"2024-09-16T00:59:44.833739+0000","last_undegraded":"2024-09-16T00:59:44.833739+0000","last_fullsized":"2024-09-16T00:59:44.833739+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:20.934937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833294+0000","last_change":"2024-09-16T00:58:36.516416+0000","last_active":"2024-09-16T00:59:44.833294+0000","last_peered":"2024-09-16T00:59:44.833294+0000","last_clean":"2024-09-16T00:59:44.833294+0000","last_became_active":"2024-09-16T00:58:36.516121+0000","last_became_peered":"2024-09-16T00:58:36.516121+0000","last_unstale":"2024-09-16T00:59:44.833294+0000","last_undegraded":"2024-09-16T00:59:44.833294+0000","last_fullsized":"2024-09-16T00:59:44.833294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:28.848616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828700+0000","last_change":"2024-09-16T00:58:36.510854+0000","last_active":"2024-09-16T00:59:44.828700+0000","last_peered":"2024-09-16T00:59:44.828700+0000","last_clean":"2024-09-16T00:59:44.828700+0000","last_became_active":"2024-09-16T00:58:36.510505+0000","last_became_peered":"2024-09-16T00:58:36.510505+0000","last_unstale":"2024-09-16T00:59:44.828700+0000","last_undegraded":"2024-09-16T00:59:44.828700+0000","last_fullsized":"2024-09-16T00:59:44.828700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.699942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862941+0000","last_change":"2024-09-16T00:58:36.509016+0000","last_active":"2024-09-16T00:59:44.862941+0000","last_peered":"2024-09-16T00:59:44.862941+0000","last_clean":"2024-09-16T00:59:44.862941+0000","last_became_active":"2024-09-16T00:58:36.508690+0000","last_became_peered":"2024-09-16T00:58:36.508690+0000","last_unstale":"2024-09-16T00:59:44.862941+0000","last_undegraded":"2024-09-16T00:59:44.862941+0000","last_fullsized":"2024-09-16T00:59:44.862941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:41.425016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830557+0000","last_change":"2024-09-16T00:58:36.511659+0000","last_active":"2024-09-16T00:59:44.830557+0000","last_peered":"2024-09-16T00:59:44.830557+0000","last_clean":"2024-09-16T00:59:44.830557+0000","last_became_active":"2024-09-16T00:58:36.511225+0000","last_became_peered":"2024-09-16T00:58:36.511225+0000","last_unstale":"2024-09-16T00:59:44.830557+0000","last_undegraded":"2024-09-16T00:59:44.830557+0000","last_fullsized":"2024-09-16T00:59:44.830557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:43.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834361+0000","last_change":"2024-09-16T00:58:36.511614+0000","last_active":"2024-09-16T00:59:44.834361+0000","last_peered":"2024-09-16T00:59:44.834361+0000","last_clean":"2024-09-16T00:59:44.834361+0000","last_became_active":"2024-09-16T00:58:36.511304+0000","last_became_peered":"2024-09-16T00:58:36.511304+0000","last_unstale":"2024-09-16T00:59:44.834361+0000","last_undegraded":"2024-09-16T00:59:44.834361+0000","last_fullsized":"2024-09-16T00:59:44.834361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:20.755419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833783+0000","last_change":"2024-09-16T00:58:36.509399+0000","last_active":"2024-09-16T00:59:44.833783+0000","last_peered":"2024-09-16T00:59:44.833783+0000","last_clean":"2024-09-16T00:59:44.833783+0000","last_became_active":"2024-09-16T00:58:36.509072+0000","last_became_peered":"2024-09-16T00:58:36.509072+0000","last_unstale":"2024-09-16T00:59:44.833783+0000","last_undegraded":"2024-09-16T00:59:44.833783+0000","last_fullsized":"2024-09-16T00:59:44.833783+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:29.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.835835+0000","last_change":"2024-09-16T00:58:36.506252+0000","last_active":"2024-09-16T00:59:44.835835+0000","last_peered":"2024-09-16T00:59:44.835835+0000","last_clean":"2024-09-16T00:59:44.835835+0000","last_became_active":"2024-09-16T00:58:36.505923+0000","last_became_peered":"2024-09-16T00:58:36.505923+0000","last_unstale":"2024-09-16T00:59:44.835835+0000","last_undegraded":"2024-09-16T00:59:44.835835+0000","last_fullsized":"2024-09-16T00:59:44.835835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:05.332472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833151+0000","last_change":"2024-09-16T00:58:36.506598+0000","last_active":"2024-09-16T00:59:44.833151+0000","last_peered":"2024-09-16T00:59:44.833151+0000","last_clean":"2024-09-16T00:59:44.833151+0000","last_became_active":"2024-09-16T00:58:36.506299+0000","last_became_peered":"2024-09-16T00:58:36.506299+0000","last_unstale":"2024-09-16T00:59:44.833151+0000","last_undegraded":"2024-09-16T00:59:44.833151+0000","last_fullsized":"2024-09-16T00:59:44.833151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.327225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.095942+0000","last_change":"2024-09-16T00:58:36.517050+0000","last_active":"2024-09-16T00:59:45.095942+0000","last_peered":"2024-09-16T00:59:45.095942+0000","last_clean":"2024-09-16T00:59:45.095942+0000","last_became_active":"2024-09-16T00:58:36.516745+0000","last_became_peered":"2024-09-16T00:58:36.516745+0000","last_unstale":"2024-09-16T00:59:45.095942+0000","last_undegraded":"2024-09-16T00:59:45.095942+0000","last_fullsized":"2024-09-16T00:59:45.095942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:59.981792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862573+0000","last_change":"2024-09-16T00:58:36.512442+0000","last_active":"2024-09-16T00:59:44.862573+0000","last_peered":"2024-09-16T00:59:44.862573+0000","last_clean":"2024-09-16T00:59:44.862573+0000","last_became_active":"2024-09-16T00:58:36.512132+0000","last_became_peered":"2024-09-16T00:58:36.512132+0000","last_unstale":"2024-09-16T00:59:44.862573+0000","last_undegraded":"2024-09-16T00:59:44.862573+0000","last_fullsized":"2024-09-16T00:59:44.862573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:06.511257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829974+0000","last_change":"2024-09-16T00:58:36.519754+0000","last_active":"2024-09-16T00:59:44.829974+0000","last_peered":"2024-09-16T00:59:44.829974+0000","last_clean":"2024-09-16T00:59:44.829974+0000","last_became_active":"2024-09-16T00:58:36.519378+0000","last_became_peered":"2024-09-16T00:58:36.519378+0000","last_unstale":"2024-09-16T00:59:44.829974+0000","last_undegraded":"2024-09-16T00:59:44.829974+0000","last_fullsized":"2024-09-16T00:59:44.829974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:51.076588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.834579+0000","last_change":"2024-09-16T00:58:36.504627+0000","last_active":"2024-09-16T00:59:44.834579+0000","last_peered":"2024-09-16T00:59:44.834579+0000","last_clean":"2024-09-16T00:59:44.834579+0000","last_became_active":"2024-09-16T00:58:36.504282+0000","last_became_peered":"2024-09-16T00:58:36.504282+0000","last_unstale":"2024-09-16T00:59:44.834579+0000","last_undegraded":"2024-09-16T00:59:44.834579+0000","last_fullsized":"2024-09-16T00:59:44.834579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.857181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831462+0000","last_change":"2024-09-16T00:58:36.508971+0000","last_active":"2024-09-16T00:59:44.831462+0000","last_peered":"2024-09-16T00:59:44.831462+0000","last_clean":"2024-09-16T00:59:44.831462+0000","last_became_active":"2024-09-16T00:58:36.508631+0000","last_became_peered":"2024-09-16T00:58:36.508631+0000","last_unstale":"2024-09-16T00:59:44.831462+0000","last_undegraded":"2024-09-16T00:59:44.831462+0000","last_fullsized":"2024-09-16T00:59:44.831462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:17.092613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830465+0000","last_change":"2024-09-16T00:58:36.517255+0000","last_active":"2024-09-16T00:59:44.830465+0000","last_peered":"2024-09-16T00:59:44.830465+0000","last_clean":"2024-09-16T00:59:44.830465+0000","last_became_active":"2024-09-16T00:58:36.516957+0000","last_became_peered":"2024-09-16T00:58:36.516957+0000","last_unstale":"2024-09-16T00:59:44.830465+0000","last_undegraded":"2024-09-16T00:59:44.830465+0000","last_fullsized":"2024-09-16T00:59:44.830465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:34.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.095619+0000","last_change":"2024-09-16T00:58:36.516429+0000","last_active":"2024-09-16T00:59:45.095619+0000","last_peered":"2024-09-16T00:59:45.095619+0000","last_clean":"2024-09-16T00:59:45.095619+0000","last_became_active":"2024-09-16T00:58:36.516111+0000","last_became_peered":"2024-09-16T00:58:36.516111+0000","last_unstale":"2024-09-16T00:59:45.095619+0000","last_undegraded":"2024-09-16T00:59:45.095619+0000","last_fullsized":"2024-09-16T00:59:45.095619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:06.120653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828384+0000","last_change":"2024-09-16T00:58:36.512873+0000","last_active":"2024-09-16T00:59:44.828384+0000","last_peered":"2024-09-16T00:59:44.828384+0000","last_clean":"2024-09-16T00:59:44.828384+0000","last_became_active":"2024-09-16T00:58:36.511761+0000","last_became_peered":"2024-09-16T00:58:36.511761+0000","last_unstale":"2024-09-16T00:59:44.828384+0000","last_undegraded":"2024-09-16T00:59:44.828384+0000","last_fullsized":"2024-09-16T00:59:44.828384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:51.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828492+0000","last_change":"2024-09-16T00:58:36.511585+0000","last_active":"2024-09-16T00:59:44.828492+0000","last_peered":"2024-09-16T00:59:44.828492+0000","last_clean":"2024-09-16T00:59:44.828492+0000","last_became_active":"2024-09-16T00:58:36.510479+0000","last_became_peered":"2024-09-16T00:58:36.510479+0000","last_unstale":"2024-09-16T00:59:44.828492+0000","last_undegraded":"2024-09-16T00:59:44.828492+0000","last_fullsized":"2024-09-16T00:59:44.828492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:58.017132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.862523+0000","last_change":"2024-09-16T00:58:36.508263+0000","last_active":"2024-09-16T00:59:44.862523+0000","last_peered":"2024-09-16T00:59:44.862523+0000","last_clean":"2024-09-16T00:59:44.862523+0000","last_became_active":"2024-09-16T00:58:36.507979+0000","last_became_peered":"2024-09-16T00:58:36.507979+0000","last_unstale":"2024-09-16T00:59:44.862523+0000","last_undegraded":"2024-09-16T00:59:44.862523+0000","last_fullsized":"2024-09-16T00:59:44.862523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:07.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833564+0000","last_change":"2024-09-16T00:58:36.514981+0000","last_active":"2024-09-16T00:59:44.833564+0000","last_peered":"2024-09-16T00:59:44.833564+0000","last_clean":"2024-09-16T00:59:44.833564+0000","last_became_active":"2024-09-16T00:58:36.510433+0000","last_became_peered":"2024-09-16T00:58:36.510433+0000","last_unstale":"2024-09-16T00:59:44.833564+0000","last_undegraded":"2024-09-16T00:59:44.833564+0000","last_fullsized":"2024-09-16T00:59:44.833564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:10.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833562+0000","last_change":"2024-09-16T00:58:36.521336+0000","last_active":"2024-09-16T00:59:44.833562+0000","last_peered":"2024-09-16T00:59:44.833562+0000","last_clean":"2024-09-16T00:59:44.833562+0000","last_became_active":"2024-09-16T00:58:36.521026+0000","last_became_peered":"2024-09-16T00:58:36.521026+0000","last_unstale":"2024-09-16T00:59:44.833562+0000","last_undegraded":"2024-09-16T00:59:44.833562+0000","last_fullsized":"2024-09-16T00:59:44.833562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:29.409024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829711+0000","last_change":"2024-09-16T00:58:36.518724+0000","last_active":"2024-09-16T00:59:44.829711+0000","last_peered":"2024-09-16T00:59:44.829711+0000","last_clean":"2024-09-16T00:59:44.829711+0000","last_became_active":"2024-09-16T00:58:36.518428+0000","last_became_peered":"2024-09-16T00:58:36.518428+0000","last_unstale":"2024-09-16T00:59:44.829711+0000","last_undegraded":"2024-09-16T00:59:44.829711+0000","last_fullsized":"2024-09-16T00:59:44.829711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:06.486299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:45.096401+0000","last_change":"2024-09-16T00:58:36.514347+0000","last_active":"2024-09-16T00:59:45.096401+0000","last_peered":"2024-09-16T00:59:45.096401+0000","last_clean":"2024-09-16T00:59:45.096401+0000","last_became_active":"2024-09-16T00:58:36.512243+0000","last_became_peered":"2024-09-16T00:58:36.512243+0000","last_unstale":"2024-09-16T00:59:45.096401+0000","last_undegraded":"2024-09-16T00:59:45.096401+0000","last_fullsized":"2024-09-16T00:59:45.096401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.289541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.837828+0000","last_change":"2024-09-16T00:59:44.837828+0000","last_active":"2024-09-16T00:59:44.837828+0000","last_peered":"2024-09-16T00:59:44.837828+0000","last_clean":"2024-09-16T00:59:44.837828+0000","last_became_active":"2024-09-16T00:59:44.837486+0000","last_became_peered":"2024-09-16T00:59:44.837486+0000","last_unstale":"2024-09-16T00:59:44.837828+0000","last_undegraded":"2024-09-16T00:59:44.837828+0000","last_fullsized":"2024-09-16T00:59:44.837828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:46.914056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.832571+0000","last_change":"2024-09-16T00:58:36.516797+0000","last_active":"2024-09-16T00:59:44.832571+0000","last_peered":"2024-09-16T00:59:44.832571+0000","last_clean":"2024-09-16T00:59:44.832571+0000","last_became_active":"2024-09-16T00:58:36.516480+0000","last_became_peered":"2024-09-16T00:58:36.516480+0000","last_unstale":"2024-09-16T00:59:44.832571+0000","last_undegraded":"2024-09-16T00:59:44.832571+0000","last_fullsized":"2024-09-16T00:59:44.832571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:55.262528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.829196+0000","last_change":"2024-09-16T00:58:36.517973+0000","last_active":"2024-09-16T00:59:44.829196+0000","last_peered":"2024-09-16T00:59:44.829196+0000","last_clean":"2024-09-16T00:59:44.829196+0000","last_became_active":"2024-09-16T00:58:36.517634+0000","last_became_peered":"2024-09-16T00:58:36.517634+0000","last_unstale":"2024-09-16T00:59:44.829196+0000","last_undegraded":"2024-09-16T00:59:44.829196+0000","last_fullsized":"2024-09-16T00:59:44.829196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:19.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.831181+0000","last_change":"2024-09-16T00:58:36.507643+0000","last_active":"2024-09-16T00:59:44.831181+0000","last_peered":"2024-09-16T00:59:44.831181+0000","last_clean":"2024-09-16T00:59:44.831181+0000","last_became_active":"2024-09-16T00:58:36.507263+0000","last_became_peered":"2024-09-16T00:58:36.507263+0000","last_unstale":"2024-09-16T00:59:44.831181+0000","last_undegraded":"2024-09-16T00:59:44.831181+0000","last_fullsized":"2024-09-16T00:59:44.831181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:24.317490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.833460+0000","last_change":"2024-09-16T00:58:36.508798+0000","last_active":"2024-09-16T00:59:44.833460+0000","last_peered":"2024-09-16T00:59:44.833460+0000","last_clean":"2024-09-16T00:59:44.833460+0000","last_became_active":"2024-09-16T00:58:36.508490+0000","last_became_peered":"2024-09-16T00:58:36.508490+0000","last_unstale":"2024-09-16T00:59:44.833460+0000","last_undegraded":"2024-09-16T00:59:44.833460+0000","last_fullsized":"2024-09-16T00:59:44.833460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:44.282270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828876+0000","last_change":"2024-09-16T00:58:36.519065+0000","last_active":"2024-09-16T00:59:44.828876+0000","last_peered":"2024-09-16T00:59:44.828876+0000","last_clean":"2024-09-16T00:59:44.828876+0000","last_became_active":"2024-09-16T00:58:36.518708+0000","last_became_peered":"2024-09-16T00:58:36.518708+0000","last_unstale":"2024-09-16T00:59:44.828876+0000","last_undegraded":"2024-09-16T00:59:44.828876+0000","last_fullsized":"2024-09-16T00:59:44.828876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:10.290341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.828516+0000","last_change":"2024-09-16T00:58:36.513018+0000","last_active":"2024-09-16T00:59:44.828516+0000","last_peered":"2024-09-16T00:59:44.828516+0000","last_clean":"2024-09-16T00:59:44.828516+0000","last_became_active":"2024-09-16T00:58:36.511730+0000","last_became_peered":"2024-09-16T00:58:36.511730+0000","last_unstale":"2024-09-16T00:59:44.828516+0000","last_undegraded":"2024-09-16T00:59:44.828516+0000","last_fullsized":"2024-09-16T00:59:44.828516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:20.852121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T00:59:44.830645+0000","last_change":"2024-09-16T00:58:36.518265+0000","last_active":"2024-09-16T00:59:44.830645+0000","last_peered":"2024-09-16T00:59:44.830645+0000","last_clean":"2024-09-16T00:59:44.830645+0000","last_became_active":"2024-09-16T00:58:36.517906+0000","last_became_peered":"2024-09-16T00:58:36.517906+0000","last_unstale":"2024-09-16T00:59:44.830645+0000","last_undegraded":"2024-09-16T00:59:44.830645+0000","last_fullsized":"2024-09-16T00:59:44.830645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.255849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70299,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":563,"num_read_kb":355,"num_write":246,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":210897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282150,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612642,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":966656,"data_stored":494502,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841573,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1118208,"data_stored":1144409,"data_compressed":59505,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":995328,"data_stored":498135,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":493745,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":1090523,"data_compressed":59505,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":489543,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":1086105,"data_compressed":59505,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":494289,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":978944,"data_stored":489251,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1056768,"data_stored":554670,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1036288,"data_stored":554057,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":991232,"data_stored":491392,"data_compressed":23622,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:00:18.216 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T01:00:18.216 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T01:00:18.217 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-16T01:00:18.217 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-16T01:00:18.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:18 smithi119 ceph-mon[35049]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:18.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:18 smithi119 ceph-mon[35049]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:18.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:18 smithi098 ceph-mon[35346]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:18.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:18 smithi098 ceph-mon[35346]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 -- 172.21.15.12:0/3563733066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94d8101450 msgr2=0x7f94d8105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 --2- 172.21.15.12:0/3563733066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94d8101450 0x7f94d8105920 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009900 tx=0x7f94cc02a470 comp rx=0 tx=0).stop 2024-09-16T01:00:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 -- 172.21.15.12:0/3563733066 shutdown_connections 2024-09-16T01:00:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 --2- 172.21.15.12:0/3563733066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d8105f40 0x7f94d81063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 --2- 172.21.15.12:0/3563733066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94d8101450 0x7f94d8105920 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 --2- 172.21.15.12:0/3563733066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d8100b30 0x7f94d8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 -- 172.21.15.12:0/3563733066 >> 172.21.15.12:0/3563733066 conn(0x7f94d80fc7a0 msgr2=0x7f94d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 -- 172.21.15.12:0/3563733066 shutdown_connections 2024-09-16T01:00:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 -- 172.21.15.12:0/3563733066 wait complete. 2024-09-16T01:00:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 Processor -- start 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.978+0000 7f94dd3f5640 1 -- start start 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94dd3f5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d8100b30 0x7f94d81a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94dd3f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94d8101450 0x7f94d81a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94dd3f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d8105f40 0x7f94d819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94dd3f5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f94d8118540 con 0x7f94d8101450 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94dd3f5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81183c0 con 0x7f94d8100b30 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94dd3f5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81186c0 con 0x7f94d8105f40 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94d8101450 0x7f94d81a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94d8101450 0x7f94d81a4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41140/0 (socket says 172.21.15.12:41140) 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d67fc640 1 -- 172.21.15.12:0/39495840 learned_addr learned my addr 172.21.15.12:0/39495840 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d6ffd640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d8100b30 0x7f94d81a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d77fe640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d8105f40 0x7f94d819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d67fc640 1 -- 172.21.15.12:0/39495840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d8105f40 msgr2=0x7f94d819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d67fc640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d8105f40 0x7f94d819e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d67fc640 1 -- 172.21.15.12:0/39495840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d8100b30 msgr2=0x7f94d81a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d67fc640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d8100b30 0x7f94d81a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d67fc640 1 -- 172.21.15.12:0/39495840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d819f020 con 0x7f94d8101450 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.979+0000 7f94d67fc640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94d8101450 0x7f94d81a4c70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f94cc006010 tx=0x7f94cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.980+0000 7f94bffff640 1 -- 172.21.15.12:0/39495840 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc03f030 con 0x7f94d8101450 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.980+0000 7f94dd3f5640 1 -- 172.21.15.12:0/39495840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d819f2b0 con 0x7f94d8101450 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.980+0000 7f94bffff640 1 -- 172.21.15.12:0/39495840 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94cc003ce0 con 0x7f94d8101450 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.980+0000 7f94bffff640 1 -- 172.21.15.12:0/39495840 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc035070 con 0x7f94d8101450 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.980+0000 7f94dd3f5640 1 -- 172.21.15.12:0/39495840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d81ab600 con 0x7f94d8101450 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.981+0000 7f94dd3f5640 1 -- 172.21.15.12:0/39495840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d8105920 con 0x7f94d8101450 2024-09-16T01:00:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.982+0000 7f94bffff640 1 -- 172.21.15.12:0/39495840 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f94cc042030 con 0x7f94d8101450 2024-09-16T01:00:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.982+0000 7f94bffff640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f94c00a32d0 0x7f94c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.983+0000 7f94bffff640 1 -- 172.21.15.12:0/39495840 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f94cc0f0290 con 0x7f94d8101450 2024-09-16T01:00:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.983+0000 7f94d6ffd640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f94c00a32d0 0x7f94c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.983+0000 7f94d6ffd640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f94c00a32d0 0x7f94c00a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f94c80058c0 tx=0x7f94c800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:18.987+0000 7f94bffff640 1 -- 172.21.15.12:0/39495840 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f94cc0bc580 con 0x7f94d8101450 2024-09-16T01:00:19.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.203+0000 7f94dd3f5640 1 -- 172.21.15.12:0/39495840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f94d81ab830 con 0x7f94d8101450 2024-09-16T01:00:19.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.203+0000 7f94bffff640 1 -- 172.21.15.12:0/39495840 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f94cc0c0880 con 0x7f94d8101450 2024-09-16T01:00:19.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:19.204 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T01:00:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 -- 172.21.15.12:0/39495840 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f94c00a32d0 msgr2=0x7f94c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f94c00a32d0 0x7f94c00a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f94c80058c0 tx=0x7f94c800a2d0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 -- 172.21.15.12:0/39495840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94d8101450 msgr2=0x7f94d81a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94d8101450 0x7f94d81a4c70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f94cc006010 tx=0x7f94cc0042f0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 -- 172.21.15.12:0/39495840 shutdown_connections 2024-09-16T01:00:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f94c00a32d0 0x7f94c00a5790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94d8105f40 0x7f94d819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94d8101450 0x7f94d81a4c70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 --2- 172.21.15.12:0/39495840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d8100b30 0x7f94d81a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 -- 172.21.15.12:0/39495840 >> 172.21.15.12:0/39495840 conn(0x7f94d80fc7a0 msgr2=0x7f94d80fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 -- 172.21.15.12:0/39495840 shutdown_connections 2024-09-16T01:00:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:19.207+0000 7f94dd3f5640 1 -- 172.21.15.12:0/39495840 wait complete. 2024-09-16T01:00:20.004 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-16T01:00:20.005 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:20.271 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:20.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:20 smithi119 ceph-mon[35049]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:20.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:20 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/39495840' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T01:00:20.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:20 smithi012 ceph-mon[31197]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:20.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:20 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/39495840' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T01:00:20.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:20 smithi098 ceph-mon[35346]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:20.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:20 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/39495840' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T01:00:20.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 -- 172.21.15.12:0/3568603920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23dc100e20 msgr2=0x7f23dc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 --2- 172.21.15.12:0/3568603920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23dc100e20 0x7f23dc101200 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009900 tx=0x7f23cc02a480 comp rx=0 tx=0).stop 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 -- 172.21.15.12:0/3568603920 shutdown_connections 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 --2- 172.21.15.12:0/3568603920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23dc102ef0 0x7f23dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 --2- 172.21.15.12:0/3568603920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc102570 0x7f23dc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 --2- 172.21.15.12:0/3568603920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23dc100e20 0x7f23dc101200 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 -- 172.21.15.12:0/3568603920 >> 172.21.15.12:0/3568603920 conn(0x7f23dc0fc7d0 msgr2=0x7f23dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 -- 172.21.15.12:0/3568603920 shutdown_connections 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 -- 172.21.15.12:0/3568603920 wait complete. 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 Processor -- start 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.787+0000 7f23e26d6640 1 -- start start 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e26d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23dc100e20 0x7f23dc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:20.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e26d6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc102570 0x7f23dc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e26d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23dc102ef0 0x7f23dc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e26d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc110fa0 con 0x7f23dc102ef0 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e26d6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc110e20 con 0x7f23dc102570 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e26d6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc111120 con 0x7f23dc100e20 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e0c73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23dc102ef0 0x7f23dc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e0c73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23dc102ef0 0x7f23dc19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41162/0 (socket says 172.21.15.12:41162) 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e0c73640 1 -- 172.21.15.12:0/3202419131 learned_addr learned my addr 172.21.15.12:0/3202419131 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23dbfff640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23dc100e20 0x7f23dc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23d3fff640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc102570 0x7f23dc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e0c73640 1 -- 172.21.15.12:0/3202419131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23dc100e20 msgr2=0x7f23dc198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e0c73640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23dc100e20 0x7f23dc198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e0c73640 1 -- 172.21.15.12:0/3202419131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc102570 msgr2=0x7f23dc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:20.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e0c73640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc102570 0x7f23dc198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e0c73640 1 -- 172.21.15.12:0/3202419131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc19d4e0 con 0x7f23dc102ef0 2024-09-16T01:00:20.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23d3fff640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc102570 0x7f23dc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:20.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.788+0000 7f23e0c73640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23dc102ef0 0x7f23dc19ce00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f23d400b970 tx=0x7f23d400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:20.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.789+0000 7f23d9ffb640 1 -- 172.21.15.12:0/3202419131 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4019070 con 0x7f23dc102ef0 2024-09-16T01:00:20.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.789+0000 7f23d9ffb640 1 -- 172.21.15.12:0/3202419131 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23d400cb40 con 0x7f23dc102ef0 2024-09-16T01:00:20.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.789+0000 7f23e26d6640 1 -- 172.21.15.12:0/3202419131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc19d7d0 con 0x7f23dc102ef0 2024-09-16T01:00:20.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.789+0000 7f23d9ffb640 1 -- 172.21.15.12:0/3202419131 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4007650 con 0x7f23dc102ef0 2024-09-16T01:00:20.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.789+0000 7f23e26d6640 1 -- 172.21.15.12:0/3202419131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23dc1a50b0 con 0x7f23dc102ef0 2024-09-16T01:00:20.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.790+0000 7f23e26d6640 1 -- 172.21.15.12:0/3202419131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23dc101200 con 0x7f23dc102ef0 2024-09-16T01:00:20.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.791+0000 7f23d9ffb640 1 -- 172.21.15.12:0/3202419131 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f23d401c070 con 0x7f23dc102ef0 2024-09-16T01:00:20.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.791+0000 7f23d9ffb640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f23c80a3350 0x7f23c80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:20.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.792+0000 7f23d9ffb640 1 -- 172.21.15.12:0/3202419131 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f23d40cf200 con 0x7f23dc102ef0 2024-09-16T01:00:20.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.792+0000 7f23dbfff640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f23c80a3350 0x7f23c80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:20.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.792+0000 7f23dbfff640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f23c80a3350 0x7f23c80a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009230 tx=0x7f23cc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:20.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:20.796+0000 7f23d9ffb640 1 -- 172.21.15.12:0/3202419131 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23d409b540 con 0x7f23dc102ef0 2024-09-16T01:00:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.009+0000 7f23e26d6640 1 -- 172.21.15.12:0/3202419131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23dc10a0a0 con 0x7f23dc102ef0 2024-09-16T01:00:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.010+0000 7f23d9ffb640 1 -- 172.21.15.12:0/3202419131 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7f23d409f840 con 0x7f23dc102ef0 2024-09-16T01:00:21.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:21.011 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-16T00:59:22:581924+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T00:59:22.581909+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24482,24475,24458,14601]},"id":1}]} 2024-09-16T01:00:21.012 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-16T01:00:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 -- 172.21.15.12:0/3202419131 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f23c80a3350 msgr2=0x7f23c80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f23c80a3350 0x7f23c80a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009230 tx=0x7f23cc0058d0 comp rx=0 tx=0).stop 2024-09-16T01:00:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 -- 172.21.15.12:0/3202419131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23dc102ef0 msgr2=0x7f23dc19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23dc102ef0 0x7f23dc19ce00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f23d400b970 tx=0x7f23d400be30 comp rx=0 tx=0).stop 2024-09-16T01:00:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 -- 172.21.15.12:0/3202419131 shutdown_connections 2024-09-16T01:00:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f23c80a3350 0x7f23c80a5810 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23dc102ef0 0x7f23dc19ce00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc102570 0x7f23dc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 --2- 172.21.15.12:0/3202419131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23dc100e20 0x7f23dc198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 -- 172.21.15.12:0/3202419131 >> 172.21.15.12:0/3202419131 conn(0x7f23dc0fc7d0 msgr2=0x7f23dc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 -- 172.21.15.12:0/3202419131 shutdown_connections 2024-09-16T01:00:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:21.012+0000 7f23e26d6640 1 -- 172.21.15.12:0/3202419131 wait complete. 2024-09-16T01:00:21.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:21 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3202419131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:21.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:21 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3202419131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:21.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:21 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3202419131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:21.854 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:22.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:22 smithi012 ceph-mon[31197]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:00:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:22.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:22 smithi119 ceph-mon[35049]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:00:22.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:22 smithi098 ceph-mon[35346]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:00:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.563+0000 7fd7fe22e640 1 -- 172.21.15.12:0/1430434113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8100e30 msgr2=0x7fd7f8104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.563+0000 7fd7fe22e640 1 --2- 172.21.15.12:0/1430434113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8100e30 0x7fd7f8104e80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009900 tx=0x7fd7e002a410 comp rx=0 tx=0).stop 2024-09-16T01:00:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.563+0000 7fd7fe22e640 1 -- 172.21.15.12:0/1430434113 shutdown_connections 2024-09-16T01:00:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.563+0000 7fd7fe22e640 1 --2- 172.21.15.12:0/1430434113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7f81055b0 0x7fd7f810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.563+0000 7fd7fe22e640 1 --2- 172.21.15.12:0/1430434113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8100e30 0x7fd7f8104e80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.563+0000 7fd7fe22e640 1 --2- 172.21.15.12:0/1430434113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f8100480 0x7fd7f8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.563+0000 7fd7fe22e640 1 -- 172.21.15.12:0/1430434113 >> 172.21.15.12:0/1430434113 conn(0x7fd7f8077210 msgr2=0x7fd7f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.563+0000 7fd7fe22e640 1 -- 172.21.15.12:0/1430434113 shutdown_connections 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.563+0000 7fd7fe22e640 1 -- 172.21.15.12:0/1430434113 wait complete. 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7fe22e640 1 Processor -- start 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7fe22e640 1 -- start start 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7fe22e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8100480 0x7fd7f819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7fe22e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7f8100e30 0x7fd7f819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7fe22e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f81055b0 0x7fd7f819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7fe22e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8111fe0 con 0x7fd7f8100480 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7fe22e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8111e60 con 0x7fd7f8100e30 2024-09-16T01:00:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7fe22e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8112160 con 0x7fd7f81055b0 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8100480 0x7fd7f819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8100480 0x7fd7f819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41188/0 (socket says 172.21.15.12:41188) 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.564+0000 7fd7f77fe640 1 -- 172.21.15.12:0/68040167 learned_addr learned my addr 172.21.15.12:0/68040167 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7effff640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7f8100e30 0x7fd7f819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7f77fe640 1 -- 172.21.15.12:0/68040167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f81055b0 msgr2=0x7fd7f819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7f77fe640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f81055b0 0x7fd7f819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7f77fe640 1 -- 172.21.15.12:0/68040167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7f8100e30 msgr2=0x7fd7f819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7f77fe640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7f8100e30 0x7fd7f819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7f77fe640 1 -- 172.21.15.12:0/68040167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f819f650 con 0x7fd7f8100480 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7f77fe640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8100480 0x7fd7f819a6a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800d770 tx=0x7fd7e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7f57fa640 1 -- 172.21.15.12:0/68040167 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8017070 con 0x7fd7f8100480 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7fe22e640 1 -- 172.21.15.12:0/68040167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f819f940 con 0x7fd7f8100480 2024-09-16T01:00:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7f57fa640 1 -- 172.21.15.12:0/68040167 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e8005500 con 0x7fd7f8100480 2024-09-16T01:00:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7f57fa640 1 -- 172.21.15.12:0/68040167 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8004e00 con 0x7fd7f8100480 2024-09-16T01:00:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.565+0000 7fd7fe22e640 1 -- 172.21.15.12:0/68040167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f81a7220 con 0x7fd7f8100480 2024-09-16T01:00:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.566+0000 7fd7fe22e640 1 -- 172.21.15.12:0/68040167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f8100860 con 0x7fd7f8100480 2024-09-16T01:00:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.567+0000 7fd7f57fa640 1 -- 172.21.15.12:0/68040167 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd7e8004fa0 con 0x7fd7f8100480 2024-09-16T01:00:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.568+0000 7fd7f57fa640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7e40a32d0 0x7fd7e40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.568+0000 7fd7f57fa640 1 -- 172.21.15.12:0/68040167 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fd7e80cfda0 con 0x7fd7f8100480 2024-09-16T01:00:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.568+0000 7fd7effff640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7e40a32d0 0x7fd7e40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.569+0000 7fd7effff640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7e40a32d0 0x7fd7e40a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0000c00 tx=0x7fd7e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:22.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.572+0000 7fd7f57fa640 1 -- 172.21.15.12:0/68040167 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7e809c5c0 con 0x7fd7f8100480 2024-09-16T01:00:22.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.782+0000 7fd7fe22e640 1 -- 172.21.15.12:0/68040167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7f81a7490 con 0x7fd7f8100480 2024-09-16T01:00:22.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.783+0000 7fd7f57fa640 1 -- 172.21.15.12:0/68040167 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7fd7e809bec0 con 0x7fd7f8100480 2024-09-16T01:00:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:22.784 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-16T00:59:22:581924+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T00:59:22.581909+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24482,24475,24458,14601]},"id":1}]} 2024-09-16T01:00:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-16T01:00:22.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 -- 172.21.15.12:0/68040167 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7e40a32d0 msgr2=0x7fd7e40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7e40a32d0 0x7fd7e40a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0000c00 tx=0x7fd7e0005a20 comp rx=0 tx=0).stop 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 -- 172.21.15.12:0/68040167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8100480 msgr2=0x7fd7f819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8100480 0x7fd7f819a6a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800d770 tx=0x7fd7e800dc30 comp rx=0 tx=0).stop 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 -- 172.21.15.12:0/68040167 shutdown_connections 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd7e40a32d0 0x7fd7e40a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7f81055b0 0x7fd7f819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7f8100e30 0x7fd7f819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 --2- 172.21.15.12:0/68040167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8100480 0x7fd7f819a6a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 -- 172.21.15.12:0/68040167 >> 172.21.15.12:0/68040167 conn(0x7fd7f8077210 msgr2=0x7fd7f8103ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 -- 172.21.15.12:0/68040167 shutdown_connections 2024-09-16T01:00:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:22.785+0000 7fd7fe22e640 1 -- 172.21.15.12:0/68040167 wait complete. 2024-09-16T01:00:23.249 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:23 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/68040167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:23.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:23 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/68040167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:23.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:23 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/68040167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:23.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:00:23.868 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:24.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:24 smithi012 ceph-mon[31197]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:24.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:24 smithi119 ceph-mon[35049]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:24.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 -- 172.21.15.12:0/4130062761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddb0102d30 msgr2=0x7fddb0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:24.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 --2- 172.21.15.12:0/4130062761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddb0102d30 0x7fddb0103110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009930 tx=0x7fdda002a420 comp rx=0 tx=0).stop 2024-09-16T01:00:24.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 -- 172.21.15.12:0/4130062761 shutdown_connections 2024-09-16T01:00:24.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 --2- 172.21.15.12:0/4130062761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb01082a0 0x7fddb010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 --2- 172.21.15.12:0/4130062761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddb01036e0 0x7fddb0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 --2- 172.21.15.12:0/4130062761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddb0102d30 0x7fddb0103110 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 -- 172.21.15.12:0/4130062761 >> 172.21.15.12:0/4130062761 conn(0x7fddb00fc7d0 msgr2=0x7fddb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 -- 172.21.15.12:0/4130062761 shutdown_connections 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 -- 172.21.15.12:0/4130062761 wait complete. 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 Processor -- start 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.382+0000 7fddb5bd6640 1 -- start start 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddb5bd6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddb0102d30 0x7fddb01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddb5bd6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddb01036e0 0x7fddb0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddb5bd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb01082a0 0x7fddb019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddb5bd6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fddb01120a0 con 0x7fddb0102d30 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddb5bd6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fddb0111f20 con 0x7fddb01036e0 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddb5bd6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fddb0112220 con 0x7fddb01082a0 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddb0102d30 0x7fddb01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddb0102d30 0x7fddb01985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41198/0 (socket says 172.21.15.12:41198) 2024-09-16T01:00:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaf7fe640 1 -- 172.21.15.12:0/2408249061 learned_addr learned my addr 172.21.15.12:0/2408249061 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaeffd640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddb01036e0 0x7fddb0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaffff640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb01082a0 0x7fddb019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaf7fe640 1 -- 172.21.15.12:0/2408249061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb01082a0 msgr2=0x7fddb019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaf7fe640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb01082a0 0x7fddb019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaf7fe640 1 -- 172.21.15.12:0/2408249061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddb01036e0 msgr2=0x7fddb0198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaf7fe640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddb01036e0 0x7fddb0198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaf7fe640 1 -- 172.21.15.12:0/2408249061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb019d570 con 0x7fddb0102d30 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaffff640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb01082a0 0x7fddb019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddaf7fe640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddb0102d30 0x7fddb01985c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009230 tx=0x7fdda0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddacff9640 1 -- 172.21.15.12:0/2408249061 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda003f030 con 0x7fddb0102d30 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddacff9640 1 -- 172.21.15.12:0/2408249061 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda0003ad0 con 0x7fddb0102d30 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddb5bd6640 1 -- 172.21.15.12:0/2408249061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb019d800 con 0x7fddb0102d30 2024-09-16T01:00:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.383+0000 7fddacff9640 1 -- 172.21.15.12:0/2408249061 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0035070 con 0x7fddb0102d30 2024-09-16T01:00:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.384+0000 7fddb5bd6640 1 -- 172.21.15.12:0/2408249061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb01a5140 con 0x7fddb0102d30 2024-09-16T01:00:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.385+0000 7fddb5bd6640 1 -- 172.21.15.12:0/2408249061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb006a850 con 0x7fddb0102d30 2024-09-16T01:00:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.386+0000 7fddacff9640 1 -- 172.21.15.12:0/2408249061 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdda0042030 con 0x7fddb0102d30 2024-09-16T01:00:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.386+0000 7fddacff9640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd980a32d0 0x7fdd980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.387+0000 7fddaeffd640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd980a32d0 0x7fdd980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.387+0000 7fddacff9640 1 -- 172.21.15.12:0/2408249061 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fdda00f0820 con 0x7fddb0102d30 2024-09-16T01:00:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.387+0000 7fddaeffd640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd980a32d0 0x7fdd980a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdda4005fd0 tx=0x7fdda4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.390+0000 7fddacff9640 1 -- 172.21.15.12:0/2408249061 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdda00bd040 con 0x7fddb0102d30 2024-09-16T01:00:24.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:24 smithi098 ceph-mon[35346]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:24.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.565+0000 7fddb5bd6640 1 -- 172.21.15.12:0/2408249061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddb0103110 con 0x7fddb0102d30 2024-09-16T01:00:24.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.567+0000 7fddacff9640 1 -- 172.21.15.12:0/2408249061 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24631 (secure 0 0 0) 0x7fdda00bc940 con 0x7fddb0102d30 2024-09-16T01:00:24.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:24.568 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T00:59:44.825186+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:00:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 -- 172.21.15.12:0/2408249061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd980a32d0 msgr2=0x7fdd980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd980a32d0 0x7fdd980a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdda4005fd0 tx=0x7fdda4005850 comp rx=0 tx=0).stop 2024-09-16T01:00:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 -- 172.21.15.12:0/2408249061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddb0102d30 msgr2=0x7fddb01985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddb0102d30 0x7fddb01985c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009230 tx=0x7fdda0004270 comp rx=0 tx=0).stop 2024-09-16T01:00:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 -- 172.21.15.12:0/2408249061 shutdown_connections 2024-09-16T01:00:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd980a32d0 0x7fdd980a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb01082a0 0x7fddb019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddb01036e0 0x7fddb0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 --2- 172.21.15.12:0/2408249061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddb0102d30 0x7fddb01985c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 -- 172.21.15.12:0/2408249061 >> 172.21.15.12:0/2408249061 conn(0x7fddb00fc7d0 msgr2=0x7fddb0105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 -- 172.21.15.12:0/2408249061 shutdown_connections 2024-09-16T01:00:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:24.569+0000 7fddb5bd6640 1 -- 172.21.15.12:0/2408249061 wait complete. 2024-09-16T01:00:25.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:25 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2408249061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:25.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:25 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2408249061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:25.363 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:25.364 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:25 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2408249061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:25.624 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:26.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.108+0000 7fb35b5e0640 1 -- 172.21.15.12:0/309739036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb354102570 msgr2=0x7fb3541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:26.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.108+0000 7fb35b5e0640 1 --2- 172.21.15.12:0/309739036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb354102570 0x7fb3541029b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb344009900 tx=0x7fb34402a480 comp rx=0 tx=0).stop 2024-09-16T01:00:26.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.108+0000 7fb35b5e0640 1 -- 172.21.15.12:0/309739036 shutdown_connections 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.108+0000 7fb35b5e0640 1 --2- 172.21.15.12:0/309739036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb354102ef0 0x7fb35410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.108+0000 7fb35b5e0640 1 --2- 172.21.15.12:0/309739036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb354102570 0x7fb3541029b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.108+0000 7fb35b5e0640 1 --2- 172.21.15.12:0/309739036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb354100e20 0x7fb354101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.108+0000 7fb35b5e0640 1 -- 172.21.15.12:0/309739036 >> 172.21.15.12:0/309739036 conn(0x7fb3540fc7d0 msgr2=0x7fb3540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.108+0000 7fb35b5e0640 1 -- 172.21.15.12:0/309739036 shutdown_connections 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.108+0000 7fb35b5e0640 1 -- 172.21.15.12:0/309739036 wait complete. 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.108+0000 7fb35b5e0640 1 Processor -- start 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb35b5e0640 1 -- start start 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb35b5e0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb354100e20 0x7fb3541984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb35b5e0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb354102570 0x7fb3541989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb35b5e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb354102ef0 0x7fb35419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb35b5e0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb3541120a0 con 0x7fb354102ef0 2024-09-16T01:00:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb35b5e0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb354111f20 con 0x7fb354102570 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb35b5e0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb354112220 con 0x7fb354100e20 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb359b7d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb354102ef0 0x7fb35419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb35937c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb354100e20 0x7fb3541984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb359b7d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb354102ef0 0x7fb35419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41218/0 (socket says 172.21.15.12:41218) 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb359b7d640 1 -- 172.21.15.12:0/2824225292 learned_addr learned my addr 172.21.15.12:0/2824225292 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb358b7b640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb354102570 0x7fb3541989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb359b7d640 1 -- 172.21.15.12:0/2824225292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb354100e20 msgr2=0x7fb3541984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb359b7d640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb354100e20 0x7fb3541984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb359b7d640 1 -- 172.21.15.12:0/2824225292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb354102570 msgr2=0x7fb3541989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb359b7d640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb354102570 0x7fb3541989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb359b7d640 1 -- 172.21.15.12:0/2824225292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35419d450 con 0x7fb354102ef0 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb35937c640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb354100e20 0x7fb3541984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:00:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.109+0000 7fb359b7d640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb354102ef0 0x7fb35419cd70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00d950 tx=0x7fb34c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.110+0000 7fb34a7fc640 1 -- 172.21.15.12:0/2824225292 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c017030 con 0x7fb354102ef0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.110+0000 7fb34a7fc640 1 -- 172.21.15.12:0/2824225292 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb34c004020 con 0x7fb354102ef0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.110+0000 7fb35b5e0640 1 -- 172.21.15.12:0/2824225292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb35419d740 con 0x7fb354102ef0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.110+0000 7fb34a7fc640 1 -- 172.21.15.12:0/2824225292 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c003c00 con 0x7fb354102ef0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.110+0000 7fb35b5e0640 1 -- 172.21.15.12:0/2824225292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3541a5020 con 0x7fb354102ef0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.111+0000 7fb35b5e0640 1 -- 172.21.15.12:0/2824225292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb354101200 con 0x7fb354102ef0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.112+0000 7fb34a7fc640 1 -- 172.21.15.12:0/2824225292 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb34c01a070 con 0x7fb354102ef0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.113+0000 7fb34a7fc640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb3400a3350 0x7fb3400a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.113+0000 7fb34a7fc640 1 -- 172.21.15.12:0/2824225292 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fb34c0cfc50 con 0x7fb354102ef0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.113+0000 7fb35937c640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb3400a3350 0x7fb3400a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.113+0000 7fb35937c640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb3400a3350 0x7fb3400a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb350005fd0 tx=0x7fb350009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.116+0000 7fb34a7fc640 1 -- 172.21.15.12:0/2824225292 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb34c09c550 con 0x7fb354102ef0 2024-09-16T01:00:26.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.331+0000 7fb35b5e0640 1 -- 172.21.15.12:0/2824225292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb354199800 con 0x7fb354102ef0 2024-09-16T01:00:26.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:26 smithi012 ceph-mon[31197]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:00:26.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.331+0000 7fb34a7fc640 1 -- 172.21.15.12:0/2824225292 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7fb354199800 con 0x7fb354102ef0 2024-09-16T01:00:26.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:26.333 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-16T00:59:22:581924+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T00:59:22.581909+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24482,24475,24458,14601]},"id":1}]} 2024-09-16T01:00:26.333 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 -- 172.21.15.12:0/2824225292 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb3400a3350 msgr2=0x7fb3400a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb3400a3350 0x7fb3400a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb350005fd0 tx=0x7fb350009500 comp rx=0 tx=0).stop 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 -- 172.21.15.12:0/2824225292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb354102ef0 msgr2=0x7fb35419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb354102ef0 0x7fb35419cd70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00d950 tx=0x7fb34c00de10 comp rx=0 tx=0).stop 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 -- 172.21.15.12:0/2824225292 shutdown_connections 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb3400a3350 0x7fb3400a5810 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb354102ef0 0x7fb35419cd70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb354102570 0x7fb3541989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 --2- 172.21.15.12:0/2824225292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb354100e20 0x7fb3541984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 -- 172.21.15.12:0/2824225292 >> 172.21.15.12:0/2824225292 conn(0x7fb3540fc7d0 msgr2=0x7fb3540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:26.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 -- 172.21.15.12:0/2824225292 shutdown_connections 2024-09-16T01:00:26.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:26.334+0000 7fb35b5e0640 1 -- 172.21.15.12:0/2824225292 wait complete. 2024-09-16T01:00:26.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:26 smithi119 ceph-mon[35049]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:00:26.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:26 smithi098 ceph-mon[35346]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:00:26.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-16T00:58:37.161987+0000', 'modified': '2024-09-16T00:59:22.581909+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24518, 'mds_1': 24482, 'mds_2': 24475, 'mds_3': 24458, 'mds_4': 14601}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14595': {'gid': 14595, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6839/3964724197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6838', 'nonce': 3964724197}, {'type': 'v1', 'addr': '172.21.15.12:6839', 'nonce': 3964724197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14601': {'gid': 14601, 'name': 'a', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.12:6841/1625323518', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6840', 'nonce': 1625323518}, {'type': 'v1', 'addr': '172.21.15.12:6841', 'nonce': 1625323518}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6833/489944636', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6832', 'nonce': 489944636}, {'type': 'v1', 'addr': '172.21.15.119:6833', 'nonce': 489944636}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24434': {'gid': 24434, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6833/676872767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6832', 'nonce': 676872767}, {'type': 'v1', 'addr': '172.21.15.98:6833', 'nonce': 676872767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/3086232870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 3086232870}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 3086232870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6837/3417248856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 3417248856}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 3417248856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'e', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.98:6835/1575072845', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 1575072845}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 1575072845}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.119:6839/3964855150', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 3964855150}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 3964855150}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.98:6837/390846726', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 390846726}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 390846726}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24518': {'gid': 24518, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.98:6839/2784619271', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 2784619271}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 2784619271}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24518, 'qdb_cluster': [24518, 24482, 24475, 24458, 14601]} 2024-09-16T01:00:26.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-16T01:00:26.988 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-16T01:00:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:27.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:27 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2824225292' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:27.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:27 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2824225292' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:27.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:27 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2824225292' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:27.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.753+0000 7f9efca49640 1 -- 172.21.15.12:0/4292636202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ef8106f10 msgr2=0x7f9ef810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.753+0000 7f9efca49640 1 --2- 172.21.15.12:0/4292636202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ef8106f10 0x7f9ef810ea90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009ca0 tx=0x7f9ef002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.753+0000 7f9efca49640 1 -- 172.21.15.12:0/4292636202 shutdown_connections 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.753+0000 7f9efca49640 1 --2- 172.21.15.12:0/4292636202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ef8106f10 0x7f9ef810ea90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.753+0000 7f9efca49640 1 --2- 172.21.15.12:0/4292636202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef8102790 0x7f9ef81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.753+0000 7f9efca49640 1 --2- 172.21.15.12:0/4292636202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ef8101de0 0x7f9ef81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.753+0000 7f9efca49640 1 -- 172.21.15.12:0/4292636202 >> 172.21.15.12:0/4292636202 conn(0x7f9ef80fd8c0 msgr2=0x7f9ef80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.753+0000 7f9efca49640 1 -- 172.21.15.12:0/4292636202 shutdown_connections 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.753+0000 7f9efca49640 1 -- 172.21.15.12:0/4292636202 wait complete. 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9efca49640 1 Processor -- start 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9efca49640 1 -- start start 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9efca49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ef8101de0 0x7f9ef80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9efca49640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef8102790 0x7f9ef8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9efca49640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ef8106f10 0x7f9ef8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9efca49640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef8111f90 con 0x7f9ef8101de0 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9efca49640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef8111e10 con 0x7f9ef8106f10 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9efca49640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef8112110 con 0x7f9ef8102790 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9ef659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ef8101de0 0x7f9ef80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9ef659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ef8101de0 0x7f9ef80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59762/0 (socket says 172.21.15.12:59762) 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9ef659c640 1 -- 172.21.15.12:0/882636976 learned_addr learned my addr 172.21.15.12:0/882636976 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9ef6d9d640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ef8106f10 0x7f9ef8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9eeffff640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef8102790 0x7f9ef8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9ef659c640 1 -- 172.21.15.12:0/882636976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef8102790 msgr2=0x7f9ef8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9ef659c640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef8102790 0x7f9ef8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9ef659c640 1 -- 172.21.15.12:0/882636976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ef8106f10 msgr2=0x7f9ef8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9ef659c640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ef8106f10 0x7f9ef8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9ef659c640 1 -- 172.21.15.12:0/882636976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef81a69c0 con 0x7f9ef8101de0 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.754+0000 7f9ef6d9d640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ef8106f10 0x7f9ef8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.755+0000 7f9ef659c640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ef8101de0 0x7f9ef80744f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c890 tx=0x7f9ee800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.755+0000 7f9eef7fe640 1 -- 172.21.15.12:0/882636976 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8004220 con 0x7f9ef8101de0 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.755+0000 7f9eef7fe640 1 -- 172.21.15.12:0/882636976 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee80043c0 con 0x7f9ef8101de0 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.755+0000 7f9efca49640 1 -- 172.21.15.12:0/882636976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef81a6cb0 con 0x7f9ef8101de0 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.755+0000 7f9eef7fe640 1 -- 172.21.15.12:0/882636976 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80049e0 con 0x7f9ef8101de0 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.755+0000 7f9efca49640 1 -- 172.21.15.12:0/882636976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef81a71e0 con 0x7f9ef8101de0 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.757+0000 7f9eef7fe640 1 -- 172.21.15.12:0/882636976 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9ee80079b0 con 0x7f9ef8101de0 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.757+0000 7f9efee22740 1 Processor -- start 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9efee22740 1 -- start start 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9efee22740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56353921e9d0 0x56353921edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9efee22740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x563539229670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9efee22740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563539229bb0 0x56353922bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9efee22740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563539185090 con 0x56353921f2f0 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9efee22740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56353912ca70 con 0x563539229bb0 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9efee22740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563539181050 con 0x56353921e9d0 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9ef659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x563539229670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9eef7fe640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ee40a3350 0x7f9ee40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9ef659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x563539229670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59768/0 (socket says 172.21.15.12:59768) 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9ef659c640 1 -- 172.21.15.12:0/1773470618 learned_addr learned my addr 172.21.15.12:0/1773470618 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9ef6d9d640 1 --2- 172.21.15.12:0/1773470618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56353921e9d0 0x56353921edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9eeffff640 1 --2- 172.21.15.12:0/1773470618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563539229bb0 0x56353922bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9ef6d9d640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ee40a3350 0x7f9ee40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9eef7fe640 1 -- 172.21.15.12:0/882636976 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f9ee80cfaf0 con 0x7f9ef8101de0 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9ef659c640 1 -- 172.21.15.12:0/1773470618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56353921e9d0 msgr2=0x56353921edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9ef659c640 1 --2- 172.21.15.12:0/1773470618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56353921e9d0 0x56353921edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9ef659c640 1 -- 172.21.15.12:0/1773470618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563539229bb0 msgr2=0x56353922bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9ef659c640 1 --2- 172.21.15.12:0/1773470618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563539229bb0 0x56353922bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.758+0000 7f9ef659c640 1 -- 172.21.15.12:0/1773470618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563539139130 con 0x56353921f2f0 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.759+0000 7f9eeffff640 1 --2- 172.21.15.12:0/1773470618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563539229bb0 0x56353922bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.759+0000 7f9ef659c640 1 --2- 172.21.15.12:0/1773470618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x563539229670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80cd0d0 tx=0x7f9ee8005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d0dcf5477549a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.759+0000 7f9eecff9640 1 -- 172.21.15.12:0/1773470618 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee801d050 con 0x56353921f2f0 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.759+0000 7f9ef6d9d640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ee40a3350 0x7f9ee40a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005fe0 tx=0x7f9ef00095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.759+0000 7f9eecff9640 1 -- 172.21.15.12:0/1773470618 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee809c370 con 0x56353921f2f0 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.759+0000 7f9eecff9640 1 -- 172.21.15.12:0/1773470618 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80d4040 con 0x56353921f2f0 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 -- 172.21.15.12:0/1773470618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 msgr2=0x563539229670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 --2- 172.21.15.12:0/1773470618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x563539229670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80cd0d0 tx=0x7f9ee8005300 comp rx=0 tx=0).stop 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 -- 172.21.15.12:0/1773470618 shutdown_connections 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 --2- 172.21.15.12:0/1773470618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563539229bb0 0x56353922bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 --2- 172.21.15.12:0/1773470618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x563539229670 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 --2- 172.21.15.12:0/1773470618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56353921e9d0 0x56353921edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 -- 172.21.15.12:0/1773470618 >> 172.21.15.12:0/1773470618 conn(0x56353921af60 msgr2=0x56353921b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 -- 172.21.15.12:0/1773470618 shutdown_connections 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 -- 172.21.15.12:0/1773470618 wait complete. 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 -- start start 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.760+0000 7f9efee22740 1 Processor -- start 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9efee22740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56353921e9d0 0x563539229400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9efee22740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921f2f0 0x563539226750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9efee22740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563539229bb0 0x563539226c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9efee22740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56353922c780 con 0x563539229bb0 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9efee22740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56353913ff20 con 0x56353921f2f0 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9efee22740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56353922c900 con 0x56353921e9d0 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9efee22740 10 client.0 _ll_register_callbacks cb 0x563539109030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9ef6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563539229bb0 0x563539226c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9ef6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563539229bb0 0x563539226c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59784/0 (socket says 172.21.15.12:59784) 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9ef6d9d640 1 -- 172.21.15.12:0/3114922304 learned_addr learned my addr 172.21.15.12:0/3114922304 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9ef659c640 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56353921e9d0 0x563539229400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9eeffff640 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921f2f0 0x563539226750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9ef6d9d640 1 -- 172.21.15.12:0/3114922304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56353921e9d0 msgr2=0x563539229400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9ef6d9d640 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56353921e9d0 0x563539229400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9ef6d9d640 1 -- 172.21.15.12:0/3114922304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921f2f0 msgr2=0x563539226750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9ef6d9d640 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921f2f0 0x563539226750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9ef6d9d640 1 -- 172.21.15.12:0/3114922304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563538ef62b0 con 0x563539229bb0 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9ef6d9d640 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563539229bb0 0x563539226c90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0035000 tx=0x7f9ef002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1cef8a2cf440d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9eddffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9eddffb640 1 -- 172.21.15.12:0/3114922304 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef004d070 con 0x563539229bb0 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9eddffb640 1 -- 172.21.15.12:0/3114922304 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f9ef0004450 con 0x563539229bb0 2024-09-16T01:00:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.761+0000 7f9efee22740 1 -- 172.21.15.12:0/3114922304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ee809c370 con 0x563539229bb0 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9eddffb640 1 -- 172.21.15.12:0/3114922304 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9ef0043070 con 0x563539229bb0 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9efee22740 10 client.15054 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9efee22740 1 -- 172.21.15.12:0/3114922304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563539238050 con 0x563539229bb0 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9eddffb640 1 -- 172.21.15.12:0/3114922304 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee809c370 con 0x563539229bb0 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9eddffb640 1 -- 172.21.15.12:0/3114922304 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9ef00305c0 con 0x563539229bb0 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9efee22740 10 client.15054 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9efee22740 10 client.15054 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9efee22740 20 client.15054 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9efee22740 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x56353923a700 0x56353923bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9efee22740 4 client.15054 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9efee22740 1 -- 172.21.15.12:0/3114922304 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563539192600 con 0x56353923a700 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.762+0000 7f9ef659c640 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x56353923a700 0x56353923bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9eddffb640 10 client.15054 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:00:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9ef659c640 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x56353923a700 0x56353923bb70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5e2f0588496dda2a server_cookie=1b02d8c943c2241b in_seq=0 out_seq=0 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9eddffb640 1 -- 172.21.15.12:0/3114922304 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563539192600 con 0x56353923a700 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9eddffb640 10 client.15054 handle_command_reply: tid=0 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9efee22740 1 client.15054 shutdown 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9efee22740 1 -- 172.21.15.12:0/3114922304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563539229bb0 msgr2=0x563539226c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9efee22740 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563539229bb0 0x563539226c90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0035000 tx=0x7f9ef002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9efee22740 1 -- 172.21.15.12:0/3114922304 shutdown_connections 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9efee22740 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x56353923a700 0x56353923bb70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9eddffb640 0 client.15054 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9efee22740 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563539229bb0 0x563539226c90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9efee22740 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921f2f0 0x563539226750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9efee22740 1 --2- 172.21.15.12:0/3114922304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56353921e9d0 0x563539229400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.763+0000 7f9efee22740 1 -- 172.21.15.12:0/3114922304 >> 172.21.15.12:0/3114922304 conn(0x56353921af60 msgr2=0x563539220c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.764+0000 7f9efee22740 1 -- 172.21.15.12:0/3114922304 shutdown_connections 2024-09-16T01:00:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.764+0000 7f9efee22740 1 -- 172.21.15.12:0/3114922304 wait complete. 2024-09-16T01:00:27.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.764+0000 7f9efee22740 20 client.15054 trim_cache size 0 max 16384 2024-09-16T01:00:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9efee22740 1 Processor -- start 2024-09-16T01:00:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9efee22740 1 -- start start 2024-09-16T01:00:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9efee22740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921e9d0 0x56353923bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9efee22740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921f2f0 0x56353921b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9efee22740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563539229bb0 0x563539221c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9efee22740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563539239eb0 con 0x56353921e9d0 2024-09-16T01:00:27.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9efee22740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56353923a580 con 0x56353921f2f0 2024-09-16T01:00:27.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9efee22740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56353923ac50 con 0x563539229bb0 2024-09-16T01:00:27.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9ef659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921e9d0 0x56353923bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9ef659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921e9d0 0x56353923bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59798/0 (socket says 172.21.15.12:59798) 2024-09-16T01:00:27.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9ef659c640 1 -- 172.21.15.12:0/3945309681 learned_addr learned my addr 172.21.15.12:0/3945309681 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:27.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9ef6d9d640 1 --2- 172.21.15.12:0/3945309681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563539229bb0 0x563539221c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9eeffff640 1 --2- 172.21.15.12:0/3945309681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921f2f0 0x56353921b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9ef659c640 1 -- 172.21.15.12:0/3945309681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563539229bb0 msgr2=0x563539221c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:27.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9ef659c640 1 --2- 172.21.15.12:0/3945309681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563539229bb0 0x563539221c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9ef659c640 1 -- 172.21.15.12:0/3945309681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921f2f0 msgr2=0x56353921b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:27.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9ef659c640 1 --2- 172.21.15.12:0/3945309681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921f2f0 0x56353921b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.782+0000 7f9ef659c640 1 -- 172.21.15.12:0/3945309681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56353922c890 con 0x56353921e9d0 2024-09-16T01:00:27.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.783+0000 7f9ef659c640 1 --2- 172.21.15.12:0/3945309681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921e9d0 0x56353923bb70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ee809b970 tx=0x7f9ee809bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5adfd17ccd1dc9c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:27.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.783+0000 7f9edffff640 1 -- 172.21.15.12:0/3945309681 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee801d040 con 0x56353921e9d0 2024-09-16T01:00:27.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.783+0000 7f9edffff640 1 -- 172.21.15.12:0/3945309681 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee80a0020 con 0x56353921e9d0 2024-09-16T01:00:27.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.783+0000 7f9edffff640 1 -- 172.21.15.12:0/3945309681 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80a4450 con 0x56353921e9d0 2024-09-16T01:00:27.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.783+0000 7f9efee22740 1 -- 172.21.15.12:0/3945309681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921e9d0 msgr2=0x56353923bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.783+0000 7f9efee22740 1 --2- 172.21.15.12:0/3945309681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921e9d0 0x56353923bb70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ee809b970 tx=0x7f9ee809bb70 comp rx=0 tx=0).stop 2024-09-16T01:00:27.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.783+0000 7f9efee22740 1 -- 172.21.15.12:0/3945309681 shutdown_connections 2024-09-16T01:00:27.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 --2- 172.21.15.12:0/3945309681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563539229bb0 0x563539221c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 --2- 172.21.15.12:0/3945309681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921f2f0 0x56353921b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 --2- 172.21.15.12:0/3945309681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921e9d0 0x56353923bb70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 -- 172.21.15.12:0/3945309681 >> 172.21.15.12:0/3945309681 conn(0x56353921af60 msgr2=0x563539221560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 -- 172.21.15.12:0/3945309681 shutdown_connections 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 -- 172.21.15.12:0/3945309681 wait complete. 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 -- start start 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 Processor -- start 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921e9d0 0x5635392442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x56353923d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563539229bb0 0x56353923db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56353923b9f0 con 0x56353921f2f0 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56353923b320 con 0x56353921e9d0 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56353923c0c0 con 0x563539229bb0 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.784+0000 7f9efee22740 10 client.0 _ll_register_callbacks cb 0x7f9ef0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eeffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x56353923d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eeffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x56353923d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59800/0 (socket says 172.21.15.12:59800) 2024-09-16T01:00:27.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eeffff640 1 -- 172.21.15.12:0/471842351 learned_addr learned my addr 172.21.15.12:0/471842351 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9ef659c640 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921e9d0 0x5635392442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9ef6d9d640 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563539229bb0 0x56353923db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eeffff640 1 -- 172.21.15.12:0/471842351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563539229bb0 msgr2=0x56353923db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eeffff640 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563539229bb0 0x56353923db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eeffff640 1 -- 172.21.15.12:0/471842351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921e9d0 msgr2=0x5635392442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eeffff640 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921e9d0 0x5635392442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eeffff640 1 -- 172.21.15.12:0/471842351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56353923e070 con 0x56353921f2f0 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eeffff640 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x56353923d5f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x56353921c2e0 tx=0x7f9ee00136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebeaafc2c9cb19d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eddffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eddffb640 1 -- 172.21.15.12:0/471842351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee001c070 con 0x56353921f2f0 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eddffb640 1 -- 172.21.15.12:0/471842351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f9ee0016460 con 0x56353921f2f0 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9efee22740 1 -- 172.21.15.12:0/471842351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ee80a0020 con 0x56353921f2f0 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.785+0000 7f9eddffb640 1 -- 172.21.15.12:0/471842351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9ee0028050 con 0x56353921f2f0 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9efee22740 10 client.15060 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:27.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9efee22740 1 -- 172.21.15.12:0/471842351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563539242c00 con 0x56353921f2f0 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9eddffb640 1 -- 172.21.15.12:0/471842351 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee80a0020 con 0x56353921f2f0 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9eddffb640 1 -- 172.21.15.12:0/471842351 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9ee0015720 con 0x56353921f2f0 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9efee22740 10 client.15060 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9efee22740 10 client.15060 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9efee22740 20 client.15060 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9efee22740 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x56353923a700 0x5635392a8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9efee22740 4 client.15060 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9efee22740 1 -- 172.21.15.12:0/471842351 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "status"}) -- 0x56353918cb10 con 0x56353923a700 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9ef659c640 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x56353923a700 0x5635392a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9eddffb640 10 client.15060 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.786+0000 7f9ef659c640 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x56353923a700 0x5635392a8530 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e697251e7fb314fb server_cookie=dbe06056602b8e88 in_seq=0 out_seq=0 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9eddffb640 1 -- 172.21.15.12:0/471842351 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56353918cb10 con 0x56353923a700 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9eddffb640 10 client.15060 handle_command_reply: tid=0 2024-09-16T01:00:27.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 client.15060 shutdown 2024-09-16T01:00:27.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 -- 172.21.15.12:0/471842351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 msgr2=0x56353923d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x56353923d5f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x56353921c2e0 tx=0x7f9ee00136b0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 -- 172.21.15.12:0/471842351 shutdown_connections 2024-09-16T01:00:27.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x56353923a700 0x5635392a8530 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563539229bb0 0x56353923db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353921f2f0 0x56353923d5f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 --2- 172.21.15.12:0/471842351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353921e9d0 0x5635392442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 -- 172.21.15.12:0/471842351 >> 172.21.15.12:0/471842351 conn(0x56353921af60 msgr2=0x56353921a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:27.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9eddffb640 0 client.15060 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:00:27.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 -- 172.21.15.12:0/471842351 shutdown_connections 2024-09-16T01:00:27.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 1 -- 172.21.15.12:0/471842351 wait complete. 2024-09-16T01:00:27.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.787+0000 7f9efee22740 20 client.15060 trim_cache size 0 max 16384 2024-09-16T01:00:27.797 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 4, 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 14601, 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 66.215541454000004, 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 87, 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 124.089947186 2024-09-16T01:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:00:27.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 -- 172.21.15.12:0/882636976 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ee40a3350 msgr2=0x7f9ee40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ee40a3350 0x7f9ee40a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005fe0 tx=0x7f9ef00095c0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 -- 172.21.15.12:0/882636976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ef8101de0 msgr2=0x7f9ef80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ef8101de0 0x7f9ef80744f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c890 tx=0x7f9ee800cd50 comp rx=0 tx=0).stop 2024-09-16T01:00:27.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 -- 172.21.15.12:0/882636976 shutdown_connections 2024-09-16T01:00:27.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ee40a3350 0x7f9ee40a5810 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ef8106f10 0x7f9ef8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef8102790 0x7f9ef8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 --2- 172.21.15.12:0/882636976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ef8101de0 0x7f9ef80744f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 -- 172.21.15.12:0/882636976 >> 172.21.15.12:0/882636976 conn(0x7f9ef80fd8c0 msgr2=0x7f9ef80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:27.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 -- 172.21.15.12:0/882636976 shutdown_connections 2024-09-16T01:00:27.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:27.788+0000 7f9efca49640 1 -- 172.21.15.12:0/882636976 wait complete. 2024-09-16T01:00:28.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:28 smithi119 ceph-mon[35049]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:28.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:28 smithi012 ceph-mon[31197]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:28.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:28 smithi098 ceph-mon[35346]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:28.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.e status 2024-09-16T01:00:28.918 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:29.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.398+0000 7f7bfe663640 1 -- 172.21.15.12:0/1806270688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bf8100310 msgr2=0x7f7bf81006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.398+0000 7f7bfe663640 1 --2- 172.21.15.12:0/1806270688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bf8100310 0x7f7bf81006f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009ca0 tx=0x7f7be802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.398+0000 7f7bfe663640 1 -- 172.21.15.12:0/1806270688 shutdown_connections 2024-09-16T01:00:29.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.398+0000 7f7bfe663640 1 --2- 172.21.15.12:0/1806270688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bf8106f30 0x7f7bf810eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.398+0000 7f7bfe663640 1 --2- 172.21.15.12:0/1806270688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bf8100cc0 0x7f7bf8106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.398+0000 7f7bfe663640 1 --2- 172.21.15.12:0/1806270688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bf8100310 0x7f7bf81006f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.398+0000 7f7bfe663640 1 -- 172.21.15.12:0/1806270688 >> 172.21.15.12:0/1806270688 conn(0x7f7bf8077210 msgr2=0x7f7bf80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:29.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.398+0000 7f7bfe663640 1 -- 172.21.15.12:0/1806270688 shutdown_connections 2024-09-16T01:00:29.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.398+0000 7f7bfe663640 1 -- 172.21.15.12:0/1806270688 wait complete. 2024-09-16T01:00:29.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfe663640 1 Processor -- start 2024-09-16T01:00:29.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfe663640 1 -- start start 2024-09-16T01:00:29.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfe663640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bf8100310 0x7f7bf8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfe663640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bf8100cc0 0x7f7bf81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfe663640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bf8106f30 0x7f7bf819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfe663640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf8111f50 con 0x7f7bf8106f30 2024-09-16T01:00:29.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfe663640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf8111dd0 con 0x7f7bf8100310 2024-09-16T01:00:29.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfe663640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf81120d0 con 0x7f7bf8100cc0 2024-09-16T01:00:29.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfcc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bf8106f30 0x7f7bf819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfcc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bf8106f30 0x7f7bf819cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59822/0 (socket says 172.21.15.12:59822) 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bfcc00640 1 -- 172.21.15.12:0/3162877656 learned_addr learned my addr 172.21.15.12:0/3162877656 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bf8100310 0x7f7bf8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.399+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bf8100cc0 0x7f7bf81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bfcc00640 1 -- 172.21.15.12:0/3162877656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bf8100cc0 msgr2=0x7f7bf81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bfcc00640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bf8100cc0 0x7f7bf81989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bfcc00640 1 -- 172.21.15.12:0/3162877656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bf8100310 msgr2=0x7f7bf8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bfcc00640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bf8100310 0x7f7bf8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bfcc00640 1 -- 172.21.15.12:0/3162877656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf819d410 con 0x7f7bf8106f30 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bfcc00640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bf8106f30 0x7f7bf819cd30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000e970 tx=0x7f7bf000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bf57fa640 1 -- 172.21.15.12:0/3162877656 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf000ccc0 con 0x7f7bf8106f30 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bfe663640 1 -- 172.21.15.12:0/3162877656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf819d700 con 0x7f7bf8106f30 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bf57fa640 1 -- 172.21.15.12:0/3162877656 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bf000ce60 con 0x7f7bf8106f30 2024-09-16T01:00:29.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bf57fa640 1 -- 172.21.15.12:0/3162877656 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0010490 con 0x7f7bf8106f30 2024-09-16T01:00:29.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.400+0000 7f7bfe663640 1 -- 172.21.15.12:0/3162877656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf81a4fe0 con 0x7f7bf8106f30 2024-09-16T01:00:29.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.402+0000 7f7bf57fa640 1 -- 172.21.15.12:0/3162877656 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7bf0005020 con 0x7f7bf8106f30 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7c00a3c740 1 Processor -- start 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7c00a3c740 1 -- start start 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b719d0 0x557812b71db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b722f0 0x557812b7c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b7cbb0 0x557812b7efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557812ad8090 con 0x557812b7cbb0 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557812a7fa70 con 0x557812b719d0 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557812ad4050 con 0x557812b722f0 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7bf77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b7cbb0 0x557812b7efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7bf77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b7cbb0 0x557812b7efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59830/0 (socket says 172.21.15.12:59830) 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.403+0000 7f7bf77fe640 1 -- 172.21.15.12:0/2784863939 learned_addr learned my addr 172.21.15.12:0/2784863939 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bf57fa640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7be00a32d0 0x7f7be00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/2784863939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b722f0 0x557812b7c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/2784863939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b719d0 0x557812b71db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bfcc00640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7be00a32d0 0x7f7be00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bf77fe640 1 -- 172.21.15.12:0/2784863939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b722f0 msgr2=0x557812b7c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/2784863939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b722f0 0x557812b7c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bf77fe640 1 -- 172.21.15.12:0/2784863939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b719d0 msgr2=0x557812b71db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/2784863939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b719d0 0x557812b71db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bf77fe640 1 -- 172.21.15.12:0/2784863939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557812a8c130 con 0x557812b7cbb0 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bf57fa640 1 -- 172.21.15.12:0/3162877656 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f7bf00d0310 con 0x7f7bf8106f30 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/2784863939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b7cbb0 0x557812b7efa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7bec013630 tx=0x7f7bec00c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bbff4391faae4d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bde7fc640 1 -- 172.21.15.12:0/2784863939 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec019030 con 0x557812b7cbb0 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bfcc00640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7be00a32d0 0x7f7be00a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7bf009c3c0 tx=0x7f7bf0004a50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bde7fc640 1 -- 172.21.15.12:0/2784863939 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bec005500 con 0x557812b7cbb0 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.404+0000 7f7bde7fc640 1 -- 172.21.15.12:0/2784863939 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec011800 con 0x557812b7cbb0 2024-09-16T01:00:29.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.405+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2784863939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b7cbb0 msgr2=0x557812b7efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.405+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/2784863939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b7cbb0 0x557812b7efa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7bec013630 tx=0x7f7bec00c690 comp rx=0 tx=0).stop 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.405+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2784863939 shutdown_connections 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.405+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/2784863939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b7cbb0 0x557812b7efa0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.405+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/2784863939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b722f0 0x557812b7c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.405+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/2784863939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b719d0 0x557812b71db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.405+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2784863939 >> 172.21.15.12:0/2784863939 conn(0x557812b6df60 msgr2=0x557812b6e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.405+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2784863939 shutdown_connections 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.405+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2784863939 wait complete. 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.405+0000 7f7c00a3c740 1 -- start start 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7c00a3c740 1 Processor -- start 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b7c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b722f0 0x557812b79810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b7cbb0 0x557812b79d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557812b7f780 con 0x557812b719d0 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557812a92f20 con 0x557812b7cbb0 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557812b7f900 con 0x557812b722f0 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7c00a3c740 10 client.0 _ll_register_callbacks cb 0x557812a5c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7bf77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b7c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7bf77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b7c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59842/0 (socket says 172.21.15.12:59842) 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7bf77fe640 1 -- 172.21.15.12:0/1830905445 learned_addr learned my addr 172.21.15.12:0/1830905445 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b722f0 0x557812b79810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7bf77fe640 1 -- 172.21.15.12:0/1830905445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b722f0 msgr2=0x557812b79810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b722f0 0x557812b79810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7bf77fe640 1 -- 172.21.15.12:0/1830905445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b7cbb0 msgr2=0x557812b79d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.406+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b7cbb0 0x557812b79d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.407+0000 7f7bf77fe640 1 -- 172.21.15.12:0/1830905445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578128492b0 con 0x557812b719d0 2024-09-16T01:00:29.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.407+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b7c4c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00c420 tx=0x7f7bec004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f09d68d01a393d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.407+0000 7f7bd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.407+0000 7f7bd77fe640 1 -- 172.21.15.12:0/1830905445 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec019040 con 0x557812b719d0 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.407+0000 7f7bd77fe640 1 -- 172.21.15.12:0/1830905445 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f7bec005190 con 0x557812b719d0 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.407+0000 7f7c00a3c740 1 -- 172.21.15.12:0/1830905445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bec005500 con 0x557812b719d0 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.407+0000 7f7bd77fe640 1 -- 172.21.15.12:0/1830905445 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7bec004030 con 0x557812b719d0 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.407+0000 7f7c00a3c740 10 client.15072 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.407+0000 7f7c00a3c740 1 -- 172.21.15.12:0/1830905445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557812b8b100 con 0x557812b719d0 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.407+0000 7f7bd77fe640 1 -- 172.21.15.12:0/1830905445 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bec005500 con 0x557812b719d0 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.408+0000 7f7bd77fe640 1 -- 172.21.15.12:0/1830905445 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7bec025020 con 0x557812b719d0 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.408+0000 7f7c00a3c740 10 client.15072 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.408+0000 7f7c00a3c740 10 client.15072 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.408+0000 7f7c00a3c740 20 client.15072 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.408+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x557812b8d430 0x557812b8e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.408+0000 7f7c00a3c740 4 client.15072 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:00:29.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.408+0000 7f7c00a3c740 1 -- 172.21.15.12:0/1830905445 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557812ae5600 con 0x557812b8d430 2024-09-16T01:00:29.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.408+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x557812b8d430 0x557812b8e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.408+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x557812b8d430 0x557812b8e8a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a07a35676ca9d692 server_cookie=c302d6e552cca5b7 in_seq=0 out_seq=0 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.408+0000 7f7bd77fe640 10 client.15072 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.409+0000 7f7bd77fe640 1 -- 172.21.15.12:0/1830905445 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557812ae5600 con 0x557812b8d430 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.409+0000 7f7bd77fe640 10 client.15072 handle_command_reply: tid=0 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.409+0000 7f7c00a3c740 1 client.15072 shutdown 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.409+0000 7f7c00a3c740 1 -- 172.21.15.12:0/1830905445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 msgr2=0x557812b7c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.409+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b7c4c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00c420 tx=0x7f7bec004ef0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.409+0000 7f7c00a3c740 1 -- 172.21.15.12:0/1830905445 shutdown_connections 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.409+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x557812b8d430 0x557812b8e8a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.409+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b7cbb0 0x557812b79d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.409+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b722f0 0x557812b79810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.409+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/1830905445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b7c4c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.410+0000 7f7c00a3c740 1 -- 172.21.15.12:0/1830905445 >> 172.21.15.12:0/1830905445 conn(0x557812b6df60 msgr2=0x557812b73c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:29.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.410+0000 7f7bd77fe640 0 client.15072 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:00:29.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.410+0000 7f7c00a3c740 1 -- 172.21.15.12:0/1830905445 shutdown_connections 2024-09-16T01:00:29.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.410+0000 7f7c00a3c740 1 -- 172.21.15.12:0/1830905445 wait complete. 2024-09-16T01:00:29.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.410+0000 7f7c00a3c740 20 client.15072 trim_cache size 0 max 16384 2024-09-16T01:00:29.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.428+0000 7f7c00a3c740 1 Processor -- start 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.428+0000 7f7c00a3c740 1 -- start start 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.428+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.428+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 0x557812b790f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.428+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b7cbb0 0x557812b68ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.428+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557812b8cbe0 con 0x557812b719d0 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.428+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557812b8d2b0 con 0x557812b722f0 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.428+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557812b8d980 con 0x557812b7cbb0 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.428+0000 7f7bf77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bf77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59848/0 (socket says 172.21.15.12:59848) 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bf77fe640 1 -- 172.21.15.12:0/3151533534 learned_addr learned my addr 172.21.15.12:0/3151533534 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/3151533534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 0x557812b790f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bf77fe640 1 -- 172.21.15.12:0/3151533534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b7cbb0 msgr2=0x557812b68ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/3151533534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b7cbb0 0x557812b68ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bf77fe640 1 -- 172.21.15.12:0/3151533534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 msgr2=0x557812b790f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/3151533534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 0x557812b790f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bf77fe640 1 -- 172.21.15.12:0/3151533534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557812b7c830 con 0x557812b719d0 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/3151533534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 0x557812b790f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/3151533534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8e8a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0058c0 tx=0x7f7bec00c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208ea38de6ed5418 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bddffb640 1 -- 172.21.15.12:0/3151533534 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec019040 con 0x557812b719d0 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bddffb640 1 -- 172.21.15.12:0/3151533534 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bec00c690 con 0x557812b719d0 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.429+0000 7f7bddffb640 1 -- 172.21.15.12:0/3151533534 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec003850 con 0x557812b719d0 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.430+0000 7f7c00a3c740 1 -- 172.21.15.12:0/3151533534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 msgr2=0x557812b8e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.430+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/3151533534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8e8a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0058c0 tx=0x7f7bec00c530 comp rx=0 tx=0).stop 2024-09-16T01:00:29.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.430+0000 7f7c00a3c740 1 -- 172.21.15.12:0/3151533534 shutdown_connections 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.430+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/3151533534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b7cbb0 0x557812b68ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.430+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/3151533534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 0x557812b790f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.430+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/3151533534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8e8a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.430+0000 7f7c00a3c740 1 -- 172.21.15.12:0/3151533534 >> 172.21.15.12:0/3151533534 conn(0x557812b6df60 msgr2=0x557812b745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.430+0000 7f7c00a3c740 1 -- 172.21.15.12:0/3151533534 shutdown_connections 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.430+0000 7f7c00a3c740 1 -- 172.21.15.12:0/3151533534 wait complete. 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.430+0000 7f7c00a3c740 1 -- start start 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7c00a3c740 1 Processor -- start 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 0x557812b8ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7c00a3c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b7cbb0 0x557812b904a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557812b8e720 con 0x557812b719d0 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557812b8e050 con 0x557812b722f0 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7c00a3c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557812b8edf0 con 0x557812b7cbb0 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7c00a3c740 10 client.0 _ll_register_callbacks cb 0x7f7be8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7bf77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7bf77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59858/0 (socket says 172.21.15.12:59858) 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7bf77fe640 1 -- 172.21.15.12:0/2790134970 learned_addr learned my addr 172.21.15.12:0/2790134970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 0x557812b8ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7bf77fe640 1 -- 172.21.15.12:0/2790134970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b7cbb0 msgr2=0x557812b904a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b7cbb0 0x557812b904a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7bf77fe640 1 -- 172.21.15.12:0/2790134970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 msgr2=0x557812b8ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 0x557812b8ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7bf77fe640 1 -- 172.21.15.12:0/2790134970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557812bf5bb0 con 0x557812b719d0 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.431+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 0x557812b8ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7bf77fe640 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8fa20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00c480 tx=0x7f7bec005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d8e17d8216cb00 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7bd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7bd77fe640 1 -- 172.21.15.12:0/2790134970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec041060 con 0x557812b719d0 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7bd77fe640 1 -- 172.21.15.12:0/2790134970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f7bec013230 con 0x557812b719d0 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2790134970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557812adfb10 con 0x557812b719d0 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7bd77fe640 1 -- 172.21.15.12:0/2790134970 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7bec048050 con 0x557812b719d0 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7c00a3c740 10 client.15078 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2790134970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557812bf6eb0 con 0x557812b719d0 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7bd77fe640 1 -- 172.21.15.12:0/2790134970 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557812adfb10 con 0x557812b719d0 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7bd77fe640 1 -- 172.21.15.12:0/2790134970 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7bec025070 con 0x557812b719d0 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7c00a3c740 10 client.15078 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7c00a3c740 10 client.15078 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.432+0000 7f7c00a3c740 20 client.15078 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.433+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x557812bfb840 0x557812bfa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.433+0000 7f7c00a3c740 4 client.15078 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.433+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2790134970 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "status"}) -- 0x557812a5c0e0 con 0x557812bfb840 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.433+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x557812bfb840 0x557812bfa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.433+0000 7f7bf7fff640 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x557812bfb840 0x557812bfa550 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ec3a1b2984b5daf1 server_cookie=aa6d5aeb392544ef in_seq=0 out_seq=0 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.433+0000 7f7bd77fe640 10 client.15078 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.433+0000 7f7bd77fe640 1 -- 172.21.15.12:0/2790134970 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557812a5c0e0 con 0x557812bfb840 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.433+0000 7f7bd77fe640 10 client.15078 handle_command_reply: tid=0 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.433+0000 7f7c00a3c740 1 client.15078 shutdown 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2790134970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 msgr2=0x557812b8fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8fa20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00c480 tx=0x7f7bec005c50 comp rx=0 tx=0).stop 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2790134970 shutdown_connections 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x557812bfb840 0x557812bfa550 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557812b7cbb0 0x557812b904a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557812b722f0 0x557812b8ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 1 --2- 172.21.15.12:0/2790134970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557812b719d0 0x557812b8fa20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2790134970 >> 172.21.15.12:0/2790134970 conn(0x557812b6df60 msgr2=0x557812b6d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7bd77fe640 0 client.15078 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:00:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2790134970 shutdown_connections 2024-09-16T01:00:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 1 -- 172.21.15.12:0/2790134970 wait complete. 2024-09-16T01:00:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7c00a3c740 20 client.15078 trim_cache size 0 max 16384 2024-09-16T01:00:29.443 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:00:29.443 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:00:29.443 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 3, 2024-09-16T01:00:29.443 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24458, 2024-09-16T01:00:29.443 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:00:29.443 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:00:29.444 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:00:29.444 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 68.673089614000006, 2024-09-16T01:00:29.444 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-16T01:00:29.444 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 87, 2024-09-16T01:00:29.444 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T01:00:29.444 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 142.25800247500001 2024-09-16T01:00:29.444 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:00:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7bfe663640 1 -- 172.21.15.12:0/3162877656 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7be00a32d0 msgr2=0x7f7be00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7bfe663640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7be00a32d0 0x7f7be00a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7bf009c3c0 tx=0x7f7bf0004a50 comp rx=0 tx=0).stop 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7bfe663640 1 -- 172.21.15.12:0/3162877656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bf8106f30 msgr2=0x7f7bf819cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7bfe663640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bf8106f30 0x7f7bf819cd30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000e970 tx=0x7f7bf000ed70 comp rx=0 tx=0).stop 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7bfe663640 1 -- 172.21.15.12:0/3162877656 shutdown_connections 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7bfe663640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f7be00a32d0 0x7f7be00a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7bfe663640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bf8106f30 0x7f7bf819cd30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7bfe663640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bf8100cc0 0x7f7bf81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.434+0000 7f7bfe663640 1 --2- 172.21.15.12:0/3162877656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bf8100310 0x7f7bf8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.435+0000 7f7bfe663640 1 -- 172.21.15.12:0/3162877656 >> 172.21.15.12:0/3162877656 conn(0x7f7bf8077210 msgr2=0x7f7bf80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.435+0000 7f7bfe663640 1 -- 172.21.15.12:0/3162877656 shutdown_connections 2024-09-16T01:00:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:29.435+0000 7f7bfe663640 1 -- 172.21.15.12:0/3162877656 wait complete. 2024-09-16T01:00:30.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-16T01:00:30.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:30 smithi119 ceph-mon[35049]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:30.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:30 smithi012 ceph-mon[31197]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:30.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:30 smithi098 ceph-mon[35346]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:30.493 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:30.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.964+0000 7f67b01d1640 1 -- 172.21.15.12:0/2865000805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8102d30 msgr2=0x7f67a8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:30.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.964+0000 7f67b01d1640 1 --2- 172.21.15.12:0/2865000805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8102d30 0x7f67a8103110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009cd0 tx=0x7f67a402a910 comp rx=0 tx=0).stop 2024-09-16T01:00:30.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.964+0000 7f67b01d1640 1 -- 172.21.15.12:0/2865000805 shutdown_connections 2024-09-16T01:00:30.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.964+0000 7f67b01d1640 1 --2- 172.21.15.12:0/2865000805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67a81082a0 0x7f67a810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.964+0000 7f67b01d1640 1 --2- 172.21.15.12:0/2865000805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67a81036e0 0x7f67a8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.964+0000 7f67b01d1640 1 --2- 172.21.15.12:0/2865000805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8102d30 0x7f67a8103110 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.964+0000 7f67b01d1640 1 -- 172.21.15.12:0/2865000805 >> 172.21.15.12:0/2865000805 conn(0x7f67a80fc7d0 msgr2=0x7f67a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.964+0000 7f67b01d1640 1 -- 172.21.15.12:0/2865000805 shutdown_connections 2024-09-16T01:00:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.964+0000 7f67b01d1640 1 -- 172.21.15.12:0/2865000805 wait complete. 2024-09-16T01:00:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.964+0000 7f67b01d1640 1 Processor -- start 2024-09-16T01:00:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67b01d1640 1 -- start start 2024-09-16T01:00:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67b01d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67a8102d30 0x7f67a8198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67b01d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a81036e0 0x7f67a8198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67b01d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67a81082a0 0x7f67a819cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67b01d1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8112160 con 0x7f67a81036e0 2024-09-16T01:00:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67b01d1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8111fe0 con 0x7f67a81082a0 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67b01d1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f67a81122e0 con 0x7f67a8102d30 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67ad76c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a81036e0 0x7f67a8198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67ad76c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a81036e0 0x7f67a8198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59870/0 (socket says 172.21.15.12:59870) 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67ad76c640 1 -- 172.21.15.12:0/36452960 learned_addr learned my addr 172.21.15.12:0/36452960 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67adf6d640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67a8102d30 0x7f67a8198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67ae76e640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67a81082a0 0x7f67a819cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67ad76c640 1 -- 172.21.15.12:0/36452960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67a8102d30 msgr2=0x7f67a8198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67ad76c640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67a8102d30 0x7f67a8198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67ad76c640 1 -- 172.21.15.12:0/36452960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67a81082a0 msgr2=0x7f67a819cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67ad76c640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67a81082a0 0x7f67a819cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67ad76c640 1 -- 172.21.15.12:0/36452960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a819d6d0 con 0x7f67a81036e0 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.965+0000 7f67ad76c640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a81036e0 0x7f67a8198c60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6798006fd0 tx=0x7f679800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.966+0000 7f679effd640 1 -- 172.21.15.12:0/36452960 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798011830 con 0x7f67a81036e0 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.966+0000 7f679effd640 1 -- 172.21.15.12:0/36452960 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6798016070 con 0x7f67a81036e0 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.966+0000 7f67b01d1640 1 -- 172.21.15.12:0/36452960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a819d9c0 con 0x7f67a81036e0 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.966+0000 7f679effd640 1 -- 172.21.15.12:0/36452960 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679800f2e0 con 0x7f67a81036e0 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.966+0000 7f67b01d1640 1 -- 172.21.15.12:0/36452960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a81a52a0 con 0x7f67a81036e0 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.968+0000 7f679effd640 1 -- 172.21.15.12:0/36452960 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f679801b460 con 0x7f67a81036e0 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.968+0000 7f67b25aa740 1 Processor -- start 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.968+0000 7f67b25aa740 1 -- start start 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x56498259edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67b25aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564982505090 con 0x56498259f2f0 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67b25aa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649824aca70 con 0x5649825a9bb0 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67b25aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564982501050 con 0x56498259e9d0 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67adf6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f679effd640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67940a32d0 0x7f67940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67adf6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59874/0 (socket says 172.21.15.12:59874) 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67adf6d640 1 -- 172.21.15.12:0/2201787096 learned_addr learned my addr 172.21.15.12:0/2201787096 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67ae76e640 1 --2- 172.21.15.12:0/2201787096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x56498259edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f679effd640 1 -- 172.21.15.12:0/36452960 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f67980cf2c0 con 0x7f67a81036e0 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67ad76c640 1 --2- 172.21.15.12:0/2201787096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67ae76e640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67940a32d0 0x7f67940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67adf6d640 1 -- 172.21.15.12:0/2201787096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 msgr2=0x56498259edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67adf6d640 1 --2- 172.21.15.12:0/2201787096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x56498259edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67adf6d640 1 -- 172.21.15.12:0/2201787096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 msgr2=0x5649825abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67adf6d640 1 --2- 172.21.15.12:0/2201787096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825abfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67adf6d640 1 -- 172.21.15.12:0/2201787096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649824b9130 con 0x56498259f2f0 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67ae76e640 1 --2- 172.21.15.12:0/2201787096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x56498259edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.969+0000 7f67adf6d640 1 --2- 172.21.15.12:0/2201787096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a9670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009cd0 tx=0x7f67a402f320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30893b0dc0e3f122 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f67ae76e640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67940a32d0 0x7f67940a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009d10 tx=0x7f67a00090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f6793fff640 1 -- 172.21.15.12:0/2201787096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4031e40 con 0x56498259f2f0 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f6793fff640 1 -- 172.21.15.12:0/2201787096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67a4036030 con 0x56498259f2f0 2024-09-16T01:00:30.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f6793fff640 1 -- 172.21.15.12:0/2201787096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4004330 con 0x56498259f2f0 2024-09-16T01:00:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f67b25aa740 1 -- 172.21.15.12:0/2201787096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 msgr2=0x5649825a9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f67b25aa740 1 --2- 172.21.15.12:0/2201787096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a9670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009cd0 tx=0x7f67a402f320 comp rx=0 tx=0).stop 2024-09-16T01:00:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f67b25aa740 1 -- 172.21.15.12:0/2201787096 shutdown_connections 2024-09-16T01:00:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f67b25aa740 1 --2- 172.21.15.12:0/2201787096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f67b25aa740 1 --2- 172.21.15.12:0/2201787096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a9670 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f67b25aa740 1 --2- 172.21.15.12:0/2201787096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x56498259edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.970+0000 7f67b25aa740 1 -- 172.21.15.12:0/2201787096 >> 172.21.15.12:0/2201787096 conn(0x56498259af60 msgr2=0x56498259b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 1 -- 172.21.15.12:0/2201787096 shutdown_connections 2024-09-16T01:00:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 1 -- 172.21.15.12:0/2201787096 wait complete. 2024-09-16T01:00:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 1 -- start start 2024-09-16T01:00:30.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 1 Processor -- start 2024-09-16T01:00:30.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56498259e9d0 0x5649825a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259f2f0 0x5649825a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649825a9bb0 0x5649825a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649825ac780 con 0x5649825a9bb0 2024-09-16T01:00:30.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649824bff20 con 0x56498259e9d0 2024-09-16T01:00:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5649825ac900 con 0x56498259f2f0 2024-09-16T01:00:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.971+0000 7f67b25aa740 10 client.0 _ll_register_callbacks cb 0x564982489030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67ae76e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649825a9bb0 0x5649825a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67ae76e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649825a9bb0 0x5649825a6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59876/0 (socket says 172.21.15.12:59876) 2024-09-16T01:00:31.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67ae76e640 1 -- 172.21.15.12:0/3268241052 learned_addr learned my addr 172.21.15.12:0/3268241052 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:31.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67ad76c640 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259f2f0 0x5649825a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67adf6d640 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56498259e9d0 0x5649825a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67ae76e640 1 -- 172.21.15.12:0/3268241052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259f2f0 msgr2=0x5649825a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:31.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67ae76e640 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259f2f0 0x5649825a66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67ae76e640 1 -- 172.21.15.12:0/3268241052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56498259e9d0 msgr2=0x5649825a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:31.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67ae76e640 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56498259e9d0 0x5649825a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67ae76e640 1 -- 172.21.15.12:0/3268241052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649822762b0 con 0x5649825a9bb0 2024-09-16T01:00:31.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67ae76e640 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649825a9bb0 0x5649825a6c30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f67a0017040 tx=0x7f67a00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba99cb42a37b5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67917fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67917fa640 1 -- 172.21.15.12:0/3268241052 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0023030 con 0x5649825a9bb0 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67917fa640 1 -- 172.21.15.12:0/3268241052 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f67a000f040 con 0x5649825a9bb0 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67b25aa740 1 -- 172.21.15.12:0/3268241052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67a4036030 con 0x5649825a9bb0 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67917fa640 1 -- 172.21.15.12:0/3268241052 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f67a0019040 con 0x5649825a9bb0 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67b25aa740 10 client.15090 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.972+0000 7f67b25aa740 1 -- 172.21.15.12:0/3268241052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5649825b7ff0 con 0x5649825a9bb0 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.973+0000 7f67917fa640 1 -- 172.21.15.12:0/3268241052 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67a4036030 con 0x5649825a9bb0 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.973+0000 7f67917fa640 1 -- 172.21.15.12:0/3268241052 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f67a001f6c0 con 0x5649825a9bb0 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.973+0000 7f67b25aa740 10 client.15090 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.973+0000 7f67b25aa740 10 client.15090 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.973+0000 7f67b25aa740 20 client.15090 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.973+0000 7f67b25aa740 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5649825ba6a0 0x5649825bbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.973+0000 7f67b25aa740 4 client.15090 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.973+0000 7f67b25aa740 1 -- 172.21.15.12:0/3268241052 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564982512600 con 0x5649825ba6a0 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.973+0000 7f67adf6d640 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5649825ba6a0 0x5649825bbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.974+0000 7f67adf6d640 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5649825ba6a0 0x5649825bbb10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=987b8802ca5141d2 server_cookie=5e3aa0413cf53eb0 in_seq=0 out_seq=0 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.974+0000 7f67917fa640 10 client.15090 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.974+0000 7f67917fa640 1 -- 172.21.15.12:0/3268241052 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564982512600 con 0x5649825ba6a0 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.974+0000 7f67917fa640 10 client.15090 handle_command_reply: tid=0 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 client.15090 shutdown 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 -- 172.21.15.12:0/3268241052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649825a9bb0 msgr2=0x5649825a6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649825a9bb0 0x5649825a6c30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f67a0017040 tx=0x7f67a00047d0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 -- 172.21.15.12:0/3268241052 shutdown_connections 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5649825ba6a0 0x5649825bbb10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649825a9bb0 0x5649825a6c30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259f2f0 0x5649825a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 --2- 172.21.15.12:0/3268241052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56498259e9d0 0x5649825a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 -- 172.21.15.12:0/3268241052 >> 172.21.15.12:0/3268241052 conn(0x56498259af60 msgr2=0x5649825a0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:31.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67917fa640 0 client.15090 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:00:31.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 -- 172.21.15.12:0/3268241052 shutdown_connections 2024-09-16T01:00:31.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 1 -- 172.21.15.12:0/3268241052 wait complete. 2024-09-16T01:00:31.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.975+0000 7f67b25aa740 20 client.15090 trim_cache size 0 max 16384 2024-09-16T01:00:31.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.993+0000 7f67b25aa740 1 Processor -- start 2024-09-16T01:00:31.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67b25aa740 1 -- start start 2024-09-16T01:00:31.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x5649825bad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:31.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:31.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:31.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67b25aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649825b9e50 con 0x56498259f2f0 2024-09-16T01:00:31.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67b25aa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649825ba520 con 0x5649825a9bb0 2024-09-16T01:00:31.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67b25aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5649825babf0 con 0x56498259e9d0 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67ad76c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67ad76c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59878/0 (socket says 172.21.15.12:59878) 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67ad76c640 1 -- 172.21.15.12:0/1757193723 learned_addr learned my addr 172.21.15.12:0/1757193723 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67adf6d640 1 --2- 172.21.15.12:0/1757193723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x5649825bad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67ae76e640 1 --2- 172.21.15.12:0/1757193723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67ad76c640 1 -- 172.21.15.12:0/1757193723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 msgr2=0x5649825bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67ad76c640 1 --2- 172.21.15.12:0/1757193723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x5649825bad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67ad76c640 1 -- 172.21.15.12:0/1757193723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 msgr2=0x5649825a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67ad76c640 1 --2- 172.21.15.12:0/1757193723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67ad76c640 1 -- 172.21.15.12:0/1757193723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649825a96d0 con 0x56498259f2f0 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.994+0000 7f67ae76e640 1 --2- 172.21.15.12:0/1757193723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:31.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.995+0000 7f67ad76c640 1 --2- 172.21.15.12:0/1757193723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a66b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f67980cf5e0 tx=0x7f67980d1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e669a3582922fdeb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:31.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.995+0000 7f67937fe640 1 -- 172.21.15.12:0/1757193723 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679809bc50 con 0x56498259f2f0 2024-09-16T01:00:31.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.995+0000 7f67937fe640 1 -- 172.21.15.12:0/1757193723 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f679809b550 con 0x56498259f2f0 2024-09-16T01:00:31.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.995+0000 7f67937fe640 1 -- 172.21.15.12:0/1757193723 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679809a9a0 con 0x56498259f2f0 2024-09-16T01:00:31.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 -- 172.21.15.12:0/1757193723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 msgr2=0x5649825a66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:31.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 --2- 172.21.15.12:0/1757193723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a66b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f67980cf5e0 tx=0x7f67980d1040 comp rx=0 tx=0).stop 2024-09-16T01:00:31.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 -- 172.21.15.12:0/1757193723 shutdown_connections 2024-09-16T01:00:31.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 --2- 172.21.15.12:0/1757193723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 --2- 172.21.15.12:0/1757193723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825a66b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 --2- 172.21.15.12:0/1757193723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x5649825bad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 -- 172.21.15.12:0/1757193723 >> 172.21.15.12:0/1757193723 conn(0x56498259af60 msgr2=0x5649825a5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 -- 172.21.15.12:0/1757193723 shutdown_connections 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 -- 172.21.15.12:0/1757193723 wait complete. 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 -- start start 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 Processor -- start 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x5649825c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.996+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67b25aa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67b25aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649825bb990 con 0x56498259f2f0 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67b25aa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649825bb2c0 con 0x5649825a9bb0 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67b25aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5649825bc060 con 0x56498259e9d0 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67b25aa740 10 client.0 _ll_register_callbacks cb 0x7f67a00095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67ad76c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67ad76c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59894/0 (socket says 172.21.15.12:59894) 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67ad76c640 1 -- 172.21.15.12:0/2012767098 learned_addr learned my addr 172.21.15.12:0/2012767098 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67adf6d640 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x5649825c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67ae76e640 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67ad76c640 1 -- 172.21.15.12:0/2012767098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 msgr2=0x5649825c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67ad76c640 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x5649825c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67ad76c640 1 -- 172.21.15.12:0/2012767098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 msgr2=0x5649825aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67ad76c640 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67ad76c640 1 -- 172.21.15.12:0/2012767098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649825ab720 con 0x56498259f2f0 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67ad76c640 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825aa9e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6798011040 tx=0x7f6798000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b849b28afbad8767 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67917fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67917fa640 1 -- 172.21.15.12:0/2012767098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67980b4020 con 0x56498259f2f0 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67917fa640 1 -- 172.21.15.12:0/2012767098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f679809a9a0 con 0x56498259f2f0 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67b25aa740 1 -- 172.21.15.12:0/2012767098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f679809b550 con 0x56498259f2f0 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67917fa640 1 -- 172.21.15.12:0/2012767098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f67980ccb80 con 0x56498259f2f0 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67b25aa740 10 client.15096 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.997+0000 7f67b25aa740 1 -- 172.21.15.12:0/2012767098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564982624db0 con 0x56498259f2f0 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.998+0000 7f67917fa640 1 -- 172.21.15.12:0/2012767098 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f679807b030 con 0x56498259f2f0 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.998+0000 7f67917fa640 1 -- 172.21.15.12:0/2012767098 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f67980b42e0 con 0x56498259f2f0 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.998+0000 7f67b25aa740 10 client.15096 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.998+0000 7f67b25aa740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.998+0000 7f67b25aa740 20 client.15096 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.998+0000 7f67b25aa740 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5649826292a0 0x564982627fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.998+0000 7f67b25aa740 4 client.15096 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:00:31.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.998+0000 7f67b25aa740 1 -- 172.21.15.12:0/2012767098 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "status"}) -- 0x56498250cb10 con 0x5649826292a0 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.998+0000 7f67adf6d640 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5649826292a0 0x564982627fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67adf6d640 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5649826292a0 0x564982627fb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17a1e5cb2d63e938 server_cookie=11d00e929d9c125 in_seq=0 out_seq=0 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67917fa640 10 client.15096 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67917fa640 1 -- 172.21.15.12:0/2012767098 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56498250cb10 con 0x5649826292a0 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67917fa640 10 client.15096 handle_command_reply: tid=0 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 client.15096 shutdown 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 -- 172.21.15.12:0/2012767098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 msgr2=0x5649825aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825aa9e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6798011040 tx=0x7f6798000bc0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 -- 172.21.15.12:0/2012767098 shutdown_connections 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5649826292a0 0x564982627fb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649825a9bb0 0x5649825aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67917fa640 0 client.15096 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:00:31.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498259f2f0 0x5649825aa9e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 --2- 172.21.15.12:0/2012767098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56498259e9d0 0x5649825c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 -- 172.21.15.12:0/2012767098 >> 172.21.15.12:0/2012767098 conn(0x56498259af60 msgr2=0x5649825a66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:31.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 -- 172.21.15.12:0/2012767098 shutdown_connections 2024-09-16T01:00:31.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 1 -- 172.21.15.12:0/2012767098 wait complete. 2024-09-16T01:00:31.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:30.999+0000 7f67b25aa740 20 client.15096 trim_cache size 0 max 16384 2024-09-16T01:00:31.016 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:00:31.016 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:00:31.016 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 2, 2024-09-16T01:00:31.016 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24475, 2024-09-16T01:00:31.016 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:00:31.017 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:00:31.017 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:00:31.017 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 71.243360280000005, 2024-09-16T01:00:31.017 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-16T01:00:31.017 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 87, 2024-09-16T01:00:31.017 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T01:00:31.017 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 133.168711519 2024-09-16T01:00:31.017 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:00:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 -- 172.21.15.12:0/36452960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67940a32d0 msgr2=0x7f67940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67940a32d0 0x7f67940a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009d10 tx=0x7f67a00090e0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 -- 172.21.15.12:0/36452960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a81036e0 msgr2=0x7f67a8198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a81036e0 0x7f67a8198c60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6798006fd0 tx=0x7f679800b8e0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 -- 172.21.15.12:0/36452960 shutdown_connections 2024-09-16T01:00:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67940a32d0 0x7f67940a5790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67a81082a0 0x7f67a819cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a81036e0 0x7f67a8198c60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 --2- 172.21.15.12:0/36452960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67a8102d30 0x7f67a8198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 -- 172.21.15.12:0/36452960 >> 172.21.15.12:0/36452960 conn(0x7f67a80fc7d0 msgr2=0x7f67a8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:31.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 -- 172.21.15.12:0/36452960 shutdown_connections 2024-09-16T01:00:31.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:31.000+0000 7f67b01d1640 1 -- 172.21.15.12:0/36452960 wait complete. 2024-09-16T01:00:31.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-16T01:00:32.156 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:32.265 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:32 smithi012 ceph-mon[31197]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:00:32.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:32 smithi119 ceph-mon[35049]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:00:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:32 smithi098 ceph-mon[35346]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:00:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.643+0000 7f6c09bdc640 1 -- 172.21.15.12:0/3227095645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c04101de0 msgr2=0x7f6c041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.643+0000 7f6c09bdc640 1 --2- 172.21.15.12:0/3227095645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c04101de0 0x7f6c041021c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4009900 tx=0x7f6bf402a410 comp rx=0 tx=0).stop 2024-09-16T01:00:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.643+0000 7f6c09bdc640 1 -- 172.21.15.12:0/3227095645 shutdown_connections 2024-09-16T01:00:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.643+0000 7f6c09bdc640 1 --2- 172.21.15.12:0/3227095645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c04106f10 0x7f6c0410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.643+0000 7f6c09bdc640 1 --2- 172.21.15.12:0/3227095645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04102790 0x7f6c041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.643+0000 7f6c09bdc640 1 --2- 172.21.15.12:0/3227095645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c04101de0 0x7f6c041021c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.643+0000 7f6c09bdc640 1 -- 172.21.15.12:0/3227095645 >> 172.21.15.12:0/3227095645 conn(0x7f6c040fd8c0 msgr2=0x7f6c040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.643+0000 7f6c09bdc640 1 -- 172.21.15.12:0/3227095645 shutdown_connections 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.644+0000 7f6c09bdc640 1 -- 172.21.15.12:0/3227095645 wait complete. 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.644+0000 7f6c09bdc640 1 Processor -- start 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.644+0000 7f6c09bdc640 1 -- start start 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.644+0000 7f6c09bdc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c04101de0 0x7f6c04198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.644+0000 7f6c09bdc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c04102790 0x7f6c04198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.644+0000 7f6c09bdc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106f10 0x7f6c0419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.644+0000 7f6c09bdc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04111f70 con 0x7f6c04101de0 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.644+0000 7f6c09bdc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04111df0 con 0x7f6c04106f10 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.644+0000 7f6c09bdc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6c041120f0 con 0x7f6c04102790 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c04101de0 0x7f6c04198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c04101de0 0x7f6c04198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59912/0 (socket says 172.21.15.12:59912) 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c037fe640 1 -- 172.21.15.12:0/2754695440 learned_addr learned my addr 172.21.15.12:0/2754695440 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c04102790 0x7f6c04198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c03fff640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106f10 0x7f6c0419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c037fe640 1 -- 172.21.15.12:0/2754695440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c04102790 msgr2=0x7f6c04198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c037fe640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c04102790 0x7f6c04198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c037fe640 1 -- 172.21.15.12:0/2754695440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106f10 msgr2=0x7f6c0419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c037fe640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106f10 0x7f6c0419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c037fe640 1 -- 172.21.15.12:0/2754695440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0419d3e0 con 0x7f6c04101de0 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c037fe640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c04101de0 0x7f6c04198430 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4006010 tx=0x7f6bf40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c00ff9640 1 -- 172.21.15.12:0/2754695440 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf403f030 con 0x7f6c04101de0 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c00ff9640 1 -- 172.21.15.12:0/2754695440 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bf4003ce0 con 0x7f6c04101de0 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c09bdc640 1 -- 172.21.15.12:0/2754695440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c0419d670 con 0x7f6c04101de0 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c00ff9640 1 -- 172.21.15.12:0/2754695440 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4035070 con 0x7f6c04101de0 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.645+0000 7f6c09bdc640 1 -- 172.21.15.12:0/2754695440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c041a4fb0 con 0x7f6c04101de0 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.648+0000 7f6c00ff9640 1 -- 172.21.15.12:0/2754695440 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6bf4042030 con 0x7f6c04101de0 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.648+0000 7f6c0bfb5740 1 Processor -- start 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.648+0000 7f6c0bfb5740 1 -- start start 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.648+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 0x56229fa34cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.648+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 0x56229fa43a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.648+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa43fc0 0x56229fa463b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.648+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56229f99b090 con 0x56229fa43fc0 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.648+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56229f942a70 con 0x56229fa348d0 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.648+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56229f997050 con 0x56229fa351f0 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.648+0000 7f6c02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa43fc0 0x56229fa463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa43fc0 0x56229fa463b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59924/0 (socket says 172.21.15.12:59924) 2024-09-16T01:00:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c02ffd640 1 -- 172.21.15.12:0/179842692 learned_addr learned my addr 172.21.15.12:0/179842692 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c03fff640 1 --2- 172.21.15.12:0/179842692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 0x56229fa34cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c037fe640 1 --2- 172.21.15.12:0/179842692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 0x56229fa43a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c02ffd640 1 -- 172.21.15.12:0/179842692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 msgr2=0x56229fa43a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/179842692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 0x56229fa43a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c02ffd640 1 -- 172.21.15.12:0/179842692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 msgr2=0x56229fa34cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/179842692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 0x56229fa34cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c02ffd640 1 -- 172.21.15.12:0/179842692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56229f94f130 con 0x56229fa43fc0 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c00ff9640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6bf00a32d0 0x7f6bf00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/179842692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa43fc0 0x56229fa463b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00abf0 tx=0x7f6bec00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b29f2eed170e39a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c03fff640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6bf00a32d0 0x7f6bf00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6c00ff9640 1 -- 172.21.15.12:0/2754695440 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f6bf40effa0 con 0x7f6c04101de0 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6bf9ffb640 1 -- 172.21.15.12:0/179842692 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec01d070 con 0x56229fa43fc0 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6bf9ffb640 1 -- 172.21.15.12:0/179842692 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bec018b20 con 0x56229fa43fc0 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.649+0000 7f6bf9ffb640 1 -- 172.21.15.12:0/179842692 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec010ac0 con 0x56229fa43fc0 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.650+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/179842692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa43fc0 msgr2=0x56229fa463b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.650+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/179842692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa43fc0 0x56229fa463b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00abf0 tx=0x7f6bec00f790 comp rx=0 tx=0).stop 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.650+0000 7f6c03fff640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6bf00a32d0 0x7f6bf00a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc005fd0 tx=0x7f6bfc0096e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.650+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/179842692 shutdown_connections 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.650+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/179842692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa43fc0 0x56229fa463b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.650+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/179842692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 0x56229fa43a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.650+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/179842692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 0x56229fa34cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.650+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/179842692 >> 172.21.15.12:0/179842692 conn(0x56229fa30f60 msgr2=0x56229fa31340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.650+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/179842692 shutdown_connections 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.650+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/179842692 wait complete. 2024-09-16T01:00:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c0bfb5740 1 -- start start 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c0bfb5740 1 Processor -- start 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa351f0 0x56229fa40bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 0x56229fa41130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56229fa46bf0 con 0x56229fa348d0 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56229f955f20 con 0x56229fa351f0 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56229fa46d70 con 0x56229fa43fc0 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c0bfb5740 10 client.0 _ll_register_callbacks cb 0x56229f91f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59940/0 (socket says 172.21.15.12:59940) 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c037fe640 1 -- 172.21.15.12:0/3172857276 learned_addr learned my addr 172.21.15.12:0/3172857276 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.651+0000 7f6c03fff640 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 0x56229fa41130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa351f0 0x56229fa40bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c037fe640 1 -- 172.21.15.12:0/3172857276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 msgr2=0x56229fa41130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c037fe640 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 0x56229fa41130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c037fe640 1 -- 172.21.15.12:0/3172857276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa351f0 msgr2=0x56229fa40bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c037fe640 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa351f0 0x56229fa40bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c037fe640 1 -- 172.21.15.12:0/3172857276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56229f70c2b0 con 0x56229fa348d0 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa351f0 0x56229fa40bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c037fe640 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa438a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40b8bb0 tx=0x7f6bf4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86ea9a950d2c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6be2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6be2ffd640 1 -- 172.21.15.12:0/3172857276 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4049050 con 0x56229fa348d0 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6be2ffd640 1 -- 172.21.15.12:0/3172857276 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f6bf40b8850 con 0x56229fa348d0 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/3172857276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bec018b20 con 0x56229fa348d0 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6be2ffd640 1 -- 172.21.15.12:0/3172857276 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6bf40b8480 con 0x56229fa348d0 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c0bfb5740 10 client.15108 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/3172857276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56229fa525a0 con 0x56229fa348d0 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6be2ffd640 1 -- 172.21.15.12:0/3172857276 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bec018b20 con 0x56229fa348d0 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.652+0000 7f6be2ffd640 1 -- 172.21.15.12:0/3172857276 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6bf40f20d0 con 0x56229fa348d0 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.653+0000 7f6c0bfb5740 10 client.15108 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.653+0000 7f6c0bfb5740 10 client.15108 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.653+0000 7f6c0bfb5740 20 client.15108 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.653+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56229fa54c40 0x56229fa560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.653+0000 7f6c0bfb5740 4 client.15108 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.653+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/3172857276 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56229f9a8600 con 0x56229fa54c40 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.653+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56229fa54c40 0x56229fa560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.654+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56229fa54c40 0x56229fa560b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8382c7daf014e719 server_cookie=778a09b0b0de2307 in_seq=0 out_seq=0 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.654+0000 7f6be2ffd640 10 client.15108 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.654+0000 7f6be2ffd640 1 -- 172.21.15.12:0/3172857276 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56229f9a8600 con 0x56229fa54c40 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.654+0000 7f6be2ffd640 10 client.15108 handle_command_reply: tid=0 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.654+0000 7f6c0bfb5740 1 client.15108 shutdown 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/3172857276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 msgr2=0x56229fa438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa438a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40b8bb0 tx=0x7f6bf4003f10 comp rx=0 tx=0).stop 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/3172857276 shutdown_connections 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56229fa54c40 0x56229fa560b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 0x56229fa41130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa351f0 0x56229fa40bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6be2ffd640 0 client.15108 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/3172857276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa438a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/3172857276 >> 172.21.15.12:0/3172857276 conn(0x56229fa30f60 msgr2=0x56229fa36cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:32.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/3172857276 shutdown_connections 2024-09-16T01:00:32.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/3172857276 wait complete. 2024-09-16T01:00:32.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.655+0000 7f6c0bfb5740 20 client.15108 trim_cache size 0 max 16384 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c0bfb5740 1 Processor -- start 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c0bfb5740 1 -- start start 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 0x56229fa560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa351f0 0x56229fa54570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 0x56229fa3f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56229fa543f0 con 0x56229fa351f0 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56229fa54ac0 con 0x56229fa348d0 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56229fa55190 con 0x56229fa43fc0 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa351f0 0x56229fa54570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa351f0 0x56229fa54570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59950/0 (socket says 172.21.15.12:59950) 2024-09-16T01:00:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c02ffd640 1 -- 172.21.15.12:0/619364742 learned_addr learned my addr 172.21.15.12:0/619364742 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c02ffd640 1 -- 172.21.15.12:0/619364742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 msgr2=0x56229fa3f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c037fe640 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 0x56229fa560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c03fff640 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 0x56229fa3f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 0x56229fa3f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c02ffd640 1 -- 172.21.15.12:0/619364742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 msgr2=0x56229fa560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 0x56229fa560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c02ffd640 1 -- 172.21.15.12:0/619364742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56229fa35020 con 0x56229fa351f0 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c037fe640 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 0x56229fa560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.673+0000 7f6c03fff640 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 0x56229fa3f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.674+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa351f0 0x56229fa54570 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6bec01b040 tx=0x7f6bec010760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba64cc6f75e6150 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.674+0000 7f6bf97fa640 1 -- 172.21.15.12:0/619364742 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec01d040 con 0x56229fa351f0 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.674+0000 7f6bf97fa640 1 -- 172.21.15.12:0/619364742 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bec010430 con 0x56229fa351f0 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.674+0000 7f6bf97fa640 1 -- 172.21.15.12:0/619364742 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0107d0 con 0x56229fa351f0 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.674+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/619364742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa351f0 msgr2=0x56229fa54570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.674+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa351f0 0x56229fa54570 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6bec01b040 tx=0x7f6bec010760 comp rx=0 tx=0).stop 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/619364742 shutdown_connections 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa43fc0 0x56229fa3f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa351f0 0x56229fa54570 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/619364742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa348d0 0x56229fa560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/619364742 >> 172.21.15.12:0/619364742 conn(0x56229fa30f60 msgr2=0x56229fa31340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/619364742 shutdown_connections 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/619364742 wait complete. 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 -- start start 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 Processor -- start 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 0x56229fa57de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa43fc0 0x56229fabd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56229fa55f30 con 0x56229fa348d0 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56229fa55860 con 0x56229fa43fc0 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56229fa56600 con 0x56229fa351f0 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.675+0000 7f6c0bfb5740 10 client.0 _ll_register_callbacks cb 0x7f6bf4005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59962/0 (socket says 172.21.15.12:59962) 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c037fe640 1 -- 172.21.15.12:0/1314870828 learned_addr learned my addr 172.21.15.12:0/1314870828 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c03fff640 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa43fc0 0x56229fabd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 0x56229fa57de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c037fe640 1 -- 172.21.15.12:0/1314870828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 msgr2=0x56229fa57de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c037fe640 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 0x56229fa57de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c037fe640 1 -- 172.21.15.12:0/1314870828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa43fc0 msgr2=0x56229fabd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c037fe640 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa43fc0 0x56229fabd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c037fe640 1 -- 172.21.15.12:0/1314870828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56229fabd8b0 con 0x56229fa348d0 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 0x56229fa57de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c037fe640 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa578a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4000c00 tx=0x7f6bf40dc280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931f5ab6927dfeb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6be2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6be2ffd640 1 -- 172.21.15.12:0/1314870828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4049070 con 0x56229fa348d0 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6be2ffd640 1 -- 172.21.15.12:0/1314870828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f6bf40bc440 con 0x56229fa348d0 2024-09-16T01:00:32.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/1314870828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bec010430 con 0x56229fa348d0 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6be2ffd640 1 -- 172.21.15.12:0/1314870828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6bf40044e0 con 0x56229fa348d0 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.676+0000 7f6c0bfb5740 10 client.15114 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.677+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/1314870828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56229fabeaa0 con 0x56229fa348d0 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.677+0000 7f6be2ffd640 1 -- 172.21.15.12:0/1314870828 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bec010430 con 0x56229fa348d0 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.677+0000 7f6be2ffd640 1 -- 172.21.15.12:0/1314870828 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6bf40f1070 con 0x56229fa348d0 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.677+0000 7f6c0bfb5740 10 client.15114 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.677+0000 7f6c0bfb5740 10 client.15114 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.677+0000 7f6c0bfb5740 20 client.15114 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.677+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56229fac34e0 0x56229fac21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.677+0000 7f6c0bfb5740 4 client.15114 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.677+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/1314870828 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "status"}) -- 0x56229f9a2b10 con 0x56229fac34e0 2024-09-16T01:00:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.677+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56229fac34e0 0x56229fac21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c02ffd640 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56229fac34e0 0x56229fac21f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59d5c3925adfe298 server_cookie=ec2a632d7504b809 in_seq=0 out_seq=0 2024-09-16T01:00:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6be2ffd640 10 client.15114 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:00:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6be2ffd640 1 -- 172.21.15.12:0/1314870828 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56229f9a2b10 con 0x56229fac34e0 2024-09-16T01:00:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6be2ffd640 10 client.15114 handle_command_reply: tid=0 2024-09-16T01:00:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 client.15114 shutdown 2024-09-16T01:00:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/1314870828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 msgr2=0x56229fa578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa578a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4000c00 tx=0x7f6bf40dc280 comp rx=0 tx=0).stop 2024-09-16T01:00:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/1314870828 shutdown_connections 2024-09-16T01:00:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56229fac34e0 0x56229fac21f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56229fa43fc0 0x56229fabd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56229fa351f0 0x56229fa57de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 --2- 172.21.15.12:0/1314870828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56229fa348d0 0x56229fa578a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6be2ffd640 0 client.15114 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:00:32.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/1314870828 >> 172.21.15.12:0/1314870828 conn(0x56229fa30f60 msgr2=0x56229fa3f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:32.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/1314870828 shutdown_connections 2024-09-16T01:00:32.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.678+0000 7f6c0bfb5740 1 -- 172.21.15.12:0/1314870828 wait complete. 2024-09-16T01:00:32.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c0bfb5740 20 client.15114 trim_cache size 0 max 16384 2024-09-16T01:00:32.686 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:00:32.686 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:00:32.686 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 1, 2024-09-16T01:00:32.686 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24482, 2024-09-16T01:00:32.686 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:00:32.686 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:00:32.687 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:00:32.687 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 73.937090006999995, 2024-09-16T01:00:32.687 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-16T01:00:32.687 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 87, 2024-09-16T01:00:32.687 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T01:00:32.687 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 137.47189222700001 2024-09-16T01:00:32.687 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:00:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 -- 172.21.15.12:0/2754695440 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6bf00a32d0 msgr2=0x7f6bf00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6bf00a32d0 0x7f6bf00a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc005fd0 tx=0x7f6bfc0096e0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 -- 172.21.15.12:0/2754695440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c04101de0 msgr2=0x7f6c04198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c04101de0 0x7f6c04198430 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4006010 tx=0x7f6bf40042f0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 -- 172.21.15.12:0/2754695440 shutdown_connections 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6bf00a32d0 0x7f6bf00a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c04106f10 0x7f6c0419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c04102790 0x7f6c04198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 --2- 172.21.15.12:0/2754695440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c04101de0 0x7f6c04198430 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 -- 172.21.15.12:0/2754695440 >> 172.21.15.12:0/2754695440 conn(0x7f6c040fd8c0 msgr2=0x7f6c040febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 -- 172.21.15.12:0/2754695440 shutdown_connections 2024-09-16T01:00:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:32.679+0000 7f6c09bdc640 1 -- 172.21.15.12:0/2754695440 wait complete. 2024-09-16T01:00:33.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-16T01:00:33.726 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.211+0000 7fa1f84d8640 1 -- 172.21.15.12:0/185367996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1f0102790 msgr2=0x7fa1f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.211+0000 7fa1f84d8640 1 --2- 172.21.15.12:0/185367996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1f0102790 0x7fa1f01067e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009900 tx=0x7fa1e402a410 comp rx=0 tx=0).stop 2024-09-16T01:00:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.211+0000 7fa1f84d8640 1 -- 172.21.15.12:0/185367996 shutdown_connections 2024-09-16T01:00:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.211+0000 7fa1f84d8640 1 --2- 172.21.15.12:0/185367996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f0106f10 0x7fa1f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.211+0000 7fa1f84d8640 1 --2- 172.21.15.12:0/185367996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1f0102790 0x7fa1f01067e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.211+0000 7fa1f84d8640 1 --2- 172.21.15.12:0/185367996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f0101de0 0x7fa1f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.211+0000 7fa1f84d8640 1 -- 172.21.15.12:0/185367996 >> 172.21.15.12:0/185367996 conn(0x7fa1f00fd8c0 msgr2=0x7fa1f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.211+0000 7fa1f84d8640 1 -- 172.21.15.12:0/185367996 shutdown_connections 2024-09-16T01:00:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.211+0000 7fa1f84d8640 1 -- 172.21.15.12:0/185367996 wait complete. 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f84d8640 1 Processor -- start 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f84d8640 1 -- start start 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f84d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1f0101de0 0x7fa1f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f84d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f0102790 0x7fa1f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f84d8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f0106f10 0x7fa1f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f84d8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0111f70 con 0x7fa1f0101de0 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f84d8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0111df0 con 0x7fa1f0106f10 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f84d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01120f0 con 0x7fa1f0102790 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f6274640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1f0101de0 0x7fa1f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f6274640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1f0101de0 0x7fa1f00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59974/0 (socket says 172.21.15.12:59974) 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f6274640 1 -- 172.21.15.12:0/1688296700 learned_addr learned my addr 172.21.15.12:0/1688296700 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f6a75640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f0106f10 0x7fa1f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f0102790 0x7fa1f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f6274640 1 -- 172.21.15.12:0/1688296700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f0102790 msgr2=0x7fa1f0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f6274640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f0102790 0x7fa1f0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.212+0000 7fa1f6274640 1 -- 172.21.15.12:0/1688296700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f0106f10 msgr2=0x7fa1f0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.213+0000 7fa1f6274640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f0106f10 0x7fa1f0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.213+0000 7fa1f6274640 1 -- 172.21.15.12:0/1688296700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f01a6970 con 0x7fa1f0101de0 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.213+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f0102790 0x7fa1f0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.213+0000 7fa1f6a75640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f0106f10 0x7fa1f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.213+0000 7fa1f6274640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1f0101de0 0x7fa1f00744f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00ea80 tx=0x7fa1ec00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.213+0000 7fa1e37fe640 1 -- 172.21.15.12:0/1688296700 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00ce40 con 0x7fa1f0101de0 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.213+0000 7fa1f84d8640 1 -- 172.21.15.12:0/1688296700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f01a6c60 con 0x7fa1f0101de0 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.213+0000 7fa1e37fe640 1 -- 172.21.15.12:0/1688296700 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1ec005020 con 0x7fa1f0101de0 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.213+0000 7fa1e37fe640 1 -- 172.21.15.12:0/1688296700 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec011760 con 0x7fa1f0101de0 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.213+0000 7fa1f84d8640 1 -- 172.21.15.12:0/1688296700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f01a7150 con 0x7fa1f0101de0 2024-09-16T01:00:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.215+0000 7fa1e37fe640 1 -- 172.21.15.12:0/1688296700 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa1ec0051d0 con 0x7fa1f0101de0 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1fa8b1740 1 Processor -- start 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1fa8b1740 1 -- start start 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1e37fe640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1dc0a32d0 0x7fa1dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa241db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 0x55adfa24c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa24efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55adfa1a8090 con 0x55adfa2419d0 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55adfa14fa70 con 0x55adfa24cbb0 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55adfa1a4050 con 0x55adfa2422f0 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1e37fe640 1 -- 172.21.15.12:0/1688296700 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fa1ec0d04b0 con 0x7fa1f0101de0 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1f6a75640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1dc0a32d0 0x7fa1dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.216+0000 7fa1f6274640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa241db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f6274640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa241db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59986/0 (socket says 172.21.15.12:59986) 2024-09-16T01:00:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f6274640 1 -- 172.21.15.12:0/753295757 learned_addr learned my addr 172.21.15.12:0/753295757 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f6a75640 1 --2- 172.21.15.12:0/753295757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa24efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/753295757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 0x55adfa24c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f6274640 1 -- 172.21.15.12:0/753295757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 msgr2=0x55adfa24c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f6274640 1 --2- 172.21.15.12:0/753295757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 0x55adfa24c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f6274640 1 -- 172.21.15.12:0/753295757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 msgr2=0x55adfa24efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f6274640 1 --2- 172.21.15.12:0/753295757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa24efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f6274640 1 -- 172.21.15.12:0/753295757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adfa15c130 con 0x55adfa2419d0 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/753295757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 0x55adfa24c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f6a75640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1dc0a32d0 0x7fa1dc0a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005fd0 tx=0x7fa1e80138e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1f6274640 1 --2- 172.21.15.12:0/753295757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa241db0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0a4d70 tx=0x7fa1ec05c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1e3dbaae54e99a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1e0ff9640 1 -- 172.21.15.12:0/753295757 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec01f040 con 0x55adfa2419d0 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1e0ff9640 1 -- 172.21.15.12:0/753295757 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1ec0a09e0 con 0x55adfa2419d0 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.217+0000 7fa1e0ff9640 1 -- 172.21.15.12:0/753295757 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec005540 con 0x55adfa2419d0 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.218+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/753295757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 msgr2=0x55adfa241db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.218+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/753295757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa241db0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0a4d70 tx=0x7fa1ec05c190 comp rx=0 tx=0).stop 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.218+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/753295757 shutdown_connections 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.218+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/753295757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa24efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.218+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/753295757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 0x55adfa24c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.218+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/753295757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa241db0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.218+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/753295757 >> 172.21.15.12:0/753295757 conn(0x55adfa23df60 msgr2=0x55adfa23e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.218+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/753295757 shutdown_connections 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.218+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/753295757 wait complete. 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.218+0000 7fa1fa8b1740 1 -- start start 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1fa8b1740 1 Processor -- start 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa24c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 0x55adfa2497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa249d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55adfa24f780 con 0x55adfa2419d0 2024-09-16T01:00:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55adfa162f20 con 0x55adfa24cbb0 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55adfa24f900 con 0x55adfa2422f0 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1fa8b1740 10 client.0 _ll_register_callbacks cb 0x55adfa12c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f6274640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa24c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f6274640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa24c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59998/0 (socket says 172.21.15.12:59998) 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f6274640 1 -- 172.21.15.12:0/1379767963 learned_addr learned my addr 172.21.15.12:0/1379767963 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f6a75640 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa249d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 0x55adfa2497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f6274640 1 -- 172.21.15.12:0/1379767963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 msgr2=0x55adfa2497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f6274640 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 0x55adfa2497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f6274640 1 -- 172.21.15.12:0/1379767963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 msgr2=0x55adfa249d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f6274640 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa249d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f6274640 1 -- 172.21.15.12:0/1379767963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adf9f192b0 con 0x55adfa2419d0 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 0x55adfa2497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.219+0000 7fa1f6a75640 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa249d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1f6274640 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa24c420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c700 tx=0x7fa1ec09ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432f1fe008f02243 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/1379767963 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec061030 con 0x55adfa2419d0 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/1379767963 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fa1ec005540 con 0x55adfa2419d0 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1379767963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1ec0a09e0 con 0x55adfa2419d0 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/1379767963 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa1ec01f070 con 0x55adfa2419d0 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1fa8b1740 10 client.15126 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1379767963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55adfa25b0b0 con 0x55adfa2419d0 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/1379767963 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1ec0a09e0 con 0x55adfa2419d0 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/1379767963 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa1ec00f040 con 0x55adfa2419d0 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1fa8b1740 10 client.15126 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.220+0000 7fa1fa8b1740 10 client.15126 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.221+0000 7fa1fa8b1740 20 client.15126 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.221+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55adfa25c400 0x55adfa25e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.221+0000 7fa1fa8b1740 4 client.15126 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:00:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.221+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1379767963 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adfa1b5600 con 0x55adfa25c400 2024-09-16T01:00:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.221+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55adfa25c400 0x55adfa25e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.221+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55adfa25c400 0x55adfa25e550 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=101bded36b14f5d0 server_cookie=33857215adf4b2dc in_seq=0 out_seq=0 2024-09-16T01:00:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.221+0000 7fa1d9ffb640 10 client.15126 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:00:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/1379767963 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55adfa1b5600 con 0x55adfa25c400 2024-09-16T01:00:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1d9ffb640 10 client.15126 handle_command_reply: tid=0 2024-09-16T01:00:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 client.15126 shutdown 2024-09-16T01:00:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1379767963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 msgr2=0x55adfa24c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa24c420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c700 tx=0x7fa1ec09ce70 comp rx=0 tx=0).stop 2024-09-16T01:00:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1379767963 shutdown_connections 2024-09-16T01:00:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55adfa25c400 0x55adfa25e550 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa249d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1d9ffb640 0 client.15126 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:00:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2422f0 0x55adfa2497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/1379767963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2419d0 0x55adfa24c420 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1379767963 >> 172.21.15.12:0/1379767963 conn(0x55adfa23df60 msgr2=0x55adfa243c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1379767963 shutdown_connections 2024-09-16T01:00:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1379767963 wait complete. 2024-09-16T01:00:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.222+0000 7fa1fa8b1740 20 client.15126 trim_cache size 0 max 16384 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1fa8b1740 1 Processor -- start 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1fa8b1740 1 -- start start 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2419d0 0x55adfa25e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa246a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa246f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55adfa25c890 con 0x55adfa2422f0 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55adfa25cf60 con 0x55adfa24cbb0 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55adfa25d630 con 0x55adfa2419d0 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1f5a73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa246a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1f5a73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa246a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60004/0 (socket says 172.21.15.12:60004) 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.240+0000 7fa1f5a73640 1 -- 172.21.15.12:0/1510470750 learned_addr learned my addr 172.21.15.12:0/1510470750 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:34.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1f6274640 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2419d0 0x55adfa25e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1f6a75640 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa246f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1f5a73640 1 -- 172.21.15.12:0/1510470750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2419d0 msgr2=0x55adfa25e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2419d0 0x55adfa25e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1f5a73640 1 -- 172.21.15.12:0/1510470750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 msgr2=0x55adfa246f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa246f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1f5a73640 1 -- 172.21.15.12:0/1510470750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adfa23f0d0 con 0x55adfa2422f0 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1f6274640 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2419d0 0x55adfa25e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1f6a75640 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa246f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa246a40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4005ab0 tx=0x7fa1e402ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be05932fc7f0ebfb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1dbfff640 1 -- 172.21.15.12:0/1510470750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4035040 con 0x55adfa2422f0 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1dbfff640 1 -- 172.21.15.12:0/1510470750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e4005520 con 0x55adfa2422f0 2024-09-16T01:00:34.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.241+0000 7fa1dbfff640 1 -- 172.21.15.12:0/1510470750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4004d20 con 0x55adfa2422f0 2024-09-16T01:00:34.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1510470750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 msgr2=0x55adfa246a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa246a40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4005ab0 tx=0x7fa1e402ab30 comp rx=0 tx=0).stop 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1510470750 shutdown_connections 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa24cbb0 0x55adfa246f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa246a40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/1510470750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa2419d0 0x55adfa25e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1510470750 >> 172.21.15.12:0/1510470750 conn(0x55adfa23df60 msgr2=0x55adfa243c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1510470750 shutdown_connections 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/1510470750 wait complete. 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 -- start start 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 Processor -- start 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa2419d0 0x55adfa266ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa267010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa24cbb0 0x55adfa261e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55adfa25e3d0 con 0x55adfa2422f0 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55adfa25dd00 con 0x55adfa2419d0 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.242+0000 7fa1fa8b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55adfa25eaa0 con 0x55adfa24cbb0 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1fa8b1740 10 client.0 _ll_register_callbacks cb 0x7fa1ec09c1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f5a73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa267010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f5a73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa267010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60006/0 (socket says 172.21.15.12:60006) 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f5a73640 1 -- 172.21.15.12:0/2547541719 learned_addr learned my addr 172.21.15.12:0/2547541719 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f6274640 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa2419d0 0x55adfa266ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f6a75640 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa24cbb0 0x55adfa261e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f5a73640 1 -- 172.21.15.12:0/2547541719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa24cbb0 msgr2=0x55adfa261e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa24cbb0 0x55adfa261e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f5a73640 1 -- 172.21.15.12:0/2547541719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa2419d0 msgr2=0x55adfa266ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa2419d0 0x55adfa266ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f5a73640 1 -- 172.21.15.12:0/2547541719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adfa262670 con 0x55adfa2422f0 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1f5a73640 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa267010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40092a0 tx=0x7fa1e4004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8088addc987c66a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/2547541719 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e404f030 con 0x55adfa2422f0 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/2547541719 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fa1e4041050 con 0x55adfa2422f0 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.243+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/2547541719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e4005520 con 0x55adfa2422f0 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/2547541719 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa1e4035040 con 0x55adfa2422f0 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1fa8b1740 10 client.15132 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/2547541719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55adfa2c72c0 con 0x55adfa2422f0 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/2547541719 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e4005520 con 0x55adfa2422f0 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/2547541719 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa1e4004c60 con 0x55adfa2422f0 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1fa8b1740 10 client.15132 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1fa8b1740 10 client.15132 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1fa8b1740 20 client.15132 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55adfa2cb990 0x55adfa2ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1fa8b1740 4 client.15132 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/2547541719 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "status"}) -- 0x55adfa1afb10 con 0x55adfa2cb990 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.244+0000 7fa1f6274640 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55adfa2cb990 0x55adfa2ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1f6274640 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55adfa2cb990 0x55adfa2ca6a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fa67534741872da server_cookie=39c856fdb86dddfe in_seq=0 out_seq=0 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1d9ffb640 10 client.15132 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1d9ffb640 1 -- 172.21.15.12:0/2547541719 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55adfa1afb10 con 0x55adfa2cb990 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1d9ffb640 10 client.15132 handle_command_reply: tid=0 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 client.15132 shutdown 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/2547541719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 msgr2=0x55adfa267010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa267010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40092a0 tx=0x7fa1e4004860 comp rx=0 tx=0).stop 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/2547541719 shutdown_connections 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55adfa2cb990 0x55adfa2ca6a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55adfa24cbb0 0x55adfa261e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55adfa2422f0 0x55adfa267010 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1d9ffb640 0 client.15132 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:00:34.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 --2- 172.21.15.12:0/2547541719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adfa2419d0 0x55adfa266ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/2547541719 >> 172.21.15.12:0/2547541719 conn(0x55adfa23df60 msgr2=0x55adfa2445f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:34.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/2547541719 shutdown_connections 2024-09-16T01:00:34.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.245+0000 7fa1fa8b1740 1 -- 172.21.15.12:0/2547541719 wait complete. 2024-09-16T01:00:34.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1fa8b1740 20 client.15132 trim_cache size 0 max 16384 2024-09-16T01:00:34.251 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:00:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:00:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-16T01:00:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24518, 2024-09-16T01:00:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:00:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:00:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:00:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 116.67547694700001, 2024-09-16T01:00:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-16T01:00:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 87, 2024-09-16T01:00:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T01:00:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 127.846031887 2024-09-16T01:00:34.252 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 -- 172.21.15.12:0/1688296700 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1dc0a32d0 msgr2=0x7fa1dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1dc0a32d0 0x7fa1dc0a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005fd0 tx=0x7fa1e80138e0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 -- 172.21.15.12:0/1688296700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1f0101de0 msgr2=0x7fa1f00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1f0101de0 0x7fa1f00744f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00ea80 tx=0x7fa1ec00ef40 comp rx=0 tx=0).stop 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 -- 172.21.15.12:0/1688296700 shutdown_connections 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1dc0a32d0 0x7fa1dc0a5790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f0106f10 0x7fa1f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f0102790 0x7fa1f0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 --2- 172.21.15.12:0/1688296700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1f0101de0 0x7fa1f00744f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 -- 172.21.15.12:0/1688296700 >> 172.21.15.12:0/1688296700 conn(0x7fa1f00fd8c0 msgr2=0x7fa1f00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 -- 172.21.15.12:0/1688296700 shutdown_connections 2024-09-16T01:00:34.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:34.246+0000 7fa1f84d8640 1 -- 172.21.15.12:0/1688296700 wait complete. 2024-09-16T01:00:34.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:34 smithi119 ceph-mon[35049]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:34.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:34 smithi012 ceph-mon[31197]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:34.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:34 smithi098 ceph-mon[35346]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:34.941 INFO:tasks.cephadm:Setup complete, yielding 2024-09-16T01:00:34.941 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T01:00:34.953 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-16T01:00:34.953 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-16T01:00:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:35.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.721+0000 7fec5c504640 1 -- 172.21.15.12:0/1290075819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec54107960 msgr2=0x7fec54109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:35.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.721+0000 7fec5c504640 1 --2- 172.21.15.12:0/1290075819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec54107960 0x7fec54109d50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009ca0 tx=0x7fec4c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.721+0000 7fec5c504640 1 -- 172.21.15.12:0/1290075819 shutdown_connections 2024-09-16T01:00:35.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.721+0000 7fec5c504640 1 --2- 172.21.15.12:0/1290075819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec54107960 0x7fec54109d50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.721+0000 7fec5c504640 1 --2- 172.21.15.12:0/1290075819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec54105030 0x7fec54107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.721+0000 7fec5c504640 1 --2- 172.21.15.12:0/1290075819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec54102700 0x7fec54104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.721+0000 7fec5c504640 1 -- 172.21.15.12:0/1290075819 >> 172.21.15.12:0/1290075819 conn(0x7fec540fc2a0 msgr2=0x7fec540fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:35.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.721+0000 7fec5c504640 1 -- 172.21.15.12:0/1290075819 shutdown_connections 2024-09-16T01:00:35.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.721+0000 7fec5c504640 1 -- 172.21.15.12:0/1290075819 wait complete. 2024-09-16T01:00:35.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5c504640 1 Processor -- start 2024-09-16T01:00:35.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5c504640 1 -- start start 2024-09-16T01:00:35.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5c504640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec54102700 0x7fec54102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:35.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5c504640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec54105030 0x7fec541006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:35.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5c504640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec54107960 0x7fec54100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:35.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5c504640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fec5410d990 con 0x7fec54107960 2024-09-16T01:00:35.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5c504640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fec5410d810 con 0x7fec54102700 2024-09-16T01:00:35.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5c504640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fec5410db10 con 0x7fec54105030 2024-09-16T01:00:35.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5aaa1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec54107960 0x7fec54100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:35.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5aaa1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec54107960 0x7fec54100bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60034/0 (socket says 172.21.15.12:60034) 2024-09-16T01:00:35.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5aaa1640 1 -- 172.21.15.12:0/2824935598 learned_addr learned my addr 172.21.15.12:0/2824935598 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:35.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5a2a0640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec54102700 0x7fec54102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:35.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec59a9f640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec54105030 0x7fec541006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:35.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5aaa1640 1 -- 172.21.15.12:0/2824935598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec54105030 msgr2=0x7fec541006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:35.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5aaa1640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec54105030 0x7fec541006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5aaa1640 1 -- 172.21.15.12:0/2824935598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec54102700 msgr2=0x7fec54102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:35.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5aaa1640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec54102700 0x7fec54102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec5aaa1640 1 -- 172.21.15.12:0/2824935598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec541014b0 con 0x7fec54107960 2024-09-16T01:00:35.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.722+0000 7fec59a9f640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec54105030 0x7fec541006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:35.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.723+0000 7fec5aaa1640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec54107960 0x7fec54100bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0098d0 tx=0x7fec4c02f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:35.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.723+0000 7fec4b7fe640 1 -- 172.21.15.12:0/2824935598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c02fc30 con 0x7fec54107960 2024-09-16T01:00:35.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.723+0000 7fec4b7fe640 1 -- 172.21.15.12:0/2824935598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec4c003e50 con 0x7fec54107960 2024-09-16T01:00:35.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.723+0000 7fec5c504640 1 -- 172.21.15.12:0/2824935598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec541a21b0 con 0x7fec54107960 2024-09-16T01:00:35.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.723+0000 7fec4b7fe640 1 -- 172.21.15.12:0/2824935598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c004810 con 0x7fec54107960 2024-09-16T01:00:35.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.723+0000 7fec5c504640 1 -- 172.21.15.12:0/2824935598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec541a2790 con 0x7fec54107960 2024-09-16T01:00:35.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.724+0000 7fec5c504640 1 -- 172.21.15.12:0/2824935598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec540fdd90 con 0x7fec54107960 2024-09-16T01:00:35.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.725+0000 7fec4b7fe640 1 -- 172.21.15.12:0/2824935598 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fec4c003970 con 0x7fec54107960 2024-09-16T01:00:35.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.726+0000 7fec4b7fe640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fec400a3350 0x7fec400a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:35.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.726+0000 7fec5a2a0640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fec400a3350 0x7fec400a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:35.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.726+0000 7fec4b7fe640 1 -- 172.21.15.12:0/2824935598 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fec4c0f0fb0 con 0x7fec54107960 2024-09-16T01:00:35.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.726+0000 7fec5a2a0640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fec400a3350 0x7fec400a5810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fec50009990 tx=0x7fec50009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:35.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.730+0000 7fec4b7fe640 1 -- 172.21.15.12:0/2824935598 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec4c0bd940 con 0x7fec54107960 2024-09-16T01:00:35.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.925+0000 7fec5c504640 1 -- 172.21.15.12:0/2824935598 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fec54062630 con 0x7fec400a3350 2024-09-16T01:00:35.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.926+0000 7fec4b7fe640 1 -- 172.21.15.12:0/2824935598 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fec54062630 con 0x7fec400a3350 2024-09-16T01:00:35.927 INFO:teuthology.orchestra.run.smithi012.stdout:Backend: cephadm 2024-09-16T01:00:35.927 INFO:teuthology.orchestra.run.smithi012.stdout:Available: Yes 2024-09-16T01:00:35.927 INFO:teuthology.orchestra.run.smithi012.stdout:Paused: No 2024-09-16T01:00:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.928+0000 7fec5c504640 1 -- 172.21.15.12:0/2824935598 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fec400a3350 msgr2=0x7fec400a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.928+0000 7fec5c504640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fec400a3350 0x7fec400a5810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fec50009990 tx=0x7fec50009110 comp rx=0 tx=0).stop 2024-09-16T01:00:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.928+0000 7fec5c504640 1 -- 172.21.15.12:0/2824935598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec54107960 msgr2=0x7fec54100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:35.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.928+0000 7fec5c504640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec54107960 0x7fec54100bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0098d0 tx=0x7fec4c02f840 comp rx=0 tx=0).stop 2024-09-16T01:00:35.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.929+0000 7fec5c504640 1 -- 172.21.15.12:0/2824935598 shutdown_connections 2024-09-16T01:00:35.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.929+0000 7fec5c504640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fec400a3350 0x7fec400a5810 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.929+0000 7fec5c504640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec54107960 0x7fec54100bf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.929+0000 7fec5c504640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec54105030 0x7fec541006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.929+0000 7fec5c504640 1 --2- 172.21.15.12:0/2824935598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec54102700 0x7fec54102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.929+0000 7fec5c504640 1 -- 172.21.15.12:0/2824935598 >> 172.21.15.12:0/2824935598 conn(0x7fec540fc2a0 msgr2=0x7fec54103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:35.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.929+0000 7fec5c504640 1 -- 172.21.15.12:0/2824935598 shutdown_connections 2024-09-16T01:00:35.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:35.929+0000 7fec5c504640 1 -- 172.21.15.12:0/2824935598 wait complete. 2024-09-16T01:00:36.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:36 smithi012 ceph-mon[31197]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:00:36.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:36 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:36.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:36 smithi119 ceph-mon[35049]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:00:36.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:36 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:36 smithi098 ceph-mon[35346]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:00:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:36 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:36.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-16T01:00:37.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:37 smithi119 ceph-mon[35049]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:37.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:37 smithi012 ceph-mon[31197]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:37.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:37 smithi098 ceph-mon[35346]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:37.584 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:38.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.073+0000 7fc108193640 1 -- 172.21.15.12:0/1648029328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc100105050 msgr2=0x7fc100107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:38.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.073+0000 7fc108193640 1 --2- 172.21.15.12:0/1648029328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc100105050 0x7fc100107440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009900 tx=0x7fc0fc02a410 comp rx=0 tx=0).stop 2024-09-16T01:00:38.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.073+0000 7fc108193640 1 -- 172.21.15.12:0/1648029328 shutdown_connections 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.073+0000 7fc108193640 1 --2- 172.21.15.12:0/1648029328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100107980 0x7fc100109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.073+0000 7fc108193640 1 --2- 172.21.15.12:0/1648029328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc100105050 0x7fc100107440 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.073+0000 7fc108193640 1 --2- 172.21.15.12:0/1648029328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc100102720 0x7fc100104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.073+0000 7fc108193640 1 -- 172.21.15.12:0/1648029328 >> 172.21.15.12:0/1648029328 conn(0x7fc1000fc280 msgr2=0x7fc1000fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.073+0000 7fc108193640 1 -- 172.21.15.12:0/1648029328 shutdown_connections 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.073+0000 7fc108193640 1 -- 172.21.15.12:0/1648029328 wait complete. 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc108193640 1 Processor -- start 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc108193640 1 -- start start 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc108193640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc100102720 0x7fc100197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc108193640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100105050 0x7fc100198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc108193640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc100107980 0x7fc10019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc108193640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc10010d890 con 0x7fc100102720 2024-09-16T01:00:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc108193640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc10010d710 con 0x7fc100105050 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc108193640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc10010da10 con 0x7fc100107980 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc105f2f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc100102720 0x7fc100197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc105f2f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc100102720 0x7fc100197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42884/0 (socket says 172.21.15.12:42884) 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc105f2f640 1 -- 172.21.15.12:0/3711896924 learned_addr learned my addr 172.21.15.12:0/3711896924 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc10572e640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100105050 0x7fc100198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc106730640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc100107980 0x7fc10019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc105f2f640 1 -- 172.21.15.12:0/3711896924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc100107980 msgr2=0x7fc10019f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc105f2f640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc100107980 0x7fc10019f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc105f2f640 1 -- 172.21.15.12:0/3711896924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100105050 msgr2=0x7fc100198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc105f2f640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100105050 0x7fc100198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.074+0000 7fc105f2f640 1 -- 172.21.15.12:0/3711896924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10019fb40 con 0x7fc100102720 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.075+0000 7fc105f2f640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc100102720 0x7fc100197f10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000d950 tx=0x7fc0f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.075+0000 7fc0f6ffd640 1 -- 172.21.15.12:0/3711896924 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0017030 con 0x7fc100102720 2024-09-16T01:00:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.075+0000 7fc0f6ffd640 1 -- 172.21.15.12:0/3711896924 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f0004020 con 0x7fc100102720 2024-09-16T01:00:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.075+0000 7fc108193640 1 -- 172.21.15.12:0/3711896924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10019fe30 con 0x7fc100102720 2024-09-16T01:00:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.075+0000 7fc0f6ffd640 1 -- 172.21.15.12:0/3711896924 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f00047a0 con 0x7fc100102720 2024-09-16T01:00:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.075+0000 7fc108193640 1 -- 172.21.15.12:0/3711896924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1001a0280 con 0x7fc100102720 2024-09-16T01:00:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.076+0000 7fc108193640 1 -- 172.21.15.12:0/3711896924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1000fdd70 con 0x7fc100102720 2024-09-16T01:00:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.077+0000 7fc0f6ffd640 1 -- 172.21.15.12:0/3711896924 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc0f00041d0 con 0x7fc100102720 2024-09-16T01:00:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.078+0000 7fc0f6ffd640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0ec0a3300 0x7fc0ec0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.078+0000 7fc10572e640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0ec0a3300 0x7fc0ec0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.078+0000 7fc0f6ffd640 1 -- 172.21.15.12:0/3711896924 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fc0f00cf820 con 0x7fc100102720 2024-09-16T01:00:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.079+0000 7fc10572e640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0ec0a3300 0x7fc0ec0a57c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc02aa00 tx=0x7fc0fc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.083+0000 7fc0f6ffd640 1 -- 172.21.15.12:0/3711896924 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0f009c0a0 con 0x7fc100102720 2024-09-16T01:00:38.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.280+0000 7fc108193640 1 -- 172.21.15.12:0/3711896924 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc100062630 con 0x7fc0ec0a3300 2024-09-16T01:00:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.294+0000 7fc0f6ffd640 1 -- 172.21.15.12:0/3711896924 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7fc100062630 con 0x7fc0ec0a3300 2024-09-16T01:00:38.295 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T01:00:38.295 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (2m) 63s ago 2m 16.9M - 19.1.1-326-g8921c8ef f1455bd0219c 138edc3f38ea 2024-09-16T01:00:38.295 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi098 running (2m) 0s ago 2m 29.2M - 19.1.1-326-g8921c8ef f1455bd0219c 8ddc78de0437 2024-09-16T01:00:38.295 INFO:teuthology.orchestra.run.smithi012.stdout:mds.c smithi119 running (2m) 0s ago 2m 19.5M - 19.1.1-326-g8921c8ef f1455bd0219c c2178b95243f 2024-09-16T01:00:38.295 INFO:teuthology.orchestra.run.smithi012.stdout:mds.d smithi012 running (2m) 63s ago 2m 13.7M - 19.1.1-326-g8921c8ef f1455bd0219c a5e8bab2b624 2024-09-16T01:00:38.296 INFO:teuthology.orchestra.run.smithi012.stdout:mds.e smithi098 running (2m) 0s ago 2m 20.7M - 19.1.1-326-g8921c8ef f1455bd0219c 62b2d106249f 2024-09-16T01:00:38.296 INFO:teuthology.orchestra.run.smithi012.stdout:mds.f smithi119 running (2m) 0s ago 2m 18.5M - 19.1.1-326-g8921c8ef f1455bd0219c deb74c504e4c 2024-09-16T01:00:38.296 INFO:teuthology.orchestra.run.smithi012.stdout:mds.g smithi012 running (2m) 63s ago 2m 14.6M - 19.1.1-326-g8921c8ef f1455bd0219c 955595e5529e 2024-09-16T01:00:38.296 INFO:teuthology.orchestra.run.smithi012.stdout:mds.h smithi098 running (2m) 0s ago 2m 19.4M - 19.1.1-326-g8921c8ef f1455bd0219c 9e69ba55b170 2024-09-16T01:00:38.296 INFO:teuthology.orchestra.run.smithi012.stdout:mds.i smithi119 running (2m) 0s ago 2m 21.1M - 19.1.1-326-g8921c8ef f1455bd0219c 8edf38410664 2024-09-16T01:00:38.296 INFO:teuthology.orchestra.run.smithi012.stdout:mds.j smithi012 running (2m) 63s ago 2m 16.8M - 19.1.1-326-g8921c8ef f1455bd0219c 0b8a1996b359 2024-09-16T01:00:38.296 INFO:teuthology.orchestra.run.smithi012.stdout:mds.k smithi098 running (2m) 0s ago 2m 18.5M - 19.1.1-326-g8921c8ef f1455bd0219c 3638a1ad9e48 2024-09-16T01:00:38.296 INFO:teuthology.orchestra.run.smithi012.stdout:mds.l smithi119 running (2m) 0s ago 2m 17.7M - 19.1.1-326-g8921c8ef f1455bd0219c f24e9cb767c8 2024-09-16T01:00:38.296 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi012 *:9283,8765 running (9m) 63s ago 9m 507M - 19.1.1-326-g8921c8ef f1455bd0219c f5f7edc62587 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi098 *:8443,8765 running (7m) 0s ago 7m 444M - 19.1.1-326-g8921c8ef f1455bd0219c a9ff6b958502 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.z smithi119 *:8443,8765 running (8m) 0s ago 7m 443M - 19.1.1-326-g8921c8ef f1455bd0219c 55522edc9584 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (9m) 63s ago 9m 50.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c f5366c394d45 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi098 running (8m) 0s ago 8m 41.6M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 6c33642f5f84 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi119 running (8m) 0s ago 8m 41.0M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 5ba633bd207f 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (7m) 63s ago 7m 58.8M 4273M 19.1.1-326-g8921c8ef f1455bd0219c cb0c9f10ae35 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi098 running (7m) 0s ago 7m 60.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 71024a4a7c46 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi119 running (6m) 0s ago 6m 59.8M 4272M 19.1.1-326-g8921c8ef f1455bd0219c a7d9ab157164 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (6m) 63s ago 6m 43.4M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 8017828bc4c4 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi098 running (6m) 0s ago 6m 44.2M 4272M 19.1.1-326-g8921c8ef f1455bd0219c cde8a6259f17 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi119 running (5m) 0s ago 5m 45.9M 4272M 19.1.1-326-g8921c8ef f1455bd0219c c72e50ac120c 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi012 running (5m) 63s ago 5m 42.4M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 748fe6fd2bcc 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi098 running (4m) 0s ago 4m 44.9M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 6762acfd1f8e 2024-09-16T01:00:38.297 INFO:teuthology.orchestra.run.smithi012.stdout:osd.8 smithi119 running (4m) 0s ago 4m 56.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c e3c9177618a6 2024-09-16T01:00:38.298 INFO:teuthology.orchestra.run.smithi012.stdout:osd.9 smithi012 running (3m) 63s ago 3m 53.2M 4273M 19.1.1-326-g8921c8ef f1455bd0219c e6e78ee8bfe2 2024-09-16T01:00:38.298 INFO:teuthology.orchestra.run.smithi012.stdout:osd.10 smithi098 running (3m) 0s ago 3m 52.7M 4272M 19.1.1-326-g8921c8ef f1455bd0219c cacf2c851c5c 2024-09-16T01:00:38.298 INFO:teuthology.orchestra.run.smithi012.stdout:osd.11 smithi119 running (3m) 0s ago 3m 53.5M 4272M 19.1.1-326-g8921c8ef f1455bd0219c dffab6824b50 2024-09-16T01:00:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.296+0000 7fc108193640 1 -- 172.21.15.12:0/3711896924 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0ec0a3300 msgr2=0x7fc0ec0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.296+0000 7fc108193640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0ec0a3300 0x7fc0ec0a57c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc02aa00 tx=0x7fc0fc0315b0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.296+0000 7fc108193640 1 -- 172.21.15.12:0/3711896924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc100102720 msgr2=0x7fc100197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.296+0000 7fc108193640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc100102720 0x7fc100197f10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000d950 tx=0x7fc0f000de10 comp rx=0 tx=0).stop 2024-09-16T01:00:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.297+0000 7fc108193640 1 -- 172.21.15.12:0/3711896924 shutdown_connections 2024-09-16T01:00:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.297+0000 7fc108193640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc0ec0a3300 0x7fc0ec0a57c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.297+0000 7fc108193640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc100107980 0x7fc10019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.297+0000 7fc108193640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc100105050 0x7fc100198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.297+0000 7fc108193640 1 --2- 172.21.15.12:0/3711896924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc100102720 0x7fc100197f10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.297+0000 7fc108193640 1 -- 172.21.15.12:0/3711896924 >> 172.21.15.12:0/3711896924 conn(0x7fc1000fc280 msgr2=0x7fc100103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.297+0000 7fc108193640 1 -- 172.21.15.12:0/3711896924 shutdown_connections 2024-09-16T01:00:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:38.297+0000 7fc108193640 1 -- 172.21.15.12:0/3711896924 wait complete. 2024-09-16T01:00:38.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:38 smithi012 ceph-mon[31197]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:38.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:38 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:38 smithi119 ceph-mon[35049]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:38.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.848 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:38 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.939 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-16T01:00:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:38 smithi098 ceph-mon[35346]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:38 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:39 smithi012 ceph-mon[31197]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:39 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:39 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:39 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:39 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:39 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.717+0000 7fed87732640 1 -- 172.21.15.12:0/3303032433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed80102690 msgr2=0x7fed80108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.717+0000 7fed87732640 1 --2- 172.21.15.12:0/3303032433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed80102690 0x7fed80108f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fed78009ca0 tx=0x7fed7802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.717+0000 7fed87732640 1 -- 172.21.15.12:0/3303032433 shutdown_connections 2024-09-16T01:00:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.717+0000 7fed87732640 1 --2- 172.21.15.12:0/3303032433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed80102690 0x7fed80108f20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.717+0000 7fed87732640 1 --2- 172.21.15.12:0/3303032433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed80101cd0 0x7fed80102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.717+0000 7fed87732640 1 --2- 172.21.15.12:0/3303032433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed80100ad0 0x7fed80100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.717+0000 7fed87732640 1 -- 172.21.15.12:0/3303032433 >> 172.21.15.12:0/3303032433 conn(0x7fed800fc280 msgr2=0x7fed800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.717+0000 7fed87732640 1 -- 172.21.15.12:0/3303032433 shutdown_connections 2024-09-16T01:00:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.717+0000 7fed87732640 1 -- 172.21.15.12:0/3303032433 wait complete. 2024-09-16T01:00:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed87732640 1 Processor -- start 2024-09-16T01:00:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed87732640 1 -- start start 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed87732640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed80100ad0 0x7fed80104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed87732640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed80101cd0 0x7fed801030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed87732640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed80102690 0x7fed801035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed87732640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fed8010c780 con 0x7fed80100ad0 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed87732640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fed8010c600 con 0x7fed80102690 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed87732640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fed8010c900 con 0x7fed80101cd0 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed854ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed80100ad0 0x7fed80104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed854ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed80100ad0 0x7fed80104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42902/0 (socket says 172.21.15.12:42902) 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed854ce640 1 -- 172.21.15.12:0/3105156045 learned_addr learned my addr 172.21.15.12:0/3105156045 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed85ccf640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed80102690 0x7fed801035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed84ccd640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed80101cd0 0x7fed801030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.718+0000 7fed854ce640 1 -- 172.21.15.12:0/3105156045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed80101cd0 msgr2=0x7fed801030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed854ce640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed80101cd0 0x7fed801030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed854ce640 1 -- 172.21.15.12:0/3105156045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed80102690 msgr2=0x7fed801035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed854ce640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed80102690 0x7fed801035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed854ce640 1 -- 172.21.15.12:0/3105156045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed80103eb0 con 0x7fed80100ad0 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed84ccd640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed80101cd0 0x7fed801030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed85ccf640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed80102690 0x7fed801035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed854ce640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed80100ad0 0x7fed80104a60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c970 tx=0x7fed7c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed767fc640 1 -- 172.21.15.12:0/3105156045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c007c10 con 0x7fed80100ad0 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed767fc640 1 -- 172.21.15.12:0/3105156045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed7c007db0 con 0x7fed80100ad0 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed87732640 1 -- 172.21.15.12:0/3105156045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed801a1f20 con 0x7fed80100ad0 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed767fc640 1 -- 172.21.15.12:0/3105156045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c00f940 con 0x7fed80100ad0 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.719+0000 7fed87732640 1 -- 172.21.15.12:0/3105156045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed801a2310 con 0x7fed80100ad0 2024-09-16T01:00:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.720+0000 7fed87732640 1 -- 172.21.15.12:0/3105156045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed801a25d0 con 0x7fed80100ad0 2024-09-16T01:00:39.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.721+0000 7fed767fc640 1 -- 172.21.15.12:0/3105156045 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fed7c00fae0 con 0x7fed80100ad0 2024-09-16T01:00:39.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.722+0000 7fed767fc640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fed6c0a32d0 0x7fed6c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:39.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.722+0000 7fed767fc640 1 -- 172.21.15.12:0/3105156045 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fed7c0d0450 con 0x7fed80100ad0 2024-09-16T01:00:39.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.722+0000 7fed84ccd640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fed6c0a32d0 0x7fed6c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:39.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.723+0000 7fed84ccd640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fed6c0a32d0 0x7fed6c0a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fed801047e0 tx=0x7fed7000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:39.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.725+0000 7fed767fc640 1 -- 172.21.15.12:0/3105156045 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed7c09cdf0 con 0x7fed80100ad0 2024-09-16T01:00:39.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:39 smithi119 ceph-mon[35049]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:39.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:39 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:39.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:39 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:39.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:39 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:39.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:39 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:39.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:39 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:39.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.922+0000 7fed87732640 1 -- 172.21.15.12:0/3105156045 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fed800fe370 con 0x7fed6c0a32d0 2024-09-16T01:00:39.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.928+0000 7fed767fc640 1 -- 172.21.15.12:0/3105156045 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fed800fe370 con 0x7fed6c0a32d0 2024-09-16T01:00:39.929 INFO:teuthology.orchestra.run.smithi012.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-16T01:00:39.929 INFO:teuthology.orchestra.run.smithi012.stdout:mds.all 12/12 2s ago 2m smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2024-09-16T01:00:39.929 INFO:teuthology.orchestra.run.smithi012.stdout:mgr 3/3 2s ago 8m smithi012=x;smithi098=y;smithi119=z;count:3 2024-09-16T01:00:39.929 INFO:teuthology.orchestra.run.smithi012.stdout:mon 3/3 2s ago 8m smithi012:172.21.15.12=a;smithi098:172.21.15.98=b;smithi119:172.21.15.119=c;count:3 2024-09-16T01:00:39.929 INFO:teuthology.orchestra.run.smithi012.stdout:osd 12 2s ago - 2024-09-16T01:00:39.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 -- 172.21.15.12:0/3105156045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fed6c0a32d0 msgr2=0x7fed6c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:39.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fed6c0a32d0 0x7fed6c0a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fed801047e0 tx=0x7fed7000a5c0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 -- 172.21.15.12:0/3105156045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed80100ad0 msgr2=0x7fed80104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:39.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed80100ad0 0x7fed80104a60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c970 tx=0x7fed7c00ce30 comp rx=0 tx=0).stop 2024-09-16T01:00:39.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 -- 172.21.15.12:0/3105156045 shutdown_connections 2024-09-16T01:00:39.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fed6c0a32d0 0x7fed6c0a5790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed80102690 0x7fed801035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed80101cd0 0x7fed801030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 --2- 172.21.15.12:0/3105156045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed80100ad0 0x7fed80104a60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 -- 172.21.15.12:0/3105156045 >> 172.21.15.12:0/3105156045 conn(0x7fed800fc280 msgr2=0x7fed800fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:39.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 -- 172.21.15.12:0/3105156045 shutdown_connections 2024-09-16T01:00:39.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:39.930+0000 7fed87732640 1 -- 172.21.15.12:0/3105156045 wait complete. 2024-09-16T01:00:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:39 smithi098 ceph-mon[35346]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:39 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:39 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:39 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:39 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:39 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:00:40.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:40 smithi012 ceph-mon[31197]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:40.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-16T01:00:40.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:40 smithi119 ceph-mon[35049]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:40.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:40 smithi098 ceph-mon[35346]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:00:41.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.372+0000 7f120cc38640 1 -- 172.21.15.12:0/3107955739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1208102690 msgr2=0x7f1208108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.372+0000 7f120cc38640 1 --2- 172.21.15.12:0/3107955739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1208102690 0x7f1208108f20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1200009ca0 tx=0x7f120002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.372+0000 7f120cc38640 1 -- 172.21.15.12:0/3107955739 shutdown_connections 2024-09-16T01:00:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.372+0000 7f120cc38640 1 --2- 172.21.15.12:0/3107955739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1208102690 0x7f1208108f20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.372+0000 7f120cc38640 1 --2- 172.21.15.12:0/3107955739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208101cd0 0x7f1208102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.372+0000 7f120cc38640 1 --2- 172.21.15.12:0/3107955739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1208100ad0 0x7f1208100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.372+0000 7f120cc38640 1 -- 172.21.15.12:0/3107955739 >> 172.21.15.12:0/3107955739 conn(0x7f12080fc280 msgr2=0x7f12080fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.372+0000 7f120cc38640 1 -- 172.21.15.12:0/3107955739 shutdown_connections 2024-09-16T01:00:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.372+0000 7f120cc38640 1 -- 172.21.15.12:0/3107955739 wait complete. 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f120cc38640 1 Processor -- start 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f120cc38640 1 -- start start 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f120cc38640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1208100ad0 0x7f120819a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f120cc38640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1208101cd0 0x7f120819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f120cc38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208102690 0x7f12081a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f120cc38640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f120810c780 con 0x7f1208101cd0 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f120cc38640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f120810c600 con 0x7f1208102690 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f120cc38640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f120810c900 con 0x7f1208100ad0 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f1205d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1208101cd0 0x7f120819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f1205d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1208101cd0 0x7f120819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42924/0 (socket says 172.21.15.12:42924) 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.373+0000 7f1205d9b640 1 -- 172.21.15.12:0/2627100610 learned_addr learned my addr 172.21.15.12:0/2627100610 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f120659c640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1208100ad0 0x7f120819a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f1206d9d640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208102690 0x7f12081a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f1205d9b640 1 -- 172.21.15.12:0/2627100610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1208100ad0 msgr2=0x7f120819a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f1205d9b640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1208100ad0 0x7f120819a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f1205d9b640 1 -- 172.21.15.12:0/2627100610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208102690 msgr2=0x7f12081a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f1205d9b640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208102690 0x7f12081a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f1205d9b640 1 -- 172.21.15.12:0/2627100610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12081a1c40 con 0x7f1208101cd0 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f1205d9b640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1208101cd0 0x7f120819a550 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00d950 tx=0x7f11fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f11f77fe640 1 -- 172.21.15.12:0/2627100610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc017070 con 0x7f1208101cd0 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f11f77fe640 1 -- 172.21.15.12:0/2627100610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11fc009c30 con 0x7f1208101cd0 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f120cc38640 1 -- 172.21.15.12:0/2627100610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12081a1f30 con 0x7f1208101cd0 2024-09-16T01:00:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f11f77fe640 1 -- 172.21.15.12:0/2627100610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00f6b0 con 0x7f1208101cd0 2024-09-16T01:00:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.374+0000 7f120cc38640 1 -- 172.21.15.12:0/2627100610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12081a2430 con 0x7f1208101cd0 2024-09-16T01:00:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.375+0000 7f120cc38640 1 -- 172.21.15.12:0/2627100610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12081a2720 con 0x7f1208101cd0 2024-09-16T01:00:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.376+0000 7f11f77fe640 1 -- 172.21.15.12:0/2627100610 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f11fc0109d0 con 0x7f1208101cd0 2024-09-16T01:00:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.377+0000 7f11f77fe640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11f00a3380 0x7f11f00a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.377+0000 7f120659c640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11f00a3380 0x7f11f00a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.377+0000 7f11f77fe640 1 -- 172.21.15.12:0/2627100610 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f11fc0cf9e0 con 0x7f1208101cd0 2024-09-16T01:00:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.378+0000 7f120659c640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11f00a3380 0x7f11f00a5840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f11f80058c0 tx=0x7f11f8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.382+0000 7f11f77fe640 1 -- 172.21.15.12:0/2627100610 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11fc009de0 con 0x7f1208101cd0 2024-09-16T01:00:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.563+0000 7f120cc38640 1 -- 172.21.15.12:0/2627100610 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f12080fe3e0 con 0x7f11f00a3380 2024-09-16T01:00:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.565+0000 7f11f77fe640 1 -- 172.21.15.12:0/2627100610 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f12080fe3e0 con 0x7f11f00a3380 2024-09-16T01:00:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:HOST ADDR LABELS STATUS 2024-09-16T01:00:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012 172.21.15.12 2024-09-16T01:00:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:smithi098 172.21.15.98 2024-09-16T01:00:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:smithi119 172.21.15.119 2024-09-16T01:00:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:3 hosts in cluster 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 -- 172.21.15.12:0/2627100610 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11f00a3380 msgr2=0x7f11f00a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11f00a3380 0x7f11f00a5840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f11f80058c0 tx=0x7f11f8005850 comp rx=0 tx=0).stop 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 -- 172.21.15.12:0/2627100610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1208101cd0 msgr2=0x7f120819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1208101cd0 0x7f120819a550 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00d950 tx=0x7f11fc00de10 comp rx=0 tx=0).stop 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 -- 172.21.15.12:0/2627100610 shutdown_connections 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11f00a3380 0x7f11f00a5840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1208102690 0x7f12081a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1208101cd0 0x7f120819a550 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 --2- 172.21.15.12:0/2627100610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1208100ad0 0x7f120819a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 -- 172.21.15.12:0/2627100610 >> 172.21.15.12:0/2627100610 conn(0x7f12080fc280 msgr2=0x7f12080fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 -- 172.21.15.12:0/2627100610 shutdown_connections 2024-09-16T01:00:41.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:41.567+0000 7f120cc38640 1 -- 172.21.15.12:0/2627100610 wait complete. 2024-09-16T01:00:41.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:41 smithi119 ceph-mon[35049]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:41.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:41 smithi012 ceph-mon[31197]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:41.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:41 smithi098 ceph-mon[35346]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:42.309 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-16T01:00:42.567 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:42.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:42 smithi012 ceph-mon[31197]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:00:42.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:42 smithi012 ceph-mon[31197]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:42.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:42 smithi119 ceph-mon[35049]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:00:42.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:42 smithi119 ceph-mon[35049]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:42.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:42 smithi098 ceph-mon[35346]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:00:42.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:42 smithi098 ceph-mon[35346]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 -- 172.21.15.12:0/4260030148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87481026d0 msgr2=0x7f8748108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 --2- 172.21.15.12:0/4260030148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87481026d0 0x7f8748108f60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8740009ca0 tx=0x7f874002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 -- 172.21.15.12:0/4260030148 shutdown_connections 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 --2- 172.21.15.12:0/4260030148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87481026d0 0x7f8748108f60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 --2- 172.21.15.12:0/4260030148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8748101d10 0x7f8748102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 --2- 172.21.15.12:0/4260030148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8748100b10 0x7f8748100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 -- 172.21.15.12:0/4260030148 >> 172.21.15.12:0/4260030148 conn(0x7f87480fc2a0 msgr2=0x7f87480fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 -- 172.21.15.12:0/4260030148 shutdown_connections 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 -- 172.21.15.12:0/4260030148 wait complete. 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 Processor -- start 2024-09-16T01:00:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.094+0000 7f874e277640 1 -- start start 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f874e277640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8748100b10 0x7f8748104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f874e277640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8748101d10 0x7f87481030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f874e277640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87481026d0 0x7f8748103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f874e277640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f874810c7f0 con 0x7f8748101d10 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f874e277640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f874810c670 con 0x7f87481026d0 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f874e277640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f874810c970 con 0x7f8748100b10 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f87477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8748101d10 0x7f87481030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f87477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8748101d10 0x7f87481030f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42946/0 (socket says 172.21.15.12:42946) 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f87477fe640 1 -- 172.21.15.12:0/1111696011 learned_addr learned my addr 172.21.15.12:0/1111696011 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f8747fff640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8748100b10 0x7f8748104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f874c814640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87481026d0 0x7f8748103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f87477fe640 1 -- 172.21.15.12:0/1111696011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8748100b10 msgr2=0x7f8748104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f87477fe640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8748100b10 0x7f8748104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f87477fe640 1 -- 172.21.15.12:0/1111696011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87481026d0 msgr2=0x7f8748103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f87477fe640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87481026d0 0x7f8748103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f87477fe640 1 -- 172.21.15.12:0/1111696011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8748103ef0 con 0x7f8748101d10 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f87477fe640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8748101d10 0x7f87481030f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f873c00b4a0 tx=0x7f873c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.095+0000 7f87457fa640 1 -- 172.21.15.12:0/1111696011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c014070 con 0x7f8748101d10 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.096+0000 7f87457fa640 1 -- 172.21.15.12:0/1111696011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f873c010af0 con 0x7f8748101d10 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.096+0000 7f87457fa640 1 -- 172.21.15.12:0/1111696011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c017d10 con 0x7f8748101d10 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.096+0000 7f874e277640 1 -- 172.21.15.12:0/1111696011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87481a1fd0 con 0x7f8748101d10 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.096+0000 7f874e277640 1 -- 172.21.15.12:0/1111696011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87481a24b0 con 0x7f8748101d10 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.097+0000 7f874e277640 1 -- 172.21.15.12:0/1111696011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87481a2740 con 0x7f8748101d10 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.098+0000 7f87457fa640 1 -- 172.21.15.12:0/1111696011 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f873c017070 con 0x7f8748101d10 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.099+0000 7f87457fa640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87300a3350 0x7f87300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:43.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.099+0000 7f87457fa640 1 -- 172.21.15.12:0/1111696011 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f873c0cef50 con 0x7f8748101d10 2024-09-16T01:00:43.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.099+0000 7f8747fff640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87300a3350 0x7f87300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:43.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.099+0000 7f8747fff640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87300a3350 0x7f87300a5810 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8748101b70 tx=0x7f8738005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:43.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.103+0000 7f87457fa640 1 -- 172.21.15.12:0/1111696011 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f873c09b230 con 0x7f8748101d10 2024-09-16T01:00:43.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.284+0000 7f874e277640 1 -- 172.21.15.12:0/1111696011 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f87480fe440 con 0x7f87300a3350 2024-09-16T01:00:43.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.286+0000 7f87457fa640 1 -- 172.21.15.12:0/1111696011 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f87480fe440 con 0x7f87300a3350 2024-09-16T01:00:43.287 INFO:teuthology.orchestra.run.smithi012.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-16T01:00:43.287 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005J400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-16T01:00:43.287 INFO:teuthology.orchestra.run.smithi012.stdout:smithi098 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010H400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-16T01:00:43.287 INFO:teuthology.orchestra.run.smithi012.stdout:smithi119 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-16T01:00:43.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 -- 172.21.15.12:0/1111696011 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87300a3350 msgr2=0x7f87300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:43.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87300a3350 0x7f87300a5810 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8748101b70 tx=0x7f8738005f90 comp rx=0 tx=0).stop 2024-09-16T01:00:43.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 -- 172.21.15.12:0/1111696011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8748101d10 msgr2=0x7f87481030f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:43.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8748101d10 0x7f87481030f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f873c00b4a0 tx=0x7f873c00b960 comp rx=0 tx=0).stop 2024-09-16T01:00:43.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 -- 172.21.15.12:0/1111696011 shutdown_connections 2024-09-16T01:00:43.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87300a3350 0x7f87300a5810 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87481026d0 0x7f8748103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8748101d10 0x7f87481030f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 --2- 172.21.15.12:0/1111696011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8748100b10 0x7f8748104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 -- 172.21.15.12:0/1111696011 >> 172.21.15.12:0/1111696011 conn(0x7f87480fc2a0 msgr2=0x7f87480fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:43.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 -- 172.21.15.12:0/1111696011 shutdown_connections 2024-09-16T01:00:43.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:43.288+0000 7f874e277640 1 -- 172.21.15.12:0/1111696011 wait complete. 2024-09-16T01:00:44.017 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T01:00:44.027 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-16T01:00:44.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T01:00:44.290 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:44.665 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:44 smithi012 ceph-mon[31197]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:44.665 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:44 smithi012 ceph-mon[31197]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:44.666 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:44 smithi012 ceph-mon[31197]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-16T01:00:44.666 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:44 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-16T01:00:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.800+0000 7fb254147640 1 -- 172.21.15.12:0/3011832019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24c104fd0 msgr2=0x7fb24c1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.800+0000 7fb254147640 1 --2- 172.21.15.12:0/3011832019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24c104fd0 0x7fb24c1073c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009900 tx=0x7fb23c02a410 comp rx=0 tx=0).stop 2024-09-16T01:00:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.800+0000 7fb254147640 1 -- 172.21.15.12:0/3011832019 shutdown_connections 2024-09-16T01:00:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.800+0000 7fb254147640 1 --2- 172.21.15.12:0/3011832019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb24c107900 0x7fb24c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.800+0000 7fb254147640 1 --2- 172.21.15.12:0/3011832019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24c104fd0 0x7fb24c1073c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.800+0000 7fb254147640 1 --2- 172.21.15.12:0/3011832019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb24c1026a0 0x7fb24c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.800+0000 7fb254147640 1 -- 172.21.15.12:0/3011832019 >> 172.21.15.12:0/3011832019 conn(0x7fb24c0fc2a0 msgr2=0x7fb24c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.800+0000 7fb254147640 1 -- 172.21.15.12:0/3011832019 shutdown_connections 2024-09-16T01:00:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.800+0000 7fb254147640 1 -- 172.21.15.12:0/3011832019 wait complete. 2024-09-16T01:00:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb254147640 1 Processor -- start 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb254147640 1 -- start start 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb254147640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb24c1026a0 0x7fb24c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb254147640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24c104fd0 0x7fb24c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb254147640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb24c107900 0x7fb24c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb254147640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c10d8f0 con 0x7fb24c104fd0 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb254147640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c10d770 con 0x7fb24c1026a0 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb254147640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c10da70 con 0x7fb24c107900 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb2516e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24c104fd0 0x7fb24c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb2516e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24c104fd0 0x7fb24c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42960/0 (socket says 172.21.15.12:42960) 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb2516e2640 1 -- 172.21.15.12:0/196260997 learned_addr learned my addr 172.21.15.12:0/196260997 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.801+0000 7fb2526e4640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb24c107900 0x7fb24c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb251ee3640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb24c1026a0 0x7fb24c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb2516e2640 1 -- 172.21.15.12:0/196260997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb24c107900 msgr2=0x7fb24c19f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb2516e2640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb24c107900 0x7fb24c19f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb2516e2640 1 -- 172.21.15.12:0/196260997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb24c1026a0 msgr2=0x7fb24c197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb2516e2640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb24c1026a0 0x7fb24c197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb2516e2640 1 -- 172.21.15.12:0/196260997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24c19fbd0 con 0x7fb24c104fd0 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb2526e4640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb24c107900 0x7fb24c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb251ee3640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb24c1026a0 0x7fb24c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb2516e2640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24c104fd0 0x7fb24c1984e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb23c031610 tx=0x7fb23c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb242ffd640 1 -- 172.21.15.12:0/196260997 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c03f030 con 0x7fb24c104fd0 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb254147640 1 -- 172.21.15.12:0/196260997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24c19fe60 con 0x7fb24c104fd0 2024-09-16T01:00:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb242ffd640 1 -- 172.21.15.12:0/196260997 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb23c003ce0 con 0x7fb24c104fd0 2024-09-16T01:00:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb242ffd640 1 -- 172.21.15.12:0/196260997 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c035070 con 0x7fb24c104fd0 2024-09-16T01:00:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.802+0000 7fb254147640 1 -- 172.21.15.12:0/196260997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24c1a02b0 con 0x7fb24c104fd0 2024-09-16T01:00:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.803+0000 7fb254147640 1 -- 172.21.15.12:0/196260997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24c0fdd90 con 0x7fb24c104fd0 2024-09-16T01:00:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.804+0000 7fb242ffd640 1 -- 172.21.15.12:0/196260997 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb23c042030 con 0x7fb24c104fd0 2024-09-16T01:00:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.805+0000 7fb242ffd640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb2380a3270 0x7fb2380a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.805+0000 7fb251ee3640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb2380a3270 0x7fb2380a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.805+0000 7fb242ffd640 1 -- 172.21.15.12:0/196260997 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9100+0+0 (secure 0 0 0) 0x7fb23c0f0270 con 0x7fb24c104fd0 2024-09-16T01:00:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.806+0000 7fb251ee3640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb2380a3270 0x7fb2380a5730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb248005d00 tx=0x7fb248005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:44.809+0000 7fb242ffd640 1 -- 172.21.15.12:0/196260997 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb23c0bcc30 con 0x7fb24c104fd0 2024-09-16T01:00:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:44 smithi098 ceph-mon[35346]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:44 smithi098 ceph-mon[35346]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:44 smithi098 ceph-mon[35346]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-16T01:00:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:44 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-16T01:00:45.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.021+0000 7fb254147640 1 -- 172.21.15.12:0/196260997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb24c062e90 con 0x7fb24c104fd0 2024-09-16T01:00:45.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.022+0000 7fb242ffd640 1 -- 172.21.15.12:0/196260997 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3128 (secure 0 0 0) 0x7fb23c0bc530 con 0x7fb24c104fd0 2024-09-16T01:00:45.023 INFO:teuthology.orchestra.run.smithi012.stdout:e28 2024-09-16T01:00:45.023 INFO:teuthology.orchestra.run.smithi012.stdout:btime 2024-09-16T00:59:22:581924+0000 2024-09-16T01:00:45.023 INFO:teuthology.orchestra.run.smithi012.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T01:00:45.023 INFO:teuthology.orchestra.run.smithi012.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T01:00:45.023 INFO:teuthology.orchestra.run.smithi012.stdout:legacy client fscid: 1 2024-09-16T01:00:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:45.023 INFO:teuthology.orchestra.run.smithi012.stdout:Filesystem 'cephfs' (1) 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:fs_name cephfs 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 28 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-16T00:58:37.161987+0000 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2024-09-16T00:59:22.581909+0000 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:tableserver 0 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:root 0 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:session_timeout 300 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:session_autoclose 300 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:max_file_size 1099511627776 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:max_xattr_size 65536 2024-09-16T01:00:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:required_client_features {} 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:last_failure 0 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:last_failure_osd_epoch 0 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:max_mds 5 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:in 0,1,2,3,4 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:up {0=24518,1=24482,2=24475,3=24458,4=14601} 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:failed 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:damaged 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:stopped 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:data_pools [3,4] 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:metadata_pool 2 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:inline_data disabled 2024-09-16T01:00:45.025 INFO:teuthology.orchestra.run.smithi012.stdout:balancer 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:bal_rank_mask -1 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:standby_count_wanted 0 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:qdb_cluster leader: 24518 members: 24518,24482,24475,24458,14601 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b{0:24518} state up:active seq 4 addr [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c{0:24457} state up:standby-replay seq 1 addr [v2:172.21.15.119:6836/3417248856,v1:172.21.15.119:6837/3417248856] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.h{1:24482} state up:active seq 17 addr [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.f{1:24451} state up:standby-replay seq 1 addr [v2:172.21.15.119:6834/3086232870,v1:172.21.15.119:6835/3086232870] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.i{2:24475} state up:active seq 17 addr [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.k{2:24434} state up:standby-replay seq 1 addr [v2:172.21.15.98:6832/676872767,v1:172.21.15.98:6833/676872767] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.e{3:24458} state up:active seq 20 addr [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.l{3:24424} state up:standby-replay seq 1 addr [v2:172.21.15.119:6832/489944636,v1:172.21.15.119:6833/489944636] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a{4:14601} state up:active seq 16 addr [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.g{4:14595} state up:standby-replay seq 1 addr [v2:172.21.15.12:6838/3964724197,v1:172.21.15.12:6839/3964724197] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:45.027 INFO:teuthology.orchestra.run.smithi012.stdout:Standby daemons: 2024-09-16T01:00:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:45.027 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.12:6834/1483789466,v1:172.21.15.12:6835/1483789466] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.027 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d{-1:14541} state up:standby seq 1 addr [v2:172.21.15.12:6836/2487951096,v1:172.21.15.12:6837/2487951096] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 -- 172.21.15.12:0/196260997 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb2380a3270 msgr2=0x7fb2380a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb2380a3270 0x7fb2380a5730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb248005d00 tx=0x7fb248005ed0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 -- 172.21.15.12:0/196260997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24c104fd0 msgr2=0x7fb24c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24c104fd0 0x7fb24c1984e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb23c031610 tx=0x7fb23c0043b0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 -- 172.21.15.12:0/196260997 shutdown_connections 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb2380a3270 0x7fb2380a5730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb24c107900 0x7fb24c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24c104fd0 0x7fb24c1984e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 --2- 172.21.15.12:0/196260997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb24c1026a0 0x7fb24c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 -- 172.21.15.12:0/196260997 >> 172.21.15.12:0/196260997 conn(0x7fb24c0fc2a0 msgr2=0x7fb24c103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:45.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 -- 172.21.15.12:0/196260997 shutdown_connections 2024-09-16T01:00:45.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:45.025+0000 7fb254147640 1 -- 172.21.15.12:0/196260997 wait complete. 2024-09-16T01:00:45.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:44 smithi119 ceph-mon[35049]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:00:45.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:44 smithi119 ceph-mon[35049]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:45.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:44 smithi119 ceph-mon[35049]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-16T01:00:45.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:44 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-16T01:00:45.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-16T01:00:45.955 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:45.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:45 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-16T01:00:45.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:45 smithi098 ceph-mon[35346]: osdmap e88: 12 total, 12 up, 12 in 2024-09-16T01:00:45.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:45 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/196260997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:00:46.076 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:45 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-16T01:00:46.077 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:45 smithi012 ceph-mon[31197]: osdmap e88: 12 total, 12 up, 12 in 2024-09-16T01:00:46.077 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:45 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/196260997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:00:46.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:45 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-16T01:00:46.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:45 smithi119 ceph-mon[35049]: osdmap e88: 12 total, 12 up, 12 in 2024-09-16T01:00:46.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:45 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/196260997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:00:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.514+0000 7ff1e8159640 1 -- 172.21.15.12:0/2507503396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1e0105790 msgr2=0x7ff1e0105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.514+0000 7ff1e8159640 1 --2- 172.21.15.12:0/2507503396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1e0105790 0x7ff1e0105c40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009ca0 tx=0x7ff1d802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.514+0000 7ff1e8159640 1 -- 172.21.15.12:0/2507503396 shutdown_connections 2024-09-16T01:00:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.514+0000 7ff1e8159640 1 --2- 172.21.15.12:0/2507503396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1e0105790 0x7ff1e0105c40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.514+0000 7ff1e8159640 1 --2- 172.21.15.12:0/2507503396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1e0102de0 0x7ff1e0105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.514+0000 7ff1e8159640 1 --2- 172.21.15.12:0/2507503396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e0100490 0x7ff1e01028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.514+0000 7ff1e8159640 1 -- 172.21.15.12:0/2507503396 >> 172.21.15.12:0/2507503396 conn(0x7ff1e00fc2a0 msgr2=0x7ff1e00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.514+0000 7ff1e8159640 1 -- 172.21.15.12:0/2507503396 shutdown_connections 2024-09-16T01:00:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.514+0000 7ff1e8159640 1 -- 172.21.15.12:0/2507503396 wait complete. 2024-09-16T01:00:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e8159640 1 Processor -- start 2024-09-16T01:00:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e8159640 1 -- start start 2024-09-16T01:00:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e8159640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1e0100490 0x7ff1e019e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e8159640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1e0102de0 0x7ff1e019e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e8159640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e0105790 0x7ff1e01a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e8159640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0113ea0 con 0x7ff1e0102de0 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e8159640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0113d20 con 0x7ff1e0105790 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e8159640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0114020 con 0x7ff1e0100490 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e56f4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1e0102de0 0x7ff1e019e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e56f4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1e0102de0 0x7ff1e019e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46274/0 (socket says 172.21.15.12:46274) 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e56f4640 1 -- 172.21.15.12:0/1849510600 learned_addr learned my addr 172.21.15.12:0/1849510600 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e5ef5640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1e0100490 0x7ff1e019e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e66f6640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e0105790 0x7ff1e01a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e56f4640 1 -- 172.21.15.12:0/1849510600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1e0100490 msgr2=0x7ff1e019e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e56f4640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1e0100490 0x7ff1e019e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e56f4640 1 -- 172.21.15.12:0/1849510600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e0105790 msgr2=0x7ff1e01a5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e56f4640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e0105790 0x7ff1e01a5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.515+0000 7ff1e56f4640 1 -- 172.21.15.12:0/1849510600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e01a60b0 con 0x7ff1e0102de0 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.516+0000 7ff1e56f4640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1e0102de0 0x7ff1e019e9c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000d950 tx=0x7ff1d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.516+0000 7ff1d6ffd640 1 -- 172.21.15.12:0/1849510600 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0017070 con 0x7ff1e0102de0 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.516+0000 7ff1d6ffd640 1 -- 172.21.15.12:0/1849510600 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d0009c30 con 0x7ff1e0102de0 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.516+0000 7ff1d6ffd640 1 -- 172.21.15.12:0/1849510600 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000f6b0 con 0x7ff1e0102de0 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.516+0000 7ff1e8159640 1 -- 172.21.15.12:0/1849510600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e01a63a0 con 0x7ff1e0102de0 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.516+0000 7ff1e8159640 1 -- 172.21.15.12:0/1849510600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e01a68e0 con 0x7ff1e0102de0 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.517+0000 7ff1e8159640 1 -- 172.21.15.12:0/1849510600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e00fdd90 con 0x7ff1e0102de0 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.518+0000 7ff1d6ffd640 1 -- 172.21.15.12:0/1849510600 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff1d00109d0 con 0x7ff1e0102de0 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.519+0000 7ff1d6ffd640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1cc0a3270 0x7ff1cc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.519+0000 7ff1e5ef5640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1cc0a3270 0x7ff1cc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.519+0000 7ff1d6ffd640 1 -- 172.21.15.12:0/1849510600 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7ff1d00cf940 con 0x7ff1e0102de0 2024-09-16T01:00:46.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.519+0000 7ff1e5ef5640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1cc0a3270 0x7ff1cc0a5730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc005fd0 tx=0x7ff1dc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:46.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.523+0000 7ff1d6ffd640 1 -- 172.21.15.12:0/1849510600 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1d009c300 con 0x7ff1e0102de0 2024-09-16T01:00:46.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.701+0000 7ff1e8159640 1 -- 172.21.15.12:0/1849510600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7ff1e0062df0 con 0x7ff1e0102de0 2024-09-16T01:00:46.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.702+0000 7ff1d6ffd640 1 -- 172.21.15.12:0/1849510600 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) ==== 56+0+5595 (secure 0 0 0) 0x7ff1d009bc00 con 0x7ff1e0102de0 2024-09-16T01:00:46.703 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 89 2024-09-16T01:00:46.703 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T01:00:46.704 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-16T00:50:45.145349+0000 2024-09-16T01:00:46.704 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2024-09-16T01:00:45.617096+0000 2024-09-16T01:00:46.704 INFO:teuthology.orchestra.run.smithi012.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T01:00:46.704 INFO:teuthology.orchestra.run.smithi012.stdout:crush_version 27 2024-09-16T01:00:46.704 INFO:teuthology.orchestra.run.smithi012.stdout:full_ratio 0.95 2024-09-16T01:00:46.704 INFO:teuthology.orchestra.run.smithi012.stdout:backfillfull_ratio 0.9 2024-09-16T01:00:46.704 INFO:teuthology.orchestra.run.smithi012.stdout:nearfull_ratio 0.85 2024-09-16T01:00:46.705 INFO:teuthology.orchestra.run.smithi012.stdout:require_min_compat_client luminous 2024-09-16T01:00:46.705 INFO:teuthology.orchestra.run.smithi012.stdout:min_compat_client luminous 2024-09-16T01:00:46.705 INFO:teuthology.orchestra.run.smithi012.stdout:require_osd_release squid 2024-09-16T01:00:46.705 INFO:teuthology.orchestra.run.smithi012.stdout:stretch_mode_enabled false 2024-09-16T01:00:46.705 INFO:teuthology.orchestra.run.smithi012.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-16T01:00:46.705 INFO:teuthology.orchestra.run.smithi012.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-16T01:00:46.705 INFO:teuthology.orchestra.run.smithi012.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-16T01:00:46.705 INFO:teuthology.orchestra.run.smithi012.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-16T01:00:46.706 INFO:teuthology.orchestra.run.smithi012.stdout:max_osd 12 2024-09-16T01:00:46.706 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6802/363081419,v1:172.21.15.12:6803/363081419] [v2:172.21.15.12:6804/363081419,v1:172.21.15.12:6805/363081419] exists,up 23b4eba0-9c04-4fa9-b8fb-73e21c94d03e 2024-09-16T01:00:46.706 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 up in weight 1 up_from 12 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/1011366493,v1:172.21.15.98:6801/1011366493] [v2:172.21.15.98:6802/1011366493,v1:172.21.15.98:6803/1011366493] exists,up bc043dbf-d80e-4a37-b9c1-f54359868df5 2024-09-16T01:00:46.706 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 up in weight 1 up_from 17 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/3491429477,v1:172.21.15.119:6801/3491429477] [v2:172.21.15.119:6802/3491429477,v1:172.21.15.119:6803/3491429477] exists,up 3e24aa9f-c324-40d0-9cef-1bdc211e0eb6 2024-09-16T01:00:46.706 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 up in weight 1 up_from 23 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6810/1376341190,v1:172.21.15.12:6811/1376341190] [v2:172.21.15.12:6812/1376341190,v1:172.21.15.12:6813/1376341190] exists,up e860e2c0-5765-406a-837e-cccb8b2ef8a0 2024-09-16T01:00:46.706 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 up in weight 1 up_from 30 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6808/4152065816,v1:172.21.15.98:6809/4152065816] [v2:172.21.15.98:6810/4152065816,v1:172.21.15.98:6811/4152065816] exists,up 95ab617c-cff5-4bf9-9429-cba8e3da1d97 2024-09-16T01:00:46.706 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 up in weight 1 up_from 35 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/2310752755,v1:172.21.15.119:6809/2310752755] [v2:172.21.15.119:6810/2310752755,v1:172.21.15.119:6811/2310752755] exists,up 6524ca6c-c07a-497c-a034-8ad6055ca487 2024-09-16T01:00:46.706 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 up in weight 1 up_from 42 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6818/2023873518,v1:172.21.15.12:6819/2023873518] [v2:172.21.15.12:6820/2023873518,v1:172.21.15.12:6821/2023873518] exists,up 575ceec2-6940-445f-87c3-1986e9efaf50 2024-09-16T01:00:46.706 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 up in weight 1 up_from 47 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6816/4018048637,v1:172.21.15.98:6817/4018048637] [v2:172.21.15.98:6818/4018048637,v1:172.21.15.98:6819/4018048637] exists,up 7bbbdc0e-928f-4288-b7c3-c11d797dafc7 2024-09-16T01:00:46.707 INFO:teuthology.orchestra.run.smithi012.stdout:osd.8 up in weight 1 up_from 54 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/1727447871,v1:172.21.15.119:6817/1727447871] [v2:172.21.15.119:6818/1727447871,v1:172.21.15.119:6819/1727447871] exists,up 5bf5d5ca-7917-4956-bca7-20126befb69f 2024-09-16T01:00:46.707 INFO:teuthology.orchestra.run.smithi012.stdout:osd.9 up in weight 1 up_from 61 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6826/646713448,v1:172.21.15.12:6827/646713448] [v2:172.21.15.12:6828/646713448,v1:172.21.15.12:6829/646713448] exists,up 13e32644-63a4-4a41-8eb7-36955407891c 2024-09-16T01:00:46.707 INFO:teuthology.orchestra.run.smithi012.stdout:osd.10 up in weight 1 up_from 66 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6824/4044449416,v1:172.21.15.98:6825/4044449416] [v2:172.21.15.98:6826/4044449416,v1:172.21.15.98:6827/4044449416] exists,up 2f128201-841b-47a9-84ca-d116ed049062 2024-09-16T01:00:46.707 INFO:teuthology.orchestra.run.smithi012.stdout:osd.11 up in weight 1 up_from 73 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6824/4062307393,v1:172.21.15.119:6825/4062307393] [v2:172.21.15.119:6826/4062307393,v1:172.21.15.119:6827/4062307393] exists,up 182d2b8d-ac09-47d4-8bea-716de07f7c9f 2024-09-16T01:00:46.707 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.8 [2,11] 2024-09-16T01:00:46.707 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.a [2,11] 2024-09-16T01:00:46.707 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.1f [8,4] 2024-09-16T01:00:46.707 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.0 [4,8] 2024-09-16T01:00:46.708 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.13 [4,9] 2024-09-16T01:00:46.708 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.1d [5,9] 2024-09-16T01:00:46.708 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.38 [3,9] 2024-09-16T01:00:46.708 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 4.6 [5,8,9,11] 2024-09-16T01:00:46.708 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 4.17 [9,8] 2024-09-16T01:00:46.708 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 4.18 [9,8] 2024-09-16T01:00:46.708 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/2197597102 expires 2024-09-17T00:51:42.808843+0000 2024-09-16T01:00:46.708 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/2549589240 expires 2024-09-17T00:51:42.808843+0000 2024-09-16T01:00:46.709 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6801/1863535251 expires 2024-09-17T00:51:42.808843+0000 2024-09-16T01:00:46.709 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/570072659 expires 2024-09-17T00:51:42.808843+0000 2024-09-16T01:00:46.709 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6800/1863535251 expires 2024-09-17T00:51:42.808843+0000 2024-09-16T01:00:46.709 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/1710824695 expires 2024-09-17T00:51:19.512115+0000 2024-09-16T01:00:46.709 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/4246888310 expires 2024-09-17T00:51:19.512115+0000 2024-09-16T01:00:46.709 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6801/3324219193 expires 2024-09-17T00:51:19.512115+0000 2024-09-16T01:00:46.709 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6800/3324219193 expires 2024-09-17T00:51:19.512115+0000 2024-09-16T01:00:46.709 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/2420216586 expires 2024-09-17T00:51:19.512115+0000 2024-09-16T01:00:46.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 -- 172.21.15.12:0/1849510600 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1cc0a3270 msgr2=0x7ff1cc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:46.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1cc0a3270 0x7ff1cc0a5730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc005fd0 tx=0x7ff1dc005850 comp rx=0 tx=0).stop 2024-09-16T01:00:46.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 -- 172.21.15.12:0/1849510600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1e0102de0 msgr2=0x7ff1e019e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:46.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1e0102de0 0x7ff1e019e9c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000d950 tx=0x7ff1d000de10 comp rx=0 tx=0).stop 2024-09-16T01:00:46.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 -- 172.21.15.12:0/1849510600 shutdown_connections 2024-09-16T01:00:46.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1cc0a3270 0x7ff1cc0a5730 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:46.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1e0105790 0x7ff1e01a5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:46.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1e0102de0 0x7ff1e019e9c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:46.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 --2- 172.21.15.12:0/1849510600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1e0100490 0x7ff1e019e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:46.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 -- 172.21.15.12:0/1849510600 >> 172.21.15.12:0/1849510600 conn(0x7ff1e00fc2a0 msgr2=0x7ff1e0100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:46.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 -- 172.21.15.12:0/1849510600 shutdown_connections 2024-09-16T01:00:46.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:46.704+0000 7ff1e8159640 1 -- 172.21.15.12:0/1849510600 wait complete. 2024-09-16T01:00:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:46 smithi098 ceph-mon[35346]: pgmap v349: 129 pgs: 129 active+clean; 646 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2024-09-16T01:00:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:46 smithi098 ceph-mon[35346]: osdmap e89: 12 total, 12 up, 12 in 2024-09-16T01:00:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:46 smithi119 ceph-mon[35049]: pgmap v349: 129 pgs: 129 active+clean; 646 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2024-09-16T01:00:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:46 smithi119 ceph-mon[35049]: osdmap e89: 12 total, 12 up, 12 in 2024-09-16T01:00:47.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:46 smithi012 ceph-mon[31197]: pgmap v349: 129 pgs: 129 active+clean; 646 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2024-09-16T01:00:47.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:46 smithi012 ceph-mon[31197]: osdmap e89: 12 total, 12 up, 12 in 2024-09-16T01:00:47.421 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-16T01:00:47.434 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:47.693 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:47.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:47 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1849510600' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-16T01:00:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:47 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1849510600' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-16T01:00:48.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:47 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1849510600' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-16T01:00:48.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.196+0000 7f880f8b8640 1 -- 172.21.15.12:0/739725407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f880810e480 msgr2=0x7f8808110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:48.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.196+0000 7f880f8b8640 1 --2- 172.21.15.12:0/739725407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f880810e480 0x7f8808110870 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8800009ca0 tx=0x7f880002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.197+0000 7f880f8b8640 1 -- 172.21.15.12:0/739725407 shutdown_connections 2024-09-16T01:00:48.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.197+0000 7f880f8b8640 1 --2- 172.21.15.12:0/739725407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f880810e480 0x7f8808110870 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.197+0000 7f880f8b8640 1 --2- 172.21.15.12:0/739725407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8808101280 0x7f880810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.197+0000 7f880f8b8640 1 --2- 172.21.15.12:0/739725407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88081008d0 0x7f8808100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.197+0000 7f880f8b8640 1 -- 172.21.15.12:0/739725407 >> 172.21.15.12:0/739725407 conn(0x7f88080fc7a0 msgr2=0x7f88080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:48.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.197+0000 7f880f8b8640 1 -- 172.21.15.12:0/739725407 shutdown_connections 2024-09-16T01:00:48.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.197+0000 7f880f8b8640 1 -- 172.21.15.12:0/739725407 wait complete. 2024-09-16T01:00:48.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.197+0000 7f880f8b8640 1 Processor -- start 2024-09-16T01:00:48.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.197+0000 7f880f8b8640 1 -- start start 2024-09-16T01:00:48.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880f8b8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88081008d0 0x7f880819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:48.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880f8b8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8808101280 0x7f880819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:48.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880f8b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f880810e480 0x7f880819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:48.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880f8b8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f88081141d0 con 0x7f880810e480 2024-09-16T01:00:48.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880f8b8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8808114050 con 0x7f8808101280 2024-09-16T01:00:48.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880f8b8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8808114350 con 0x7f88081008d0 2024-09-16T01:00:48.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880de55640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f880810e480 0x7f880819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:48.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880de55640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f880810e480 0x7f880819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46290/0 (socket says 172.21.15.12:46290) 2024-09-16T01:00:48.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880de55640 1 -- 172.21.15.12:0/467711046 learned_addr learned my addr 172.21.15.12:0/467711046 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:48.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880ce53640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8808101280 0x7f880819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:48.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880d654640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88081008d0 0x7f880819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:48.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880de55640 1 -- 172.21.15.12:0/467711046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88081008d0 msgr2=0x7f880819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:48.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880de55640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88081008d0 0x7f880819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880de55640 1 -- 172.21.15.12:0/467711046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8808101280 msgr2=0x7f880819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:48.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880de55640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8808101280 0x7f880819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880de55640 1 -- 172.21.15.12:0/467711046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880819f5c0 con 0x7f880810e480 2024-09-16T01:00:48.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880de55640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f880810e480 0x7f880819eee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f880002ade0 tx=0x7f8800031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f87fa7fc640 1 -- 172.21.15.12:0/467711046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800003b70 con 0x7f880810e480 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f87fa7fc640 1 -- 172.21.15.12:0/467711046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8800003d10 con 0x7f880810e480 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.198+0000 7f880f8b8640 1 -- 172.21.15.12:0/467711046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880819f850 con 0x7f880810e480 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.199+0000 7f87fa7fc640 1 -- 172.21.15.12:0/467711046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800004730 con 0x7f880810e480 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.199+0000 7f880f8b8640 1 -- 172.21.15.12:0/467711046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88081a7190 con 0x7f880810e480 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.199+0000 7f880f8b8640 1 -- 172.21.15.12:0/467711046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8808100cb0 con 0x7f880810e480 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.201+0000 7f87fa7fc640 1 -- 172.21.15.12:0/467711046 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f880002f710 con 0x7f880810e480 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.201+0000 7f87fa7fc640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87f40a3240 0x7f87f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.202+0000 7f87fa7fc640 1 -- 172.21.15.12:0/467711046 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f88000f0ff0 con 0x7f880810e480 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.202+0000 7f880d654640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87f40a3240 0x7f87f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:48.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.202+0000 7f880d654640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87f40a3240 0x7f87f40a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8804009990 tx=0x7f8804009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:48.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.205+0000 7f87fa7fc640 1 -- 172.21.15.12:0/467711046 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88000bd9b0 con 0x7f880810e480 2024-09-16T01:00:48.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.415+0000 7f880f8b8640 1 -- 172.21.15.12:0/467711046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88081a73c0 con 0x7f880810e480 2024-09-16T01:00:48.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.416+0000 7f87fa7fc640 1 -- 172.21.15.12:0/467711046 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7f88000b7e20 con 0x7f880810e480 2024-09-16T01:00:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:48.417 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-16T00:59:22:581924+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T00:59:22.581909+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24482,24475,24458,14601]},"id":1}]} 2024-09-16T01:00:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-16T01:00:48.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.419+0000 7f880f8b8640 1 -- 172.21.15.12:0/467711046 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87f40a3240 msgr2=0x7f87f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:48.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.419+0000 7f880f8b8640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87f40a3240 0x7f87f40a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8804009990 tx=0x7f8804009110 comp rx=0 tx=0).stop 2024-09-16T01:00:48.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.419+0000 7f880f8b8640 1 -- 172.21.15.12:0/467711046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f880810e480 msgr2=0x7f880819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:48.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.419+0000 7f880f8b8640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f880810e480 0x7f880819eee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f880002ade0 tx=0x7f8800031a60 comp rx=0 tx=0).stop 2024-09-16T01:00:48.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.419+0000 7f880f8b8640 1 -- 172.21.15.12:0/467711046 shutdown_connections 2024-09-16T01:00:48.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.419+0000 7f880f8b8640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f87f40a3240 0x7f87f40a5700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.419+0000 7f880f8b8640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f880810e480 0x7f880819eee0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.420+0000 7f880f8b8640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8808101280 0x7f880819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.420+0000 7f880f8b8640 1 --2- 172.21.15.12:0/467711046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88081008d0 0x7f880819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.420+0000 7f880f8b8640 1 -- 172.21.15.12:0/467711046 >> 172.21.15.12:0/467711046 conn(0x7f88080fc7a0 msgr2=0x7f88080feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:48.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.420+0000 7f880f8b8640 1 -- 172.21.15.12:0/467711046 shutdown_connections 2024-09-16T01:00:48.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:48.420+0000 7f880f8b8640 1 -- 172.21.15.12:0/467711046 wait complete. 2024-09-16T01:00:48.762 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:48 smithi012 ceph-mon[31197]: pgmap v351: 129 pgs: 129 active+clean; 646 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 11 op/s 2024-09-16T01:00:48.762 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:48 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/467711046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:48.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:48 smithi098 ceph-mon[35346]: pgmap v351: 129 pgs: 129 active+clean; 646 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 11 op/s 2024-09-16T01:00:48.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:48 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/467711046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:49.094 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:48 smithi119 ceph-mon[35049]: pgmap v351: 129 pgs: 129 active+clean; 646 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 11 op/s 2024-09-16T01:00:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:48 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/467711046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:49.354 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:49.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.849+0000 7fa2097f6640 1 -- 172.21.15.12:0/4164779865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20410c170 msgr2=0x7fa20410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:49.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.849+0000 7fa2097f6640 1 --2- 172.21.15.12:0/4164779865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20410c170 0x7fa20410e610 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009ca0 tx=0x7fa1fc02a950 comp rx=0 tx=0).stop 2024-09-16T01:00:49.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.849+0000 7fa2097f6640 1 -- 172.21.15.12:0/4164779865 shutdown_connections 2024-09-16T01:00:49.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.849+0000 7fa2097f6640 1 --2- 172.21.15.12:0/4164779865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20410c170 0x7fa20410e610 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:49.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.849+0000 7fa2097f6640 1 --2- 172.21.15.12:0/4164779865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa204103660 0x7fa20410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:49.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.849+0000 7fa2097f6640 1 --2- 172.21.15.12:0/4164779865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa204102d40 0x7fa204103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:49.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.849+0000 7fa2097f6640 1 -- 172.21.15.12:0/4164779865 >> 172.21.15.12:0/4164779865 conn(0x7fa2040fc7a0 msgr2=0x7fa2040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:49.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.849+0000 7fa2097f6640 1 -- 172.21.15.12:0/4164779865 shutdown_connections 2024-09-16T01:00:49.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.849+0000 7fa2097f6640 1 -- 172.21.15.12:0/4164779865 wait complete. 2024-09-16T01:00:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2097f6640 1 Processor -- start 2024-09-16T01:00:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2097f6640 1 -- start start 2024-09-16T01:00:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2097f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa204102d40 0x7fa204198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2097f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa204103660 0x7fa204198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2097f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa20410c170 0x7fa20419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2097f6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa204111f70 con 0x7fa204103660 2024-09-16T01:00:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2097f6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa204111df0 con 0x7fa204102d40 2024-09-16T01:00:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2097f6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2041120f0 con 0x7fa20410c170 2024-09-16T01:00:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2027fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa204103660 0x7fa204198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2027fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa204103660 0x7fa204198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46316/0 (socket says 172.21.15.12:46316) 2024-09-16T01:00:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.850+0000 7fa2027fc640 1 -- 172.21.15.12:0/1811916095 learned_addr learned my addr 172.21.15.12:0/1811916095 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa202ffd640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa204102d40 0x7fa204198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa2037fe640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa20410c170 0x7fa20419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa2027fc640 1 -- 172.21.15.12:0/1811916095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa20410c170 msgr2=0x7fa20419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa2027fc640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa20410c170 0x7fa20419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa2027fc640 1 -- 172.21.15.12:0/1811916095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa204102d40 msgr2=0x7fa204198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa2027fc640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa204102d40 0x7fa204198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa2027fc640 1 -- 172.21.15.12:0/1811916095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20419d3c0 con 0x7fa204103660 2024-09-16T01:00:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa2027fc640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa204103660 0x7fa204198950 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c940 tx=0x7fa1f800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa1ebfff640 1 -- 172.21.15.12:0/1811916095 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8004220 con 0x7fa204103660 2024-09-16T01:00:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa1ebfff640 1 -- 172.21.15.12:0/1811916095 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1f80043c0 con 0x7fa204103660 2024-09-16T01:00:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa1ebfff640 1 -- 172.21.15.12:0/1811916095 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8004a00 con 0x7fa204103660 2024-09-16T01:00:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa2097f6640 1 -- 172.21.15.12:0/1811916095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20419d6b0 con 0x7fa204103660 2024-09-16T01:00:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.851+0000 7fa2097f6640 1 -- 172.21.15.12:0/1811916095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2041a4f90 con 0x7fa204103660 2024-09-16T01:00:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.852+0000 7fa2097f6640 1 -- 172.21.15.12:0/1811916095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa204103120 con 0x7fa204103660 2024-09-16T01:00:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.853+0000 7fa1ebfff640 1 -- 172.21.15.12:0/1811916095 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa1f80079b0 con 0x7fa204103660 2024-09-16T01:00:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.854+0000 7fa1ebfff640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1ec0a3240 0x7fa1ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.854+0000 7fa202ffd640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1ec0a3240 0x7fa1ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.854+0000 7fa1ebfff640 1 -- 172.21.15.12:0/1811916095 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa1f80cfbc0 con 0x7fa204103660 2024-09-16T01:00:49.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.855+0000 7fa202ffd640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1ec0a3240 0x7fa1ec0a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4005fd0 tx=0x7fa1f400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:49.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:49.858+0000 7fa1ebfff640 1 -- 172.21.15.12:0/1811916095 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1f8014030 con 0x7fa204103660 2024-09-16T01:00:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.071+0000 7fa2097f6640 1 -- 172.21.15.12:0/1811916095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2041a5280 con 0x7fa204103660 2024-09-16T01:00:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.072+0000 7fa1ebfff640 1 -- 172.21.15.12:0/1811916095 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7fa1f809c580 con 0x7fa204103660 2024-09-16T01:00:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:50.073 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-16T00:59:22:581924+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T00:59:22.581909+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24482,24475,24458,14601]},"id":1}]} 2024-09-16T01:00:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-16T01:00:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.074+0000 7fa2097f6640 1 -- 172.21.15.12:0/1811916095 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1ec0a3240 msgr2=0x7fa1ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.074+0000 7fa2097f6640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1ec0a3240 0x7fa1ec0a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4005fd0 tx=0x7fa1f400b390 comp rx=0 tx=0).stop 2024-09-16T01:00:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.074+0000 7fa2097f6640 1 -- 172.21.15.12:0/1811916095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa204103660 msgr2=0x7fa204198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.074+0000 7fa2097f6640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa204103660 0x7fa204198950 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c940 tx=0x7fa1f800ce00 comp rx=0 tx=0).stop 2024-09-16T01:00:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.074+0000 7fa2097f6640 1 -- 172.21.15.12:0/1811916095 shutdown_connections 2024-09-16T01:00:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.074+0000 7fa2097f6640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1ec0a3240 0x7fa1ec0a5700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.074+0000 7fa2097f6640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa20410c170 0x7fa20419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.074+0000 7fa2097f6640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa204103660 0x7fa204198950 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.074+0000 7fa2097f6640 1 --2- 172.21.15.12:0/1811916095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa204102d40 0x7fa204198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.074+0000 7fa2097f6640 1 -- 172.21.15.12:0/1811916095 >> 172.21.15.12:0/1811916095 conn(0x7fa2040fc7a0 msgr2=0x7fa2040fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.075+0000 7fa2097f6640 1 -- 172.21.15.12:0/1811916095 shutdown_connections 2024-09-16T01:00:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:50.075+0000 7fa2097f6640 1 -- 172.21.15.12:0/1811916095 wait complete. 2024-09-16T01:00:50.730 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:50 smithi012 ceph-mon[31197]: pgmap v352: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:50.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:50 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1811916095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:50.761 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:00:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:50 smithi098 ceph-mon[35346]: pgmap v352: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:50 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1811916095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:51.021 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:51.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:50 smithi119 ceph-mon[35049]: pgmap v352: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:51.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:50 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1811916095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.508+0000 7f75741fb640 1 -- 172.21.15.12:0/1910680635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f756c100a80 msgr2=0x7f756c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.508+0000 7f75741fb640 1 --2- 172.21.15.12:0/1910680635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f756c100a80 0x7f756c100ee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f755c009930 tx=0x7f755c02a420 comp rx=0 tx=0).stop 2024-09-16T01:00:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.508+0000 7f75741fb640 1 -- 172.21.15.12:0/1910680635 shutdown_connections 2024-09-16T01:00:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.508+0000 7f75741fb640 1 --2- 172.21.15.12:0/1910680635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f756c101420 0x7f756c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.508+0000 7f75741fb640 1 --2- 172.21.15.12:0/1910680635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f756c100a80 0x7f756c100ee0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.508+0000 7f75741fb640 1 --2- 172.21.15.12:0/1910680635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f756c106a80 0x7f756c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.508+0000 7f75741fb640 1 -- 172.21.15.12:0/1910680635 >> 172.21.15.12:0/1910680635 conn(0x7f756c0fc7a0 msgr2=0x7f756c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f75741fb640 1 -- 172.21.15.12:0/1910680635 shutdown_connections 2024-09-16T01:00:51.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f75741fb640 1 -- 172.21.15.12:0/1910680635 wait complete. 2024-09-16T01:00:51.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f75741fb640 1 Processor -- start 2024-09-16T01:00:51.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f75741fb640 1 -- start start 2024-09-16T01:00:51.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f75741fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f756c100a80 0x7f756c0fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:51.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f75741fb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f756c101420 0x7f756c0fd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:51.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f75741fb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f756c106a80 0x7f756c0fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:51.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f75741fb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f756c110e40 con 0x7f756c100a80 2024-09-16T01:00:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f75741fb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f756c110cc0 con 0x7f756c106a80 2024-09-16T01:00:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f75741fb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f756c110fc0 con 0x7f756c101420 2024-09-16T01:00:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.509+0000 7f7571f97640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f756c100a80 0x7f756c0fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7571f97640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f756c100a80 0x7f756c0fcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46344/0 (socket says 172.21.15.12:46344) 2024-09-16T01:00:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7571f97640 1 -- 172.21.15.12:0/3050167171 learned_addr learned my addr 172.21.15.12:0/3050167171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7571796640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f756c101420 0x7f756c0fd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7572798640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f756c106a80 0x7f756c0fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7571f97640 1 -- 172.21.15.12:0/3050167171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f756c101420 msgr2=0x7f756c0fd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7571f97640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f756c101420 0x7f756c0fd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7571f97640 1 -- 172.21.15.12:0/3050167171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f756c106a80 msgr2=0x7f756c0fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7571f97640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f756c106a80 0x7f756c0fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7571f97640 1 -- 172.21.15.12:0/3050167171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c1a6830 con 0x7f756c100a80 2024-09-16T01:00:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7572798640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f756c106a80 0x7f756c0fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7571f97640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f756c100a80 0x7f756c0fcca0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f756800c920 tx=0x7f756800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7562ffd640 1 -- 172.21.15.12:0/3050167171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568007c70 con 0x7f756c100a80 2024-09-16T01:00:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7562ffd640 1 -- 172.21.15.12:0/3050167171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7568007e10 con 0x7f756c100a80 2024-09-16T01:00:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f7562ffd640 1 -- 172.21.15.12:0/3050167171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568018890 con 0x7f756c100a80 2024-09-16T01:00:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f75741fb640 1 -- 172.21.15.12:0/3050167171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756c1a6b20 con 0x7f756c100a80 2024-09-16T01:00:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.510+0000 7f75741fb640 1 -- 172.21.15.12:0/3050167171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756c1a7080 con 0x7f756c100a80 2024-09-16T01:00:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.511+0000 7f75741fb640 1 -- 172.21.15.12:0/3050167171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756c100ee0 con 0x7f756c100a80 2024-09-16T01:00:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.512+0000 7f7562ffd640 1 -- 172.21.15.12:0/3050167171 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7568018a50 con 0x7f756c100a80 2024-09-16T01:00:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.513+0000 7f7562ffd640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75580a32c0 0x7f75580a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.513+0000 7f7562ffd640 1 -- 172.21.15.12:0/3050167171 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f75680cffb0 con 0x7f756c100a80 2024-09-16T01:00:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.513+0000 7f7571796640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75580a32c0 0x7f75580a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.514+0000 7f7571796640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75580a32c0 0x7f75580a5780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f755c009900 tx=0x7f755c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.516+0000 7f7562ffd640 1 -- 172.21.15.12:0/3050167171 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7568014030 con 0x7f756c100a80 2024-09-16T01:00:51.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.697+0000 7f75741fb640 1 -- 172.21.15.12:0/3050167171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f756c0fe1d0 con 0x7f756c100a80 2024-09-16T01:00:51.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.699+0000 7f7562ffd640 1 -- 172.21.15.12:0/3050167171 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24678 (secure 0 0 0) 0x7f75680ac080 con 0x7f756c100a80 2024-09-16T01:00:51.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:00:51.700 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T01:00:45.617096+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 -- 172.21.15.12:0/3050167171 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75580a32c0 msgr2=0x7f75580a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75580a32c0 0x7f75580a5780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f755c009900 tx=0x7f755c0058d0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 -- 172.21.15.12:0/3050167171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f756c100a80 msgr2=0x7f756c0fcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f756c100a80 0x7f756c0fcca0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f756800c920 tx=0x7f756800cde0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 -- 172.21.15.12:0/3050167171 shutdown_connections 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75580a32c0 0x7f75580a5780 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f756c106a80 0x7f756c0fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f756c101420 0x7f756c0fd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 --2- 172.21.15.12:0/3050167171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f756c100a80 0x7f756c0fcca0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 -- 172.21.15.12:0/3050167171 >> 172.21.15.12:0/3050167171 conn(0x7f756c0fc7a0 msgr2=0x7f756c06a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:51.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 -- 172.21.15.12:0/3050167171 shutdown_connections 2024-09-16T01:00:51.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:51.702+0000 7f75741fb640 1 -- 172.21.15.12:0/3050167171 wait complete. 2024-09-16T01:00:52.415 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-16T00:58:37.161987+0000', 'modified': '2024-09-16T00:59:22.581909+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24518, 'mds_1': 24482, 'mds_2': 24475, 'mds_3': 24458, 'mds_4': 14601}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14595': {'gid': 14595, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6839/3964724197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6838', 'nonce': 3964724197}, {'type': 'v1', 'addr': '172.21.15.12:6839', 'nonce': 3964724197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14601': {'gid': 14601, 'name': 'a', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.12:6841/1625323518', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6840', 'nonce': 1625323518}, {'type': 'v1', 'addr': '172.21.15.12:6841', 'nonce': 1625323518}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6833/489944636', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6832', 'nonce': 489944636}, {'type': 'v1', 'addr': '172.21.15.119:6833', 'nonce': 489944636}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24434': {'gid': 24434, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6833/676872767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6832', 'nonce': 676872767}, {'type': 'v1', 'addr': '172.21.15.98:6833', 'nonce': 676872767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/3086232870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 3086232870}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 3086232870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6837/3417248856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 3417248856}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 3417248856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'e', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.98:6835/1575072845', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 1575072845}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 1575072845}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.119:6839/3964855150', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 3964855150}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 3964855150}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.98:6837/390846726', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 390846726}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 390846726}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24518': {'gid': 24518, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.98:6839/2784619271', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 2784619271}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 2784619271}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24518, 'qdb_cluster': [24518, 24482, 24475, 24458, 14601]} 2024-09-16T01:00:52.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-16T01:00:52.416 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-16T01:00:52.683 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:52 smithi012 ceph-mon[31197]: pgmap v353: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:52 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3050167171' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:52.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:52 smithi098 ceph-mon[35346]: pgmap v353: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:52.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:52 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3050167171' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:53.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:52 smithi119 ceph-mon[35049]: pgmap v353: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:53.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:52 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3050167171' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.176+0000 7f02db666640 1 -- 172.21.15.12:0/3107054990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d4103660 msgr2=0x7f02d410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.176+0000 7f02db666640 1 --2- 172.21.15.12:0/3107054990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d4103660 0x7f02d410bb50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009900 tx=0x7f02c402a480 comp rx=0 tx=0).stop 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.176+0000 7f02db666640 1 -- 172.21.15.12:0/3107054990 shutdown_connections 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.176+0000 7f02db666640 1 --2- 172.21.15.12:0/3107054990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d410c170 0x7f02d410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.176+0000 7f02db666640 1 --2- 172.21.15.12:0/3107054990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d4103660 0x7f02d410bb50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.176+0000 7f02db666640 1 --2- 172.21.15.12:0/3107054990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d4102d40 0x7f02d4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.176+0000 7f02db666640 1 -- 172.21.15.12:0/3107054990 >> 172.21.15.12:0/3107054990 conn(0x7f02d40fc7a0 msgr2=0x7f02d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.176+0000 7f02db666640 1 -- 172.21.15.12:0/3107054990 shutdown_connections 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.176+0000 7f02db666640 1 -- 172.21.15.12:0/3107054990 wait complete. 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02db666640 1 Processor -- start 2024-09-16T01:00:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02db666640 1 -- start start 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02db666640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d4102d40 0x7f02d41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02db666640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d4103660 0x7f02d4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02db666640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d410c170 0x7f02d4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02db666640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f02d4111f70 con 0x7f02d410c170 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02db666640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f02d4111df0 con 0x7f02d4103660 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02db666640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f02d41120f0 con 0x7f02d4102d40 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02d9c03640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d410c170 0x7f02d4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02d9c03640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d410c170 0x7f02d4101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46356/0 (socket says 172.21.15.12:46356) 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.177+0000 7f02d9c03640 1 -- 172.21.15.12:0/1041480603 learned_addr learned my addr 172.21.15.12:0/1041480603 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02d9402640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d4102d40 0x7f02d41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02d8c01640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d4103660 0x7f02d4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02d9c03640 1 -- 172.21.15.12:0/1041480603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d4102d40 msgr2=0x7f02d41009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02d9c03640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d4102d40 0x7f02d41009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02d9c03640 1 -- 172.21.15.12:0/1041480603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d4103660 msgr2=0x7f02d4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02d9c03640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d4103660 0x7f02d4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02d9c03640 1 -- 172.21.15.12:0/1041480603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d41a6930 con 0x7f02d410c170 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02d9402640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d4102d40 0x7f02d41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02d9c03640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d410c170 0x7f02d4101420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009fd0 tx=0x7f02cc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02ca7fc640 1 -- 172.21.15.12:0/1041480603 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc017070 con 0x7f02d410c170 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02db666640 1 -- 172.21.15.12:0/1041480603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d41a6c20 con 0x7f02d410c170 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02ca7fc640 1 -- 172.21.15.12:0/1041480603 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02cc003e50 con 0x7f02d410c170 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02ca7fc640 1 -- 172.21.15.12:0/1041480603 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc0106c0 con 0x7f02d410c170 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.178+0000 7f02db666640 1 -- 172.21.15.12:0/1041480603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d41a7110 con 0x7f02d410c170 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.180+0000 7f02ca7fc640 1 -- 172.21.15.12:0/1041480603 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f02cc003970 con 0x7f02d410c170 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02dda3f740 1 Processor -- start 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02dda3f740 1 -- start start 2024-09-16T01:00:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136bf9d0 0x55ce136bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136c02f0 0x55ce136ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02dda3f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce13626090 con 0x55ce136cabb0 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02dda3f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce135cda70 con 0x55ce136bf9d0 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02dda3f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ce13622050 con 0x55ce136c02f0 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02d8c01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02ca7fc640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f02c00a3240 0x7f02c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02d8c01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46372/0 (socket says 172.21.15.12:46372) 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.181+0000 7f02d8c01640 1 -- 172.21.15.12:0/1030990240 learned_addr learned my addr 172.21.15.12:0/1030990240 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02d9402640 1 --2- 172.21.15.12:0/1030990240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136c02f0 0x55ce136ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02d9c03640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f02c00a3240 0x7f02c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02d8c01640 1 --2- 172.21.15.12:0/1030990240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136bf9d0 0x55ce136bfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02ca7fc640 1 -- 172.21.15.12:0/1041480603 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f02cc0cfa50 con 0x7f02d410c170 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02d8c01640 1 -- 172.21.15.12:0/1030990240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136c02f0 msgr2=0x55ce136ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02d8c01640 1 --2- 172.21.15.12:0/1030990240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136c02f0 0x55ce136ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02d8c01640 1 -- 172.21.15.12:0/1030990240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136bf9d0 msgr2=0x55ce136bfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02d8c01640 1 --2- 172.21.15.12:0/1030990240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136bf9d0 0x55ce136bfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02d8c01640 1 -- 172.21.15.12:0/1030990240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce135da130 con 0x55ce136cabb0 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02d8c01640 1 --2- 172.21.15.12:0/1030990240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136ccfa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f02c4031550 tx=0x7f02c4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95db54ab8dbca155 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02bf7fe640 1 -- 172.21.15.12:0/1030990240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4035040 con 0x55ce136cabb0 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02d9c03640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f02c00a3240 0x7f02c00a5700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f02cc098170 tx=0x7f02cc0666a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02bf7fe640 1 -- 172.21.15.12:0/1030990240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c4004030 con 0x55ce136cabb0 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.182+0000 7f02bf7fe640 1 -- 172.21.15.12:0/1030990240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c40039f0 con 0x55ce136cabb0 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 -- 172.21.15.12:0/1030990240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 msgr2=0x55ce136ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 --2- 172.21.15.12:0/1030990240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136ccfa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f02c4031550 tx=0x7f02c4005b50 comp rx=0 tx=0).stop 2024-09-16T01:00:53.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 -- 172.21.15.12:0/1030990240 shutdown_connections 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 --2- 172.21.15.12:0/1030990240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136ccfa0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 --2- 172.21.15.12:0/1030990240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136c02f0 0x55ce136ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 --2- 172.21.15.12:0/1030990240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136bf9d0 0x55ce136bfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 -- 172.21.15.12:0/1030990240 >> 172.21.15.12:0/1030990240 conn(0x55ce136bbf60 msgr2=0x55ce136bc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 -- 172.21.15.12:0/1030990240 shutdown_connections 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 -- 172.21.15.12:0/1030990240 wait complete. 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 -- start start 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.183+0000 7f02dda3f740 1 Processor -- start 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136bf9d0 0x55ce136ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136c02f0 0x55ce136c7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136cabb0 0x55ce136c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02dda3f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce136cd780 con 0x55ce136bf9d0 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02dda3f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce135e0f20 con 0x55ce136c02f0 2024-09-16T01:00:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02dda3f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ce136cd900 con 0x55ce136cabb0 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02dda3f740 10 client.0 _ll_register_callbacks cb 0x55ce135aa030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02d8c01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136bf9d0 0x55ce136ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02d8c01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136bf9d0 0x55ce136ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46380/0 (socket says 172.21.15.12:46380) 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02d8c01640 1 -- 172.21.15.12:0/2546695233 learned_addr learned my addr 172.21.15.12:0/2546695233 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02d8c01640 1 -- 172.21.15.12:0/2546695233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136cabb0 msgr2=0x55ce136c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02d8c01640 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136cabb0 0x55ce136c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02d8c01640 1 -- 172.21.15.12:0/2546695233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136c02f0 msgr2=0x55ce136c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02d9402640 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136c02f0 0x55ce136c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02d8c01640 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136c02f0 0x55ce136c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02d8c01640 1 -- 172.21.15.12:0/2546695233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce133972b0 con 0x55ce136bf9d0 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02d8c01640 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136bf9d0 0x55ce136ca3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f02c402a9a0 tx=0x7f02c4005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a612fa55b7be03d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.184+0000 7f02bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02bcff9640 1 -- 172.21.15.12:0/2546695233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c404f020 con 0x55ce136bf9d0 2024-09-16T01:00:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02bcff9640 1 -- 172.21.15.12:0/2546695233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f02c4003770 con 0x55ce136bf9d0 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02dda3f740 1 -- 172.21.15.12:0/2546695233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c4004030 con 0x55ce136bf9d0 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02bcff9640 1 -- 172.21.15.12:0/2546695233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02c405a050 con 0x55ce136bf9d0 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02dda3f740 10 client.15204 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02dda3f740 1 -- 172.21.15.12:0/2546695233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ce136d9070 con 0x55ce136bf9d0 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02bcff9640 1 -- 172.21.15.12:0/2546695233 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c4004030 con 0x55ce136bf9d0 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02bcff9640 1 -- 172.21.15.12:0/2546695233 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f02c403a040 con 0x55ce136bf9d0 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02dda3f740 10 client.15204 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02dda3f740 10 client.15204 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02dda3f740 20 client.15204 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55ce136db260 0x55ce136dc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02dda3f740 4 client.15204 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02dda3f740 1 -- 172.21.15.12:0/2546695233 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce13633600 con 0x55ce136db260 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.185+0000 7f02d9402640 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55ce136db260 0x55ce136dc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.186+0000 7f02d9402640 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55ce136db260 0x55ce136dc6d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8e7281e645949c24 server_cookie=417a7145155c56b5 in_seq=0 out_seq=0 2024-09-16T01:00:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.186+0000 7f02bcff9640 10 client.15204 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.186+0000 7f02bcff9640 1 -- 172.21.15.12:0/2546695233 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce13633600 con 0x55ce136db260 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.186+0000 7f02bcff9640 10 client.15204 handle_command_reply: tid=0 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.186+0000 7f02dda3f740 1 client.15204 shutdown 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.186+0000 7f02dda3f740 1 -- 172.21.15.12:0/2546695233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136bf9d0 msgr2=0x55ce136ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.186+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136bf9d0 0x55ce136ca3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f02c402a9a0 tx=0x7f02c4005d50 comp rx=0 tx=0).stop 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.187+0000 7f02dda3f740 1 -- 172.21.15.12:0/2546695233 shutdown_connections 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.187+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55ce136db260 0x55ce136dc6d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.187+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136cabb0 0x55ce136c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.187+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136c02f0 0x55ce136c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.187+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2546695233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136bf9d0 0x55ce136ca3f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.187+0000 7f02bcff9640 0 client.15204 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.187+0000 7f02dda3f740 1 -- 172.21.15.12:0/2546695233 >> 172.21.15.12:0/2546695233 conn(0x55ce136bbf60 msgr2=0x55ce136c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.187+0000 7f02dda3f740 1 -- 172.21.15.12:0/2546695233 shutdown_connections 2024-09-16T01:00:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.187+0000 7f02dda3f740 1 -- 172.21.15.12:0/2546695233 wait complete. 2024-09-16T01:00:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.187+0000 7f02dda3f740 20 client.15204 trim_cache size 0 max 16384 2024-09-16T01:00:53.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.205+0000 7f02dda3f740 1 Processor -- start 2024-09-16T01:00:53.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.205+0000 7f02dda3f740 1 -- start start 2024-09-16T01:00:53.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.205+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136bf9d0 0x55ce136dc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.205+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136c02f0 0x55ce136dab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.205+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136c7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.205+0000 7f02dda3f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce136daa10 con 0x55ce136cabb0 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.205+0000 7f02dda3f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce136db0e0 con 0x55ce136bf9d0 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.205+0000 7f02dda3f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ce136db7b0 con 0x55ce136c02f0 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.205+0000 7f02d8c01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02d8c01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46386/0 (socket says 172.21.15.12:46386) 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02d8c01640 1 -- 172.21.15.12:0/1330467463 learned_addr learned my addr 172.21.15.12:0/1330467463 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02d8c01640 1 --2- 172.21.15.12:0/1330467463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136bf9d0 0x55ce136dc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02d8c01640 1 -- 172.21.15.12:0/1330467463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136c02f0 msgr2=0x55ce136dab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02d9402640 1 --2- 172.21.15.12:0/1330467463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136c02f0 0x55ce136dab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02d8c01640 1 --2- 172.21.15.12:0/1330467463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136c02f0 0x55ce136dab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02d8c01640 1 -- 172.21.15.12:0/1330467463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136bf9d0 msgr2=0x55ce136dc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02d8c01640 1 --2- 172.21.15.12:0/1330467463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136bf9d0 0x55ce136dc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02d8c01640 1 -- 172.21.15.12:0/1330467463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce136c0120 con 0x55ce136cabb0 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02d8c01640 1 --2- 172.21.15.12:0/1330467463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136c7000 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f02c402a4c0 tx=0x7f02c4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6814c49db69f2108 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02beffd640 1 -- 172.21.15.12:0/1330467463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c404f070 con 0x55ce136cabb0 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02beffd640 1 -- 172.21.15.12:0/1330467463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c403d450 con 0x55ce136cabb0 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.206+0000 7f02beffd640 1 -- 172.21.15.12:0/1330467463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4035040 con 0x55ce136cabb0 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 -- 172.21.15.12:0/1330467463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 msgr2=0x55ce136c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 --2- 172.21.15.12:0/1330467463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136c7000 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f02c402a4c0 tx=0x7f02c4000bc0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 -- 172.21.15.12:0/1330467463 shutdown_connections 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 --2- 172.21.15.12:0/1330467463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136cabb0 0x55ce136c7000 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 --2- 172.21.15.12:0/1330467463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136c02f0 0x55ce136dab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 --2- 172.21.15.12:0/1330467463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136bf9d0 0x55ce136dc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 -- 172.21.15.12:0/1330467463 >> 172.21.15.12:0/1330467463 conn(0x55ce136bbf60 msgr2=0x55ce136bc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 -- 172.21.15.12:0/1330467463 shutdown_connections 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 -- 172.21.15.12:0/1330467463 wait complete. 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 -- start start 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.207+0000 7f02dda3f740 1 Processor -- start 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136bf9d0 0x55ce136dde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136c02f0 0x55ce136de3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02dda3f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136cabb0 0x55ce13743960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02dda3f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce136dc550 con 0x55ce136c02f0 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02dda3f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce136dbe80 con 0x55ce136cabb0 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02dda3f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ce136dcc20 con 0x55ce136bf9d0 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02dda3f740 10 client.0 _ll_register_callbacks cb 0x7f02d00095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d9402640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136c02f0 0x55ce136de3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d9402640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136c02f0 0x55ce136de3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46388/0 (socket says 172.21.15.12:46388) 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d9402640 1 -- 172.21.15.12:0/2635508458 learned_addr learned my addr 172.21.15.12:0/2635508458 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d8c01640 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136cabb0 0x55ce13743960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d8c01640 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136bf9d0 0x55ce136dde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d9402640 1 -- 172.21.15.12:0/2635508458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136bf9d0 msgr2=0x55ce136dde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d9402640 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136bf9d0 0x55ce136dde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d9402640 1 -- 172.21.15.12:0/2635508458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136cabb0 msgr2=0x55ce13743960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d9402640 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136cabb0 0x55ce13743960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d9402640 1 -- 172.21.15.12:0/2635508458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce13743ea0 con 0x55ce136c02f0 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.208+0000 7f02d8c01640 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136bf9d0 0x55ce136dde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02d9402640 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136c02f0 0x55ce136de3b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55ce136c8d80 tx=0x7f02d0009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c002aaf8e05464 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02bcff9640 1 -- 172.21.15.12:0/2635508458 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0003cd0 con 0x55ce136c02f0 2024-09-16T01:00:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02bcff9640 1 -- 172.21.15.12:0/2635508458 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f02d0003e70 con 0x55ce136c02f0 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02dda3f740 1 -- 172.21.15.12:0/2635508458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c403d450 con 0x55ce136c02f0 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02bcff9640 1 -- 172.21.15.12:0/2635508458 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02d002e050 con 0x55ce136c02f0 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02dda3f740 10 client.15210 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02dda3f740 1 -- 172.21.15.12:0/2635508458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ce13745210 con 0x55ce136c02f0 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02bcff9640 1 -- 172.21.15.12:0/2635508458 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c403d450 con 0x55ce136c02f0 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02bcff9640 1 -- 172.21.15.12:0/2635508458 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f02d0026720 con 0x55ce136c02f0 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02dda3f740 10 client.15210 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02dda3f740 10 client.15210 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02dda3f740 20 client.15210 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55ce13749e50 0x55ce13748b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02dda3f740 4 client.15210 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.209+0000 7f02dda3f740 1 -- 172.21.15.12:0/2635508458 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "status"}) -- 0x55ce1362db10 con 0x55ce13749e50 2024-09-16T01:00:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02d8c01640 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55ce13749e50 0x55ce13748b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02bcff9640 10 client.15210 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02d8c01640 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55ce13749e50 0x55ce13748b60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7233fadf1c685ed9 server_cookie=1020839d4cbff639 in_seq=0 out_seq=0 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02bcff9640 1 -- 172.21.15.12:0/2635508458 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55ce1362db10 con 0x55ce13749e50 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02bcff9640 10 client.15210 handle_command_reply: tid=0 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02dda3f740 1 client.15210 shutdown 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02dda3f740 1 -- 172.21.15.12:0/2635508458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136c02f0 msgr2=0x55ce136de3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136c02f0 0x55ce136de3b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55ce136c8d80 tx=0x7f02d0009d00 comp rx=0 tx=0).stop 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02dda3f740 1 -- 172.21.15.12:0/2635508458 shutdown_connections 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55ce13749e50 0x55ce13748b60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce136cabb0 0x55ce13743960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce136c02f0 0x55ce136de3b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02bcff9640 0 client.15210 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02dda3f740 1 --2- 172.21.15.12:0/2635508458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce136bf9d0 0x55ce136dde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.210+0000 7f02dda3f740 1 -- 172.21.15.12:0/2635508458 >> 172.21.15.12:0/2635508458 conn(0x55ce136bbf60 msgr2=0x55ce136c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02dda3f740 1 -- 172.21.15.12:0/2635508458 shutdown_connections 2024-09-16T01:00:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02dda3f740 1 -- 172.21.15.12:0/2635508458 wait complete. 2024-09-16T01:00:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02dda3f740 20 client.15210 trim_cache size 0 max 16384 2024-09-16T01:00:53.223 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:00:53.223 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:00:53.223 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 4, 2024-09-16T01:00:53.223 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 14601, 2024-09-16T01:00:53.223 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:00:53.223 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:00:53.223 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:00:53.224 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 91.63896493, 2024-09-16T01:00:53.224 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-16T01:00:53.224 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-09-16T01:00:53.224 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T01:00:53.224 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 149.51337231599999 2024-09-16T01:00:53.224 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:00:53.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 -- 172.21.15.12:0/1041480603 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f02c00a3240 msgr2=0x7f02c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f02c00a3240 0x7f02c00a5700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f02cc098170 tx=0x7f02cc0666a0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 -- 172.21.15.12:0/1041480603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d410c170 msgr2=0x7f02d4101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d410c170 0x7f02d4101420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009fd0 tx=0x7f02cc00b260 comp rx=0 tx=0).stop 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 -- 172.21.15.12:0/1041480603 shutdown_connections 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f02c00a3240 0x7f02c00a5700 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d410c170 0x7f02d4101420 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d4103660 0x7f02d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 --2- 172.21.15.12:0/1041480603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d4102d40 0x7f02d41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 -- 172.21.15.12:0/1041480603 >> 172.21.15.12:0/1041480603 conn(0x7f02d40fc7a0 msgr2=0x7f02d40fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 -- 172.21.15.12:0/1041480603 shutdown_connections 2024-09-16T01:00:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:53.211+0000 7f02db666640 1 -- 172.21.15.12:0/1041480603 wait complete. 2024-09-16T01:00:53.971 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.e status 2024-09-16T01:00:54.229 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:54.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.737+0000 7fe1e5529640 1 -- 172.21.15.12:0/610112929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e0100a80 msgr2=0x7fe1e0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.737+0000 7fe1e5529640 1 --2- 172.21.15.12:0/610112929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e0100a80 0x7fe1e0100ee0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009930 tx=0x7fe1d402a420 comp rx=0 tx=0).stop 2024-09-16T01:00:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.737+0000 7fe1e5529640 1 -- 172.21.15.12:0/610112929 shutdown_connections 2024-09-16T01:00:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.737+0000 7fe1e5529640 1 --2- 172.21.15.12:0/610112929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1e0101420 0x7fe1e010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.737+0000 7fe1e5529640 1 --2- 172.21.15.12:0/610112929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e0100a80 0x7fe1e0100ee0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.737+0000 7fe1e5529640 1 --2- 172.21.15.12:0/610112929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e0106a80 0x7fe1e0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.737+0000 7fe1e5529640 1 -- 172.21.15.12:0/610112929 >> 172.21.15.12:0/610112929 conn(0x7fe1e00fc7a0 msgr2=0x7fe1e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.737+0000 7fe1e5529640 1 -- 172.21.15.12:0/610112929 shutdown_connections 2024-09-16T01:00:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.737+0000 7fe1e5529640 1 -- 172.21.15.12:0/610112929 wait complete. 2024-09-16T01:00:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.738+0000 7fe1e5529640 1 Processor -- start 2024-09-16T01:00:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.738+0000 7fe1e5529640 1 -- start start 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.738+0000 7fe1e5529640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e0100a80 0x7fe1e01a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.738+0000 7fe1e5529640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1e0101420 0x7fe1e01a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.738+0000 7fe1e5529640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e0106a80 0x7fe1e019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.738+0000 7fe1e5529640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0110e80 con 0x7fe1e0100a80 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.738+0000 7fe1e5529640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0110d00 con 0x7fe1e0106a80 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.738+0000 7fe1e5529640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0111000 con 0x7fe1e0101420 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.738+0000 7fe1deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e0100a80 0x7fe1e01a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.738+0000 7fe1deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e0100a80 0x7fe1e01a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46402/0 (socket says 172.21.15.12:46402) 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1deffd640 1 -- 172.21.15.12:0/4205461467 learned_addr learned my addr 172.21.15.12:0/4205461467 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1e0101420 0x7fe1e01a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1df7fe640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e0106a80 0x7fe1e019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1deffd640 1 -- 172.21.15.12:0/4205461467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1e0101420 msgr2=0x7fe1e01a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1deffd640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1e0101420 0x7fe1e01a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1deffd640 1 -- 172.21.15.12:0/4205461467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e0106a80 msgr2=0x7fe1e019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1deffd640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e0106a80 0x7fe1e019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1deffd640 1 -- 172.21.15.12:0/4205461467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e019ace0 con 0x7fe1e0100a80 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1e0101420 0x7fe1e01a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1df7fe640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e0106a80 0x7fe1e019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1deffd640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e0100a80 0x7fe1e01a03f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000e9f0 tx=0x7fe1d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1c7fff640 1 -- 172.21.15.12:0/4205461467 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000cd80 con 0x7fe1e0100a80 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1e5529640 1 -- 172.21.15.12:0/4205461467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e019afd0 con 0x7fe1e0100a80 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1c7fff640 1 -- 172.21.15.12:0/4205461467 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d0010910 con 0x7fe1e0100a80 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1c7fff640 1 -- 172.21.15.12:0/4205461467 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00188f0 con 0x7fe1e0100a80 2024-09-16T01:00:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.739+0000 7fe1e5529640 1 -- 172.21.15.12:0/4205461467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e01a72c0 con 0x7fe1e0100a80 2024-09-16T01:00:54.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.741+0000 7fe1c7fff640 1 -- 172.21.15.12:0/4205461467 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe1d0010ac0 con 0x7fe1e0100a80 2024-09-16T01:00:54.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1e7902740 1 Processor -- start 2024-09-16T01:00:54.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1e7902740 1 -- start start 2024-09-16T01:00:54.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590cf9d0 0x55a2590cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 0x55a2590da670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590dabb0 0x55a2590dcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1e7902740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a259036090 con 0x55a2590dabb0 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1e7902740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a258fdda70 con 0x55a2590cf9d0 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1e7902740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a259032050 con 0x55a2590d02f0 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1de7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590dabb0 0x55a2590dcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1de7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590dabb0 0x55a2590dcfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46414/0 (socket says 172.21.15.12:46414) 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1c7fff640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe1c80a3240 0x7fe1c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.742+0000 7fe1de7fc640 1 -- 172.21.15.12:0/776949367 learned_addr learned my addr 172.21.15.12:0/776949367 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1deffd640 1 --2- 172.21.15.12:0/776949367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 0x55a2590da670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1df7fe640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe1c80a3240 0x7fe1c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1df7fe640 1 --2- 172.21.15.12:0/776949367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590cf9d0 0x55a2590cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1de7fc640 1 -- 172.21.15.12:0/776949367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 msgr2=0x55a2590da670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1c7fff640 1 -- 172.21.15.12:0/4205461467 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fe1d00d0130 con 0x7fe1e0100a80 2024-09-16T01:00:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/776949367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 0x55a2590da670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1de7fc640 1 -- 172.21.15.12:0/776949367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590cf9d0 msgr2=0x55a2590cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/776949367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590cf9d0 0x55a2590cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1de7fc640 1 -- 172.21.15.12:0/776949367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a258fea130 con 0x55a2590dabb0 2024-09-16T01:00:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1df7fe640 1 --2- 172.21.15.12:0/776949367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590cf9d0 0x55a2590cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/776949367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590dabb0 0x55a2590dcfa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009930 tx=0x7fe1d4005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929a30b2c7800eaa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1df7fe640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe1c80a3240 0x7fe1c80a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8005c40 tx=0x7fe1d8009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1c57fa640 1 -- 172.21.15.12:0/776949367 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d403f070 con 0x55a2590dabb0 2024-09-16T01:00:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1c57fa640 1 -- 172.21.15.12:0/776949367 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d4004030 con 0x55a2590dabb0 2024-09-16T01:00:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.743+0000 7fe1c57fa640 1 -- 172.21.15.12:0/776949367 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4035070 con 0x55a2590dabb0 2024-09-16T01:00:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.744+0000 7fe1e7902740 1 -- 172.21.15.12:0/776949367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590dabb0 msgr2=0x55a2590dcfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.744+0000 7fe1e7902740 1 --2- 172.21.15.12:0/776949367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590dabb0 0x55a2590dcfa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009930 tx=0x7fe1d4005e60 comp rx=0 tx=0).stop 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.744+0000 7fe1e7902740 1 -- 172.21.15.12:0/776949367 shutdown_connections 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.744+0000 7fe1e7902740 1 --2- 172.21.15.12:0/776949367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590dabb0 0x55a2590dcfa0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.744+0000 7fe1e7902740 1 --2- 172.21.15.12:0/776949367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 0x55a2590da670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.744+0000 7fe1e7902740 1 --2- 172.21.15.12:0/776949367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590cf9d0 0x55a2590cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.744+0000 7fe1e7902740 1 -- 172.21.15.12:0/776949367 >> 172.21.15.12:0/776949367 conn(0x55a2590cbf60 msgr2=0x55a2590cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.744+0000 7fe1e7902740 1 -- 172.21.15.12:0/776949367 shutdown_connections 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.744+0000 7fe1e7902740 1 -- 172.21.15.12:0/776949367 wait complete. 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.744+0000 7fe1e7902740 1 -- start start 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1e7902740 1 Processor -- start 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590da440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 0x55a2590d7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590dabb0 0x55a2590d7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1e7902740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a2590dd780 con 0x55a2590cf9d0 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1e7902740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a258ff0f20 con 0x55a2590d02f0 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1e7902740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a2590dd900 con 0x55a2590dabb0 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1e7902740 10 client.0 _ll_register_callbacks cb 0x55a258fba030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590da440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590da440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46420/0 (socket says 172.21.15.12:46420) 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1deffd640 1 -- 172.21.15.12:0/2679265419 learned_addr learned my addr 172.21.15.12:0/2679265419 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1df7fe640 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590dabb0 0x55a2590d7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 0x55a2590d7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1deffd640 1 -- 172.21.15.12:0/2679265419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590dabb0 msgr2=0x55a2590d7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1deffd640 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590dabb0 0x55a2590d7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1deffd640 1 -- 172.21.15.12:0/2679265419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 msgr2=0x55a2590d7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1deffd640 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 0x55a2590d7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.745+0000 7fe1deffd640 1 -- 172.21.15.12:0/2679265419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a258da72b0 con 0x55a2590cf9d0 2024-09-16T01:00:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1deffd640 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590da440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00cd8d0 tx=0x7fe1d0014cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acda5ebd359cd820 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2679265419 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d009c3f0 con 0x55a2590cf9d0 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2679265419 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fe1d00a0400 con 0x55a2590cf9d0 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1e7902740 1 -- 172.21.15.12:0/2679265419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d4004030 con 0x55a2590cf9d0 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2679265419 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe1d00a07a0 con 0x55a2590cf9d0 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1e7902740 10 client.15222 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1e7902740 1 -- 172.21.15.12:0/2679265419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a2590e9000 con 0x55a2590cf9d0 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2679265419 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d4004030 con 0x55a2590cf9d0 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2679265419 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe1d0018b70 con 0x55a2590cf9d0 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1e7902740 10 client.15222 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1e7902740 10 client.15222 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1e7902740 20 client.15222 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55a2590eb5e0 0x55a2590eca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1e7902740 4 client.15222 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.746+0000 7fe1e7902740 1 -- 172.21.15.12:0/2679265419 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a259043600 con 0x55a2590eb5e0 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.747+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55a2590eb5e0 0x55a2590eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.747+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55a2590eb5e0 0x55a2590eca50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8ea96ba0ef0edd6b server_cookie=e1baca09d564fcec in_seq=0 out_seq=0 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.747+0000 7fe1c2ff5640 10 client.15222 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2679265419 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a259043600 con 0x55a2590eb5e0 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1c2ff5640 10 client.15222 handle_command_reply: tid=0 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 client.15222 shutdown 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 -- 172.21.15.12:0/2679265419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 msgr2=0x55a2590da440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590da440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00cd8d0 tx=0x7fe1d0014cb0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 -- 172.21.15.12:0/2679265419 shutdown_connections 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55a2590eb5e0 0x55a2590eca50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590dabb0 0x55a2590d7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 0x55a2590d7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2679265419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590da440 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 -- 172.21.15.12:0/2679265419 >> 172.21.15.12:0/2679265419 conn(0x55a2590cbf60 msgr2=0x55a2590d1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:54.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1c2ff5640 0 client.15222 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:00:54.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 -- 172.21.15.12:0/2679265419 shutdown_connections 2024-09-16T01:00:54.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.748+0000 7fe1e7902740 1 -- 172.21.15.12:0/2679265419 wait complete. 2024-09-16T01:00:54.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.749+0000 7fe1e7902740 20 client.15222 trim_cache size 0 max 16384 2024-09-16T01:00:54.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.766+0000 7fe1e7902740 1 Processor -- start 2024-09-16T01:00:54.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.766+0000 7fe1e7902740 1 -- start start 2024-09-16T01:00:54.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590ebcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 0x55a2590d7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590dabb0 0x55a2590d7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1e7902740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a2590ead90 con 0x55a2590cf9d0 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1e7902740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a2590eb460 con 0x55a2590dabb0 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1e7902740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a2590ebb30 con 0x55a2590d02f0 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590ebcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590ebcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46434/0 (socket says 172.21.15.12:46434) 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1deffd640 1 -- 172.21.15.12:0/4244042580 learned_addr learned my addr 172.21.15.12:0/4244042580 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/4244042580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 0x55a2590d7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1df7fe640 1 --2- 172.21.15.12:0/4244042580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590dabb0 0x55a2590d7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1deffd640 1 -- 172.21.15.12:0/4244042580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 msgr2=0x55a2590d7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1deffd640 1 --2- 172.21.15.12:0/4244042580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 0x55a2590d7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1deffd640 1 -- 172.21.15.12:0/4244042580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590dabb0 msgr2=0x55a2590d7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:54.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1deffd640 1 --2- 172.21.15.12:0/4244042580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590dabb0 0x55a2590d7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1deffd640 1 -- 172.21.15.12:0/4244042580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2590ccb60 con 0x55a2590cf9d0 2024-09-16T01:00:54.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/4244042580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 0x55a2590d7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:54.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1deffd640 1 --2- 172.21.15.12:0/4244042580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590ebcb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe1d009a6a0 tx=0x7fe1d009a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a9672b5ac5e0b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:54.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1c4ff9640 1 -- 172.21.15.12:0/4244042580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d009caf0 con 0x55a2590cf9d0 2024-09-16T01:00:54.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.767+0000 7fe1c4ff9640 1 -- 172.21.15.12:0/4244042580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d00a5060 con 0x55a2590cf9d0 2024-09-16T01:00:54.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.768+0000 7fe1c4ff9640 1 -- 172.21.15.12:0/4244042580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00b50f0 con 0x55a2590cf9d0 2024-09-16T01:00:54.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.768+0000 7fe1e7902740 1 -- 172.21.15.12:0/4244042580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 msgr2=0x55a2590ebcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:54.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.768+0000 7fe1e7902740 1 --2- 172.21.15.12:0/4244042580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590ebcb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe1d009a6a0 tx=0x7fe1d009a900 comp rx=0 tx=0).stop 2024-09-16T01:00:54.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.768+0000 7fe1e7902740 1 -- 172.21.15.12:0/4244042580 shutdown_connections 2024-09-16T01:00:54.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.768+0000 7fe1e7902740 1 --2- 172.21.15.12:0/4244042580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590dabb0 0x55a2590d7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.768+0000 7fe1e7902740 1 --2- 172.21.15.12:0/4244042580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590d02f0 0x55a2590d7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.768+0000 7fe1e7902740 1 --2- 172.21.15.12:0/4244042580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590ebcb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.768+0000 7fe1e7902740 1 -- 172.21.15.12:0/4244042580 >> 172.21.15.12:0/4244042580 conn(0x55a2590cbf60 msgr2=0x55a2590d6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:54.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.768+0000 7fe1e7902740 1 -- 172.21.15.12:0/4244042580 shutdown_connections 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.768+0000 7fe1e7902740 1 -- 172.21.15.12:0/4244042580 wait complete. 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1e7902740 1 -- start start 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1e7902740 1 Processor -- start 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590f0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 0x55a2590f0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1e7902740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590dabb0 0x55a259153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1e7902740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a2590ec8d0 con 0x55a2590cf9d0 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1e7902740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a2590ec200 con 0x55a2590d02f0 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1e7902740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a2590ecfa0 con 0x55a2590dabb0 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1e7902740 10 client.0 _ll_register_callbacks cb 0x7fe1d009bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590f0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46444/0 (socket says 172.21.15.12:46444) 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1deffd640 1 -- 172.21.15.12:0/2250388483 learned_addr learned my addr 172.21.15.12:0/2250388483 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:54.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1df7fe640 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590dabb0 0x55a259153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 0x55a2590f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1deffd640 1 -- 172.21.15.12:0/2250388483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590dabb0 msgr2=0x55a259153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1deffd640 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590dabb0 0x55a259153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1deffd640 1 -- 172.21.15.12:0/2250388483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 msgr2=0x55a2590f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1deffd640 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 0x55a2590f0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1deffd640 1 -- 172.21.15.12:0/2250388483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a259154220 con 0x55a2590cf9d0 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.769+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 0x55a2590f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1deffd640 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590f0200 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00980d0 tx=0x7fe1d000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a082c7f35237e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2250388483 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00b52f0 con 0x55a2590cf9d0 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2250388483 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fe1d009b840 con 0x55a2590cf9d0 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1e7902740 1 -- 172.21.15.12:0/2250388483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d00a5060 con 0x55a2590cf9d0 2024-09-16T01:00:54.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2250388483 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe1d009ba80 con 0x55a2590cf9d0 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1e7902740 10 client.15228 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1e7902740 1 -- 172.21.15.12:0/2250388483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a259155430 con 0x55a2590cf9d0 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2250388483 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d00a5060 con 0x55a2590cf9d0 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2250388483 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe1d00982d0 con 0x55a2590cf9d0 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1e7902740 10 client.15228 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1e7902740 10 client.15228 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1e7902740 20 client.15228 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55a259159a90 0x55a2591587a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1e7902740 4 client.15228 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.770+0000 7fe1e7902740 1 -- 172.21.15.12:0/2250388483 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "status"}) -- 0x55a25903db10 con 0x55a259159a90 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.771+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55a259159a90 0x55a2591587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.771+0000 7fe1de7fc640 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55a259159a90 0x55a2591587a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=10520c09b3e0a9a3 server_cookie=12605c219f001aaf in_seq=0 out_seq=0 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.771+0000 7fe1c2ff5640 10 client.15228 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:00:54.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.771+0000 7fe1c2ff5640 1 -- 172.21.15.12:0/2250388483 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a25903db10 con 0x55a259159a90 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.771+0000 7fe1c2ff5640 10 client.15228 handle_command_reply: tid=0 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.771+0000 7fe1e7902740 1 client.15228 shutdown 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.771+0000 7fe1e7902740 1 -- 172.21.15.12:0/2250388483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 msgr2=0x55a2590f0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.771+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590f0200 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00980d0 tx=0x7fe1d000cf20 comp rx=0 tx=0).stop 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e7902740 1 -- 172.21.15.12:0/2250388483 shutdown_connections 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55a259159a90 0x55a2591587a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2590dabb0 0x55a259153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2590d02f0 0x55a2590f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e7902740 1 --2- 172.21.15.12:0/2250388483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2590cf9d0 0x55a2590f0200 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1c2ff5640 0 client.15228 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e7902740 1 -- 172.21.15.12:0/2250388483 >> 172.21.15.12:0/2250388483 conn(0x55a2590cbf60 msgr2=0x55a2590d7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e7902740 1 -- 172.21.15.12:0/2250388483 shutdown_connections 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e7902740 1 -- 172.21.15.12:0/2250388483 wait complete. 2024-09-16T01:00:54.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e7902740 20 client.15228 trim_cache size 0 max 16384 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 3, 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24458, 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 94.011016045999995, 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-09-16T01:00:54.779 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T01:00:54.780 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 167.59593014699999 2024-09-16T01:00:54.780 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:00:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e5529640 1 -- 172.21.15.12:0/4205461467 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe1c80a3240 msgr2=0x7fe1c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e5529640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe1c80a3240 0x7fe1c80a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8005c40 tx=0x7fe1d8009590 comp rx=0 tx=0).stop 2024-09-16T01:00:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e5529640 1 -- 172.21.15.12:0/4205461467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e0100a80 msgr2=0x7fe1e01a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e5529640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e0100a80 0x7fe1e01a03f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000e9f0 tx=0x7fe1d000eeb0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e5529640 1 -- 172.21.15.12:0/4205461467 shutdown_connections 2024-09-16T01:00:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.772+0000 7fe1e5529640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe1c80a3240 0x7fe1c80a5700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.773+0000 7fe1e5529640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e0106a80 0x7fe1e019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.773+0000 7fe1e5529640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1e0101420 0x7fe1e01a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.773+0000 7fe1e5529640 1 --2- 172.21.15.12:0/4205461467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e0100a80 0x7fe1e01a03f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.773+0000 7fe1e5529640 1 -- 172.21.15.12:0/4205461467 >> 172.21.15.12:0/4205461467 conn(0x7fe1e00fc7a0 msgr2=0x7fe1e006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.773+0000 7fe1e5529640 1 -- 172.21.15.12:0/4205461467 shutdown_connections 2024-09-16T01:00:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:54.773+0000 7fe1e5529640 1 -- 172.21.15.12:0/4205461467 wait complete. 2024-09-16T01:00:54.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:54 smithi098 ceph-mon[35346]: pgmap v354: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:55.091 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:54 smithi012 ceph-mon[31197]: pgmap v354: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:55.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:54 smithi119 ceph-mon[35049]: pgmap v354: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 123 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:55.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-16T01:00:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:56.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.238+0000 7fdcb10a7640 1 -- 172.21.15.12:0/3303272637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcac102570 msgr2=0x7fdcac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:56.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.238+0000 7fdcb10a7640 1 --2- 172.21.15.12:0/3303272637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcac102570 0x7fdcac1029b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009900 tx=0x7fdc9402a480 comp rx=0 tx=0).stop 2024-09-16T01:00:56.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.238+0000 7fdcb10a7640 1 -- 172.21.15.12:0/3303272637 shutdown_connections 2024-09-16T01:00:56.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.238+0000 7fdcb10a7640 1 --2- 172.21.15.12:0/3303272637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcac102ef0 0x7fdcac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.238+0000 7fdcb10a7640 1 --2- 172.21.15.12:0/3303272637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcac102570 0x7fdcac1029b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.238+0000 7fdcb10a7640 1 --2- 172.21.15.12:0/3303272637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcac100e20 0x7fdcac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.238+0000 7fdcb10a7640 1 -- 172.21.15.12:0/3303272637 >> 172.21.15.12:0/3303272637 conn(0x7fdcac0fc7d0 msgr2=0x7fdcac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.238+0000 7fdcb10a7640 1 -- 172.21.15.12:0/3303272637 shutdown_connections 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.238+0000 7fdcb10a7640 1 -- 172.21.15.12:0/3303272637 wait complete. 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcb10a7640 1 Processor -- start 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcb10a7640 1 -- start start 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcb10a7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcac100e20 0x7fdcac198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcb10a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcac102570 0x7fdcac198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcb10a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcac102ef0 0x7fdcac19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcb10a7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac110f80 con 0x7fdcac102ef0 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcb10a7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac110e00 con 0x7fdcac100e20 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcb10a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac111100 con 0x7fdcac102570 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcab59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcac102ef0 0x7fdcac19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcab59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcac102ef0 0x7fdcac19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39524/0 (socket says 172.21.15.12:39524) 2024-09-16T01:00:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcab59e640 1 -- 172.21.15.12:0/1909509787 learned_addr learned my addr 172.21.15.12:0/1909509787 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdca3fff640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcac102570 0x7fdcac198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcac100e20 0x7fdcac198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcab59e640 1 -- 172.21.15.12:0/1909509787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcac102570 msgr2=0x7fdcac198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcab59e640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcac102570 0x7fdcac198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcab59e640 1 -- 172.21.15.12:0/1909509787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcac100e20 msgr2=0x7fdcac198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcab59e640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcac100e20 0x7fdcac198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcab59e640 1 -- 172.21.15.12:0/1909509787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcac19d400 con 0x7fdcac102ef0 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcac100e20 0x7fdcac198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.239+0000 7fdcab59e640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcac102ef0 0x7fdcac19cd20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdca400eaa0 tx=0x7fdca400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.240+0000 7fdca8d99640 1 -- 172.21.15.12:0/1909509787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca400cdb0 con 0x7fdcac102ef0 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.240+0000 7fdca8d99640 1 -- 172.21.15.12:0/1909509787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdca4005020 con 0x7fdcac102ef0 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.240+0000 7fdcb10a7640 1 -- 172.21.15.12:0/1909509787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcac19d6f0 con 0x7fdcac102ef0 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.240+0000 7fdca8d99640 1 -- 172.21.15.12:0/1909509787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca40116b0 con 0x7fdcac102ef0 2024-09-16T01:00:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.240+0000 7fdcb10a7640 1 -- 172.21.15.12:0/1909509787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcac1a4fd0 con 0x7fdcac102ef0 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.242+0000 7fdca8d99640 1 -- 172.21.15.12:0/1909509787 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdca4005560 con 0x7fdcac102ef0 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.242+0000 7fdcb3480740 1 Processor -- start 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.242+0000 7fdcb3480740 1 -- start start 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b8691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b873a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b873fc0 0x56507b8763b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdcb3480740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56507b7cb090 con 0x56507b868de0 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdcb3480740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56507b772a70 con 0x56507b873fc0 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdcb3480740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56507b7c7050 con 0x56507b869700 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b8691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b8691c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39540/0 (socket says 172.21.15.12:39540) 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca3fff640 1 -- 172.21.15.12:0/3425508232 learned_addr learned my addr 172.21.15.12:0/3425508232 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca8d99640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc980a3240 0x7fdc980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/3425508232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b873a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca3fff640 1 -- 172.21.15.12:0/3425508232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 msgr2=0x56507b873a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca3fff640 1 --2- 172.21.15.12:0/3425508232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b873a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdcab59e640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc980a3240 0x7fdc980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca3fff640 1 -- 172.21.15.12:0/3425508232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b873fc0 msgr2=0x56507b8763b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca3fff640 1 --2- 172.21.15.12:0/3425508232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b873fc0 0x56507b8763b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca3fff640 1 -- 172.21.15.12:0/3425508232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56507b77f130 con 0x56507b868de0 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/3425508232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b873a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca8d99640 1 -- 172.21.15.12:0/1909509787 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fdca40cfec0 con 0x7fdcac102ef0 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.243+0000 7fdca3fff640 1 --2- 172.21.15.12:0/3425508232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b8691c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdc9402a9a0 tx=0x7fdc94004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23926c06359af385 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.244+0000 7fdca17fa640 1 -- 172.21.15.12:0/3425508232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94035070 con 0x56507b868de0 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.244+0000 7fdca17fa640 1 -- 172.21.15.12:0/3425508232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc94041030 con 0x56507b868de0 2024-09-16T01:00:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.244+0000 7fdca17fa640 1 -- 172.21.15.12:0/3425508232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94031960 con 0x56507b868de0 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.244+0000 7fdcb3480740 1 -- 172.21.15.12:0/3425508232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 msgr2=0x56507b8691c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.244+0000 7fdcab59e640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc980a3240 0x7fdc980a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdca409be80 tx=0x7fdca40c6f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.244+0000 7fdcb3480740 1 --2- 172.21.15.12:0/3425508232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b8691c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdc9402a9a0 tx=0x7fdc94004180 comp rx=0 tx=0).stop 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 -- 172.21.15.12:0/3425508232 shutdown_connections 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 --2- 172.21.15.12:0/3425508232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b873fc0 0x56507b8763b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 --2- 172.21.15.12:0/3425508232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b873a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 --2- 172.21.15.12:0/3425508232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b8691c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 -- 172.21.15.12:0/3425508232 >> 172.21.15.12:0/3425508232 conn(0x56507b865370 msgr2=0x56507b865750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 -- 172.21.15.12:0/3425508232 shutdown_connections 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 -- 172.21.15.12:0/3425508232 wait complete. 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 -- start start 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 Processor -- start 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b873840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b870b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b873fc0 0x56507b8710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56507b876b90 con 0x56507b868de0 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56507b785f20 con 0x56507b873fc0 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56507b876d10 con 0x56507b869700 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdcb3480740 10 client.0 _ll_register_callbacks cb 0x56507b74f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdca3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b873840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdca3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b873840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39542/0 (socket says 172.21.15.12:39542) 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.245+0000 7fdca3fff640 1 -- 172.21.15.12:0/2646587797 learned_addr learned my addr 172.21.15.12:0/2646587797 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdca3fff640 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b873fc0 0x56507b8710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b870b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdca3fff640 1 -- 172.21.15.12:0/2646587797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 msgr2=0x56507b870b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdca3fff640 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b870b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdca3fff640 1 -- 172.21.15.12:0/2646587797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b873fc0 msgr2=0x56507b8710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdca3fff640 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b873fc0 0x56507b8710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdca3fff640 1 -- 172.21.15.12:0/2646587797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56507b53c2b0 con 0x56507b868de0 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdca3fff640 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b873840 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdc94031640 tx=0x7fdc940058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e564ac0cd33b5be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdc927fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdc927fc640 1 -- 172.21.15.12:0/2646587797 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94051060 con 0x56507b868de0 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdc927fc640 1 -- 172.21.15.12:0/2646587797 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fdc940035f0 con 0x56507b868de0 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdcb3480740 1 -- 172.21.15.12:0/2646587797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc94041030 con 0x56507b868de0 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdc927fc640 1 -- 172.21.15.12:0/2646587797 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdc94035030 con 0x56507b868de0 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdcb3480740 10 client.15240 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdcb3480740 1 -- 172.21.15.12:0/2646587797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56507b8824d0 con 0x56507b868de0 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.246+0000 7fdc927fc640 1 -- 172.21.15.12:0/2646587797 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc94041030 con 0x56507b868de0 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.247+0000 7fdc927fc640 1 -- 172.21.15.12:0/2646587797 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fdc9403b9c0 con 0x56507b868de0 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.247+0000 7fdcb3480740 10 client.15240 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.247+0000 7fdcb3480740 10 client.15240 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:00:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.247+0000 7fdcb3480740 20 client.15240 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.247+0000 7fdcb3480740 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56507b8845c0 0x56507b883820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.247+0000 7fdcb3480740 4 client.15240 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.247+0000 7fdcb3480740 1 -- 172.21.15.12:0/2646587797 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56507b7d8600 con 0x56507b8845c0 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.247+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56507b8845c0 0x56507b883820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.248+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56507b8845c0 0x56507b883820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5e43371c24a2eb07 server_cookie=7faab83e43a308c4 in_seq=0 out_seq=0 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.248+0000 7fdc927fc640 10 client.15240 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.248+0000 7fdc927fc640 1 -- 172.21.15.12:0/2646587797 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56507b7d8600 con 0x56507b8845c0 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.248+0000 7fdc927fc640 10 client.15240 handle_command_reply: tid=0 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 client.15240 shutdown 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 -- 172.21.15.12:0/2646587797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 msgr2=0x56507b873840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b873840 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdc94031640 tx=0x7fdc940058d0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 -- 172.21.15.12:0/2646587797 shutdown_connections 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56507b8845c0 0x56507b883820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b873fc0 0x56507b8710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b870b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdc927fc640 0 client.15240 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:00:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 --2- 172.21.15.12:0/2646587797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b868de0 0x56507b873840 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 -- 172.21.15.12:0/2646587797 >> 172.21.15.12:0/2646587797 conn(0x56507b865370 msgr2=0x56507b86b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 -- 172.21.15.12:0/2646587797 shutdown_connections 2024-09-16T01:00:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 1 -- 172.21.15.12:0/2646587797 wait complete. 2024-09-16T01:00:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.249+0000 7fdcb3480740 20 client.15240 trim_cache size 0 max 16384 2024-09-16T01:00:56.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.267+0000 7fdcb3480740 1 Processor -- start 2024-09-16T01:00:56.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.267+0000 7fdcb3480740 1 -- start start 2024-09-16T01:00:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.267+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b868de0 0x56507b883ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.267+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b869700 0x56507b885360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.267+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b86f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.267+0000 7fdcb3480740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56507b883d70 con 0x56507b873fc0 2024-09-16T01:00:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.267+0000 7fdcb3480740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56507b884440 con 0x56507b869700 2024-09-16T01:00:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.267+0000 7fdcb3480740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56507b884b10 con 0x56507b868de0 2024-09-16T01:00:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b86f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b86f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39556/0 (socket says 172.21.15.12:39556) 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca3fff640 1 -- 172.21.15.12:0/3727061729 learned_addr learned my addr 172.21.15.12:0/3727061729 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca3fff640 1 --2- 172.21.15.12:0/3727061729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b868de0 0x56507b883ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/3727061729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b869700 0x56507b885360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca3fff640 1 -- 172.21.15.12:0/3727061729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b868de0 msgr2=0x56507b883ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca3fff640 1 --2- 172.21.15.12:0/3727061729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b868de0 0x56507b883ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca3fff640 1 -- 172.21.15.12:0/3727061729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b869700 msgr2=0x56507b885360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca3fff640 1 --2- 172.21.15.12:0/3727061729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b869700 0x56507b885360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca3fff640 1 -- 172.21.15.12:0/3727061729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56507b869530 con 0x56507b873fc0 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca3fff640 1 --2- 172.21.15.12:0/3727061729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b86f460 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdc940095e0 tx=0x7fdc94032680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9062049564b0335c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca0ff9640 1 -- 172.21.15.12:0/3727061729 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94051070 con 0x56507b873fc0 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca0ff9640 1 -- 172.21.15.12:0/3727061729 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc94041030 con 0x56507b873fc0 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.268+0000 7fdca0ff9640 1 -- 172.21.15.12:0/3727061729 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94004920 con 0x56507b873fc0 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.269+0000 7fdcb3480740 1 -- 172.21.15.12:0/3727061729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 msgr2=0x56507b86f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.269+0000 7fdcb3480740 1 --2- 172.21.15.12:0/3727061729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b86f460 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdc940095e0 tx=0x7fdc94032680 comp rx=0 tx=0).stop 2024-09-16T01:00:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.269+0000 7fdcb3480740 1 -- 172.21.15.12:0/3727061729 shutdown_connections 2024-09-16T01:00:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.269+0000 7fdcb3480740 1 --2- 172.21.15.12:0/3727061729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b86f460 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.269+0000 7fdcb3480740 1 --2- 172.21.15.12:0/3727061729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b869700 0x56507b885360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.269+0000 7fdcb3480740 1 --2- 172.21.15.12:0/3727061729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b868de0 0x56507b883ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.269+0000 7fdcb3480740 1 -- 172.21.15.12:0/3727061729 >> 172.21.15.12:0/3727061729 conn(0x56507b865370 msgr2=0x56507b85bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.269+0000 7fdcb3480740 1 -- 172.21.15.12:0/3727061729 shutdown_connections 2024-09-16T01:00:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.269+0000 7fdcb3480740 1 -- 172.21.15.12:0/3727061729 wait complete. 2024-09-16T01:00:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.269+0000 7fdcb3480740 1 -- start start 2024-09-16T01:00:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdcb3480740 1 Processor -- start 2024-09-16T01:00:56.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b868de0 0x56507b8892f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b889830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdcb3480740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b8e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdcb3480740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56507b8858b0 con 0x56507b873fc0 2024-09-16T01:00:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdcb3480740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56507b8851e0 con 0x56507b868de0 2024-09-16T01:00:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdcb3480740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56507b885f80 con 0x56507b869700 2024-09-16T01:00:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdcb3480740 10 client.0 _ll_register_callbacks cb 0x7fdc940040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdca3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b8e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdca3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b8e6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39570/0 (socket says 172.21.15.12:39570) 2024-09-16T01:00:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdca3fff640 1 -- 172.21.15.12:0/628322282 learned_addr learned my addr 172.21.15.12:0/628322282 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b889830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdca3fff640 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b868de0 0x56507b8892f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdca3fff640 1 -- 172.21.15.12:0/628322282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 msgr2=0x56507b889830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdca3fff640 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b889830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdca3fff640 1 -- 172.21.15.12:0/628322282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b868de0 msgr2=0x56507b8892f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdca3fff640 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b868de0 0x56507b8892f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.270+0000 7fdca3fff640 1 -- 172.21.15.12:0/628322282 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56507b8e7330 con 0x56507b873fc0 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdca3fff640 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b8e6c90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009850 tx=0x7fdc94031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984b26827a7050fb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdc927fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdc927fc640 1 -- 172.21.15.12:0/628322282 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94051040 con 0x56507b873fc0 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdc927fc640 1 -- 172.21.15.12:0/628322282 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fdc94046420 con 0x56507b873fc0 2024-09-16T01:00:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdcb3480740 1 -- 172.21.15.12:0/628322282 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc94041030 con 0x56507b873fc0 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdc927fc640 1 -- 172.21.15.12:0/628322282 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdc94070050 con 0x56507b873fc0 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdcb3480740 10 client.15246 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdcb3480740 1 -- 172.21.15.12:0/628322282 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56507b8ee6a0 con 0x56507b873fc0 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdc927fc640 1 -- 172.21.15.12:0/628322282 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc94041030 con 0x56507b873fc0 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdc927fc640 1 -- 172.21.15.12:0/628322282 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fdc9403b690 con 0x56507b873fc0 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdcb3480740 10 client.15246 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdcb3480740 10 client.15246 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdcb3480740 20 client.15246 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdcb3480740 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56507b8f2bd0 0x56507b8f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdcb3480740 4 client.15246 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.271+0000 7fdcb3480740 1 -- 172.21.15.12:0/628322282 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "status"}) -- 0x56507b7d2b10 con 0x56507b8f2bd0 2024-09-16T01:00:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.272+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56507b8f2bd0 0x56507b8f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.272+0000 7fdcaad9d640 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56507b8f2bd0 0x56507b8f18e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b0e71762e3c72e44 server_cookie=227017c2d0900c58 in_seq=0 out_seq=0 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.272+0000 7fdc927fc640 10 client.15246 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.272+0000 7fdc927fc640 1 -- 172.21.15.12:0/628322282 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56507b7d2b10 con 0x56507b8f2bd0 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.272+0000 7fdc927fc640 10 client.15246 handle_command_reply: tid=0 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.272+0000 7fdcb3480740 1 client.15246 shutdown 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 1 -- 172.21.15.12:0/628322282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 msgr2=0x56507b8e6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b8e6c90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009850 tx=0x7fdc94031400 comp rx=0 tx=0).stop 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 1 -- 172.21.15.12:0/628322282 shutdown_connections 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56507b8f2bd0 0x56507b8f18e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56507b873fc0 0x56507b8e6c90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56507b869700 0x56507b889830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdc927fc640 0 client.15246 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:00:56.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 1 --2- 172.21.15.12:0/628322282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56507b868de0 0x56507b8892f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 1 -- 172.21.15.12:0/628322282 >> 172.21.15.12:0/628322282 conn(0x56507b865370 msgr2=0x56507b865750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:56.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 1 -- 172.21.15.12:0/628322282 shutdown_connections 2024-09-16T01:00:56.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 1 -- 172.21.15.12:0/628322282 wait complete. 2024-09-16T01:00:56.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb3480740 20 client.15246 trim_cache size 0 max 16384 2024-09-16T01:00:56.280 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:00:56.280 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:00:56.280 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 2, 2024-09-16T01:00:56.280 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24475, 2024-09-16T01:00:56.280 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:00:56.281 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:00:56.281 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:00:56.281 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 96.516914228999994, 2024-09-16T01:00:56.281 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-16T01:00:56.281 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-09-16T01:00:56.281 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T01:00:56.281 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 158.44226607100001 2024-09-16T01:00:56.281 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb10a7640 1 -- 172.21.15.12:0/1909509787 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc980a3240 msgr2=0x7fdc980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb10a7640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc980a3240 0x7fdc980a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdca409be80 tx=0x7fdca40c6f50 comp rx=0 tx=0).stop 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb10a7640 1 -- 172.21.15.12:0/1909509787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcac102ef0 msgr2=0x7fdcac19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb10a7640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcac102ef0 0x7fdcac19cd20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdca400eaa0 tx=0x7fdca400ef60 comp rx=0 tx=0).stop 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb10a7640 1 -- 172.21.15.12:0/1909509787 shutdown_connections 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb10a7640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc980a3240 0x7fdc980a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb10a7640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcac102ef0 0x7fdcac19cd20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb10a7640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcac102570 0x7fdcac198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb10a7640 1 --2- 172.21.15.12:0/1909509787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcac100e20 0x7fdcac198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.273+0000 7fdcb10a7640 1 -- 172.21.15.12:0/1909509787 >> 172.21.15.12:0/1909509787 conn(0x7fdcac0fc7d0 msgr2=0x7fdcac06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.274+0000 7fdcb10a7640 1 -- 172.21.15.12:0/1909509787 shutdown_connections 2024-09-16T01:00:56.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:56.274+0000 7fdcb10a7640 1 -- 172.21.15.12:0/1909509787 wait complete. 2024-09-16T01:00:56.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:56 smithi012 ceph-mon[31197]: pgmap v355: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:56 smithi098 ceph-mon[35346]: pgmap v355: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:56.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-16T01:00:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:56 smithi119 ceph-mon[35049]: pgmap v355: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.798+0000 7f28a2b06640 1 -- 172.21.15.12:0/1539357776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f289c101de0 msgr2=0x7f289c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.798+0000 7f28a2b06640 1 --2- 172.21.15.12:0/1539357776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f289c101de0 0x7f289c1021c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2898009900 tx=0x7f289802a3f0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.798+0000 7f28a2b06640 1 -- 172.21.15.12:0/1539357776 shutdown_connections 2024-09-16T01:00:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.798+0000 7f28a2b06640 1 --2- 172.21.15.12:0/1539357776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289c106f10 0x7f289c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.798+0000 7f28a2b06640 1 --2- 172.21.15.12:0/1539357776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f289c102790 0x7f289c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.798+0000 7f28a2b06640 1 --2- 172.21.15.12:0/1539357776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f289c101de0 0x7f289c1021c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.798+0000 7f28a2b06640 1 -- 172.21.15.12:0/1539357776 >> 172.21.15.12:0/1539357776 conn(0x7f289c0fd8c0 msgr2=0x7f289c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.798+0000 7f28a2b06640 1 -- 172.21.15.12:0/1539357776 shutdown_connections 2024-09-16T01:00:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.798+0000 7f28a2b06640 1 -- 172.21.15.12:0/1539357776 wait complete. 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f28a2b06640 1 Processor -- start 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f28a2b06640 1 -- start start 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f28a2b06640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289c101de0 0x7f289c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f28a2b06640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f289c102790 0x7f289c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f28a2b06640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f289c106f10 0x7f289c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f28a2b06640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f289c111f80 con 0x7f289c102790 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f28a2b06640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f289c111e00 con 0x7f289c101de0 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f28a2b06640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f289c112100 con 0x7f289c106f10 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f2893fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f289c102790 0x7f289c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f2893fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f289c102790 0x7f289c1988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39592/0 (socket says 172.21.15.12:39592) 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f2893fff640 1 -- 172.21.15.12:0/1186064812 learned_addr learned my addr 172.21.15.12:0/1186064812 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f28a08a2640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289c101de0 0x7f289c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f28a10a3640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f289c106f10 0x7f289c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f2893fff640 1 -- 172.21.15.12:0/1186064812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f289c106f10 msgr2=0x7f289c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f2893fff640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f289c106f10 0x7f289c19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f2893fff640 1 -- 172.21.15.12:0/1186064812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289c101de0 msgr2=0x7f289c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f2893fff640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289c101de0 0x7f289c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.799+0000 7f2893fff640 1 -- 172.21.15.12:0/1186064812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c19d350 con 0x7f289c102790 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.800+0000 7f2893fff640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f289c102790 0x7f289c1988e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f288c00c920 tx=0x7f288c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.800+0000 7f2891ffb640 1 -- 172.21.15.12:0/1186064812 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c007c70 con 0x7f289c102790 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.800+0000 7f28a2b06640 1 -- 172.21.15.12:0/1186064812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289c19d640 con 0x7f289c102790 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.800+0000 7f2891ffb640 1 -- 172.21.15.12:0/1186064812 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f288c007e10 con 0x7f289c102790 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.800+0000 7f2891ffb640 1 -- 172.21.15.12:0/1186064812 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c018890 con 0x7f289c102790 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.800+0000 7f28a2b06640 1 -- 172.21.15.12:0/1186064812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f289c1a4f20 con 0x7f289c102790 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.802+0000 7f2891ffb640 1 -- 172.21.15.12:0/1186064812 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f288c018a70 con 0x7f289c102790 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a4edf740 1 Processor -- start 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a4edf740 1 -- start start 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a41f8d0 0x560c7a41fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 0x560c7a42ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a42efc0 0x560c7a4313b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a4edf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560c7a386090 con 0x560c7a41f8d0 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a4edf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560c7a32da70 con 0x560c7a4201f0 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a4edf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560c7a382050 con 0x560c7a42efc0 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a10a3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a41f8d0 0x560c7a41fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a10a3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a41f8d0 0x560c7a41fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39602/0 (socket says 172.21.15.12:39602) 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a10a3640 1 -- 172.21.15.12:0/4150700844 learned_addr learned my addr 172.21.15.12:0/4150700844 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a08a2640 1 --2- 172.21.15.12:0/4150700844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 0x560c7a42ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f2891ffb640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f28840a3240 0x7f28840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f2893fff640 1 --2- 172.21.15.12:0/4150700844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a42efc0 0x560c7a4313b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f28a10a3640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f28840a3240 0x7f28840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.803+0000 7f2891ffb640 1 -- 172.21.15.12:0/1186064812 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f288c0cfdc0 con 0x7f289c102790 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f28a10a3640 1 -- 172.21.15.12:0/4150700844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a42efc0 msgr2=0x560c7a4313b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f28a10a3640 1 --2- 172.21.15.12:0/4150700844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a42efc0 0x560c7a4313b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f28a10a3640 1 -- 172.21.15.12:0/4150700844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 msgr2=0x560c7a42ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f28a10a3640 1 --2- 172.21.15.12:0/4150700844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 0x560c7a42ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f28a10a3640 1 -- 172.21.15.12:0/4150700844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c7a33a130 con 0x560c7a41f8d0 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f28a08a2640 1 --2- 172.21.15.12:0/4150700844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 0x560c7a42ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f28a10a3640 1 --2- 172.21.15.12:0/4150700844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a41f8d0 0x560c7a41fcb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f28940129f0 tx=0x7f2894012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1f269cfdca047 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f2882ffd640 1 -- 172.21.15.12:0/4150700844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894023070 con 0x560c7a41f8d0 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f2882ffd640 1 -- 172.21.15.12:0/4150700844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2894004710 con 0x560c7a41f8d0 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f2882ffd640 1 -- 172.21.15.12:0/4150700844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289401f960 con 0x560c7a41f8d0 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.804+0000 7f28a10a3640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f28840a3240 0x7f28840a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2894022000 tx=0x7f2894021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 -- 172.21.15.12:0/4150700844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a41f8d0 msgr2=0x560c7a41fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 --2- 172.21.15.12:0/4150700844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a41f8d0 0x560c7a41fcb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f28940129f0 tx=0x7f2894012eb0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 -- 172.21.15.12:0/4150700844 shutdown_connections 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 --2- 172.21.15.12:0/4150700844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a42efc0 0x560c7a4313b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 --2- 172.21.15.12:0/4150700844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 0x560c7a42ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 --2- 172.21.15.12:0/4150700844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a41f8d0 0x560c7a41fcb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 -- 172.21.15.12:0/4150700844 >> 172.21.15.12:0/4150700844 conn(0x560c7a41bf60 msgr2=0x560c7a41c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 -- 172.21.15.12:0/4150700844 shutdown_connections 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 -- 172.21.15.12:0/4150700844 wait complete. 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 -- start start 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.805+0000 7f28a4edf740 1 Processor -- start 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a41f8d0 0x560c7a42e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 0x560c7a42bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a42efc0 0x560c7a42c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a4edf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560c7a431bf0 con 0x560c7a42efc0 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a4edf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560c7a340f20 con 0x560c7a4201f0 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a4edf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560c7a431d70 con 0x560c7a41f8d0 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a4edf740 10 client.0 _ll_register_callbacks cb 0x560c7a30a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a10a3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a42efc0 0x560c7a42c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a10a3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a42efc0 0x560c7a42c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39604/0 (socket says 172.21.15.12:39604) 2024-09-16T01:00:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a10a3640 1 -- 172.21.15.12:0/3218116954 learned_addr learned my addr 172.21.15.12:0/3218116954 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f2893fff640 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 0x560c7a42bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a08a2640 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a41f8d0 0x560c7a42e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a10a3640 1 -- 172.21.15.12:0/3218116954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a41f8d0 msgr2=0x560c7a42e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a10a3640 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a41f8d0 0x560c7a42e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a10a3640 1 -- 172.21.15.12:0/3218116954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 msgr2=0x560c7a42bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a10a3640 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 0x560c7a42bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a10a3640 1 -- 172.21.15.12:0/3218116954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c7a0f72b0 con 0x560c7a42efc0 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f28a10a3640 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a42efc0 0x560c7a42c100 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2894009730 tx=0x7f2894005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66f3c1887eba716 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.806+0000 7f287bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f287bfff640 1 -- 172.21.15.12:0/3218116954 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894023070 con 0x560c7a42efc0 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f287bfff640 1 -- 172.21.15.12:0/3218116954 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f28940042d0 con 0x560c7a42efc0 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f28a4edf740 1 -- 172.21.15.12:0/3218116954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2894004710 con 0x560c7a42efc0 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f287bfff640 1 -- 172.21.15.12:0/3218116954 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f28940044d0 con 0x560c7a42efc0 2024-09-16T01:00:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f28a4edf740 10 client.15258 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f28a4edf740 1 -- 172.21.15.12:0/3218116954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560c7a43d550 con 0x560c7a42efc0 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f287bfff640 1 -- 172.21.15.12:0/3218116954 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2894004710 con 0x560c7a42efc0 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f287bfff640 1 -- 172.21.15.12:0/3218116954 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f289402e070 con 0x560c7a42efc0 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f28a4edf740 10 client.15258 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f28a4edf740 10 client.15258 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f28a4edf740 20 client.15258 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f28a4edf740 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x560c7a43fa20 0x560c7a440e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f28a4edf740 4 client.15258 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f28a4edf740 1 -- 172.21.15.12:0/3218116954 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c7a393600 con 0x560c7a43fa20 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.807+0000 7f28a08a2640 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x560c7a43fa20 0x560c7a440e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.808+0000 7f28a08a2640 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x560c7a43fa20 0x560c7a440e90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51497b87997565a5 server_cookie=e67c081e9805b2df in_seq=0 out_seq=0 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.808+0000 7f287bfff640 10 client.15258 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f287bfff640 1 -- 172.21.15.12:0/3218116954 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c7a393600 con 0x560c7a43fa20 2024-09-16T01:00:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f287bfff640 10 client.15258 handle_command_reply: tid=0 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 client.15258 shutdown 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 -- 172.21.15.12:0/3218116954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a42efc0 msgr2=0x560c7a42c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a42efc0 0x560c7a42c100 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2894009730 tx=0x7f2894005b00 comp rx=0 tx=0).stop 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 -- 172.21.15.12:0/3218116954 shutdown_connections 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x560c7a43fa20 0x560c7a440e90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a42efc0 0x560c7a42c100 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a4201f0 0x560c7a42bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f287bfff640 0 client.15258 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 --2- 172.21.15.12:0/3218116954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a41f8d0 0x560c7a42e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 -- 172.21.15.12:0/3218116954 >> 172.21.15.12:0/3218116954 conn(0x560c7a41bf60 msgr2=0x560c7a421c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 -- 172.21.15.12:0/3218116954 shutdown_connections 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 1 -- 172.21.15.12:0/3218116954 wait complete. 2024-09-16T01:00:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.809+0000 7f28a4edf740 20 client.15258 trim_cache size 0 max 16384 2024-09-16T01:00:57.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.827+0000 7f28a4edf740 1 Processor -- start 2024-09-16T01:00:57.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.827+0000 7f28a4edf740 1 -- start start 2024-09-16T01:00:57.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.827+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a41f8d0 0x560c7a42a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.827+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a42a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.827+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a42efc0 0x560c7a428e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.827+0000 7f28a4edf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560c7a43f1d0 con 0x560c7a4201f0 2024-09-16T01:00:57.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.827+0000 7f28a4edf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560c7a43f8a0 con 0x560c7a42efc0 2024-09-16T01:00:57.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.827+0000 7f28a4edf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560c7a43ff70 con 0x560c7a41f8d0 2024-09-16T01:00:57.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.827+0000 7f2893fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a42a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f2893fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a42a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39610/0 (socket says 172.21.15.12:39610) 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f2893fff640 1 -- 172.21.15.12:0/2406847934 learned_addr learned my addr 172.21.15.12:0/2406847934 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f28a10a3640 1 --2- 172.21.15.12:0/2406847934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a42efc0 0x560c7a428e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f28a08a2640 1 --2- 172.21.15.12:0/2406847934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a41f8d0 0x560c7a42a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f2893fff640 1 -- 172.21.15.12:0/2406847934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a41f8d0 msgr2=0x560c7a42a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f2893fff640 1 --2- 172.21.15.12:0/2406847934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a41f8d0 0x560c7a42a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f2893fff640 1 -- 172.21.15.12:0/2406847934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a42efc0 msgr2=0x560c7a428e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f2893fff640 1 --2- 172.21.15.12:0/2406847934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a42efc0 0x560c7a428e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f2893fff640 1 -- 172.21.15.12:0/2406847934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c7a420f30 con 0x560c7a4201f0 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f2893fff640 1 --2- 172.21.15.12:0/2406847934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a42a9d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f288c09bd80 tx=0x7f288c06ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de812bf46ad7820 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f28827fc640 1 -- 172.21.15.12:0/2406847934 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c09c780 con 0x560c7a4201f0 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f28827fc640 1 -- 172.21.15.12:0/2406847934 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f288c09c080 con 0x560c7a4201f0 2024-09-16T01:00:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.828+0000 7f28827fc640 1 -- 172.21.15.12:0/2406847934 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c0a0110 con 0x560c7a4201f0 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 -- 172.21.15.12:0/2406847934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 msgr2=0x560c7a42a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 --2- 172.21.15.12:0/2406847934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a42a9d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f288c09bd80 tx=0x7f288c06ef00 comp rx=0 tx=0).stop 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 -- 172.21.15.12:0/2406847934 shutdown_connections 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 --2- 172.21.15.12:0/2406847934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a42efc0 0x560c7a428e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 --2- 172.21.15.12:0/2406847934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a42a9d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 --2- 172.21.15.12:0/2406847934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a41f8d0 0x560c7a42a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 -- 172.21.15.12:0/2406847934 >> 172.21.15.12:0/2406847934 conn(0x560c7a41bf60 msgr2=0x560c7a420760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 -- 172.21.15.12:0/2406847934 shutdown_connections 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 -- 172.21.15.12:0/2406847934 wait complete. 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 -- start start 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.829+0000 7f28a4edf740 1 Processor -- start 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a41f8d0 0x560c7a449850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a441fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a4edf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a42efc0 0x560c7a4424e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a4edf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560c7a440d10 con 0x560c7a4201f0 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a4edf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560c7a440640 con 0x560c7a41f8d0 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a4edf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560c7a4413e0 con 0x560c7a42efc0 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a4edf740 10 client.0 _ll_register_callbacks cb 0x7f2898009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f2893fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a441fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a08a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a41f8d0 0x560c7a449850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f2893fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a441fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39622/0 (socket says 172.21.15.12:39622) 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f2893fff640 1 -- 172.21.15.12:0/1013104566 learned_addr learned my addr 172.21.15.12:0/1013104566 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a10a3640 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a42efc0 0x560c7a4424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a08a2640 1 -- 172.21.15.12:0/1013104566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a42efc0 msgr2=0x560c7a4424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a08a2640 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a42efc0 0x560c7a4424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a08a2640 1 -- 172.21.15.12:0/1013104566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 msgr2=0x560c7a441fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:57.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a08a2640 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a441fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f28a08a2640 1 -- 172.21.15.12:0/1013104566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c7a442ba0 con 0x560c7a41f8d0 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.830+0000 7f2893fff640 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a441fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f28a08a2640 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a41f8d0 0x560c7a449850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f289802a9e0 tx=0x7f28980043a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95a107cfa78dd581 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f287bfff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f287bfff640 1 -- 172.21.15.12:0/1013104566 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898049070 con 0x560c7a41f8d0 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f287bfff640 1 -- 172.21.15.12:0/1013104566 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f2898005590 con 0x560c7a41f8d0 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f28a4edf740 1 -- 172.21.15.12:0/1013104566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f288c09c080 con 0x560c7a41f8d0 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f287bfff640 1 -- 172.21.15.12:0/1013104566 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2898055050 con 0x560c7a41f8d0 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f28a4edf740 10 client.24962 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f28a4edf740 1 -- 172.21.15.12:0/1013104566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560c7a4a9070 con 0x560c7a41f8d0 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f287bfff640 1 -- 172.21.15.12:0/1013104566 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f288c09c080 con 0x560c7a41f8d0 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f287bfff640 1 -- 172.21.15.12:0/1013104566 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2898031ae0 con 0x560c7a41f8d0 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f28a4edf740 10 client.24962 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:57.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f28a4edf740 10 client.24962 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f28a4edf740 20 client.24962 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f28a4edf740 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x560c7a4adbd0 0x560c7a4ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f28a4edf740 4 client.24962 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.831+0000 7f28a4edf740 1 -- 172.21.15.12:0/1013104566 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "status"}) -- 0x560c7a38db10 con 0x560c7a4adbd0 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f2893fff640 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x560c7a4adbd0 0x560c7a4ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f2893fff640 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x560c7a4adbd0 0x560c7a4ac8e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2ce3b5497fd1eb5 server_cookie=347ed93015cf1105 in_seq=0 out_seq=0 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f287bfff640 10 client.24962 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f287bfff640 1 -- 172.21.15.12:0/1013104566 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560c7a38db10 con 0x560c7a4adbd0 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f287bfff640 10 client.24962 handle_command_reply: tid=0 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 client.24962 shutdown 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 -- 172.21.15.12:0/1013104566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a41f8d0 msgr2=0x560c7a449850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a41f8d0 0x560c7a449850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f289802a9e0 tx=0x7f28980043a0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 -- 172.21.15.12:0/1013104566 shutdown_connections 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x560c7a4adbd0 0x560c7a4ac8e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560c7a42efc0 0x560c7a4424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7a4201f0 0x560c7a441fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f287bfff640 0 client.24962 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 --2- 172.21.15.12:0/1013104566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c7a41f8d0 0x560c7a449850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 -- 172.21.15.12:0/1013104566 >> 172.21.15.12:0/1013104566 conn(0x560c7a41bf60 msgr2=0x560c7a426a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 -- 172.21.15.12:0/1013104566 shutdown_connections 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.832+0000 7f28a4edf740 1 -- 172.21.15.12:0/1013104566 wait complete. 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a4edf740 20 client.24962 trim_cache size 0 max 16384 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:00:57.844 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 1, 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24482, 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 99.091093364000002, 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 162.62589750800001 2024-09-16T01:00:57.845 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:00:57.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 -- 172.21.15.12:0/1186064812 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f28840a3240 msgr2=0x7f28840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f28840a3240 0x7f28840a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2894022000 tx=0x7f2894021000 comp rx=0 tx=0).stop 2024-09-16T01:00:57.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 -- 172.21.15.12:0/1186064812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f289c102790 msgr2=0x7f289c1988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f289c102790 0x7f289c1988e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f288c00c920 tx=0x7f288c00cde0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 -- 172.21.15.12:0/1186064812 shutdown_connections 2024-09-16T01:00:57.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f28840a3240 0x7f28840a5700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f289c106f10 0x7f289c19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f289c102790 0x7f289c1988e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 --2- 172.21.15.12:0/1186064812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f289c101de0 0x7f289c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 -- 172.21.15.12:0/1186064812 >> 172.21.15.12:0/1186064812 conn(0x7f289c0fd8c0 msgr2=0x7f289c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:57.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 -- 172.21.15.12:0/1186064812 shutdown_connections 2024-09-16T01:00:57.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:57.833+0000 7f28a2b06640 1 -- 172.21.15.12:0/1186064812 wait complete. 2024-09-16T01:00:58.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-16T01:00:58.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:00:58 smithi012 ceph-mon[31197]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 90 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:58.868 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:58.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:00:58 smithi098 ceph-mon[35346]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 90 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:00:58 smithi119 ceph-mon[35049]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 90 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:00:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.333+0000 7f4a5032c640 1 -- 172.21.15.12:0/516324916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a48103660 msgr2=0x7f4a4810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.333+0000 7f4a5032c640 1 --2- 172.21.15.12:0/516324916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a48103660 0x7f4a4810bb50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009900 tx=0x7f4a3802a480 comp rx=0 tx=0).stop 2024-09-16T01:00:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 -- 172.21.15.12:0/516324916 shutdown_connections 2024-09-16T01:00:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 --2- 172.21.15.12:0/516324916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a4810c170 0x7f4a4810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 --2- 172.21.15.12:0/516324916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a48103660 0x7f4a4810bb50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 --2- 172.21.15.12:0/516324916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a48102d40 0x7f4a48103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 -- 172.21.15.12:0/516324916 >> 172.21.15.12:0/516324916 conn(0x7f4a480fc7a0 msgr2=0x7f4a480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 -- 172.21.15.12:0/516324916 shutdown_connections 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 -- 172.21.15.12:0/516324916 wait complete. 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 Processor -- start 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 -- start start 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a48102d40 0x7f4a48198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a48103660 0x7f4a48198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a4810c170 0x7f4a4819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4a48111f70 con 0x7f4a48102d40 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4a48111df0 con 0x7f4a4810c170 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.334+0000 7f4a5032c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4a481120f0 con 0x7f4a48103660 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e0c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a48102d40 0x7f4a48198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e0c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a48102d40 0x7f4a48198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39632/0 (socket says 172.21.15.12:39632) 2024-09-16T01:00:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e0c8640 1 -- 172.21.15.12:0/2148112485 learned_addr learned my addr 172.21.15.12:0/2148112485 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a4810c170 0x7f4a4819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4d8c7640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a48103660 0x7f4a48198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e0c8640 1 -- 172.21.15.12:0/2148112485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a48103660 msgr2=0x7f4a48198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a48103660 0x7f4a48198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e0c8640 1 -- 172.21.15.12:0/2148112485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a4810c170 msgr2=0x7f4a4819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a4810c170 0x7f4a4819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e0c8640 1 -- 172.21.15.12:0/2148112485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4819d400 con 0x7f4a48102d40 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a4810c170 0x7f4a4819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a48102d40 0x7f4a48198450 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400d950 tx=0x7f4a4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a3f7fe640 1 -- 172.21.15.12:0/2148112485 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44017030 con 0x7f4a48102d40 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a5032c640 1 -- 172.21.15.12:0/2148112485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a4819d6f0 con 0x7f4a48102d40 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a3f7fe640 1 -- 172.21.15.12:0/2148112485 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a44004020 con 0x7f4a48102d40 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a3f7fe640 1 -- 172.21.15.12:0/2148112485 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440047a0 con 0x7f4a48102d40 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.335+0000 7f4a5032c640 1 -- 172.21.15.12:0/2148112485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a481a4fd0 con 0x7f4a48102d40 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.338+0000 7f4a3f7fe640 1 -- 172.21.15.12:0/2148112485 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4a440041d0 con 0x7f4a48102d40 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.338+0000 7f4a52705740 1 Processor -- start 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.338+0000 7f4a52705740 1 -- start start 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.338+0000 7f4a52705740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x5591545f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.338+0000 7f4a52705740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x559154602670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.338+0000 7f4a52705740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x559154604fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.338+0000 7f4a52705740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55915455e090 con 0x5591545f79d0 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.338+0000 7f4a52705740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559154505a70 con 0x5591545f82f0 2024-09-16T01:00:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.338+0000 7f4a52705740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55915455a050 con 0x559154602bb0 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.338+0000 7f4a3f7fe640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4a340a3240 0x7f4a340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e8c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x5591545f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e8c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x5591545f7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39644/0 (socket says 172.21.15.12:39644) 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e8c9640 1 -- 172.21.15.12:0/2636670166 learned_addr learned my addr 172.21.15.12:0/2636670166 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4a340a3240 0x7f4a340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a3f7fe640 1 -- 172.21.15.12:0/2148112485 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f4a440cf760 con 0x7f4a48102d40 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x559154602670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e8c9640 1 -- 172.21.15.12:0/2636670166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 msgr2=0x559154604fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4d8c7640 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x559154604fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x559154604fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e8c9640 1 -- 172.21.15.12:0/2636670166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 msgr2=0x559154602670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x559154602670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e8c9640 1 -- 172.21.15.12:0/2636670166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559154512130 con 0x5591545f79d0 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4d8c7640 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x559154604fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x559154602670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x5591545f7db0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4a400129d0 tx=0x7f4a40012e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414db89425ec605d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a3cdea640 1 -- 172.21.15.12:0/2636670166 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4001d9d0 con 0x5591545f79d0 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a3cdea640 1 -- 172.21.15.12:0/2636670166 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a40022070 con 0x5591545f79d0 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.339+0000 7f4a3cdea640 1 -- 172.21.15.12:0/2636670166 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4001c360 con 0x5591545f79d0 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.340+0000 7f4a52705740 1 -- 172.21.15.12:0/2636670166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 msgr2=0x5591545f7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.340+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4a340a3240 0x7f4a340a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a40021000 tx=0x7f4a4001d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.340+0000 7f4a52705740 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x5591545f7db0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4a400129d0 tx=0x7f4a40012e90 comp rx=0 tx=0).stop 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.340+0000 7f4a52705740 1 -- 172.21.15.12:0/2636670166 shutdown_connections 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.340+0000 7f4a52705740 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x559154604fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.340+0000 7f4a52705740 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x559154602670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.340+0000 7f4a52705740 1 --2- 172.21.15.12:0/2636670166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x5591545f7db0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.340+0000 7f4a52705740 1 -- 172.21.15.12:0/2636670166 >> 172.21.15.12:0/2636670166 conn(0x5591545f3f60 msgr2=0x5591545f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.340+0000 7f4a52705740 1 -- 172.21.15.12:0/2636670166 shutdown_connections 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.340+0000 7f4a52705740 1 -- 172.21.15.12:0/2636670166 wait complete. 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a52705740 1 -- start start 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a52705740 1 Processor -- start 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a52705740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591545f79d0 0x559154602400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a52705740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x5591545ff750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a52705740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559154602bb0 0x5591545ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a52705740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559154605780 con 0x559154602bb0 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a52705740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559154518f20 con 0x5591545f82f0 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a52705740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559154605900 con 0x5591545f79d0 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a52705740 10 client.0 _ll_register_callbacks cb 0x5591544e2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4e8c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559154602bb0 0x5591545ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4e8c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559154602bb0 0x5591545ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39646/0 (socket says 172.21.15.12:39646) 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4e8c9640 1 -- 172.21.15.12:0/1554750746 learned_addr learned my addr 172.21.15.12:0/1554750746 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4d8c7640 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x5591545ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591545f79d0 0x559154602400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4e8c9640 1 -- 172.21.15.12:0/1554750746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591545f79d0 msgr2=0x559154602400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591545f79d0 0x559154602400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4e8c9640 1 -- 172.21.15.12:0/1554750746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 msgr2=0x5591545ff750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x5591545ff750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4e8c9640 1 -- 172.21.15.12:0/1554750746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591542cf2b0 con 0x559154602bb0 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.341+0000 7f4a4d8c7640 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x5591545ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559154602bb0 0x5591545ffc90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4a400108c0 tx=0x7f4a40009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db870d2390d16f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a31ffb640 1 -- 172.21.15.12:0/1554750746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40033020 con 0x559154602bb0 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a52705740 1 -- 172.21.15.12:0/1554750746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a40022070 con 0x559154602bb0 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a31ffb640 1 -- 172.21.15.12:0/1554750746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f4a4001d7d0 con 0x559154602bb0 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a31ffb640 1 -- 172.21.15.12:0/1554750746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4a4003e050 con 0x559154602bb0 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a52705740 10 client.15276 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a52705740 1 -- 172.21.15.12:0/1554750746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559154610fc0 con 0x559154602bb0 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a31ffb640 1 -- 172.21.15.12:0/1554750746 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a40022070 con 0x559154602bb0 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a31ffb640 1 -- 172.21.15.12:0/1554750746 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4a4002f8d0 con 0x559154602bb0 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.342+0000 7f4a52705740 10 client.15276 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.343+0000 7f4a52705740 10 client.15276 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.343+0000 7f4a52705740 20 client.15276 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.343+0000 7f4a52705740 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559154613410 0x559154614880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.343+0000 7f4a52705740 4 client.15276 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.343+0000 7f4a52705740 1 -- 172.21.15.12:0/1554750746 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55915456b600 con 0x559154613410 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.343+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559154613410 0x559154614880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.343+0000 7f4a31ffb640 10 client.15276 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.343+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559154613410 0x559154614880 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c95180a4e6713fa server_cookie=7093386e60709729 in_seq=0 out_seq=0 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a31ffb640 1 -- 172.21.15.12:0/1554750746 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55915456b600 con 0x559154613410 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a31ffb640 10 client.15276 handle_command_reply: tid=0 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 client.15276 shutdown 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 -- 172.21.15.12:0/1554750746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559154602bb0 msgr2=0x5591545ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559154602bb0 0x5591545ffc90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4a400108c0 tx=0x7f4a40009a70 comp rx=0 tx=0).stop 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 -- 172.21.15.12:0/1554750746 shutdown_connections 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559154613410 0x559154614880 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a31ffb640 0 client.15276 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:00:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559154602bb0 0x5591545ffc90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x5591545ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 --2- 172.21.15.12:0/1554750746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591545f79d0 0x559154602400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 -- 172.21.15.12:0/1554750746 >> 172.21.15.12:0/1554750746 conn(0x5591545f3f60 msgr2=0x5591545f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 -- 172.21.15.12:0/1554750746 shutdown_connections 2024-09-16T01:00:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.344+0000 7f4a52705740 1 -- 172.21.15.12:0/1554750746 wait complete. 2024-09-16T01:00:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.345+0000 7f4a52705740 20 client.15276 trim_cache size 0 max 16384 2024-09-16T01:00:59.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.362+0000 7f4a52705740 1 Processor -- start 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.362+0000 7f4a52705740 1 -- start start 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a52705740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x559154614880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a52705740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x5591546123d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a52705740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x5591546015b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a52705740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559154612bc0 con 0x5591545f79d0 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a52705740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559154613290 con 0x5591545f82f0 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a52705740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559154613960 con 0x559154602bb0 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4e0c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x559154614880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4e0c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x559154614880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39654/0 (socket says 172.21.15.12:39654) 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4e0c8640 1 -- 172.21.15.12:0/209341652 learned_addr learned my addr 172.21.15.12:0/209341652 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/209341652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x5591546015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4d8c7640 1 --2- 172.21.15.12:0/209341652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x5591546123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4e0c8640 1 -- 172.21.15.12:0/209341652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 msgr2=0x5591546015b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/209341652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x5591546015b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4e0c8640 1 -- 172.21.15.12:0/209341652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 msgr2=0x5591546123d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/209341652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x5591546123d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4e0c8640 1 -- 172.21.15.12:0/209341652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559154600ad0 con 0x5591545f79d0 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/209341652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x559154614880 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4a44009610 tx=0x7f4a44005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7d6fc2f875d370 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a33fff640 1 -- 172.21.15.12:0/209341652 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440b3070 con 0x5591545f79d0 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a33fff640 1 -- 172.21.15.12:0/209341652 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a4409fd70 con 0x5591545f79d0 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.363+0000 7f4a33fff640 1 -- 172.21.15.12:0/209341652 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440cf3e0 con 0x5591545f79d0 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.364+0000 7f4a52705740 1 -- 172.21.15.12:0/209341652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 msgr2=0x559154614880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.364+0000 7f4a52705740 1 --2- 172.21.15.12:0/209341652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x559154614880 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4a44009610 tx=0x7f4a44005bf0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.364+0000 7f4a52705740 1 -- 172.21.15.12:0/209341652 shutdown_connections 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.364+0000 7f4a52705740 1 --2- 172.21.15.12:0/209341652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x5591546015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.364+0000 7f4a52705740 1 --2- 172.21.15.12:0/209341652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f82f0 0x5591546123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.364+0000 7f4a52705740 1 --2- 172.21.15.12:0/209341652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f79d0 0x559154614880 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.364+0000 7f4a52705740 1 -- 172.21.15.12:0/209341652 >> 172.21.15.12:0/209341652 conn(0x5591545f3f60 msgr2=0x559154600ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.364+0000 7f4a52705740 1 -- 172.21.15.12:0/209341652 shutdown_connections 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.364+0000 7f4a52705740 1 -- 172.21.15.12:0/209341652 wait complete. 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.364+0000 7f4a52705740 1 -- start start 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a52705740 1 Processor -- start 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a52705740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f79d0 0x55915461cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a52705740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f82f0 0x5591546182b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a52705740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x5591546187f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a52705740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559154614700 con 0x5591545f82f0 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a52705740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559154614030 con 0x5591545f79d0 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a52705740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559154614dd0 con 0x559154602bb0 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a52705740 10 client.0 _ll_register_callbacks cb 0x7f4a400127d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4d8c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f82f0 0x5591546182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4d8c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f82f0 0x5591546182b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39666/0 (socket says 172.21.15.12:39666) 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4d8c7640 1 -- 172.21.15.12:0/3500986572 learned_addr learned my addr 172.21.15.12:0/3500986572 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x5591546187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f79d0 0x55915461cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4d8c7640 1 -- 172.21.15.12:0/3500986572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 msgr2=0x5591546187f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4d8c7640 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x5591546187f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4d8c7640 1 -- 172.21.15.12:0/3500986572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f79d0 msgr2=0x55915461cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4d8c7640 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f79d0 0x55915461cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4d8c7640 1 -- 172.21.15.12:0/3500986572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559154618d30 con 0x5591545f82f0 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.365+0000 7f4a4e8c9640 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x5591546187f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a4d8c7640 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f82f0 0x5591546182b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4a38005ab0 tx=0x7f4a38031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfc512e347cae7d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a31ffb640 1 -- 172.21.15.12:0/3500986572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38035050 con 0x5591545f82f0 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a31ffb640 1 -- 172.21.15.12:0/3500986572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f4a38004450 con 0x5591545f82f0 2024-09-16T01:00:59.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a52705740 1 -- 172.21.15.12:0/3500986572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a4409fd70 con 0x5591545f82f0 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a31ffb640 1 -- 172.21.15.12:0/3500986572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4a38050050 con 0x5591545f82f0 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a52705740 10 client.15282 fetch_fsmap learned FSMap version 28 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a52705740 1 -- 172.21.15.12:0/3500986572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55915467d840 con 0x5591545f82f0 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a31ffb640 1 -- 172.21.15.12:0/3500986572 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a4409fd70 con 0x5591545f82f0 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a31ffb640 1 -- 172.21.15.12:0/3500986572 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4a3803dc50 con 0x5591545f82f0 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a52705740 10 client.15282 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a52705740 10 client.15282 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a52705740 20 client.15282 populate_metadata read hostname 'smithi012' 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a52705740 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559154613410 0x559154681150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a52705740 4 client.15282 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.366+0000 7f4a52705740 1 -- 172.21.15.12:0/3500986572 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "status"}) -- 0x559154565b10 con 0x559154613410 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.367+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559154613410 0x559154681150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.367+0000 7f4a31ffb640 10 client.15282 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:00:59.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.367+0000 7f4a4e0c8640 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559154613410 0x559154681150 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2d5b3070c887d3 server_cookie=a48db89896701b90 in_seq=0 out_seq=0 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.367+0000 7f4a31ffb640 1 -- 172.21.15.12:0/3500986572 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x559154565b10 con 0x559154613410 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.367+0000 7f4a31ffb640 10 client.15282 handle_command_reply: tid=0 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.367+0000 7f4a52705740 1 client.15282 shutdown 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 1 -- 172.21.15.12:0/3500986572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f82f0 msgr2=0x5591546182b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f82f0 0x5591546182b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4a38005ab0 tx=0x7f4a38031860 comp rx=0 tx=0).stop 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 1 -- 172.21.15.12:0/3500986572 shutdown_connections 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559154613410 0x559154681150 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559154602bb0 0x5591546187f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591545f82f0 0x5591546182b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 1 --2- 172.21.15.12:0/3500986572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591545f79d0 0x55915461cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 1 -- 172.21.15.12:0/3500986572 >> 172.21.15.12:0/3500986572 conn(0x5591545f3f60 msgr2=0x559154601500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a31ffb640 0 client.15282 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:00:59.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 1 -- 172.21.15.12:0/3500986572 shutdown_connections 2024-09-16T01:00:59.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 1 -- 172.21.15.12:0/3500986572 wait complete. 2024-09-16T01:00:59.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a52705740 20 client.15282 trim_cache size 0 max 16384 2024-09-16T01:00:59.381 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:00:59.381 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:00:59.381 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-16T01:00:59.381 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24518, 2024-09-16T01:00:59.381 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:00:59.381 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:00:59.381 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:00:59.382 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 141.797791163, 2024-09-16T01:00:59.382 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-16T01:00:59.382 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-09-16T01:00:59.382 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-16T01:00:59.382 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 152.968344347 2024-09-16T01:00:59.382 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a5032c640 1 -- 172.21.15.12:0/2148112485 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4a340a3240 msgr2=0x7f4a340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a5032c640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4a340a3240 0x7f4a340a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a40021000 tx=0x7f4a4001d000 comp rx=0 tx=0).stop 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a5032c640 1 -- 172.21.15.12:0/2148112485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a48102d40 msgr2=0x7f4a48198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.368+0000 7f4a5032c640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a48102d40 0x7f4a48198450 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400d950 tx=0x7f4a4400de10 comp rx=0 tx=0).stop 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.369+0000 7f4a5032c640 1 -- 172.21.15.12:0/2148112485 shutdown_connections 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.369+0000 7f4a5032c640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4a340a3240 0x7f4a340a5700 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.369+0000 7f4a5032c640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a4810c170 0x7f4a4819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.369+0000 7f4a5032c640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a48103660 0x7f4a48198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.369+0000 7f4a5032c640 1 --2- 172.21.15.12:0/2148112485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a48102d40 0x7f4a48198450 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.369+0000 7f4a5032c640 1 -- 172.21.15.12:0/2148112485 >> 172.21.15.12:0/2148112485 conn(0x7f4a480fc7a0 msgr2=0x7f4a480fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.369+0000 7f4a5032c640 1 -- 172.21.15.12:0/2148112485 shutdown_connections 2024-09-16T01:00:59.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:00:59.369+0000 7f4a5032c640 1 -- 172.21.15.12:0/2148112485 wait complete. 2024-09-16T01:01:00.103 INFO:teuthology.run_tasks:Running task sequential... 2024-09-16T01:01:00.112 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-16T01:01:00.113 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-16T01:01:00.116 INFO:teuthology.task.print:Enabling mgr modules 2024-09-16T01:01:00.116 INFO:teuthology.run_tasks:Running task kclient... 2024-09-16T01:01:00.129 INFO:tasks.kclient:Mounting kernel clients... 2024-09-16T01:01:00.129 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-16T01:01:00.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:01:00.129 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-16T01:01:00.147 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-16T01:01:00.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:01:00.148 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:01:00.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:01:00.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-16T01:01:00.324 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-16T01:01:00.324 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:01:00.325 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:01:00.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-16T01:01:00.585 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:00.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:00 smithi098 ceph-mon[35346]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:01:01.004 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:00 smithi012 ceph-mon[31197]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:01:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:00 smithi119 ceph-mon[35049]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:01:01.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.086+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2788539802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ec10c170 msgr2=0x7fc4ec10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.086+0000 7fc4f3f7d640 1 --2- 172.21.15.12:0/2788539802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ec10c170 0x7fc4ec10e610 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009ca0 tx=0x7fc4e402a950 comp rx=0 tx=0).stop 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.086+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2788539802 shutdown_connections 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.086+0000 7fc4f3f7d640 1 --2- 172.21.15.12:0/2788539802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ec10c170 0x7fc4ec10e610 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.086+0000 7fc4f3f7d640 1 --2- 172.21.15.12:0/2788539802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ec103660 0x7fc4ec10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.086+0000 7fc4f3f7d640 1 --2- 172.21.15.12:0/2788539802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4ec102d40 0x7fc4ec103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.086+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2788539802 >> 172.21.15.12:0/2788539802 conn(0x7fc4ec0fc7a0 msgr2=0x7fc4ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.086+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2788539802 shutdown_connections 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.086+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2788539802 wait complete. 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f3f7d640 1 Processor -- start 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f3f7d640 1 -- start start 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f3f7d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ec102d40 0x7fc4ec198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:01.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f3f7d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4ec103660 0x7fc4ec198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f3f7d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ec10c170 0x7fc4ec19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f3f7d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec111fd0 con 0x7fc4ec10c170 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f3f7d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec111e50 con 0x7fc4ec103660 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f3f7d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec112150 con 0x7fc4ec102d40 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f251a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ec10c170 0x7fc4ec19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f251a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ec10c170 0x7fc4ec19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39688/0 (socket says 172.21.15.12:39688) 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f251a640 1 -- 172.21.15.12:0/2598035024 learned_addr learned my addr 172.21.15.12:0/2598035024 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f1d19640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ec102d40 0x7fc4ec198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f1518640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4ec103660 0x7fc4ec198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.087+0000 7fc4f251a640 1 -- 172.21.15.12:0/2598035024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ec102d40 msgr2=0x7fc4ec198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4f251a640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ec102d40 0x7fc4ec198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4f251a640 1 -- 172.21.15.12:0/2598035024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4ec103660 msgr2=0x7fc4ec198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:01.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4f251a640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4ec103660 0x7fc4ec198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4f251a640 1 -- 172.21.15.12:0/2598035024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec19d400 con 0x7fc4ec10c170 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4f1d19640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ec102d40 0x7fc4ec198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4f251a640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ec10c170 0x7fc4ec19cd20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc4e402ae70 tx=0x7fc4e402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4e2ffd640 1 -- 172.21.15.12:0/2598035024 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4034040 con 0x7fc4ec10c170 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4e2ffd640 1 -- 172.21.15.12:0/2598035024 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e4030920 con 0x7fc4ec10c170 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2598035024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ec19d690 con 0x7fc4ec10c170 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4e2ffd640 1 -- 172.21.15.12:0/2598035024 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4045480 con 0x7fc4ec10c170 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.088+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2598035024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ec1a4fd0 con 0x7fc4ec10c170 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.089+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2598035024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ec06b070 con 0x7fc4ec10c170 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.090+0000 7fc4e2ffd640 1 -- 172.21.15.12:0/2598035024 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc4e4037020 con 0x7fc4ec10c170 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.091+0000 7fc4e2ffd640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4d80a32c0 0x7fc4d80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.091+0000 7fc4f1d19640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4d80a32c0 0x7fc4d80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:01.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.091+0000 7fc4e2ffd640 1 -- 172.21.15.12:0/2598035024 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fc4e40f0cc0 con 0x7fc4ec10c170 2024-09-16T01:01:01.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.091+0000 7fc4f1d19640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4d80a32c0 0x7fc4d80a5780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8006fd0 tx=0x7fc4e8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:01.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.095+0000 7fc4e2ffd640 1 -- 172.21.15.12:0/2598035024 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc4e40f7080 con 0x7fc4ec10c170 2024-09-16T01:01:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.311+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2598035024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc4ec1997b0 con 0x7fc4ec10c170 2024-09-16T01:01:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.311+0000 7fc4e2ffd640 1 -- 172.21.15.12:0/2598035024 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7fc4e40bd620 con 0x7fc4ec10c170 2024-09-16T01:01:01.312 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:01:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2598035024 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4d80a32c0 msgr2=0x7fc4d80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4d80a32c0 0x7fc4d80a5780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8006fd0 tx=0x7fc4e8008040 comp rx=0 tx=0).stop 2024-09-16T01:01:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2598035024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ec10c170 msgr2=0x7fc4ec19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ec10c170 0x7fc4ec19cd20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc4e402ae70 tx=0x7fc4e402f5b0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2598035024 shutdown_connections 2024-09-16T01:01:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc4d80a32c0 0x7fc4d80a5780 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ec10c170 0x7fc4ec19cd20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4ec103660 0x7fc4ec198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 --2- 172.21.15.12:0/2598035024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4ec102d40 0x7fc4ec198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2598035024 >> 172.21.15.12:0/2598035024 conn(0x7fc4ec0fc7a0 msgr2=0x7fc4ec0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2598035024 shutdown_connections 2024-09-16T01:01:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:01.314+0000 7fc4f3f7d640 1 -- 172.21.15.12:0/2598035024 wait complete. 2024-09-16T01:01:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:01 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2598035024' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T01:01:01.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:01 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2598035024' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T01:01:02.015 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:01:02.015 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:01:02.015 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-16T01:01:02.015 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:01:02.016 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:01:02.016 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:01:02.016 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:01:02.016 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:01:02.016 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:01:02.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:01:02.016 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-16T01:01:02.034 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:01:02.034 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-16T01:01:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-16T01:01:02.036 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-16T01:01:02.036 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42200sec preferred_lft 42200sec 2024-09-16T01:01:02.036 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-16T01:01:02.036 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:01:02.036 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:01:02.036 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-16T01:01:02.036 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-16T01:01:02.036 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T01:01:02.036 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:01:02.036 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-16T01:01:02.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2024-09-16T01:01:02.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2024-09-16T01:01:02.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2024-09-16T01:01:02.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T01:01:02.037 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-16T01:01:02.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:01 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2598035024' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T01:01:02.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:01:02.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:01:02.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:01:02.181 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:01:02.205 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-16T01:01:02.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:01:02.207 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-16T01:01:02.264 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-16T01:01:02.264 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:01:02.264 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-16T01:01:02.265 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-16T01:01:02.265 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:01:02.265 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:01:02.265 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-16T01:01:02.265 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-16T01:01:02.265 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-16T01:01:02.265 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-16T01:01:02.265 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-16T01:01:02.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:01:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:01:02.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:01:02.394 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-16T01:01:02.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:01:02.410 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-09-16T01:01:02.467 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:01:02.468 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-16T01:01:02.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:01:02.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-16T01:01:02.468 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-16T01:01:02.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:01:02.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:01:02.587 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-16T01:01:02.587 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:01:02.587 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-16T01:01:02.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-16T01:01:02.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T01:01:02.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-16T01:01:02.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-16T01:01:02.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-16T01:01:02.587 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-16T01:01:02.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:01:02.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:01:02.707 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:01:02.707 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-16T01:01:02.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-16T01:01:02.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T01:01:02.707 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-16T01:01:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:01:02.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:01:02.785 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:01:02.786 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:01:02.801 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:01:02.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:01:02.802 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:01:02.857 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-16T01:01:02.857 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-16T01:01:02.857 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/c02c8b8a-a475-4c71-a880-51674f5240bb 2024-09-16T01:01:02.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:01:02.857 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/c02c8b8a-a475-4c71-a880-51674f5240bb /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-16T01:01:02.919 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:02 smithi012 ceph-mon[31197]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:01:02.942 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-16T01:01:02.942 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-16T01:01:02.942 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-16T01:01:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:02 smithi098 ceph-mon[35346]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:01:03.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:02 smithi119 ceph-mon[35049]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:01:03.096 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-16T01:01:03.096 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-16T01:01:03.097 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-16T01:01:03.097 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.98:3300,172.21.15.119:3300" 2024-09-16T01:01:03.097 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:3300,172.21.15.98:3300,172.21.15.119:3300:/volumes/qa/sv_1/c02c8b8a-a475-4c71-a880-51674f5240bb 2024-09-16T01:01:03.097 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=9a476aac-73c5-11ef-bceb-c7b262605968" will pass to kernel 2024-09-16T01:01:03.097 INFO:teuthology.orchestra.run.smithi012.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:01:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:01:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:01:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:01:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:01:03.099 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:01:03.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:01:03.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:01:03.171 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:01:03.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:01:03.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:01:03.269 INFO:teuthology.orchestra.run.smithi012.stdout:client24983 2024-09-16T01:01:03.269 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T01:01:03.269 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:01:03.287 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:01:03.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:01:03.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:01:03.385 INFO:teuthology.orchestra.run.smithi012.stdout:client24983 2024-09-16T01:01:03.385 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:01:03.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:01:03.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:01:03.442 INFO:teuthology.orchestra.run.smithi012.stdout:client24983 2024-09-16T01:01:03.443 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9a476aac-73c5-11ef-bceb-c7b262605968.client24983/status') 2024-09-16T01:01:03.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:01:03.502 INFO:teuthology.orchestra.run.smithi012.stdout:instance: client.24983 (3)172.21.15.12:0/3053763365 2024-09-16T01:01:03.503 INFO:teuthology.orchestra.run.smithi012.stdout:blocklisted: false 2024-09-16T01:01:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records in 2024-09-16T01:01:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records out 2024-09-16T01:01:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:71 bytes copied, 2.8725e-05 s, 2.5 MB/s 2024-09-16T01:01:03.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:01:03.510 INFO:teuthology.run_tasks:Running task exec... 2024-09-16T01:01:03.522 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T01:01:03.523 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-16T01:01:03.523 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-16T01:01:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.626+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/663333263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd281016b0 msgr2=0x7fdd28101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.626+0000 7fdd2fbfd640 1 --2- 172.21.15.12:0/663333263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd281016b0 0x7fdd28101b60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009ca0 tx=0x7fdd2002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.626+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/663333263 shutdown_connections 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.626+0000 7fdd2fbfd640 1 --2- 172.21.15.12:0/663333263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd281016b0 0x7fdd28101b60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.626+0000 7fdd2fbfd640 1 --2- 172.21.15.12:0/663333263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd28100d10 0x7fdd28101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.626+0000 7fdd2fbfd640 1 --2- 172.21.15.12:0/663333263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd281003d0 0x7fdd281007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.626+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/663333263 >> 172.21.15.12:0/663333263 conn(0x7fdd280fc1e0 msgr2=0x7fdd280fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/663333263 shutdown_connections 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/663333263 wait complete. 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2fbfd640 1 Processor -- start 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2fbfd640 1 -- start start 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2fbfd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd281003d0 0x7fdd28199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2fbfd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd28100d10 0x7fdd2819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2fbfd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd281016b0 0x7fdd281a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2fbfd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2810f9d0 con 0x7fdd281003d0 2024-09-16T01:01:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2fbfd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2810f850 con 0x7fdd281016b0 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2fbfd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2810fb50 con 0x7fdd28100d10 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2d999640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd281003d0 0x7fdd28199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2d999640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd281003d0 0x7fdd28199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39710/0 (socket says 172.21.15.12:39710) 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2d999640 1 -- 172.21.15.12:0/2959588490 learned_addr learned my addr 172.21.15.12:0/2959588490 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.627+0000 7fdd2e19a640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd281016b0 0x7fdd281a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd2d198640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd28100d10 0x7fdd2819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd2d999640 1 -- 172.21.15.12:0/2959588490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd28100d10 msgr2=0x7fdd2819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd2d999640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd28100d10 0x7fdd2819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd2d999640 1 -- 172.21.15.12:0/2959588490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd281016b0 msgr2=0x7fdd281a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd2d999640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd281016b0 0x7fdd281a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd2d999640 1 -- 172.21.15.12:0/2959588490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd281a1bb0 con 0x7fdd281003d0 2024-09-16T01:01:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd2d999640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd281003d0 0x7fdd28199f90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400d950 tx=0x7fdd2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd1effd640 1 -- 172.21.15.12:0/2959588490 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24017030 con 0x7fdd281003d0 2024-09-16T01:01:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd1effd640 1 -- 172.21.15.12:0/2959588490 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd24004020 con 0x7fdd281003d0 2024-09-16T01:01:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/2959588490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd281a1ea0 con 0x7fdd281003d0 2024-09-16T01:01:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd1effd640 1 -- 172.21.15.12:0/2959588490 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd240047a0 con 0x7fdd281003d0 2024-09-16T01:01:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.628+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/2959588490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd281a2300 con 0x7fdd281003d0 2024-09-16T01:01:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.629+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/2959588490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd2810b120 con 0x7fdd281003d0 2024-09-16T01:01:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.630+0000 7fdd1effd640 1 -- 172.21.15.12:0/2959588490 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdd240041d0 con 0x7fdd281003d0 2024-09-16T01:01:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.631+0000 7fdd1effd640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd140a32f0 0x7fdd140a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.631+0000 7fdd1effd640 1 -- 172.21.15.12:0/2959588490 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fdd240cf720 con 0x7fdd281003d0 2024-09-16T01:01:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.631+0000 7fdd2d198640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd140a32f0 0x7fdd140a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.631+0000 7fdd2d198640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd140a32f0 0x7fdd140a57b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdd2819b4a0 tx=0x7fdd18005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:03.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.635+0000 7fdd1effd640 1 -- 172.21.15.12:0/2959588490 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd2409c080 con 0x7fdd281003d0 2024-09-16T01:01:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:03.850+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/2959588490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fdd28062630 con 0x7fdd281003d0 2024-09-16T01:01:04.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.671+0000 7fdd1effd640 1 -- 172.21.15.12:0/2959588490 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7fdd2409b980 con 0x7fdd281003d0 2024-09-16T01:01:04.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/2959588490 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd140a32f0 msgr2=0x7fdd140a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:04.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd140a32f0 0x7fdd140a57b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdd2819b4a0 tx=0x7fdd18005be0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/2959588490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd281003d0 msgr2=0x7fdd28199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:04.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd281003d0 0x7fdd28199f90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400d950 tx=0x7fdd2400de10 comp rx=0 tx=0).stop 2024-09-16T01:01:04.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/2959588490 shutdown_connections 2024-09-16T01:01:04.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdd140a32f0 0x7fdd140a57b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd281016b0 0x7fdd281a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd28100d10 0x7fdd2819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 --2- 172.21.15.12:0/2959588490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd281003d0 0x7fdd28199f90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/2959588490 >> 172.21.15.12:0/2959588490 conn(0x7fdd280fc1e0 msgr2=0x7fdd280fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:04.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/2959588490 shutdown_connections 2024-09-16T01:01:04.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.674+0000 7fdd2fbfd640 1 -- 172.21.15.12:0/2959588490 wait complete. 2024-09-16T01:01:04.688 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-16T01:01:04.701 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-16T01:01:04.711 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:01:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.821+0000 7fb1b3559640 1 -- 172.21.15.12:0/4222942831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ac101c20 msgr2=0x7fb1ac1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.821+0000 7fb1b3559640 1 --2- 172.21.15.12:0/4222942831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ac101c20 0x7fb1ac1020a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009900 tx=0x7fb19c02a410 comp rx=0 tx=0).stop 2024-09-16T01:01:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.821+0000 7fb1b3559640 1 -- 172.21.15.12:0/4222942831 shutdown_connections 2024-09-16T01:01:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.821+0000 7fb1b3559640 1 --2- 172.21.15.12:0/4222942831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1ac1025e0 0x7fb1ac108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.821+0000 7fb1b3559640 1 --2- 172.21.15.12:0/4222942831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ac101c20 0x7fb1ac1020a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.821+0000 7fb1b3559640 1 --2- 172.21.15.12:0/4222942831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1ac100a30 0x7fb1ac100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.821+0000 7fb1b3559640 1 -- 172.21.15.12:0/4222942831 >> 172.21.15.12:0/4222942831 conn(0x7fb1ac0fc190 msgr2=0x7fb1ac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.821+0000 7fb1b3559640 1 -- 172.21.15.12:0/4222942831 shutdown_connections 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.821+0000 7fb1b3559640 1 -- 172.21.15.12:0/4222942831 wait complete. 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b3559640 1 Processor -- start 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b3559640 1 -- start start 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b3559640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1ac100a30 0x7fb1ac06af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b3559640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1ac101c20 0x7fb1ac19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b3559640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ac1025e0 0x7fb1ac19f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b3559640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac10c6b0 con 0x7fb1ac1025e0 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b3559640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac10c530 con 0x7fb1ac100a30 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b3559640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac10c830 con 0x7fb1ac101c20 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b1af6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ac1025e0 0x7fb1ac19f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b1af6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ac1025e0 0x7fb1ac19f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39724/0 (socket says 172.21.15.12:39724) 2024-09-16T01:01:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b1af6640 1 -- 172.21.15.12:0/251904580 learned_addr learned my addr 172.21.15.12:0/251904580 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b12f5640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1ac100a30 0x7fb1ac06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b0af4640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1ac101c20 0x7fb1ac19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b1af6640 1 -- 172.21.15.12:0/251904580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1ac101c20 msgr2=0x7fb1ac19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b1af6640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1ac101c20 0x7fb1ac19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b1af6640 1 -- 172.21.15.12:0/251904580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1ac100a30 msgr2=0x7fb1ac06af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b1af6640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1ac100a30 0x7fb1ac06af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b1af6640 1 -- 172.21.15.12:0/251904580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ac19faf0 con 0x7fb1ac1025e0 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b0af4640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1ac101c20 0x7fb1ac19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b12f5640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1ac100a30 0x7fb1ac06af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.822+0000 7fb1b1af6640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ac1025e0 0x7fb1ac19f1e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400cad0 tx=0x7fb1a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.823+0000 7fb1a27fc640 1 -- 172.21.15.12:0/251904580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400ae20 con 0x7fb1ac1025e0 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.823+0000 7fb1a27fc640 1 -- 172.21.15.12:0/251904580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1a4005020 con 0x7fb1ac1025e0 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.823+0000 7fb1b3559640 1 -- 172.21.15.12:0/251904580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ac19fd80 con 0x7fb1ac1025e0 2024-09-16T01:01:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.823+0000 7fb1a27fc640 1 -- 172.21.15.12:0/251904580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400f6f0 con 0x7fb1ac1025e0 2024-09-16T01:01:04.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.823+0000 7fb1b3559640 1 -- 172.21.15.12:0/251904580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ac1a0270 con 0x7fb1ac1025e0 2024-09-16T01:01:04.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.824+0000 7fb1b3559640 1 -- 172.21.15.12:0/251904580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1ac107dd0 con 0x7fb1ac1025e0 2024-09-16T01:01:04.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.825+0000 7fb1a27fc640 1 -- 172.21.15.12:0/251904580 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb1a40051d0 con 0x7fb1ac1025e0 2024-09-16T01:01:04.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.826+0000 7fb1a27fc640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb1980a3250 0x7fb1980a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:04.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.826+0000 7fb1b12f5640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb1980a3250 0x7fb1980a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:04.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.826+0000 7fb1a27fc640 1 -- 172.21.15.12:0/251904580 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fb1a40d0060 con 0x7fb1ac1025e0 2024-09-16T01:01:04.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.826+0000 7fb1b12f5640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb1980a3250 0x7fb1980a5710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac101a80 tx=0x7fb1a800a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:04.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:04.829+0000 7fb1a27fc640 1 -- 172.21.15.12:0/251904580 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1a4014030 con 0x7fb1ac1025e0 2024-09-16T01:01:04.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:04 smithi098 ceph-mon[35346]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:04.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:04 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2959588490' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-16T01:01:05.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.007+0000 7fb1b3559640 1 -- 172.21.15.12:0/251904580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1ac02da10 con 0x7fb1ac1025e0 2024-09-16T01:01:05.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.008+0000 7fb1a27fc640 1 -- 172.21.15.12:0/251904580 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24678 (secure 0 0 0) 0x7fb1a409ca20 con 0x7fb1ac1025e0 2024-09-16T01:01:05.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:05.009 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T01:00:45.617096+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:01:05.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.010+0000 7fb1b3559640 1 -- 172.21.15.12:0/251904580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb1980a3250 msgr2=0x7fb1980a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.010+0000 7fb1b3559640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb1980a3250 0x7fb1980a5710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac101a80 tx=0x7fb1a800a5e0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.010+0000 7fb1b3559640 1 -- 172.21.15.12:0/251904580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ac1025e0 msgr2=0x7fb1ac19f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.010+0000 7fb1b3559640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ac1025e0 0x7fb1ac19f1e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400cad0 tx=0x7fb1a400cf90 comp rx=0 tx=0).stop 2024-09-16T01:01:05.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.010+0000 7fb1b3559640 1 -- 172.21.15.12:0/251904580 shutdown_connections 2024-09-16T01:01:05.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.010+0000 7fb1b3559640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb1980a3250 0x7fb1980a5710 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.010+0000 7fb1b3559640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ac1025e0 0x7fb1ac19f1e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.010+0000 7fb1b3559640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1ac101c20 0x7fb1ac19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.010+0000 7fb1b3559640 1 --2- 172.21.15.12:0/251904580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1ac100a30 0x7fb1ac06af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.010+0000 7fb1b3559640 1 -- 172.21.15.12:0/251904580 >> 172.21.15.12:0/251904580 conn(0x7fb1ac0fc190 msgr2=0x7fb1ac104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:05.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.011+0000 7fb1b3559640 1 -- 172.21.15.12:0/251904580 shutdown_connections 2024-09-16T01:01:05.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.011+0000 7fb1b3559640 1 -- 172.21.15.12:0/251904580 wait complete. 2024-09-16T01:01:05.021 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:04 smithi012 ceph-mon[31197]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:05.021 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:04 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2959588490' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-16T01:01:05.022 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T00:53:57.343965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T00:58:32.985046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T00:58:35.488668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-16T00:58:42.009484+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-16T01:01:05.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:01:05.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:04 smithi119 ceph-mon[35049]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:05.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:04 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2959588490' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-16T01:01:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.128+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2345050147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c401025e0 msgr2=0x7f6c40108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.128+0000 7f6c45cdd640 1 --2- 172.21.15.12:0/2345050147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c401025e0 0x7f6c40108e70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009ca0 tx=0x7f6c3802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.128+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2345050147 shutdown_connections 2024-09-16T01:01:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.128+0000 7f6c45cdd640 1 --2- 172.21.15.12:0/2345050147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c401025e0 0x7f6c40108e70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.128+0000 7f6c45cdd640 1 --2- 172.21.15.12:0/2345050147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c40101c20 0x7f6c401020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.128+0000 7f6c45cdd640 1 --2- 172.21.15.12:0/2345050147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c40100a30 0x7f6c40100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.128+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2345050147 >> 172.21.15.12:0/2345050147 conn(0x7f6c400fc1b0 msgr2=0x7f6c400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.128+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2345050147 shutdown_connections 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.128+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2345050147 wait complete. 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c45cdd640 1 Processor -- start 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c45cdd640 1 -- start start 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c45cdd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c40100a30 0x7f6c40197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c45cdd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c40101c20 0x7f6c401983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c45cdd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c401025e0 0x7f6c4019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c45cdd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4010d800 con 0x7f6c401025e0 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c45cdd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4010d680 con 0x7f6c40101c20 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c45cdd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4010d980 con 0x7f6c40100a30 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c3ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c401025e0 0x7f6c4019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c3ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c401025e0 0x7f6c4019f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39746/0 (socket says 172.21.15.12:39746) 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c3ffff640 1 -- 172.21.15.12:0/2810992800 learned_addr learned my addr 172.21.15.12:0/2810992800 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c3effd640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c40101c20 0x7f6c401983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.129+0000 7f6c3f7fe640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c40100a30 0x7f6c40197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c3ffff640 1 -- 172.21.15.12:0/2810992800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c40100a30 msgr2=0x7f6c40197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c3ffff640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c40100a30 0x7f6c40197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c3ffff640 1 -- 172.21.15.12:0/2810992800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c40101c20 msgr2=0x7f6c401983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c3ffff640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c40101c20 0x7f6c401983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c3ffff640 1 -- 172.21.15.12:0/2810992800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4019fac0 con 0x7f6c401025e0 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c3ffff640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c401025e0 0x7f6c4019f450 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c38031ee0 tx=0x7f6c38031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c3cff9640 1 -- 172.21.15.12:0/2810992800 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38003c30 con 0x7f6c401025e0 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2810992800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4019fd50 con 0x7f6c401025e0 2024-09-16T01:01:05.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c3cff9640 1 -- 172.21.15.12:0/2810992800 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c38003dd0 con 0x7f6c401025e0 2024-09-16T01:01:05.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c3cff9640 1 -- 172.21.15.12:0/2810992800 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3802fc10 con 0x7f6c401025e0 2024-09-16T01:01:05.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.130+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2810992800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c401a0240 con 0x7f6c401025e0 2024-09-16T01:01:05.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.131+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2810992800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c40107e60 con 0x7f6c401025e0 2024-09-16T01:01:05.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.132+0000 7f6c3cff9640 1 -- 172.21.15.12:0/2810992800 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6c380046c0 con 0x7f6c401025e0 2024-09-16T01:01:05.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.133+0000 7f6c3cff9640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c280a3250 0x7f6c280a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.133+0000 7f6c3f7fe640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c280a3250 0x7f6c280a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.133+0000 7f6c3cff9640 1 -- 172.21.15.12:0/2810992800 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f6c380f11a0 con 0x7f6c401025e0 2024-09-16T01:01:05.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.133+0000 7f6c3f7fe640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c280a3250 0x7f6c280a5710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6c300058c0 tx=0x7f6c3000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:05.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.137+0000 7f6c3cff9640 1 -- 172.21.15.12:0/2810992800 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c3802fe90 con 0x7f6c401025e0 2024-09-16T01:01:05.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.313+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2810992800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6c40062df0 con 0x7f6c401025e0 2024-09-16T01:01:05.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.313+0000 7f6c3cff9640 1 -- 172.21.15.12:0/2810992800 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f6c380bdb00 con 0x7f6c401025e0 2024-09-16T01:01:05.314 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-16T01:01:05.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2810992800 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c280a3250 msgr2=0x7f6c280a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c280a3250 0x7f6c280a5710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6c300058c0 tx=0x7f6c3000a4c0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2810992800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c401025e0 msgr2=0x7f6c4019f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c401025e0 0x7f6c4019f450 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c38031ee0 tx=0x7f6c38031f10 comp rx=0 tx=0).stop 2024-09-16T01:01:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2810992800 shutdown_connections 2024-09-16T01:01:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f6c280a3250 0x7f6c280a5710 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c401025e0 0x7f6c4019f450 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c40101c20 0x7f6c401983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 --2- 172.21.15.12:0/2810992800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c40100a30 0x7f6c40197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2810992800 >> 172.21.15.12:0/2810992800 conn(0x7f6c400fc1b0 msgr2=0x7f6c40105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2810992800 shutdown_connections 2024-09-16T01:01:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.315+0000 7f6c45cdd640 1 -- 172.21.15.12:0/2810992800 wait complete. 2024-09-16T01:01:05.327 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T01:01:05.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 -- 172.21.15.12:0/399180547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47d0101bf0 msgr2=0x7f47d0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 --2- 172.21.15.12:0/399180547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47d0101bf0 0x7f47d0102070 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009900 tx=0x7f47c402a410 comp rx=0 tx=0).stop 2024-09-16T01:01:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 -- 172.21.15.12:0/399180547 shutdown_connections 2024-09-16T01:01:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 --2- 172.21.15.12:0/399180547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47d01025b0 0x7f47d0108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 --2- 172.21.15.12:0/399180547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47d0101bf0 0x7f47d0102070 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 --2- 172.21.15.12:0/399180547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0100a00 0x7f47d0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 -- 172.21.15.12:0/399180547 >> 172.21.15.12:0/399180547 conn(0x7f47d00fc140 msgr2=0x7f47d00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:05.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 -- 172.21.15.12:0/399180547 shutdown_connections 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 -- 172.21.15.12:0/399180547 wait complete. 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 Processor -- start 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.433+0000 7f47d8037640 1 -- start start 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d8037640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47d0100a00 0x7f47d0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d8037640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0101bf0 0x7f47d01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d8037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47d01025b0 0x7f47d019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d8037640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f47d010d7d0 con 0x7f47d0100a00 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d8037640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f47d010d650 con 0x7f47d01025b0 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d8037640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f47d010d950 con 0x7f47d0101bf0 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d5dd3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47d0100a00 0x7f47d0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d5dd3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47d0100a00 0x7f47d0197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39754/0 (socket says 172.21.15.12:39754) 2024-09-16T01:01:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d5dd3640 1 -- 172.21.15.12:0/2831916674 learned_addr learned my addr 172.21.15.12:0/2831916674 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d55d2640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0101bf0 0x7f47d01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d65d4640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47d01025b0 0x7f47d019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d5dd3640 1 -- 172.21.15.12:0/2831916674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0101bf0 msgr2=0x7f47d01983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d5dd3640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0101bf0 0x7f47d01983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d5dd3640 1 -- 172.21.15.12:0/2831916674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47d01025b0 msgr2=0x7f47d019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d5dd3640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47d01025b0 0x7f47d019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d5dd3640 1 -- 172.21.15.12:0/2831916674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d019faa0 con 0x7f47d0100a00 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d5dd3640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47d0100a00 0x7f47d0197e80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f47c800d950 tx=0x7f47c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47ceffd640 1 -- 172.21.15.12:0/2831916674 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8017070 con 0x7f47d0100a00 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47ceffd640 1 -- 172.21.15.12:0/2831916674 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47c8009c30 con 0x7f47d0100a00 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d8037640 1 -- 172.21.15.12:0/2831916674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d019fd90 con 0x7f47d0100a00 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47ceffd640 1 -- 172.21.15.12:0/2831916674 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c800f600 con 0x7f47d0100a00 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.434+0000 7f47d8037640 1 -- 172.21.15.12:0/2831916674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d01a01f0 con 0x7f47d0100a00 2024-09-16T01:01:05.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.435+0000 7f47d8037640 1 -- 172.21.15.12:0/2831916674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d0107e40 con 0x7f47d0100a00 2024-09-16T01:01:05.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.437+0000 7f47ceffd640 1 -- 172.21.15.12:0/2831916674 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f47c801a070 con 0x7f47d0100a00 2024-09-16T01:01:05.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.437+0000 7f47ceffd640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f47b80a32d0 0x7f47b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.438+0000 7f47d55d2640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f47b80a32d0 0x7f47b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.438+0000 7f47ceffd640 1 -- 172.21.15.12:0/2831916674 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f47c80cf6b0 con 0x7f47d0100a00 2024-09-16T01:01:05.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.438+0000 7f47d55d2640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f47b80a32d0 0x7f47b80a5790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f47c4000c00 tx=0x7f47c40315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:05.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.440+0000 7f47ceffd640 1 -- 172.21.15.12:0/2831916674 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47c8009de0 con 0x7f47d0100a00 2024-09-16T01:01:05.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.616+0000 7f47d8037640 1 -- 172.21.15.12:0/2831916674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f47d0062e90 con 0x7f47d0100a00 2024-09-16T01:01:05.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.617+0000 7f47ceffd640 1 -- 172.21.15.12:0/2831916674 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f47c809c0f0 con 0x7f47d0100a00 2024-09-16T01:01:05.617 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-09-16T01:01:05.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.618+0000 7f47d8037640 1 -- 172.21.15.12:0/2831916674 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f47b80a32d0 msgr2=0x7f47b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.618+0000 7f47d8037640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f47b80a32d0 0x7f47b80a5790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f47c4000c00 tx=0x7f47c40315d0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.618+0000 7f47d8037640 1 -- 172.21.15.12:0/2831916674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47d0100a00 msgr2=0x7f47d0197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.618+0000 7f47d8037640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47d0100a00 0x7f47d0197e80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f47c800d950 tx=0x7f47c800de10 comp rx=0 tx=0).stop 2024-09-16T01:01:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.619+0000 7f47d8037640 1 -- 172.21.15.12:0/2831916674 shutdown_connections 2024-09-16T01:01:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.619+0000 7f47d8037640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f47b80a32d0 0x7f47b80a5790 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.619+0000 7f47d8037640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47d01025b0 0x7f47d019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.619+0000 7f47d8037640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0101bf0 0x7f47d01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.619+0000 7f47d8037640 1 --2- 172.21.15.12:0/2831916674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47d0100a00 0x7f47d0197e80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.619+0000 7f47d8037640 1 -- 172.21.15.12:0/2831916674 >> 172.21.15.12:0/2831916674 conn(0x7f47d00fc140 msgr2=0x7f47d0105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.619+0000 7f47d8037640 1 -- 172.21.15.12:0/2831916674 shutdown_connections 2024-09-16T01:01:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.619+0000 7f47d8037640 1 -- 172.21.15.12:0/2831916674 wait complete. 2024-09-16T01:01:05.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T01:01:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 -- 172.21.15.12:0/3604391444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4104ee0 msgr2=0x7f60c41072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 --2- 172.21.15.12:0/3604391444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4104ee0 0x7f60c41072d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009900 tx=0x7f60b402a410 comp rx=0 tx=0).stop 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 -- 172.21.15.12:0/3604391444 shutdown_connections 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 --2- 172.21.15.12:0/3604391444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c4107810 0x7f60c4109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 --2- 172.21.15.12:0/3604391444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4104ee0 0x7f60c41072d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 --2- 172.21.15.12:0/3604391444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60c41025b0 0x7f60c41049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 -- 172.21.15.12:0/3604391444 >> 172.21.15.12:0/3604391444 conn(0x7f60c40fc1b0 msgr2=0x7f60c40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 -- 172.21.15.12:0/3604391444 shutdown_connections 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 -- 172.21.15.12:0/3604391444 wait complete. 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 Processor -- start 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.738+0000 7f60caf6f640 1 -- start start 2024-09-16T01:01:05.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60caf6f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c41025b0 0x7f60c4197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60caf6f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4104ee0 0x7f60c4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60caf6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60c4107810 0x7f60c419f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60caf6f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f60c410d810 con 0x7f60c4104ee0 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60caf6f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f60c410d690 con 0x7f60c4107810 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60caf6f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f60c410d990 con 0x7f60c41025b0 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4104ee0 0x7f60c4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4104ee0 0x7f60c4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39764/0 (socket says 172.21.15.12:39764) 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60bbfff640 1 -- 172.21.15.12:0/2777506391 learned_addr learned my addr 172.21.15.12:0/2777506391 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60c8d0b640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c41025b0 0x7f60c4197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60c950c640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60c4107810 0x7f60c419f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60bbfff640 1 -- 172.21.15.12:0/2777506391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c41025b0 msgr2=0x7f60c4197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60bbfff640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c41025b0 0x7f60c4197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60bbfff640 1 -- 172.21.15.12:0/2777506391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60c4107810 msgr2=0x7f60c419f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60bbfff640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60c4107810 0x7f60c419f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60bbfff640 1 -- 172.21.15.12:0/2777506391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c419fb70 con 0x7f60c4104ee0 2024-09-16T01:01:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60bbfff640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4104ee0 0x7f60c4198490 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f60b4031610 tx=0x7f60b4032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60b9ffb640 1 -- 172.21.15.12:0/2777506391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b403f030 con 0x7f60c4104ee0 2024-09-16T01:01:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60b9ffb640 1 -- 172.21.15.12:0/2777506391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60b4032e50 con 0x7f60c4104ee0 2024-09-16T01:01:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60caf6f640 1 -- 172.21.15.12:0/2777506391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c419fe00 con 0x7f60c4104ee0 2024-09-16T01:01:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.739+0000 7f60b9ffb640 1 -- 172.21.15.12:0/2777506391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4035070 con 0x7f60c4104ee0 2024-09-16T01:01:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.740+0000 7f60caf6f640 1 -- 172.21.15.12:0/2777506391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c41a0270 con 0x7f60c4104ee0 2024-09-16T01:01:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.741+0000 7f60caf6f640 1 -- 172.21.15.12:0/2777506391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c40fdca0 con 0x7f60c4104ee0 2024-09-16T01:01:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.743+0000 7f60b9ffb640 1 -- 172.21.15.12:0/2777506391 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f60b4042030 con 0x7f60c4104ee0 2024-09-16T01:01:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.743+0000 7f60b9ffb640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f60ac0a32d0 0x7f60ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.743+0000 7f60b9ffb640 1 -- 172.21.15.12:0/2777506391 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f60b40f0510 con 0x7f60c4104ee0 2024-09-16T01:01:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.743+0000 7f60c8d0b640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f60ac0a32d0 0x7f60ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.744+0000 7f60c8d0b640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f60ac0a32d0 0x7f60ac0a5790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60c0005d00 tx=0x7f60c000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:05.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.746+0000 7f60b9ffb640 1 -- 172.21.15.12:0/2777506391 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60b40bced0 con 0x7f60c4104ee0 2024-09-16T01:01:05.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.924+0000 7f60caf6f640 1 -- 172.21.15.12:0/2777506391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f60c402da10 con 0x7f60c4104ee0 2024-09-16T01:01:05.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.924+0000 7f60b9ffb640 1 -- 172.21.15.12:0/2777506391 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f60b40bc7d0 con 0x7f60c4104ee0 2024-09-16T01:01:05.925 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-09-16T01:01:05.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 -- 172.21.15.12:0/2777506391 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f60ac0a32d0 msgr2=0x7f60ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f60ac0a32d0 0x7f60ac0a5790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60c0005d00 tx=0x7f60c000b410 comp rx=0 tx=0).stop 2024-09-16T01:01:05.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 -- 172.21.15.12:0/2777506391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4104ee0 msgr2=0x7f60c4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4104ee0 0x7f60c4198490 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f60b4031610 tx=0x7f60b4032c60 comp rx=0 tx=0).stop 2024-09-16T01:01:05.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 -- 172.21.15.12:0/2777506391 shutdown_connections 2024-09-16T01:01:05.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f60ac0a32d0 0x7f60ac0a5790 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60c4107810 0x7f60c419f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4104ee0 0x7f60c4198490 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 --2- 172.21.15.12:0/2777506391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60c41025b0 0x7f60c4197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 -- 172.21.15.12:0/2777506391 >> 172.21.15.12:0/2777506391 conn(0x7f60c40fc1b0 msgr2=0x7f60c4102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:05.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 -- 172.21.15.12:0/2777506391 shutdown_connections 2024-09-16T01:01:05.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:05.926+0000 7f60caf6f640 1 -- 172.21.15.12:0/2777506391 wait complete. 2024-09-16T01:01:05.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2959588490' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-16T01:01:05.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:05 smithi012 ceph-mon[31197]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T01:01:05.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/251904580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:05.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2810992800' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:01:05.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:05 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2831916674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:01:05.937 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-16T01:01:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:05 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2959588490' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-16T01:01:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:05 smithi098 ceph-mon[35346]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T01:01:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:05 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/251904580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:05 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2810992800' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:01:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:05 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2831916674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:01:06.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.043+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3009693630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da8101c20 msgr2=0x7f3da81020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.043+0000 7f3daf6e6640 1 --2- 172.21.15.12:0/3009693630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da8101c20 0x7f3da81020a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009900 tx=0x7f3d9802a410 comp rx=0 tx=0).stop 2024-09-16T01:01:06.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.043+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3009693630 shutdown_connections 2024-09-16T01:01:06.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.043+0000 7f3daf6e6640 1 --2- 172.21.15.12:0/3009693630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da81025e0 0x7f3da8108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.043+0000 7f3daf6e6640 1 --2- 172.21.15.12:0/3009693630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da8101c20 0x7f3da81020a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.043+0000 7f3daf6e6640 1 --2- 172.21.15.12:0/3009693630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8100a30 0x7f3da8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.043+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3009693630 >> 172.21.15.12:0/3009693630 conn(0x7f3da80fc1b0 msgr2=0x7f3da80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3009693630 shutdown_connections 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3009693630 wait complete. 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3daf6e6640 1 Processor -- start 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3daf6e6640 1 -- start start 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3daf6e6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8100a30 0x7f3da806aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3daf6e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da8101c20 0x7f3da819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3daf6e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da81025e0 0x7f3da819f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3daf6e6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3da810c6b0 con 0x7f3da8101c20 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3daf6e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3da810c530 con 0x7f3da81025e0 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3daf6e6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3da810c830 con 0x7f3da8100a30 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.044+0000 7f3dacc81640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da8101c20 0x7f3da819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dacc81640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da8101c20 0x7f3da819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39786/0 (socket says 172.21.15.12:39786) 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dacc81640 1 -- 172.21.15.12:0/3587176646 learned_addr learned my addr 172.21.15.12:0/3587176646 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dadc83640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da81025e0 0x7f3da819f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dad482640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8100a30 0x7f3da806aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dacc81640 1 -- 172.21.15.12:0/3587176646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8100a30 msgr2=0x7f3da806aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dacc81640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8100a30 0x7f3da806aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dacc81640 1 -- 172.21.15.12:0/3587176646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da81025e0 msgr2=0x7f3da819f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dacc81640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da81025e0 0x7f3da819f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dacc81640 1 -- 172.21.15.12:0/3587176646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da819fbb0 con 0x7f3da8101c20 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dad482640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8100a30 0x7f3da806aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3dacc81640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da8101c20 0x7f3da819cc80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3d98005940 tx=0x7f3d98031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3d9e7fc640 1 -- 172.21.15.12:0/3587176646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9803f030 con 0x7f3da8101c20 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3d9e7fc640 1 -- 172.21.15.12:0/3587176646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d98003ad0 con 0x7f3da8101c20 2024-09-16T01:01:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3587176646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da819fde0 con 0x7f3da8101c20 2024-09-16T01:01:06.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3d9e7fc640 1 -- 172.21.15.12:0/3587176646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98035070 con 0x7f3da8101c20 2024-09-16T01:01:06.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.045+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3587176646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da81a0250 con 0x7f3da8101c20 2024-09-16T01:01:06.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.046+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3587176646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da8107f60 con 0x7f3da8101c20 2024-09-16T01:01:06.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.048+0000 7f3d9e7fc640 1 -- 172.21.15.12:0/3587176646 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3d98042030 con 0x7f3da8101c20 2024-09-16T01:01:06.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.048+0000 7f3d9e7fc640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d940a32d0 0x7f3d940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.049+0000 7f3dad482640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d940a32d0 0x7f3d940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.049+0000 7f3d9e7fc640 1 -- 172.21.15.12:0/3587176646 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f3d980f0310 con 0x7f3da8101c20 2024-09-16T01:01:06.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.049+0000 7f3dad482640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d940a32d0 0x7f3d940a5790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3da8101a80 tx=0x7f3da4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:06.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.051+0000 7f3d9e7fc640 1 -- 172.21.15.12:0/3587176646 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d980bcd70 con 0x7f3da8101c20 2024-09-16T01:01:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:05 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2959588490' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-16T01:01:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:05 smithi119 ceph-mon[35049]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T01:01:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:05 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/251904580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:05 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2810992800' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:01:06.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:05 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2831916674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:01:06.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.226+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3587176646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3da802d7c0 con 0x7f3da8101c20 2024-09-16T01:01:06.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.226+0000 7f3d9e7fc640 1 -- 172.21.15.12:0/3587176646 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7f3d980bc670 con 0x7f3da8101c20 2024-09-16T01:01:06.227 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-09-16T01:01:06.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.228+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3587176646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d940a32d0 msgr2=0x7f3d940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.228+0000 7f3daf6e6640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d940a32d0 0x7f3d940a5790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3da8101a80 tx=0x7f3da4005f90 comp rx=0 tx=0).stop 2024-09-16T01:01:06.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.228+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3587176646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da8101c20 msgr2=0x7f3da819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.228+0000 7f3daf6e6640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da8101c20 0x7f3da819cc80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3d98005940 tx=0x7f3d98031b60 comp rx=0 tx=0).stop 2024-09-16T01:01:06.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.228+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3587176646 shutdown_connections 2024-09-16T01:01:06.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.228+0000 7f3daf6e6640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3d940a32d0 0x7f3d940a5790 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.228+0000 7f3daf6e6640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da81025e0 0x7f3da819f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.228+0000 7f3daf6e6640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da8101c20 0x7f3da819cc80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.228+0000 7f3daf6e6640 1 --2- 172.21.15.12:0/3587176646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3da8100a30 0x7f3da806aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.228+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3587176646 >> 172.21.15.12:0/3587176646 conn(0x7f3da80fc1b0 msgr2=0x7f3da8105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:06.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.229+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3587176646 shutdown_connections 2024-09-16T01:01:06.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.229+0000 7f3daf6e6640 1 -- 172.21.15.12:0/3587176646 wait complete. 2024-09-16T01:01:06.240 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-16T01:01:06.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:06.499 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:06.907 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:06 smithi012 ceph-mon[31197]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-16T01:01:06.907 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:06 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2777506391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:01:06.907 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:06 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3587176646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-16T01:01:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:06 smithi098 ceph-mon[35346]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-16T01:01:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:06 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2777506391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:01:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:06 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3587176646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-16T01:01:07.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.991+0000 7f641b21e640 1 -- 172.21.15.12:0/3531902610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6414106f10 msgr2=0x7f641410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.991+0000 7f641b21e640 1 --2- 172.21.15.12:0/3531902610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6414106f10 0x7f641410ea90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f640c009ca0 tx=0x7f640c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.991+0000 7f641b21e640 1 -- 172.21.15.12:0/3531902610 shutdown_connections 2024-09-16T01:01:07.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.991+0000 7f641b21e640 1 --2- 172.21.15.12:0/3531902610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6414106f10 0x7f641410ea90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.991+0000 7f641b21e640 1 --2- 172.21.15.12:0/3531902610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6414102790 0x7f64141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.991+0000 7f641b21e640 1 --2- 172.21.15.12:0/3531902610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6414101de0 0x7f64141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.991+0000 7f641b21e640 1 -- 172.21.15.12:0/3531902610 >> 172.21.15.12:0/3531902610 conn(0x7f64140fd8c0 msgr2=0x7f64140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:07.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.991+0000 7f641b21e640 1 -- 172.21.15.12:0/3531902610 shutdown_connections 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.991+0000 7f641b21e640 1 -- 172.21.15.12:0/3531902610 wait complete. 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f641b21e640 1 Processor -- start 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f641b21e640 1 -- start start 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f641b21e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6414101de0 0x7f6414198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f641b21e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6414102790 0x7f6414198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f641b21e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6414106f10 0x7f641419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f641b21e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6414111f70 con 0x7f6414106f10 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f641b21e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6414111df0 con 0x7f6414101de0 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f641b21e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f64141120f0 con 0x7f6414102790 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f64197bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6414106f10 0x7f641419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f64197bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6414106f10 0x7f641419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33066/0 (socket says 172.21.15.12:33066) 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f64197bb640 1 -- 172.21.15.12:0/2746352941 learned_addr learned my addr 172.21.15.12:0/2746352941 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f6418fba640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6414101de0 0x7f6414198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f6413fff640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6414102790 0x7f6414198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f64197bb640 1 -- 172.21.15.12:0/2746352941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6414102790 msgr2=0x7f6414198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f64197bb640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6414102790 0x7f6414198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f64197bb640 1 -- 172.21.15.12:0/2746352941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6414101de0 msgr2=0x7f6414198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f64197bb640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6414101de0 0x7f6414198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f64197bb640 1 -- 172.21.15.12:0/2746352941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641419d3c0 con 0x7f6414106f10 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f6413fff640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6414102790 0x7f6414198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.992+0000 7f6418fba640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6414101de0 0x7f6414198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.993+0000 7f64197bb640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6414106f10 0x7f641419cce0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f640c031a20 tx=0x7f640c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.993+0000 7f6411ffb640 1 -- 172.21.15.12:0/2746352941 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c003c30 con 0x7f6414106f10 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.993+0000 7f641b21e640 1 -- 172.21.15.12:0/2746352941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641419d650 con 0x7f6414106f10 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.993+0000 7f6411ffb640 1 -- 172.21.15.12:0/2746352941 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f640c003dd0 con 0x7f6414106f10 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.993+0000 7f6411ffb640 1 -- 172.21.15.12:0/2746352941 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c02fcf0 con 0x7f6414106f10 2024-09-16T01:01:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.993+0000 7f641b21e640 1 -- 172.21.15.12:0/2746352941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64141a4f90 con 0x7f6414106f10 2024-09-16T01:01:07.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.994+0000 7f641b21e640 1 -- 172.21.15.12:0/2746352941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64141021c0 con 0x7f6414106f10 2024-09-16T01:01:07.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.995+0000 7f6411ffb640 1 -- 172.21.15.12:0/2746352941 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f640c004050 con 0x7f6414106f10 2024-09-16T01:01:07.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.996+0000 7f6411ffb640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f64040a3240 0x7f64040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:07.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.996+0000 7f6418fba640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f64040a3240 0x7f64040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:07.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.996+0000 7f6411ffb640 1 -- 172.21.15.12:0/2746352941 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f640c0f10e0 con 0x7f6414106f10 2024-09-16T01:01:07.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:06.996+0000 7f6418fba640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f64040a3240 0x7f64040a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f64080058c0 tx=0x7f6408005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:07.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.000+0000 7f6411ffb640 1 -- 172.21.15.12:0/2746352941 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f640c0bdad0 con 0x7f6414106f10 2024-09-16T01:01:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:06 smithi119 ceph-mon[35049]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-16T01:01:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:06 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2777506391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:01:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:06 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3587176646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-16T01:01:07.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.214+0000 7f641b21e640 1 -- 172.21.15.12:0/2746352941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f641410a150 con 0x7f6414106f10 2024-09-16T01:01:07.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.215+0000 7f6411ffb640 1 -- 172.21.15.12:0/2746352941 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f640c02fe90 con 0x7f6414106f10 2024-09-16T01:01:07.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:07.216 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:01:07.216 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:01:07.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 -- 172.21.15.12:0/2746352941 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f64040a3240 msgr2=0x7f64040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f64040a3240 0x7f64040a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f64080058c0 tx=0x7f6408005850 comp rx=0 tx=0).stop 2024-09-16T01:01:07.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 -- 172.21.15.12:0/2746352941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6414106f10 msgr2=0x7f641419cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6414106f10 0x7f641419cce0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f640c031a20 tx=0x7f640c031a50 comp rx=0 tx=0).stop 2024-09-16T01:01:07.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 -- 172.21.15.12:0/2746352941 shutdown_connections 2024-09-16T01:01:07.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f64040a3240 0x7f64040a5700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6414106f10 0x7f641419cce0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6414102790 0x7f6414198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 --2- 172.21.15.12:0/2746352941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6414101de0 0x7f6414198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 -- 172.21.15.12:0/2746352941 >> 172.21.15.12:0/2746352941 conn(0x7f64140fd8c0 msgr2=0x7f64140feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:07.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 -- 172.21.15.12:0/2746352941 shutdown_connections 2024-09-16T01:01:07.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:07.217+0000 7f641b21e640 1 -- 172.21.15.12:0/2746352941 wait complete. 2024-09-16T01:01:07.900 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-16T01:01:07.900 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-16T01:01:07.900 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:01:07.924 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:07 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2746352941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:07.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:07 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2746352941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.007+0000 7fe4620f1640 1 -- 172.21.15.12:0/3685841897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe45c104ee0 msgr2=0x7fe45c1072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.007+0000 7fe4620f1640 1 --2- 172.21.15.12:0/3685841897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe45c104ee0 0x7fe45c1072d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe450009900 tx=0x7fe45002a410 comp rx=0 tx=0).stop 2024-09-16T01:01:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.007+0000 7fe4620f1640 1 -- 172.21.15.12:0/3685841897 shutdown_connections 2024-09-16T01:01:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.007+0000 7fe4620f1640 1 --2- 172.21.15.12:0/3685841897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c107810 0x7fe45c109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.007+0000 7fe4620f1640 1 --2- 172.21.15.12:0/3685841897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe45c104ee0 0x7fe45c1072d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.007+0000 7fe4620f1640 1 --2- 172.21.15.12:0/3685841897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c1025b0 0x7fe45c1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.007+0000 7fe4620f1640 1 -- 172.21.15.12:0/3685841897 >> 172.21.15.12:0/3685841897 conn(0x7fe45c0fc1b0 msgr2=0x7fe45c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.007+0000 7fe4620f1640 1 -- 172.21.15.12:0/3685841897 shutdown_connections 2024-09-16T01:01:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.007+0000 7fe4620f1640 1 -- 172.21.15.12:0/3685841897 wait complete. 2024-09-16T01:01:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe4620f1640 1 Processor -- start 2024-09-16T01:01:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe4620f1640 1 -- start start 2024-09-16T01:01:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe4620f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe45c1025b0 0x7fe45c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe4620f1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c104ee0 0x7fe45c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe4620f1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c107810 0x7fe45c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe4620f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c10d7c0 con 0x7fe45c1025b0 2024-09-16T01:01:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe4620f1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c10d640 con 0x7fe45c107810 2024-09-16T01:01:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe4620f1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c10d940 con 0x7fe45c104ee0 2024-09-16T01:01:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe45c1025b0 0x7fe45c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe45c1025b0 0x7fe45c197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33096/0 (socket says 172.21.15.12:33096) 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe45b7fe640 1 -- 172.21.15.12:0/161863596 learned_addr learned my addr 172.21.15.12:0/161863596 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe45affd640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c104ee0 0x7fe45c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe45bfff640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c107810 0x7fe45c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe45b7fe640 1 -- 172.21.15.12:0/161863596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c104ee0 msgr2=0x7fe45c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe45b7fe640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c104ee0 0x7fe45c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe45b7fe640 1 -- 172.21.15.12:0/161863596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c107810 msgr2=0x7fe45c19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe45b7fe640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c107810 0x7fe45c19f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.008+0000 7fe45b7fe640 1 -- 172.21.15.12:0/161863596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45c19fb00 con 0x7fe45c1025b0 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.009+0000 7fe45b7fe640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe45c1025b0 0x7fe45c197ee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe44c00d950 tx=0x7fe44c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.009+0000 7fe458ff9640 1 -- 172.21.15.12:0/161863596 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c017070 con 0x7fe45c1025b0 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.009+0000 7fe458ff9640 1 -- 172.21.15.12:0/161863596 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe44c009c30 con 0x7fe45c1025b0 2024-09-16T01:01:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.009+0000 7fe4620f1640 1 -- 172.21.15.12:0/161863596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45c19fdf0 con 0x7fe45c1025b0 2024-09-16T01:01:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.009+0000 7fe458ff9640 1 -- 172.21.15.12:0/161863596 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c00f6b0 con 0x7fe45c1025b0 2024-09-16T01:01:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.009+0000 7fe4620f1640 1 -- 172.21.15.12:0/161863596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe45c1a0250 con 0x7fe45c1025b0 2024-09-16T01:01:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.010+0000 7fe4620f1640 1 -- 172.21.15.12:0/161863596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe45c0fdca0 con 0x7fe45c1025b0 2024-09-16T01:01:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.011+0000 7fe458ff9640 1 -- 172.21.15.12:0/161863596 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe44c0109d0 con 0x7fe45c1025b0 2024-09-16T01:01:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.012+0000 7fe458ff9640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4440a3250 0x7fe4440a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.012+0000 7fe458ff9640 1 -- 172.21.15.12:0/161863596 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fe44c0cfc00 con 0x7fe45c1025b0 2024-09-16T01:01:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.012+0000 7fe45affd640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4440a3250 0x7fe4440a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.012+0000 7fe45affd640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4440a3250 0x7fe4440a5710 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe450005ab0 tx=0x7fe450000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.016+0000 7fe458ff9640 1 -- 172.21.15.12:0/161863596 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe44c0d6080 con 0x7fe45c1025b0 2024-09-16T01:01:08.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:07 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2746352941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:08.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.191+0000 7fe4620f1640 1 -- 172.21.15.12:0/161863596 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe45c062630 con 0x7fe4440a3250 2024-09-16T01:01:08.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.200+0000 7fe458ff9640 1 -- 172.21.15.12:0/161863596 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340798 (secure 0 0 0) 0x7fe45c062630 con 0x7fe4440a3250 2024-09-16T01:01:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:08.208 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-16T01:01:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 -- 172.21.15.12:0/161863596 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4440a3250 msgr2=0x7fe4440a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4440a3250 0x7fe4440a5710 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe450005ab0 tx=0x7fe450000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 -- 172.21.15.12:0/161863596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe45c1025b0 msgr2=0x7fe45c197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe45c1025b0 0x7fe45c197ee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe44c00d950 tx=0x7fe44c00de10 comp rx=0 tx=0).stop 2024-09-16T01:01:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 -- 172.21.15.12:0/161863596 shutdown_connections 2024-09-16T01:01:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe4440a3250 0x7fe4440a5710 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c107810 0x7fe45c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c104ee0 0x7fe45c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 --2- 172.21.15.12:0/161863596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe45c1025b0 0x7fe45c197ee0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 -- 172.21.15.12:0/161863596 >> 172.21.15.12:0/161863596 conn(0x7fe45c0fc1b0 msgr2=0x7fe45c1030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 -- 172.21.15.12:0/161863596 shutdown_connections 2024-09-16T01:01:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.204+0000 7fe4620f1640 1 -- 172.21.15.12:0/161863596 wait complete. 2024-09-16T01:01:08.216 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-16T01:01:06.936017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661907,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1192,"num_read_kb":718,"num_write":444,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373940,"kb_used_data":12168,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567884,"statfs":{"total":1151940427776,"available":1151557513216,"internally_reserved":0,"allocated":12460032,"data_stored":8110981,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":52,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003050"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:02.942810+0000","last_change":"2024-09-16T00:59:44.862009+0000","last_active":"2024-09-16T01:01:02.942810+0000","last_peered":"2024-09-16T01:01:02.942810+0000","last_clean":"2024-09-16T01:01:02.942810+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:01:02.942810+0000","last_undegraded":"2024-09-16T01:01:02.942810+0000","last_fullsized":"2024-09-16T01:01:02.942810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:11.209907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968087+0000","last_change":"2024-09-16T00:58:36.507955+0000","last_active":"2024-09-16T01:00:46.968087+0000","last_peered":"2024-09-16T01:00:46.968087+0000","last_clean":"2024-09-16T01:00:46.968087+0000","last_became_active":"2024-09-16T00:58:36.507660+0000","last_became_peered":"2024-09-16T00:58:36.507660+0000","last_unstale":"2024-09-16T01:00:46.968087+0000","last_undegraded":"2024-09-16T01:00:46.968087+0000","last_fullsized":"2024-09-16T01:00:46.968087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:05.408460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627372+0000","last_change":"2024-09-16T00:58:43.620365+0000","last_active":"2024-09-16T01:00:45.627372+0000","last_peered":"2024-09-16T01:00:45.627372+0000","last_clean":"2024-09-16T01:00:45.627372+0000","last_became_active":"2024-09-16T00:58:43.619976+0000","last_became_peered":"2024-09-16T00:58:43.619976+0000","last_unstale":"2024-09-16T01:00:45.627372+0000","last_undegraded":"2024-09-16T01:00:45.627372+0000","last_fullsized":"2024-09-16T01:00:45.627372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:37.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968248+0000","last_change":"2024-09-16T00:58:34.829549+0000","last_active":"2024-09-16T01:00:46.968248+0000","last_peered":"2024-09-16T01:00:46.968248+0000","last_clean":"2024-09-16T01:00:46.968248+0000","last_became_active":"2024-09-16T00:58:34.829180+0000","last_became_peered":"2024-09-16T00:58:34.829180+0000","last_unstale":"2024-09-16T01:00:46.968248+0000","last_undegraded":"2024-09-16T01:00:46.968248+0000","last_fullsized":"2024-09-16T01:00:46.968248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:40.731288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627338+0000","last_change":"2024-09-16T00:58:36.517190+0000","last_active":"2024-09-16T01:00:45.627338+0000","last_peered":"2024-09-16T01:00:45.627338+0000","last_clean":"2024-09-16T01:00:45.627338+0000","last_became_active":"2024-09-16T00:58:36.516877+0000","last_became_peered":"2024-09-16T00:58:36.516877+0000","last_unstale":"2024-09-16T01:00:45.627338+0000","last_undegraded":"2024-09-16T01:00:45.627338+0000","last_fullsized":"2024-09-16T01:00:45.627338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.408011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719567+0000","last_change":"2024-09-16T00:59:44.863832+0000","last_active":"2024-09-16T01:00:45.719567+0000","last_peered":"2024-09-16T01:00:45.719567+0000","last_clean":"2024-09-16T01:00:45.719567+0000","last_became_active":"2024-09-16T00:59:44.863298+0000","last_became_peered":"2024-09-16T00:59:44.863298+0000","last_unstale":"2024-09-16T01:00:45.719567+0000","last_undegraded":"2024-09-16T01:00:45.719567+0000","last_fullsized":"2024-09-16T01:00:45.719567+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:55.449728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714641+0000","last_change":"2024-09-16T00:58:34.472375+0000","last_active":"2024-09-16T01:00:45.714641+0000","last_peered":"2024-09-16T01:00:45.714641+0000","last_clean":"2024-09-16T01:00:45.714641+0000","last_became_active":"2024-09-16T00:58:34.471990+0000","last_became_peered":"2024-09-16T00:58:34.471990+0000","last_unstale":"2024-09-16T01:00:45.714641+0000","last_undegraded":"2024-09-16T01:00:45.714641+0000","last_fullsized":"2024-09-16T01:00:45.714641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:15.746005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624613+0000","last_change":"2024-09-16T00:58:36.513747+0000","last_active":"2024-09-16T01:00:45.624613+0000","last_peered":"2024-09-16T01:00:45.624613+0000","last_clean":"2024-09-16T01:00:45.624613+0000","last_became_active":"2024-09-16T00:58:36.512635+0000","last_became_peered":"2024-09-16T00:58:36.512635+0000","last_unstale":"2024-09-16T01:00:45.624613+0000","last_undegraded":"2024-09-16T01:00:45.624613+0000","last_fullsized":"2024-09-16T01:00:45.624613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:39.014961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719783+0000","last_change":"2024-09-16T00:58:43.609355+0000","last_active":"2024-09-16T01:00:45.719783+0000","last_peered":"2024-09-16T01:00:45.719783+0000","last_clean":"2024-09-16T01:00:45.719783+0000","last_became_active":"2024-09-16T00:58:43.608892+0000","last_became_peered":"2024-09-16T00:58:43.608892+0000","last_unstale":"2024-09-16T01:00:45.719783+0000","last_undegraded":"2024-09-16T01:00:45.719783+0000","last_fullsized":"2024-09-16T01:00:45.719783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:20.718163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714484+0000","last_change":"2024-09-16T00:58:34.469650+0000","last_active":"2024-09-16T01:00:45.714484+0000","last_peered":"2024-09-16T01:00:45.714484+0000","last_clean":"2024-09-16T01:00:45.714484+0000","last_became_active":"2024-09-16T00:58:34.468939+0000","last_became_peered":"2024-09-16T00:58:34.468939+0000","last_unstale":"2024-09-16T01:00:45.714484+0000","last_undegraded":"2024-09-16T01:00:45.714484+0000","last_fullsized":"2024-09-16T01:00:45.714484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:34.511111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623914+0000","last_change":"2024-09-16T00:59:45.097454+0000","last_active":"2024-09-16T01:00:45.623914+0000","last_peered":"2024-09-16T01:00:45.623914+0000","last_clean":"2024-09-16T01:00:45.623914+0000","last_became_active":"2024-09-16T00:59:45.096985+0000","last_became_peered":"2024-09-16T00:59:45.096985+0000","last_unstale":"2024-09-16T01:00:45.623914+0000","last_undegraded":"2024-09-16T01:00:45.623914+0000","last_fullsized":"2024-09-16T01:00:45.623914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:03.247850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719638+0000","last_change":"2024-09-16T00:58:43.612479+0000","last_active":"2024-09-16T01:00:45.719638+0000","last_peered":"2024-09-16T01:00:45.719638+0000","last_clean":"2024-09-16T01:00:45.719638+0000","last_became_active":"2024-09-16T00:58:43.612001+0000","last_became_peered":"2024-09-16T00:58:43.612001+0000","last_unstale":"2024-09-16T01:00:45.719638+0000","last_undegraded":"2024-09-16T01:00:45.719638+0000","last_fullsized":"2024-09-16T01:00:45.719638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:33.056052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919590+0000","last_change":"2024-09-16T00:58:36.519407+0000","last_active":"2024-09-16T01:00:45.919590+0000","last_peered":"2024-09-16T01:00:45.919590+0000","last_clean":"2024-09-16T01:00:45.919590+0000","last_became_active":"2024-09-16T00:58:36.519108+0000","last_became_peered":"2024-09-16T00:58:36.519108+0000","last_unstale":"2024-09-16T01:00:45.919590+0000","last_undegraded":"2024-09-16T01:00:45.919590+0000","last_fullsized":"2024-09-16T01:00:45.919590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:28.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714187+0000","last_change":"2024-09-16T00:58:34.472295+0000","last_active":"2024-09-16T01:00:45.714187+0000","last_peered":"2024-09-16T01:00:45.714187+0000","last_clean":"2024-09-16T01:00:45.714187+0000","last_became_active":"2024-09-16T00:58:34.471968+0000","last_became_peered":"2024-09-16T00:58:34.471968+0000","last_unstale":"2024-09-16T01:00:45.714187+0000","last_undegraded":"2024-09-16T01:00:45.714187+0000","last_fullsized":"2024-09-16T01:00:45.714187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:44.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720006+0000","last_change":"2024-09-16T00:58:43.615870+0000","last_active":"2024-09-16T01:00:45.720006+0000","last_peered":"2024-09-16T01:00:45.720006+0000","last_clean":"2024-09-16T01:00:45.720006+0000","last_became_active":"2024-09-16T00:58:43.615116+0000","last_became_peered":"2024-09-16T00:58:43.615116+0000","last_unstale":"2024-09-16T01:00:45.720006+0000","last_undegraded":"2024-09-16T01:00:45.720006+0000","last_fullsized":"2024-09-16T01:00:45.720006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:44.742792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967891+0000","last_change":"2024-09-16T00:58:36.512485+0000","last_active":"2024-09-16T01:00:46.967891+0000","last_peered":"2024-09-16T01:00:46.967891+0000","last_clean":"2024-09-16T01:00:46.967891+0000","last_became_active":"2024-09-16T00:58:36.512175+0000","last_became_peered":"2024-09-16T00:58:36.512175+0000","last_unstale":"2024-09-16T01:00:46.967891+0000","last_undegraded":"2024-09-16T01:00:46.967891+0000","last_fullsized":"2024-09-16T01:00:46.967891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.328409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'4","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.896964+0000","last_change":"2024-09-16T00:59:44.841052+0000","last_active":"2024-09-16T01:00:45.896964+0000","last_peered":"2024-09-16T01:00:45.896964+0000","last_clean":"2024-09-16T01:00:45.896964+0000","last_became_active":"2024-09-16T00:59:44.834033+0000","last_became_peered":"2024-09-16T00:59:44.834033+0000","last_unstale":"2024-09-16T01:00:45.896964+0000","last_undegraded":"2024-09-16T01:00:45.896964+0000","last_fullsized":"2024-09-16T01:00:45.896964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:09.696435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720242+0000","last_change":"2024-09-16T00:58:43.610265+0000","last_active":"2024-09-16T01:00:45.720242+0000","last_peered":"2024-09-16T01:00:45.720242+0000","last_clean":"2024-09-16T01:00:45.720242+0000","last_became_active":"2024-09-16T00:58:43.609868+0000","last_became_peered":"2024-09-16T00:58:43.609868+0000","last_unstale":"2024-09-16T01:00:45.720242+0000","last_undegraded":"2024-09-16T01:00:45.720242+0000","last_fullsized":"2024-09-16T01:00:45.720242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:54.689332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897423+0000","last_change":"2024-09-16T00:58:36.512801+0000","last_active":"2024-09-16T01:00:45.897423+0000","last_peered":"2024-09-16T01:00:45.897423+0000","last_clean":"2024-09-16T01:00:45.897423+0000","last_became_active":"2024-09-16T00:58:36.512469+0000","last_became_peered":"2024-09-16T00:58:36.512469+0000","last_unstale":"2024-09-16T01:00:45.897423+0000","last_undegraded":"2024-09-16T01:00:45.897423+0000","last_fullsized":"2024-09-16T01:00:45.897423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:57.951743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967904+0000","last_change":"2024-09-16T00:58:34.471498+0000","last_active":"2024-09-16T01:00:46.967904+0000","last_peered":"2024-09-16T01:00:46.967904+0000","last_clean":"2024-09-16T01:00:46.967904+0000","last_became_active":"2024-09-16T00:58:34.471093+0000","last_became_peered":"2024-09-16T00:58:34.471093+0000","last_unstale":"2024-09-16T01:00:46.967904+0000","last_undegraded":"2024-09-16T01:00:46.967904+0000","last_fullsized":"2024-09-16T01:00:46.967904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:35.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624262+0000","last_change":"2024-09-16T00:58:43.616376+0000","last_active":"2024-09-16T01:00:45.624262+0000","last_peered":"2024-09-16T01:00:45.624262+0000","last_clean":"2024-09-16T01:00:45.624262+0000","last_became_active":"2024-09-16T00:58:43.616029+0000","last_became_peered":"2024-09-16T00:58:43.616029+0000","last_unstale":"2024-09-16T01:00:45.624262+0000","last_undegraded":"2024-09-16T01:00:45.624262+0000","last_fullsized":"2024-09-16T01:00:45.624262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:54.776250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714062+0000","last_change":"2024-09-16T00:58:36.506625+0000","last_active":"2024-09-16T01:00:45.714062+0000","last_peered":"2024-09-16T01:00:45.714062+0000","last_clean":"2024-09-16T01:00:45.714062+0000","last_became_active":"2024-09-16T00:58:36.506337+0000","last_became_peered":"2024-09-16T00:58:36.506337+0000","last_unstale":"2024-09-16T01:00:45.714062+0000","last_undegraded":"2024-09-16T01:00:45.714062+0000","last_fullsized":"2024-09-16T01:00:45.714062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:22.080165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.901530+0000","last_change":"2024-09-16T01:00:45.901112+0000","last_active":"2024-09-16T01:00:45.901530+0000","last_peered":"2024-09-16T01:00:45.901530+0000","last_clean":"2024-09-16T01:00:45.901530+0000","last_became_active":"2024-09-16T01:00:45.898274+0000","last_became_peered":"2024-09-16T01:00:45.898274+0000","last_unstale":"2024-09-16T01:00:45.901530+0000","last_undegraded":"2024-09-16T01:00:45.901530+0000","last_fullsized":"2024-09-16T01:00:45.901530+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:55.626391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720033+0000","last_change":"2024-09-16T00:58:43.609399+0000","last_active":"2024-09-16T01:00:45.720033+0000","last_peered":"2024-09-16T01:00:45.720033+0000","last_clean":"2024-09-16T01:00:45.720033+0000","last_became_active":"2024-09-16T00:58:43.608988+0000","last_became_peered":"2024-09-16T00:58:43.608988+0000","last_unstale":"2024-09-16T01:00:45.720033+0000","last_undegraded":"2024-09-16T01:00:45.720033+0000","last_fullsized":"2024-09-16T01:00:45.720033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.500071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627256+0000","last_change":"2024-09-16T00:58:36.515930+0000","last_active":"2024-09-16T01:00:45.627256+0000","last_peered":"2024-09-16T01:00:45.627256+0000","last_clean":"2024-09-16T01:00:45.627256+0000","last_became_active":"2024-09-16T00:58:36.515625+0000","last_became_peered":"2024-09-16T00:58:36.515625+0000","last_unstale":"2024-09-16T01:00:45.627256+0000","last_undegraded":"2024-09-16T01:00:45.627256+0000","last_fullsized":"2024-09-16T01:00:45.627256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:55.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720365+0000","last_change":"2024-09-16T00:58:34.508686+0000","last_active":"2024-09-16T01:00:45.720365+0000","last_peered":"2024-09-16T01:00:45.720365+0000","last_clean":"2024-09-16T01:00:45.720365+0000","last_became_active":"2024-09-16T00:58:34.508284+0000","last_became_peered":"2024-09-16T00:58:34.508284+0000","last_unstale":"2024-09-16T01:00:45.720365+0000","last_undegraded":"2024-09-16T01:00:45.720365+0000","last_fullsized":"2024-09-16T01:00:45.720365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:47.545949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627558+0000","last_change":"2024-09-16T00:58:43.615852+0000","last_active":"2024-09-16T01:00:45.627558+0000","last_peered":"2024-09-16T01:00:45.627558+0000","last_clean":"2024-09-16T01:00:45.627558+0000","last_became_active":"2024-09-16T00:58:43.615474+0000","last_became_peered":"2024-09-16T00:58:43.615474+0000","last_unstale":"2024-09-16T01:00:45.627558+0000","last_undegraded":"2024-09-16T01:00:45.627558+0000","last_fullsized":"2024-09-16T01:00:45.627558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:39.596924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968316+0000","last_change":"2024-09-16T00:58:36.513820+0000","last_active":"2024-09-16T01:00:46.968316+0000","last_peered":"2024-09-16T01:00:46.968316+0000","last_clean":"2024-09-16T01:00:46.968316+0000","last_became_active":"2024-09-16T00:58:36.513513+0000","last_became_peered":"2024-09-16T00:58:36.513513+0000","last_unstale":"2024-09-16T01:00:46.968316+0000","last_undegraded":"2024-09-16T01:00:46.968316+0000","last_fullsized":"2024-09-16T01:00:46.968316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:34.584214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'16","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624208+0000","last_change":"2024-09-16T00:58:34.462794+0000","last_active":"2024-09-16T01:00:45.624208+0000","last_peered":"2024-09-16T01:00:45.624208+0000","last_clean":"2024-09-16T01:00:45.624208+0000","last_became_active":"2024-09-16T00:58:34.462471+0000","last_became_peered":"2024-09-16T00:58:34.462471+0000","last_unstale":"2024-09-16T01:00:45.624208+0000","last_undegraded":"2024-09-16T01:00:45.624208+0000","last_fullsized":"2024-09-16T01:00:45.624208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:13.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967564+0000","last_change":"2024-09-16T00:58:43.607718+0000","last_active":"2024-09-16T01:00:46.967564+0000","last_peered":"2024-09-16T01:00:46.967564+0000","last_clean":"2024-09-16T01:00:46.967564+0000","last_became_active":"2024-09-16T00:58:43.607347+0000","last_became_peered":"2024-09-16T00:58:43.607347+0000","last_unstale":"2024-09-16T01:00:46.967564+0000","last_undegraded":"2024-09-16T01:00:46.967564+0000","last_fullsized":"2024-09-16T01:00:46.967564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:12.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.507161+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.504062+0000","last_became_peered":"2024-09-16T00:58:36.504062+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:58:34.829848+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:58:34.829439+0000","last_became_peered":"2024-09-16T00:58:34.829439+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:06.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897267+0000","last_change":"2024-09-16T00:58:43.618334+0000","last_active":"2024-09-16T01:00:45.897267+0000","last_peered":"2024-09-16T01:00:45.897267+0000","last_clean":"2024-09-16T01:00:45.897267+0000","last_became_active":"2024-09-16T00:58:43.617810+0000","last_became_peered":"2024-09-16T00:58:43.617810+0000","last_unstale":"2024-09-16T01:00:45.897267+0000","last_undegraded":"2024-09-16T01:00:45.897267+0000","last_fullsized":"2024-09-16T01:00:45.897267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:58.202973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711427+0000","last_change":"2024-09-16T00:58:36.509025+0000","last_active":"2024-09-16T01:00:45.711427+0000","last_peered":"2024-09-16T01:00:45.711427+0000","last_clean":"2024-09-16T01:00:45.711427+0000","last_became_active":"2024-09-16T00:58:36.508660+0000","last_became_peered":"2024-09-16T00:58:36.508660+0000","last_unstale":"2024-09-16T01:00:45.711427+0000","last_undegraded":"2024-09-16T01:00:45.711427+0000","last_fullsized":"2024-09-16T01:00:45.711427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:01.433486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624046+0000","last_change":"2024-09-16T00:58:34.829899+0000","last_active":"2024-09-16T01:00:45.624046+0000","last_peered":"2024-09-16T01:00:45.624046+0000","last_clean":"2024-09-16T01:00:45.624046+0000","last_became_active":"2024-09-16T00:58:34.829546+0000","last_became_peered":"2024-09-16T00:58:34.829546+0000","last_unstale":"2024-09-16T01:00:45.624046+0000","last_undegraded":"2024-09-16T01:00:45.624046+0000","last_fullsized":"2024-09-16T01:00:45.624046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:21.253829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714080+0000","last_change":"2024-09-16T00:58:43.610143+0000","last_active":"2024-09-16T01:00:45.714080+0000","last_peered":"2024-09-16T01:00:45.714080+0000","last_clean":"2024-09-16T01:00:45.714080+0000","last_became_active":"2024-09-16T00:58:43.609739+0000","last_became_peered":"2024-09-16T00:58:43.609739+0000","last_unstale":"2024-09-16T01:00:45.714080+0000","last_undegraded":"2024-09-16T01:00:45.714080+0000","last_fullsized":"2024-09-16T01:00:45.714080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:28.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711421+0000","last_change":"2024-09-16T00:58:36.520423+0000","last_active":"2024-09-16T01:00:45.711421+0000","last_peered":"2024-09-16T01:00:45.711421+0000","last_clean":"2024-09-16T01:00:45.711421+0000","last_became_active":"2024-09-16T00:58:36.520117+0000","last_became_peered":"2024-09-16T00:58:36.520117+0000","last_unstale":"2024-09-16T01:00:45.711421+0000","last_undegraded":"2024-09-16T01:00:45.711421+0000","last_fullsized":"2024-09-16T01:00:45.711421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.652142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:04.945968+0000","last_change":"2024-09-16T00:58:34.475161+0000","last_active":"2024-09-16T01:01:04.945968+0000","last_peered":"2024-09-16T01:01:04.945968+0000","last_clean":"2024-09-16T01:01:04.945968+0000","last_became_active":"2024-09-16T00:58:34.474755+0000","last_became_peered":"2024-09-16T00:58:34.474755+0000","last_unstale":"2024-09-16T01:01:04.945968+0000","last_undegraded":"2024-09-16T01:01:04.945968+0000","last_fullsized":"2024-09-16T01:01:04.945968+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:12.884466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717746+0000","last_change":"2024-09-16T00:58:43.609042+0000","last_active":"2024-09-16T01:00:45.717746+0000","last_peered":"2024-09-16T01:00:45.717746+0000","last_clean":"2024-09-16T01:00:45.717746+0000","last_became_active":"2024-09-16T00:58:43.608596+0000","last_became_peered":"2024-09-16T00:58:43.608596+0000","last_unstale":"2024-09-16T01:00:45.717746+0000","last_undegraded":"2024-09-16T01:00:45.717746+0000","last_fullsized":"2024-09-16T01:00:45.717746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:47.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625659+0000","last_change":"2024-09-16T00:59:44.838583+0000","last_active":"2024-09-16T01:00:45.625659+0000","last_peered":"2024-09-16T01:00:45.625659+0000","last_clean":"2024-09-16T01:00:45.625659+0000","last_became_active":"2024-09-16T00:59:44.838221+0000","last_became_peered":"2024-09-16T00:59:44.838221+0000","last_unstale":"2024-09-16T01:00:45.625659+0000","last_undegraded":"2024-09-16T01:00:45.625659+0000","last_fullsized":"2024-09-16T01:00:45.625659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:27.562118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:02.744039+0000","last_change":"2024-09-16T00:58:34.829452+0000","last_active":"2024-09-16T01:01:02.744039+0000","last_peered":"2024-09-16T01:01:02.744039+0000","last_clean":"2024-09-16T01:01:02.744039+0000","last_became_active":"2024-09-16T00:58:34.829129+0000","last_became_peered":"2024-09-16T00:58:34.829129+0000","last_unstale":"2024-09-16T01:01:02.744039+0000","last_undegraded":"2024-09-16T01:01:02.744039+0000","last_fullsized":"2024-09-16T01:01:02.744039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718001+0000","last_change":"2024-09-16T00:58:43.609230+0000","last_active":"2024-09-16T01:00:45.718001+0000","last_peered":"2024-09-16T01:00:45.718001+0000","last_clean":"2024-09-16T01:00:45.718001+0000","last_became_active":"2024-09-16T00:58:43.608879+0000","last_became_peered":"2024-09-16T00:58:43.608879+0000","last_unstale":"2024-09-16T01:00:45.718001+0000","last_undegraded":"2024-09-16T01:00:45.718001+0000","last_fullsized":"2024-09-16T01:00:45.718001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.112878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717141+0000","last_change":"2024-09-16T00:58:36.503412+0000","last_active":"2024-09-16T01:00:45.717141+0000","last_peered":"2024-09-16T01:00:45.717141+0000","last_clean":"2024-09-16T01:00:45.717141+0000","last_became_active":"2024-09-16T00:58:36.503043+0000","last_became_peered":"2024-09-16T00:58:36.503043+0000","last_unstale":"2024-09-16T01:00:45.717141+0000","last_undegraded":"2024-09-16T01:00:45.717141+0000","last_fullsized":"2024-09-16T01:00:45.717141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:18.495669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919328+0000","last_change":"2024-09-16T00:58:34.468460+0000","last_active":"2024-09-16T01:00:45.919328+0000","last_peered":"2024-09-16T01:00:45.919328+0000","last_clean":"2024-09-16T01:00:45.919328+0000","last_became_active":"2024-09-16T00:58:34.468104+0000","last_became_peered":"2024-09-16T00:58:34.468104+0000","last_unstale":"2024-09-16T01:00:45.919328+0000","last_undegraded":"2024-09-16T01:00:45.919328+0000","last_fullsized":"2024-09-16T01:00:45.919328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:13.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714467+0000","last_change":"2024-09-16T00:59:44.863609+0000","last_active":"2024-09-16T01:00:45.714467+0000","last_peered":"2024-09-16T01:00:45.714467+0000","last_clean":"2024-09-16T01:00:45.714467+0000","last_became_active":"2024-09-16T00:59:44.863152+0000","last_became_peered":"2024-09-16T00:59:44.863152+0000","last_unstale":"2024-09-16T01:00:45.714467+0000","last_undegraded":"2024-09-16T01:00:45.714467+0000","last_fullsized":"2024-09-16T01:00:45.714467+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:51.312612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967875+0000","last_change":"2024-09-16T00:58:36.509749+0000","last_active":"2024-09-16T01:00:46.967875+0000","last_peered":"2024-09-16T01:00:46.967875+0000","last_clean":"2024-09-16T01:00:46.967875+0000","last_became_active":"2024-09-16T00:58:36.509411+0000","last_became_peered":"2024-09-16T00:58:36.509411+0000","last_unstale":"2024-09-16T01:00:46.967875+0000","last_undegraded":"2024-09-16T01:00:46.967875+0000","last_fullsized":"2024-09-16T01:00:46.967875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:14.291956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720026+0000","last_change":"2024-09-16T00:58:34.470190+0000","last_active":"2024-09-16T01:00:45.720026+0000","last_peered":"2024-09-16T01:00:45.720026+0000","last_clean":"2024-09-16T01:00:45.720026+0000","last_became_active":"2024-09-16T00:58:34.469832+0000","last_became_peered":"2024-09-16T00:58:34.469832+0000","last_unstale":"2024-09-16T01:00:45.720026+0000","last_undegraded":"2024-09-16T01:00:45.720026+0000","last_fullsized":"2024-09-16T01:00:45.720026+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:03.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919482+0000","last_change":"2024-09-16T00:57:23.502001+0000","last_active":"2024-09-16T01:00:45.919482+0000","last_peered":"2024-09-16T01:00:45.919482+0000","last_clean":"2024-09-16T01:00:45.919482+0000","last_became_active":"2024-09-16T00:57:23.501465+0000","last_became_peered":"2024-09-16T00:57:23.501465+0000","last_unstale":"2024-09-16T01:00:45.919482+0000","last_undegraded":"2024-09-16T01:00:45.919482+0000","last_fullsized":"2024-09-16T01:00:45.919482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_clean_scrub_stamp":"2024-09-16T00:53:57.344038+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:22.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919823+0000","last_change":"2024-09-16T00:58:43.609572+0000","last_active":"2024-09-16T01:00:45.919823+0000","last_peered":"2024-09-16T01:00:45.919823+0000","last_clean":"2024-09-16T01:00:45.919823+0000","last_became_active":"2024-09-16T00:58:43.609185+0000","last_became_peered":"2024-09-16T00:58:43.609185+0000","last_unstale":"2024-09-16T01:00:45.919823+0000","last_undegraded":"2024-09-16T01:00:45.919823+0000","last_fullsized":"2024-09-16T01:00:45.919823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.199976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919987+0000","last_change":"2024-09-16T00:58:36.510761+0000","last_active":"2024-09-16T01:00:45.919987+0000","last_peered":"2024-09-16T01:00:45.919987+0000","last_clean":"2024-09-16T01:00:45.919987+0000","last_became_active":"2024-09-16T00:58:36.510456+0000","last_became_peered":"2024-09-16T00:58:36.510456+0000","last_unstale":"2024-09-16T01:00:45.919987+0000","last_undegraded":"2024-09-16T01:00:45.919987+0000","last_fullsized":"2024-09-16T01:00:45.919987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:02.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'8","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:04.744929+0000","last_change":"2024-09-16T00:58:34.830238+0000","last_active":"2024-09-16T01:01:04.744929+0000","last_peered":"2024-09-16T01:01:04.744929+0000","last_clean":"2024-09-16T01:01:04.744929+0000","last_became_active":"2024-09-16T00:58:34.829558+0000","last_became_peered":"2024-09-16T00:58:34.829558+0000","last_unstale":"2024-09-16T01:01:04.744929+0000","last_undegraded":"2024-09-16T01:01:04.744929+0000","last_fullsized":"2024-09-16T01:01:04.744929+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.347122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624541+0000","last_change":"2024-09-16T00:58:43.613179+0000","last_active":"2024-09-16T01:00:45.624541+0000","last_peered":"2024-09-16T01:00:45.624541+0000","last_clean":"2024-09-16T01:00:45.624541+0000","last_became_active":"2024-09-16T00:58:43.612794+0000","last_became_peered":"2024-09-16T00:58:43.612794+0000","last_unstale":"2024-09-16T01:00:45.624541+0000","last_undegraded":"2024-09-16T01:00:45.624541+0000","last_fullsized":"2024-09-16T01:00:45.624541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:04:24.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919741+0000","last_change":"2024-09-16T00:58:36.512600+0000","last_active":"2024-09-16T01:00:45.919741+0000","last_peered":"2024-09-16T01:00:45.919741+0000","last_clean":"2024-09-16T01:00:45.919741+0000","last_became_active":"2024-09-16T00:58:36.512309+0000","last_became_peered":"2024-09-16T00:58:36.512309+0000","last_unstale":"2024-09-16T01:00:45.919741+0000","last_undegraded":"2024-09-16T01:00:45.919741+0000","last_fullsized":"2024-09-16T01:00:45.919741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.790755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626294+0000","last_change":"2024-09-16T00:58:34.471787+0000","last_active":"2024-09-16T01:00:45.626294+0000","last_peered":"2024-09-16T01:00:45.626294+0000","last_clean":"2024-09-16T01:00:45.626294+0000","last_became_active":"2024-09-16T00:58:34.471119+0000","last_became_peered":"2024-09-16T00:58:34.471119+0000","last_unstale":"2024-09-16T01:00:45.626294+0000","last_undegraded":"2024-09-16T01:00:45.626294+0000","last_fullsized":"2024-09-16T01:00:45.626294+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:26.121669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626989+0000","last_change":"2024-09-16T00:58:43.609676+0000","last_active":"2024-09-16T01:00:45.626989+0000","last_peered":"2024-09-16T01:00:45.626989+0000","last_clean":"2024-09-16T01:00:45.626989+0000","last_became_active":"2024-09-16T00:58:43.609313+0000","last_became_peered":"2024-09-16T00:58:43.609313+0000","last_unstale":"2024-09-16T01:00:45.626989+0000","last_undegraded":"2024-09-16T01:00:45.626989+0000","last_fullsized":"2024-09-16T01:00:45.626989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:53.339070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919903+0000","last_change":"2024-09-16T00:58:36.514621+0000","last_active":"2024-09-16T01:00:45.919903+0000","last_peered":"2024-09-16T01:00:45.919903+0000","last_clean":"2024-09-16T01:00:45.919903+0000","last_became_active":"2024-09-16T00:58:36.514259+0000","last_became_peered":"2024-09-16T00:58:36.514259+0000","last_unstale":"2024-09-16T01:00:45.919903+0000","last_undegraded":"2024-09-16T01:00:45.919903+0000","last_fullsized":"2024-09-16T01:00:45.919903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:11.411742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718006+0000","last_change":"2024-09-16T00:58:34.470512+0000","last_active":"2024-09-16T01:00:45.718006+0000","last_peered":"2024-09-16T01:00:45.718006+0000","last_clean":"2024-09-16T01:00:45.718006+0000","last_became_active":"2024-09-16T00:58:34.470140+0000","last_became_peered":"2024-09-16T00:58:34.470140+0000","last_unstale":"2024-09-16T01:00:45.718006+0000","last_undegraded":"2024-09-16T01:00:45.718006+0000","last_fullsized":"2024-09-16T01:00:45.718006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:04.068901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625516+0000","last_change":"2024-09-16T00:58:43.615221+0000","last_active":"2024-09-16T01:00:45.625516+0000","last_peered":"2024-09-16T01:00:45.625516+0000","last_clean":"2024-09-16T01:00:45.625516+0000","last_became_active":"2024-09-16T00:58:43.614820+0000","last_became_peered":"2024-09-16T00:58:43.614820+0000","last_unstale":"2024-09-16T01:00:45.625516+0000","last_undegraded":"2024-09-16T01:00:45.625516+0000","last_fullsized":"2024-09-16T01:00:45.625516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:31.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897390+0000","last_change":"2024-09-16T00:58:36.515470+0000","last_active":"2024-09-16T01:00:45.897390+0000","last_peered":"2024-09-16T01:00:45.897390+0000","last_clean":"2024-09-16T01:00:45.897390+0000","last_became_active":"2024-09-16T00:58:36.515145+0000","last_became_peered":"2024-09-16T00:58:36.515145+0000","last_unstale":"2024-09-16T01:00:45.897390+0000","last_undegraded":"2024-09-16T01:00:45.897390+0000","last_fullsized":"2024-09-16T01:00:45.897390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:10.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714720+0000","last_change":"2024-09-16T00:58:34.464865+0000","last_active":"2024-09-16T01:00:45.714720+0000","last_peered":"2024-09-16T01:00:45.714720+0000","last_clean":"2024-09-16T01:00:45.714720+0000","last_became_active":"2024-09-16T00:58:34.464448+0000","last_became_peered":"2024-09-16T00:58:34.464448+0000","last_unstale":"2024-09-16T01:00:45.714720+0000","last_undegraded":"2024-09-16T01:00:45.714720+0000","last_fullsized":"2024-09-16T01:00:45.714720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:47.454251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625710+0000","last_change":"2024-09-16T00:58:43.610348+0000","last_active":"2024-09-16T01:00:45.625710+0000","last_peered":"2024-09-16T01:00:45.625710+0000","last_clean":"2024-09-16T01:00:45.625710+0000","last_became_active":"2024-09-16T00:58:43.609497+0000","last_became_peered":"2024-09-16T00:58:43.609497+0000","last_unstale":"2024-09-16T01:00:45.625710+0000","last_undegraded":"2024-09-16T01:00:45.625710+0000","last_fullsized":"2024-09-16T01:00:45.625710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:52.931325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626081+0000","last_change":"2024-09-16T00:58:36.517412+0000","last_active":"2024-09-16T01:00:45.626081+0000","last_peered":"2024-09-16T01:00:45.626081+0000","last_clean":"2024-09-16T01:00:45.626081+0000","last_became_active":"2024-09-16T00:58:36.516600+0000","last_became_peered":"2024-09-16T00:58:36.516600+0000","last_unstale":"2024-09-16T01:00:45.626081+0000","last_undegraded":"2024-09-16T01:00:45.626081+0000","last_fullsized":"2024-09-16T01:00:45.626081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:39.445454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714191+0000","last_change":"2024-09-16T00:58:34.831420+0000","last_active":"2024-09-16T01:00:45.714191+0000","last_peered":"2024-09-16T01:00:45.714191+0000","last_clean":"2024-09-16T01:00:45.714191+0000","last_became_active":"2024-09-16T00:58:34.830991+0000","last_became_peered":"2024-09-16T00:58:34.830991+0000","last_unstale":"2024-09-16T01:00:45.714191+0000","last_undegraded":"2024-09-16T01:00:45.714191+0000","last_fullsized":"2024-09-16T01:00:45.714191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:13.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717963+0000","last_change":"2024-09-16T00:58:43.611781+0000","last_active":"2024-09-16T01:00:45.717963+0000","last_peered":"2024-09-16T01:00:45.717963+0000","last_clean":"2024-09-16T01:00:45.717963+0000","last_became_active":"2024-09-16T00:58:43.610332+0000","last_became_peered":"2024-09-16T00:58:43.610332+0000","last_unstale":"2024-09-16T01:00:45.717963+0000","last_undegraded":"2024-09-16T01:00:45.717963+0000","last_fullsized":"2024-09-16T01:00:45.717963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:18.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919291+0000","last_change":"2024-09-16T00:58:36.514395+0000","last_active":"2024-09-16T01:00:45.919291+0000","last_peered":"2024-09-16T01:00:45.919291+0000","last_clean":"2024-09-16T01:00:45.919291+0000","last_became_active":"2024-09-16T00:58:36.513570+0000","last_became_peered":"2024-09-16T00:58:36.513570+0000","last_unstale":"2024-09-16T01:00:45.919291+0000","last_undegraded":"2024-09-16T01:00:45.919291+0000","last_fullsized":"2024-09-16T01:00:45.919291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:56.148815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:01.743150+0000","last_change":"2024-09-16T00:58:34.473583+0000","last_active":"2024-09-16T01:01:01.743150+0000","last_peered":"2024-09-16T01:01:01.743150+0000","last_clean":"2024-09-16T01:01:01.743150+0000","last_became_active":"2024-09-16T00:58:34.473259+0000","last_became_peered":"2024-09-16T00:58:34.473259+0000","last_unstale":"2024-09-16T01:01:01.743150+0000","last_undegraded":"2024-09-16T01:01:01.743150+0000","last_fullsized":"2024-09-16T01:01:01.743150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:55.622609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:59:44.835446+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:41.254621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919524+0000","last_change":"2024-09-16T00:59:44.863645+0000","last_active":"2024-09-16T01:00:45.919524+0000","last_peered":"2024-09-16T01:00:45.919524+0000","last_clean":"2024-09-16T01:00:45.919524+0000","last_became_active":"2024-09-16T00:59:44.863207+0000","last_became_peered":"2024-09-16T00:59:44.863207+0000","last_unstale":"2024-09-16T01:00:45.919524+0000","last_undegraded":"2024-09-16T01:00:45.919524+0000","last_fullsized":"2024-09-16T01:00:45.919524+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:27.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626418+0000","last_change":"2024-09-16T00:58:34.470326+0000","last_active":"2024-09-16T01:00:45.626418+0000","last_peered":"2024-09-16T01:00:45.626418+0000","last_clean":"2024-09-16T01:00:45.626418+0000","last_became_active":"2024-09-16T00:58:34.469920+0000","last_became_peered":"2024-09-16T00:58:34.469920+0000","last_unstale":"2024-09-16T01:00:45.626418+0000","last_undegraded":"2024-09-16T01:00:45.626418+0000","last_fullsized":"2024-09-16T01:00:45.626418+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:58.718004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897319+0000","last_change":"2024-09-16T00:58:43.616324+0000","last_active":"2024-09-16T01:00:45.897319+0000","last_peered":"2024-09-16T01:00:45.897319+0000","last_clean":"2024-09-16T01:00:45.897319+0000","last_became_active":"2024-09-16T00:58:43.615903+0000","last_became_peered":"2024-09-16T00:58:43.615903+0000","last_unstale":"2024-09-16T01:00:45.897319+0000","last_undegraded":"2024-09-16T01:00:45.897319+0000","last_fullsized":"2024-09-16T01:00:45.897319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.683788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717440+0000","last_change":"2024-09-16T00:58:36.512490+0000","last_active":"2024-09-16T01:00:45.717440+0000","last_peered":"2024-09-16T01:00:45.717440+0000","last_clean":"2024-09-16T01:00:45.717440+0000","last_became_active":"2024-09-16T00:58:36.512167+0000","last_became_peered":"2024-09-16T00:58:36.512167+0000","last_unstale":"2024-09-16T01:00:45.717440+0000","last_undegraded":"2024-09-16T01:00:45.717440+0000","last_fullsized":"2024-09-16T01:00:45.717440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627945+0000","last_change":"2024-09-16T00:58:34.471603+0000","last_active":"2024-09-16T01:00:45.627945+0000","last_peered":"2024-09-16T01:00:45.627945+0000","last_clean":"2024-09-16T01:00:45.627945+0000","last_became_active":"2024-09-16T00:58:34.471241+0000","last_became_peered":"2024-09-16T00:58:34.471241+0000","last_unstale":"2024-09-16T01:00:45.627945+0000","last_undegraded":"2024-09-16T01:00:45.627945+0000","last_fullsized":"2024-09-16T01:00:45.627945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:33.756759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625999+0000","last_change":"2024-09-16T00:58:43.607428+0000","last_active":"2024-09-16T01:00:45.625999+0000","last_peered":"2024-09-16T01:00:45.625999+0000","last_clean":"2024-09-16T01:00:45.625999+0000","last_became_active":"2024-09-16T00:58:43.606990+0000","last_became_peered":"2024-09-16T00:58:43.606990+0000","last_unstale":"2024-09-16T01:00:45.625999+0000","last_undegraded":"2024-09-16T01:00:45.625999+0000","last_fullsized":"2024-09-16T01:00:45.625999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:52.367384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714506+0000","last_change":"2024-09-16T00:58:36.513967+0000","last_active":"2024-09-16T01:00:45.714506+0000","last_peered":"2024-09-16T01:00:45.714506+0000","last_clean":"2024-09-16T01:00:45.714506+0000","last_became_active":"2024-09-16T00:58:36.513610+0000","last_became_peered":"2024-09-16T00:58:36.513610+0000","last_unstale":"2024-09-16T01:00:45.714506+0000","last_undegraded":"2024-09-16T01:00:45.714506+0000","last_fullsized":"2024-09-16T01:00:45.714506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:22.763430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'40","reported_seq":295,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:03.742753+0000","last_change":"2024-09-16T00:58:34.471511+0000","last_active":"2024-09-16T01:01:03.742753+0000","last_peered":"2024-09-16T01:01:03.742753+0000","last_clean":"2024-09-16T01:01:03.742753+0000","last_became_active":"2024-09-16T00:58:34.470597+0000","last_became_peered":"2024-09-16T00:58:34.470597+0000","last_unstale":"2024-09-16T01:01:03.742753+0000","last_undegraded":"2024-09-16T01:01:03.742753+0000","last_fullsized":"2024-09-16T01:01:03.742753+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.782592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64041,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":171,"num_write":42,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623834+0000","last_change":"2024-09-16T00:58:43.612177+0000","last_active":"2024-09-16T01:00:45.623834+0000","last_peered":"2024-09-16T01:00:45.623834+0000","last_clean":"2024-09-16T01:00:45.623834+0000","last_became_active":"2024-09-16T00:58:43.611801+0000","last_became_peered":"2024-09-16T00:58:43.611801+0000","last_unstale":"2024-09-16T01:00:45.623834+0000","last_undegraded":"2024-09-16T01:00:45.623834+0000","last_fullsized":"2024-09-16T01:00:45.623834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.781429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624875+0000","last_change":"2024-09-16T00:58:36.502231+0000","last_active":"2024-09-16T01:00:45.624875+0000","last_peered":"2024-09-16T01:00:45.624875+0000","last_clean":"2024-09-16T01:00:45.624875+0000","last_became_active":"2024-09-16T00:58:36.501934+0000","last_became_peered":"2024-09-16T00:58:36.501934+0000","last_unstale":"2024-09-16T01:00:45.624875+0000","last_undegraded":"2024-09-16T01:00:45.624875+0000","last_fullsized":"2024-09-16T01:00:45.624875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:29.769186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626236+0000","last_change":"2024-09-16T00:58:34.829872+0000","last_active":"2024-09-16T01:00:45.626236+0000","last_peered":"2024-09-16T01:00:45.626236+0000","last_clean":"2024-09-16T01:00:45.626236+0000","last_became_active":"2024-09-16T00:58:34.829496+0000","last_became_peered":"2024-09-16T00:58:34.829496+0000","last_unstale":"2024-09-16T01:00:45.626236+0000","last_undegraded":"2024-09-16T01:00:45.626236+0000","last_fullsized":"2024-09-16T01:00:45.626236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:47.035177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720036+0000","last_change":"2024-09-16T00:58:43.615560+0000","last_active":"2024-09-16T01:00:45.720036+0000","last_peered":"2024-09-16T01:00:45.720036+0000","last_clean":"2024-09-16T01:00:45.720036+0000","last_became_active":"2024-09-16T00:58:43.615124+0000","last_became_peered":"2024-09-16T00:58:43.615124+0000","last_unstale":"2024-09-16T01:00:45.720036+0000","last_undegraded":"2024-09-16T01:00:45.720036+0000","last_fullsized":"2024-09-16T01:00:45.720036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.455528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627428+0000","last_change":"2024-09-16T00:58:36.514456+0000","last_active":"2024-09-16T01:00:45.627428+0000","last_peered":"2024-09-16T01:00:45.627428+0000","last_clean":"2024-09-16T01:00:45.627428+0000","last_became_active":"2024-09-16T00:58:36.514146+0000","last_became_peered":"2024-09-16T00:58:36.514146+0000","last_unstale":"2024-09-16T01:00:45.627428+0000","last_undegraded":"2024-09-16T01:00:45.627428+0000","last_fullsized":"2024-09-16T01:00:45.627428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:06.760121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919878+0000","last_change":"2024-09-16T00:58:34.471316+0000","last_active":"2024-09-16T01:00:45.919878+0000","last_peered":"2024-09-16T01:00:45.919878+0000","last_clean":"2024-09-16T01:00:45.919878+0000","last_became_active":"2024-09-16T00:58:34.470991+0000","last_became_peered":"2024-09-16T00:58:34.470991+0000","last_unstale":"2024-09-16T01:00:45.919878+0000","last_undegraded":"2024-09-16T01:00:45.919878+0000","last_fullsized":"2024-09-16T01:00:45.919878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:44.492439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623687+0000","last_change":"2024-09-16T00:58:43.617202+0000","last_active":"2024-09-16T01:00:45.623687+0000","last_peered":"2024-09-16T01:00:45.623687+0000","last_clean":"2024-09-16T01:00:45.623687+0000","last_became_active":"2024-09-16T00:58:43.616824+0000","last_became_peered":"2024-09-16T00:58:43.616824+0000","last_unstale":"2024-09-16T01:00:45.623687+0000","last_undegraded":"2024-09-16T01:00:45.623687+0000","last_fullsized":"2024-09-16T01:00:45.623687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:43.035003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625210+0000","last_change":"2024-09-16T00:58:36.512079+0000","last_active":"2024-09-16T01:00:45.625210+0000","last_peered":"2024-09-16T01:00:45.625210+0000","last_clean":"2024-09-16T01:00:45.625210+0000","last_became_active":"2024-09-16T00:58:36.511220+0000","last_became_peered":"2024-09-16T00:58:36.511220+0000","last_unstale":"2024-09-16T01:00:45.625210+0000","last_undegraded":"2024-09-16T01:00:45.625210+0000","last_fullsized":"2024-09-16T01:00:45.625210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:49.798132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'6","reported_seq":251,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:03.742205+0000","last_change":"2024-09-16T00:58:34.470682+0000","last_active":"2024-09-16T01:01:03.742205+0000","last_peered":"2024-09-16T01:01:03.742205+0000","last_clean":"2024-09-16T01:01:03.742205+0000","last_became_active":"2024-09-16T00:58:34.470323+0000","last_became_peered":"2024-09-16T00:58:34.470323+0000","last_unstale":"2024-09-16T01:01:03.742205+0000","last_undegraded":"2024-09-16T01:01:03.742205+0000","last_fullsized":"2024-09-16T01:01:03.742205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.361374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967738+0000","last_change":"2024-09-16T00:58:43.608941+0000","last_active":"2024-09-16T01:00:46.967738+0000","last_peered":"2024-09-16T01:00:46.967738+0000","last_clean":"2024-09-16T01:00:46.967738+0000","last_became_active":"2024-09-16T00:58:43.607406+0000","last_became_peered":"2024-09-16T00:58:43.607406+0000","last_unstale":"2024-09-16T01:00:46.967738+0000","last_undegraded":"2024-09-16T01:00:46.967738+0000","last_fullsized":"2024-09-16T01:00:46.967738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:10.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627074+0000","last_change":"2024-09-16T00:58:43.613902+0000","last_active":"2024-09-16T01:00:45.627074+0000","last_peered":"2024-09-16T01:00:45.627074+0000","last_clean":"2024-09-16T01:00:45.627074+0000","last_became_active":"2024-09-16T00:58:43.613530+0000","last_became_peered":"2024-09-16T00:58:43.613530+0000","last_unstale":"2024-09-16T01:00:45.627074+0000","last_undegraded":"2024-09-16T01:00:45.627074+0000","last_fullsized":"2024-09-16T01:00:45.627074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:34.774810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623790+0000","last_change":"2024-09-16T00:58:36.504745+0000","last_active":"2024-09-16T01:00:45.623790+0000","last_peered":"2024-09-16T01:00:45.623790+0000","last_clean":"2024-09-16T01:00:45.623790+0000","last_became_active":"2024-09-16T00:58:36.504400+0000","last_became_peered":"2024-09-16T00:58:36.504400+0000","last_unstale":"2024-09-16T01:00:45.623790+0000","last_undegraded":"2024-09-16T01:00:45.623790+0000","last_fullsized":"2024-09-16T01:00:45.623790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:34.444019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626135+0000","last_change":"2024-09-16T00:58:34.470285+0000","last_active":"2024-09-16T01:00:45.626135+0000","last_peered":"2024-09-16T01:00:45.626135+0000","last_clean":"2024-09-16T01:00:45.626135+0000","last_became_active":"2024-09-16T00:58:34.469948+0000","last_became_peered":"2024-09-16T00:58:34.469948+0000","last_unstale":"2024-09-16T01:00:45.626135+0000","last_undegraded":"2024-09-16T01:00:45.626135+0000","last_fullsized":"2024-09-16T01:00:45.626135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:28.553863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897172+0000","last_change":"2024-09-16T00:58:43.614818+0000","last_active":"2024-09-16T01:00:45.897172+0000","last_peered":"2024-09-16T01:00:45.897172+0000","last_clean":"2024-09-16T01:00:45.897172+0000","last_became_active":"2024-09-16T00:58:43.614376+0000","last_became_peered":"2024-09-16T00:58:43.614376+0000","last_unstale":"2024-09-16T01:00:45.897172+0000","last_undegraded":"2024-09-16T01:00:45.897172+0000","last_fullsized":"2024-09-16T01:00:45.897172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:41.699930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967770+0000","last_change":"2024-09-16T00:58:36.505127+0000","last_active":"2024-09-16T01:00:46.967770+0000","last_peered":"2024-09-16T01:00:46.967770+0000","last_clean":"2024-09-16T01:00:46.967770+0000","last_became_active":"2024-09-16T00:58:36.504552+0000","last_became_peered":"2024-09-16T00:58:36.504552+0000","last_unstale":"2024-09-16T01:00:46.967770+0000","last_undegraded":"2024-09-16T01:00:46.967770+0000","last_fullsized":"2024-09-16T01:00:46.967770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:48.104109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717213+0000","last_change":"2024-09-16T00:58:34.462231+0000","last_active":"2024-09-16T01:00:45.717213+0000","last_peered":"2024-09-16T01:00:45.717213+0000","last_clean":"2024-09-16T01:00:45.717213+0000","last_became_active":"2024-09-16T00:58:34.461891+0000","last_became_peered":"2024-09-16T00:58:34.461891+0000","last_unstale":"2024-09-16T01:00:45.717213+0000","last_undegraded":"2024-09-16T01:00:45.717213+0000","last_fullsized":"2024-09-16T01:00:45.717213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.483996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711498+0000","last_change":"2024-09-16T00:58:34.472457+0000","last_active":"2024-09-16T01:00:45.711498+0000","last_peered":"2024-09-16T01:00:45.711498+0000","last_clean":"2024-09-16T01:00:45.711498+0000","last_became_active":"2024-09-16T00:58:34.472084+0000","last_became_peered":"2024-09-16T00:58:34.472084+0000","last_unstale":"2024-09-16T01:00:45.711498+0000","last_undegraded":"2024-09-16T01:00:45.711498+0000","last_fullsized":"2024-09-16T01:00:45.711498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:08.005195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626019+0000","last_change":"2024-09-16T00:58:36.508791+0000","last_active":"2024-09-16T01:00:45.626019+0000","last_peered":"2024-09-16T01:00:45.626019+0000","last_clean":"2024-09-16T01:00:45.626019+0000","last_became_active":"2024-09-16T00:58:36.508461+0000","last_became_peered":"2024-09-16T00:58:36.508461+0000","last_unstale":"2024-09-16T01:00:45.626019+0000","last_undegraded":"2024-09-16T01:00:45.626019+0000","last_fullsized":"2024-09-16T01:00:45.626019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.938067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627838+0000","last_change":"2024-09-16T00:58:43.620439+0000","last_active":"2024-09-16T01:00:45.627838+0000","last_peered":"2024-09-16T01:00:45.627838+0000","last_clean":"2024-09-16T01:00:45.627838+0000","last_became_active":"2024-09-16T00:58:43.619952+0000","last_became_peered":"2024-09-16T00:58:43.619952+0000","last_unstale":"2024-09-16T01:00:45.627838+0000","last_undegraded":"2024-09-16T01:00:45.627838+0000","last_fullsized":"2024-09-16T01:00:45.627838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:00.737693+0000","last_change":"2024-09-16T00:58:34.473169+0000","last_active":"2024-09-16T01:01:00.737693+0000","last_peered":"2024-09-16T01:01:00.737693+0000","last_clean":"2024-09-16T01:01:00.737693+0000","last_became_active":"2024-09-16T00:58:34.472839+0000","last_became_peered":"2024-09-16T00:58:34.472839+0000","last_unstale":"2024-09-16T01:01:00.737693+0000","last_undegraded":"2024-09-16T01:01:00.737693+0000","last_fullsized":"2024-09-16T01:01:00.737693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:03.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714120+0000","last_change":"2024-09-16T00:58:36.508719+0000","last_active":"2024-09-16T01:00:45.714120+0000","last_peered":"2024-09-16T01:00:45.714120+0000","last_clean":"2024-09-16T01:00:45.714120+0000","last_became_active":"2024-09-16T00:58:36.508427+0000","last_became_peered":"2024-09-16T00:58:36.508427+0000","last_unstale":"2024-09-16T01:00:45.714120+0000","last_undegraded":"2024-09-16T01:00:45.714120+0000","last_fullsized":"2024-09-16T01:00:45.714120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:44.134558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627784+0000","last_change":"2024-09-16T00:58:43.616532+0000","last_active":"2024-09-16T01:00:45.627784+0000","last_peered":"2024-09-16T01:00:45.627784+0000","last_clean":"2024-09-16T01:00:45.627784+0000","last_became_active":"2024-09-16T00:58:43.616146+0000","last_became_peered":"2024-09-16T00:58:43.616146+0000","last_unstale":"2024-09-16T01:00:45.627784+0000","last_undegraded":"2024-09-16T01:00:45.627784+0000","last_fullsized":"2024-09-16T01:00:45.627784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:50.904766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897283+0000","last_change":"2024-09-16T00:58:36.513232+0000","last_active":"2024-09-16T01:00:45.897283+0000","last_peered":"2024-09-16T01:00:45.897283+0000","last_clean":"2024-09-16T01:00:45.897283+0000","last_became_active":"2024-09-16T00:58:36.512239+0000","last_became_peered":"2024-09-16T00:58:36.512239+0000","last_unstale":"2024-09-16T01:00:45.897283+0000","last_undegraded":"2024-09-16T01:00:45.897283+0000","last_fullsized":"2024-09-16T01:00:45.897283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627619+0000","last_change":"2024-09-16T00:58:36.513160+0000","last_active":"2024-09-16T01:00:45.627619+0000","last_peered":"2024-09-16T01:00:45.627619+0000","last_clean":"2024-09-16T01:00:45.627619+0000","last_became_active":"2024-09-16T00:58:36.512523+0000","last_became_peered":"2024-09-16T00:58:36.512523+0000","last_unstale":"2024-09-16T01:00:45.627619+0000","last_undegraded":"2024-09-16T01:00:45.627619+0000","last_fullsized":"2024-09-16T01:00:45.627619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:20.934937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627648+0000","last_change":"2024-09-16T00:58:36.516416+0000","last_active":"2024-09-16T01:00:45.627648+0000","last_peered":"2024-09-16T01:00:45.627648+0000","last_clean":"2024-09-16T01:00:45.627648+0000","last_became_active":"2024-09-16T00:58:36.516121+0000","last_became_peered":"2024-09-16T00:58:36.516121+0000","last_unstale":"2024-09-16T01:00:45.627648+0000","last_undegraded":"2024-09-16T01:00:45.627648+0000","last_fullsized":"2024-09-16T01:00:45.627648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:28.848616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627011+0000","last_change":"2024-09-16T00:58:36.510854+0000","last_active":"2024-09-16T01:00:45.627011+0000","last_peered":"2024-09-16T01:00:45.627011+0000","last_clean":"2024-09-16T01:00:45.627011+0000","last_became_active":"2024-09-16T00:58:36.510505+0000","last_became_peered":"2024-09-16T00:58:36.510505+0000","last_unstale":"2024-09-16T01:00:45.627011+0000","last_undegraded":"2024-09-16T01:00:45.627011+0000","last_fullsized":"2024-09-16T01:00:45.627011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.699942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.509016+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.508690+0000","last_became_peered":"2024-09-16T00:58:36.508690+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:41.425016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897266+0000","last_change":"2024-09-16T00:58:36.511659+0000","last_active":"2024-09-16T01:00:45.897266+0000","last_peered":"2024-09-16T01:00:45.897266+0000","last_clean":"2024-09-16T01:00:45.897266+0000","last_became_active":"2024-09-16T00:58:36.511225+0000","last_became_peered":"2024-09-16T00:58:36.511225+0000","last_unstale":"2024-09-16T01:00:45.897266+0000","last_undegraded":"2024-09-16T01:00:45.897266+0000","last_fullsized":"2024-09-16T01:00:45.897266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:43.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628196+0000","last_change":"2024-09-16T00:58:36.511614+0000","last_active":"2024-09-16T01:00:45.628196+0000","last_peered":"2024-09-16T01:00:45.628196+0000","last_clean":"2024-09-16T01:00:45.628196+0000","last_became_active":"2024-09-16T00:58:36.511304+0000","last_became_peered":"2024-09-16T00:58:36.511304+0000","last_unstale":"2024-09-16T01:00:45.628196+0000","last_undegraded":"2024-09-16T01:00:45.628196+0000","last_fullsized":"2024-09-16T01:00:45.628196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:20.755419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968311+0000","last_change":"2024-09-16T00:58:36.509399+0000","last_active":"2024-09-16T01:00:46.968311+0000","last_peered":"2024-09-16T01:00:46.968311+0000","last_clean":"2024-09-16T01:00:46.968311+0000","last_became_active":"2024-09-16T00:58:36.509072+0000","last_became_peered":"2024-09-16T00:58:36.509072+0000","last_unstale":"2024-09-16T01:00:46.968311+0000","last_undegraded":"2024-09-16T01:00:46.968311+0000","last_fullsized":"2024-09-16T01:00:46.968311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:29.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625679+0000","last_change":"2024-09-16T00:58:36.506252+0000","last_active":"2024-09-16T01:00:45.625679+0000","last_peered":"2024-09-16T01:00:45.625679+0000","last_clean":"2024-09-16T01:00:45.625679+0000","last_became_active":"2024-09-16T00:58:36.505923+0000","last_became_peered":"2024-09-16T00:58:36.505923+0000","last_unstale":"2024-09-16T01:00:45.625679+0000","last_undegraded":"2024-09-16T01:00:45.625679+0000","last_fullsized":"2024-09-16T01:00:45.625679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:05.332472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967824+0000","last_change":"2024-09-16T00:58:36.506598+0000","last_active":"2024-09-16T01:00:46.967824+0000","last_peered":"2024-09-16T01:00:46.967824+0000","last_clean":"2024-09-16T01:00:46.967824+0000","last_became_active":"2024-09-16T00:58:36.506299+0000","last_became_peered":"2024-09-16T00:58:36.506299+0000","last_unstale":"2024-09-16T01:00:46.967824+0000","last_undegraded":"2024-09-16T01:00:46.967824+0000","last_fullsized":"2024-09-16T01:00:46.967824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.327225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624647+0000","last_change":"2024-09-16T00:58:36.517050+0000","last_active":"2024-09-16T01:00:45.624647+0000","last_peered":"2024-09-16T01:00:45.624647+0000","last_clean":"2024-09-16T01:00:45.624647+0000","last_became_active":"2024-09-16T00:58:36.516745+0000","last_became_peered":"2024-09-16T00:58:36.516745+0000","last_unstale":"2024-09-16T01:00:45.624647+0000","last_undegraded":"2024-09-16T01:00:45.624647+0000","last_fullsized":"2024-09-16T01:00:45.624647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:59.981792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717660+0000","last_change":"2024-09-16T00:58:36.512442+0000","last_active":"2024-09-16T01:00:45.717660+0000","last_peered":"2024-09-16T01:00:45.717660+0000","last_clean":"2024-09-16T01:00:45.717660+0000","last_became_active":"2024-09-16T00:58:36.512132+0000","last_became_peered":"2024-09-16T00:58:36.512132+0000","last_unstale":"2024-09-16T01:00:45.717660+0000","last_undegraded":"2024-09-16T01:00:45.717660+0000","last_fullsized":"2024-09-16T01:00:45.717660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:06.511257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897210+0000","last_change":"2024-09-16T00:58:36.519754+0000","last_active":"2024-09-16T01:00:45.897210+0000","last_peered":"2024-09-16T01:00:45.897210+0000","last_clean":"2024-09-16T01:00:45.897210+0000","last_became_active":"2024-09-16T00:58:36.519378+0000","last_became_peered":"2024-09-16T00:58:36.519378+0000","last_unstale":"2024-09-16T01:00:45.897210+0000","last_undegraded":"2024-09-16T01:00:45.897210+0000","last_fullsized":"2024-09-16T01:00:45.897210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:51.076588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628046+0000","last_change":"2024-09-16T00:58:36.504627+0000","last_active":"2024-09-16T01:00:45.628046+0000","last_peered":"2024-09-16T01:00:45.628046+0000","last_clean":"2024-09-16T01:00:45.628046+0000","last_became_active":"2024-09-16T00:58:36.504282+0000","last_became_peered":"2024-09-16T00:58:36.504282+0000","last_unstale":"2024-09-16T01:00:45.628046+0000","last_undegraded":"2024-09-16T01:00:45.628046+0000","last_fullsized":"2024-09-16T01:00:45.628046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.857181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624140+0000","last_change":"2024-09-16T00:58:36.508971+0000","last_active":"2024-09-16T01:00:45.624140+0000","last_peered":"2024-09-16T01:00:45.624140+0000","last_clean":"2024-09-16T01:00:45.624140+0000","last_became_active":"2024-09-16T00:58:36.508631+0000","last_became_peered":"2024-09-16T00:58:36.508631+0000","last_unstale":"2024-09-16T01:00:45.624140+0000","last_undegraded":"2024-09-16T01:00:45.624140+0000","last_fullsized":"2024-09-16T01:00:45.624140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:17.092613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897604+0000","last_change":"2024-09-16T00:58:36.517255+0000","last_active":"2024-09-16T01:00:45.897604+0000","last_peered":"2024-09-16T01:00:45.897604+0000","last_clean":"2024-09-16T01:00:45.897604+0000","last_became_active":"2024-09-16T00:58:36.516957+0000","last_became_peered":"2024-09-16T00:58:36.516957+0000","last_unstale":"2024-09-16T01:00:45.897604+0000","last_undegraded":"2024-09-16T01:00:45.897604+0000","last_fullsized":"2024-09-16T01:00:45.897604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:34.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624283+0000","last_change":"2024-09-16T00:58:36.516429+0000","last_active":"2024-09-16T01:00:45.624283+0000","last_peered":"2024-09-16T01:00:45.624283+0000","last_clean":"2024-09-16T01:00:45.624283+0000","last_became_active":"2024-09-16T00:58:36.516111+0000","last_became_peered":"2024-09-16T00:58:36.516111+0000","last_unstale":"2024-09-16T01:00:45.624283+0000","last_undegraded":"2024-09-16T01:00:45.624283+0000","last_fullsized":"2024-09-16T01:00:45.624283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:06.120653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626784+0000","last_change":"2024-09-16T00:58:36.512873+0000","last_active":"2024-09-16T01:00:45.626784+0000","last_peered":"2024-09-16T01:00:45.626784+0000","last_clean":"2024-09-16T01:00:45.626784+0000","last_became_active":"2024-09-16T00:58:36.511761+0000","last_became_peered":"2024-09-16T00:58:36.511761+0000","last_unstale":"2024-09-16T01:00:45.626784+0000","last_undegraded":"2024-09-16T01:00:45.626784+0000","last_fullsized":"2024-09-16T01:00:45.626784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:51.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626810+0000","last_change":"2024-09-16T00:58:36.511585+0000","last_active":"2024-09-16T01:00:45.626810+0000","last_peered":"2024-09-16T01:00:45.626810+0000","last_clean":"2024-09-16T01:00:45.626810+0000","last_became_active":"2024-09-16T00:58:36.510479+0000","last_became_peered":"2024-09-16T00:58:36.510479+0000","last_unstale":"2024-09-16T01:00:45.626810+0000","last_undegraded":"2024-09-16T01:00:45.626810+0000","last_fullsized":"2024-09-16T01:00:45.626810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:58.017132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717650+0000","last_change":"2024-09-16T00:58:36.508263+0000","last_active":"2024-09-16T01:00:45.717650+0000","last_peered":"2024-09-16T01:00:45.717650+0000","last_clean":"2024-09-16T01:00:45.717650+0000","last_became_active":"2024-09-16T00:58:36.507979+0000","last_became_peered":"2024-09-16T00:58:36.507979+0000","last_unstale":"2024-09-16T01:00:45.717650+0000","last_undegraded":"2024-09-16T01:00:45.717650+0000","last_fullsized":"2024-09-16T01:00:45.717650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:07.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720241+0000","last_change":"2024-09-16T00:58:36.514981+0000","last_active":"2024-09-16T01:00:45.720241+0000","last_peered":"2024-09-16T01:00:45.720241+0000","last_clean":"2024-09-16T01:00:45.720241+0000","last_became_active":"2024-09-16T00:58:36.510433+0000","last_became_peered":"2024-09-16T00:58:36.510433+0000","last_unstale":"2024-09-16T01:00:45.720241+0000","last_undegraded":"2024-09-16T01:00:45.720241+0000","last_fullsized":"2024-09-16T01:00:45.720241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:10.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919996+0000","last_change":"2024-09-16T00:58:36.521336+0000","last_active":"2024-09-16T01:00:45.919996+0000","last_peered":"2024-09-16T01:00:45.919996+0000","last_clean":"2024-09-16T01:00:45.919996+0000","last_became_active":"2024-09-16T00:58:36.521026+0000","last_became_peered":"2024-09-16T00:58:36.521026+0000","last_unstale":"2024-09-16T01:00:45.919996+0000","last_undegraded":"2024-09-16T01:00:45.919996+0000","last_fullsized":"2024-09-16T01:00:45.919996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:29.409024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711912+0000","last_change":"2024-09-16T00:58:36.518724+0000","last_active":"2024-09-16T01:00:45.711912+0000","last_peered":"2024-09-16T01:00:45.711912+0000","last_clean":"2024-09-16T01:00:45.711912+0000","last_became_active":"2024-09-16T00:58:36.518428+0000","last_became_peered":"2024-09-16T00:58:36.518428+0000","last_unstale":"2024-09-16T01:00:45.711912+0000","last_undegraded":"2024-09-16T01:00:45.711912+0000","last_fullsized":"2024-09-16T01:00:45.711912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:06.486299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625258+0000","last_change":"2024-09-16T00:58:36.514347+0000","last_active":"2024-09-16T01:00:45.625258+0000","last_peered":"2024-09-16T01:00:45.625258+0000","last_clean":"2024-09-16T01:00:45.625258+0000","last_became_active":"2024-09-16T00:58:36.512243+0000","last_became_peered":"2024-09-16T00:58:36.512243+0000","last_unstale":"2024-09-16T01:00:45.625258+0000","last_undegraded":"2024-09-16T01:00:45.625258+0000","last_fullsized":"2024-09-16T01:00:45.625258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.289541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623615+0000","last_change":"2024-09-16T00:59:44.837828+0000","last_active":"2024-09-16T01:00:45.623615+0000","last_peered":"2024-09-16T01:00:45.623615+0000","last_clean":"2024-09-16T01:00:45.623615+0000","last_became_active":"2024-09-16T00:59:44.837486+0000","last_became_peered":"2024-09-16T00:59:44.837486+0000","last_unstale":"2024-09-16T01:00:45.623615+0000","last_undegraded":"2024-09-16T01:00:45.623615+0000","last_fullsized":"2024-09-16T01:00:45.623615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:46.914056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919570+0000","last_change":"2024-09-16T00:58:36.516797+0000","last_active":"2024-09-16T01:00:45.919570+0000","last_peered":"2024-09-16T01:00:45.919570+0000","last_clean":"2024-09-16T01:00:45.919570+0000","last_became_active":"2024-09-16T00:58:36.516480+0000","last_became_peered":"2024-09-16T00:58:36.516480+0000","last_unstale":"2024-09-16T01:00:45.919570+0000","last_undegraded":"2024-09-16T01:00:45.919570+0000","last_fullsized":"2024-09-16T01:00:45.919570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:55.262528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711362+0000","last_change":"2024-09-16T00:58:36.517973+0000","last_active":"2024-09-16T01:00:45.711362+0000","last_peered":"2024-09-16T01:00:45.711362+0000","last_clean":"2024-09-16T01:00:45.711362+0000","last_became_active":"2024-09-16T00:58:36.517634+0000","last_became_peered":"2024-09-16T00:58:36.517634+0000","last_unstale":"2024-09-16T01:00:45.711362+0000","last_undegraded":"2024-09-16T01:00:45.711362+0000","last_fullsized":"2024-09-16T01:00:45.711362+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:19.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714090+0000","last_change":"2024-09-16T00:58:36.507643+0000","last_active":"2024-09-16T01:00:45.714090+0000","last_peered":"2024-09-16T01:00:45.714090+0000","last_clean":"2024-09-16T01:00:45.714090+0000","last_became_active":"2024-09-16T00:58:36.507263+0000","last_became_peered":"2024-09-16T00:58:36.507263+0000","last_unstale":"2024-09-16T01:00:45.714090+0000","last_undegraded":"2024-09-16T01:00:45.714090+0000","last_fullsized":"2024-09-16T01:00:45.714090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:24.317490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720025+0000","last_change":"2024-09-16T00:58:36.508798+0000","last_active":"2024-09-16T01:00:45.720025+0000","last_peered":"2024-09-16T01:00:45.720025+0000","last_clean":"2024-09-16T01:00:45.720025+0000","last_became_active":"2024-09-16T00:58:36.508490+0000","last_became_peered":"2024-09-16T00:58:36.508490+0000","last_unstale":"2024-09-16T01:00:45.720025+0000","last_undegraded":"2024-09-16T01:00:45.720025+0000","last_fullsized":"2024-09-16T01:00:45.720025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:44.282270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627327+0000","last_change":"2024-09-16T00:58:36.519065+0000","last_active":"2024-09-16T01:00:45.627327+0000","last_peered":"2024-09-16T01:00:45.627327+0000","last_clean":"2024-09-16T01:00:45.627327+0000","last_became_active":"2024-09-16T00:58:36.518708+0000","last_became_peered":"2024-09-16T00:58:36.518708+0000","last_unstale":"2024-09-16T01:00:45.627327+0000","last_undegraded":"2024-09-16T01:00:45.627327+0000","last_fullsized":"2024-09-16T01:00:45.627327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:10.290341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627159+0000","last_change":"2024-09-16T00:58:36.513018+0000","last_active":"2024-09-16T01:00:45.627159+0000","last_peered":"2024-09-16T01:00:45.627159+0000","last_clean":"2024-09-16T01:00:45.627159+0000","last_became_active":"2024-09-16T00:58:36.511730+0000","last_became_peered":"2024-09-16T00:58:36.511730+0000","last_unstale":"2024-09-16T01:00:45.627159+0000","last_undegraded":"2024-09-16T01:00:45.627159+0000","last_fullsized":"2024-09-16T01:00:45.627159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:20.852121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897471+0000","last_change":"2024-09-16T00:58:36.518265+0000","last_active":"2024-09-16T01:00:45.897471+0000","last_peered":"2024-09-16T01:00:45.897471+0000","last_clean":"2024-09-16T01:00:45.897471+0000","last_became_active":"2024-09-16T00:58:36.517906+0000","last_became_peered":"2024-09-16T00:58:36.517906+0000","last_unstale":"2024-09-16T01:00:45.897471+0000","last_undegraded":"2024-09-16T01:00:45.897471+0000","last_fullsized":"2024-09-16T01:00:45.897471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.255849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71305,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1066,"num_read_kb":609,"num_write":261,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":217613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282150,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612652,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":513588,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32300,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712852,"statfs":{"total":95995035648,"available":95961960448,"internally_reserved":0,"allocated":1142784,"data_stored":1163603,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005110,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":516772,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234043,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1003520,"data_stored":512382,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462976,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":1109160,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626501,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":991232,"data_stored":508180,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855433,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":1104742,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018959,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":512926,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247893,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":507888,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444122,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":578627,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607646,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1060864,"data_stored":572943,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":510170,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:01:08.222 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:01:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.360+0000 7fcb901b7640 1 -- 172.21.15.12:0/1506610469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb881025c0 msgr2=0x7fcb88108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.360+0000 7fcb901b7640 1 --2- 172.21.15.12:0/1506610469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb881025c0 0x7fcb88108e50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcb80009ca0 tx=0x7fcb8002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.360+0000 7fcb901b7640 1 -- 172.21.15.12:0/1506610469 shutdown_connections 2024-09-16T01:01:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.360+0000 7fcb901b7640 1 --2- 172.21.15.12:0/1506610469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb881025c0 0x7fcb88108e50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.360+0000 7fcb901b7640 1 --2- 172.21.15.12:0/1506610469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb88101c00 0x7fcb88102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.360+0000 7fcb901b7640 1 --2- 172.21.15.12:0/1506610469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb88100a10 0x7fcb88100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.360+0000 7fcb901b7640 1 -- 172.21.15.12:0/1506610469 >> 172.21.15.12:0/1506610469 conn(0x7fcb880fc170 msgr2=0x7fcb880fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.360+0000 7fcb901b7640 1 -- 172.21.15.12:0/1506610469 shutdown_connections 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.360+0000 7fcb901b7640 1 -- 172.21.15.12:0/1506610469 wait complete. 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.360+0000 7fcb901b7640 1 Processor -- start 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb901b7640 1 -- start start 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb901b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb88100a10 0x7fcb88197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb901b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb88101c00 0x7fcb88198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb901b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb881025c0 0x7fcb8819f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb901b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8810c690 con 0x7fcb88100a10 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb901b7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8810c510 con 0x7fcb88101c00 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb901b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8810c810 con 0x7fcb881025c0 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8df53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb88100a10 0x7fcb88197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8df53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb88100a10 0x7fcb88197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33102/0 (socket says 172.21.15.12:33102) 2024-09-16T01:01:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8df53640 1 -- 172.21.15.12:0/3402342431 learned_addr learned my addr 172.21.15.12:0/3402342431 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8e754640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb881025c0 0x7fcb8819f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8d752640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb88101c00 0x7fcb88198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8df53640 1 -- 172.21.15.12:0/3402342431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb881025c0 msgr2=0x7fcb8819f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8df53640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb881025c0 0x7fcb8819f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8df53640 1 -- 172.21.15.12:0/3402342431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb88101c00 msgr2=0x7fcb88198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8df53640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb88101c00 0x7fcb88198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8df53640 1 -- 172.21.15.12:0/3402342431 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8819fa00 con 0x7fcb88100a10 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb8df53640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb88100a10 0x7fcb88197de0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400d770 tx=0x7fcb8400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.361+0000 7fcb7effd640 1 -- 172.21.15.12:0/3402342431 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84017070 con 0x7fcb88100a10 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.362+0000 7fcb901b7640 1 -- 172.21.15.12:0/3402342431 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8819fcf0 con 0x7fcb88100a10 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.362+0000 7fcb7effd640 1 -- 172.21.15.12:0/3402342431 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb84009c30 con 0x7fcb88100a10 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.362+0000 7fcb7effd640 1 -- 172.21.15.12:0/3402342431 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84003dd0 con 0x7fcb88100a10 2024-09-16T01:01:08.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.362+0000 7fcb901b7640 1 -- 172.21.15.12:0/3402342431 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb881a01d0 con 0x7fcb88100a10 2024-09-16T01:01:08.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.363+0000 7fcb901b7640 1 -- 172.21.15.12:0/3402342431 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb881a0400 con 0x7fcb88100a10 2024-09-16T01:01:08.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.364+0000 7fcb7effd640 1 -- 172.21.15.12:0/3402342431 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcb84003f70 con 0x7fcb88100a10 2024-09-16T01:01:08.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.364+0000 7fcb7effd640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcb740a3250 0x7fcb740a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.364+0000 7fcb7effd640 1 -- 172.21.15.12:0/3402342431 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fcb840cf580 con 0x7fcb88100a10 2024-09-16T01:01:08.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.364+0000 7fcb8d752640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcb740a3250 0x7fcb740a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.365+0000 7fcb8d752640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcb740a3250 0x7fcb740a5710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb881992f0 tx=0x7fcb78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.368+0000 7fcb7effd640 1 -- 172.21.15.12:0/3402342431 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb84009de0 con 0x7fcb88100a10 2024-09-16T01:01:08.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.546+0000 7fcb901b7640 1 -- 172.21.15.12:0/3402342431 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb880fe3b0 con 0x7fcb740a3250 2024-09-16T01:01:08.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.554+0000 7fcb7effd640 1 -- 172.21.15.12:0/3402342431 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340798 (secure 0 0 0) 0x7fcb880fe3b0 con 0x7fcb740a3250 2024-09-16T01:01:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-16T01:01:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.557+0000 7fcb901b7640 1 -- 172.21.15.12:0/3402342431 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcb740a3250 msgr2=0x7fcb740a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.557+0000 7fcb901b7640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcb740a3250 0x7fcb740a5710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb881992f0 tx=0x7fcb78005f90 comp rx=0 tx=0).stop 2024-09-16T01:01:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.557+0000 7fcb901b7640 1 -- 172.21.15.12:0/3402342431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb88100a10 msgr2=0x7fcb88197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.557+0000 7fcb901b7640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb88100a10 0x7fcb88197de0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400d770 tx=0x7fcb8400dc30 comp rx=0 tx=0).stop 2024-09-16T01:01:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.557+0000 7fcb901b7640 1 -- 172.21.15.12:0/3402342431 shutdown_connections 2024-09-16T01:01:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.557+0000 7fcb901b7640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcb740a3250 0x7fcb740a5710 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.557+0000 7fcb901b7640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb881025c0 0x7fcb8819f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.557+0000 7fcb901b7640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb88101c00 0x7fcb88198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.557+0000 7fcb901b7640 1 --2- 172.21.15.12:0/3402342431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb88100a10 0x7fcb88197de0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.557+0000 7fcb901b7640 1 -- 172.21.15.12:0/3402342431 >> 172.21.15.12:0/3402342431 conn(0x7fcb880fc170 msgr2=0x7fcb880fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.558+0000 7fcb901b7640 1 -- 172.21.15.12:0/3402342431 shutdown_connections 2024-09-16T01:01:08.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.558+0000 7fcb901b7640 1 -- 172.21.15.12:0/3402342431 wait complete. 2024-09-16T01:01:08.569 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-16T01:01:06.936017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661907,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1192,"num_read_kb":718,"num_write":444,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373940,"kb_used_data":12168,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567884,"statfs":{"total":1151940427776,"available":1151557513216,"internally_reserved":0,"allocated":12460032,"data_stored":8110981,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":52,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003050"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:02.942810+0000","last_change":"2024-09-16T00:59:44.862009+0000","last_active":"2024-09-16T01:01:02.942810+0000","last_peered":"2024-09-16T01:01:02.942810+0000","last_clean":"2024-09-16T01:01:02.942810+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:01:02.942810+0000","last_undegraded":"2024-09-16T01:01:02.942810+0000","last_fullsized":"2024-09-16T01:01:02.942810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:11.209907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968087+0000","last_change":"2024-09-16T00:58:36.507955+0000","last_active":"2024-09-16T01:00:46.968087+0000","last_peered":"2024-09-16T01:00:46.968087+0000","last_clean":"2024-09-16T01:00:46.968087+0000","last_became_active":"2024-09-16T00:58:36.507660+0000","last_became_peered":"2024-09-16T00:58:36.507660+0000","last_unstale":"2024-09-16T01:00:46.968087+0000","last_undegraded":"2024-09-16T01:00:46.968087+0000","last_fullsized":"2024-09-16T01:00:46.968087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:05.408460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627372+0000","last_change":"2024-09-16T00:58:43.620365+0000","last_active":"2024-09-16T01:00:45.627372+0000","last_peered":"2024-09-16T01:00:45.627372+0000","last_clean":"2024-09-16T01:00:45.627372+0000","last_became_active":"2024-09-16T00:58:43.619976+0000","last_became_peered":"2024-09-16T00:58:43.619976+0000","last_unstale":"2024-09-16T01:00:45.627372+0000","last_undegraded":"2024-09-16T01:00:45.627372+0000","last_fullsized":"2024-09-16T01:00:45.627372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:37.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968248+0000","last_change":"2024-09-16T00:58:34.829549+0000","last_active":"2024-09-16T01:00:46.968248+0000","last_peered":"2024-09-16T01:00:46.968248+0000","last_clean":"2024-09-16T01:00:46.968248+0000","last_became_active":"2024-09-16T00:58:34.829180+0000","last_became_peered":"2024-09-16T00:58:34.829180+0000","last_unstale":"2024-09-16T01:00:46.968248+0000","last_undegraded":"2024-09-16T01:00:46.968248+0000","last_fullsized":"2024-09-16T01:00:46.968248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:40.731288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627338+0000","last_change":"2024-09-16T00:58:36.517190+0000","last_active":"2024-09-16T01:00:45.627338+0000","last_peered":"2024-09-16T01:00:45.627338+0000","last_clean":"2024-09-16T01:00:45.627338+0000","last_became_active":"2024-09-16T00:58:36.516877+0000","last_became_peered":"2024-09-16T00:58:36.516877+0000","last_unstale":"2024-09-16T01:00:45.627338+0000","last_undegraded":"2024-09-16T01:00:45.627338+0000","last_fullsized":"2024-09-16T01:00:45.627338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.408011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719567+0000","last_change":"2024-09-16T00:59:44.863832+0000","last_active":"2024-09-16T01:00:45.719567+0000","last_peered":"2024-09-16T01:00:45.719567+0000","last_clean":"2024-09-16T01:00:45.719567+0000","last_became_active":"2024-09-16T00:59:44.863298+0000","last_became_peered":"2024-09-16T00:59:44.863298+0000","last_unstale":"2024-09-16T01:00:45.719567+0000","last_undegraded":"2024-09-16T01:00:45.719567+0000","last_fullsized":"2024-09-16T01:00:45.719567+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:55.449728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714641+0000","last_change":"2024-09-16T00:58:34.472375+0000","last_active":"2024-09-16T01:00:45.714641+0000","last_peered":"2024-09-16T01:00:45.714641+0000","last_clean":"2024-09-16T01:00:45.714641+0000","last_became_active":"2024-09-16T00:58:34.471990+0000","last_became_peered":"2024-09-16T00:58:34.471990+0000","last_unstale":"2024-09-16T01:00:45.714641+0000","last_undegraded":"2024-09-16T01:00:45.714641+0000","last_fullsized":"2024-09-16T01:00:45.714641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:15.746005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624613+0000","last_change":"2024-09-16T00:58:36.513747+0000","last_active":"2024-09-16T01:00:45.624613+0000","last_peered":"2024-09-16T01:00:45.624613+0000","last_clean":"2024-09-16T01:00:45.624613+0000","last_became_active":"2024-09-16T00:58:36.512635+0000","last_became_peered":"2024-09-16T00:58:36.512635+0000","last_unstale":"2024-09-16T01:00:45.624613+0000","last_undegraded":"2024-09-16T01:00:45.624613+0000","last_fullsized":"2024-09-16T01:00:45.624613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:39.014961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719783+0000","last_change":"2024-09-16T00:58:43.609355+0000","last_active":"2024-09-16T01:00:45.719783+0000","last_peered":"2024-09-16T01:00:45.719783+0000","last_clean":"2024-09-16T01:00:45.719783+0000","last_became_active":"2024-09-16T00:58:43.608892+0000","last_became_peered":"2024-09-16T00:58:43.608892+0000","last_unstale":"2024-09-16T01:00:45.719783+0000","last_undegraded":"2024-09-16T01:00:45.719783+0000","last_fullsized":"2024-09-16T01:00:45.719783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:20.718163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714484+0000","last_change":"2024-09-16T00:58:34.469650+0000","last_active":"2024-09-16T01:00:45.714484+0000","last_peered":"2024-09-16T01:00:45.714484+0000","last_clean":"2024-09-16T01:00:45.714484+0000","last_became_active":"2024-09-16T00:58:34.468939+0000","last_became_peered":"2024-09-16T00:58:34.468939+0000","last_unstale":"2024-09-16T01:00:45.714484+0000","last_undegraded":"2024-09-16T01:00:45.714484+0000","last_fullsized":"2024-09-16T01:00:45.714484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:34.511111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623914+0000","last_change":"2024-09-16T00:59:45.097454+0000","last_active":"2024-09-16T01:00:45.623914+0000","last_peered":"2024-09-16T01:00:45.623914+0000","last_clean":"2024-09-16T01:00:45.623914+0000","last_became_active":"2024-09-16T00:59:45.096985+0000","last_became_peered":"2024-09-16T00:59:45.096985+0000","last_unstale":"2024-09-16T01:00:45.623914+0000","last_undegraded":"2024-09-16T01:00:45.623914+0000","last_fullsized":"2024-09-16T01:00:45.623914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:03.247850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719638+0000","last_change":"2024-09-16T00:58:43.612479+0000","last_active":"2024-09-16T01:00:45.719638+0000","last_peered":"2024-09-16T01:00:45.719638+0000","last_clean":"2024-09-16T01:00:45.719638+0000","last_became_active":"2024-09-16T00:58:43.612001+0000","last_became_peered":"2024-09-16T00:58:43.612001+0000","last_unstale":"2024-09-16T01:00:45.719638+0000","last_undegraded":"2024-09-16T01:00:45.719638+0000","last_fullsized":"2024-09-16T01:00:45.719638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:33.056052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919590+0000","last_change":"2024-09-16T00:58:36.519407+0000","last_active":"2024-09-16T01:00:45.919590+0000","last_peered":"2024-09-16T01:00:45.919590+0000","last_clean":"2024-09-16T01:00:45.919590+0000","last_became_active":"2024-09-16T00:58:36.519108+0000","last_became_peered":"2024-09-16T00:58:36.519108+0000","last_unstale":"2024-09-16T01:00:45.919590+0000","last_undegraded":"2024-09-16T01:00:45.919590+0000","last_fullsized":"2024-09-16T01:00:45.919590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:28.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714187+0000","last_change":"2024-09-16T00:58:34.472295+0000","last_active":"2024-09-16T01:00:45.714187+0000","last_peered":"2024-09-16T01:00:45.714187+0000","last_clean":"2024-09-16T01:00:45.714187+0000","last_became_active":"2024-09-16T00:58:34.471968+0000","last_became_peered":"2024-09-16T00:58:34.471968+0000","last_unstale":"2024-09-16T01:00:45.714187+0000","last_undegraded":"2024-09-16T01:00:45.714187+0000","last_fullsized":"2024-09-16T01:00:45.714187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:44.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720006+0000","last_change":"2024-09-16T00:58:43.615870+0000","last_active":"2024-09-16T01:00:45.720006+0000","last_peered":"2024-09-16T01:00:45.720006+0000","last_clean":"2024-09-16T01:00:45.720006+0000","last_became_active":"2024-09-16T00:58:43.615116+0000","last_became_peered":"2024-09-16T00:58:43.615116+0000","last_unstale":"2024-09-16T01:00:45.720006+0000","last_undegraded":"2024-09-16T01:00:45.720006+0000","last_fullsized":"2024-09-16T01:00:45.720006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:44.742792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967891+0000","last_change":"2024-09-16T00:58:36.512485+0000","last_active":"2024-09-16T01:00:46.967891+0000","last_peered":"2024-09-16T01:00:46.967891+0000","last_clean":"2024-09-16T01:00:46.967891+0000","last_became_active":"2024-09-16T00:58:36.512175+0000","last_became_peered":"2024-09-16T00:58:36.512175+0000","last_unstale":"2024-09-16T01:00:46.967891+0000","last_undegraded":"2024-09-16T01:00:46.967891+0000","last_fullsized":"2024-09-16T01:00:46.967891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.328409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'4","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.896964+0000","last_change":"2024-09-16T00:59:44.841052+0000","last_active":"2024-09-16T01:00:45.896964+0000","last_peered":"2024-09-16T01:00:45.896964+0000","last_clean":"2024-09-16T01:00:45.896964+0000","last_became_active":"2024-09-16T00:59:44.834033+0000","last_became_peered":"2024-09-16T00:59:44.834033+0000","last_unstale":"2024-09-16T01:00:45.896964+0000","last_undegraded":"2024-09-16T01:00:45.896964+0000","last_fullsized":"2024-09-16T01:00:45.896964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:09.696435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720242+0000","last_change":"2024-09-16T00:58:43.610265+0000","last_active":"2024-09-16T01:00:45.720242+0000","last_peered":"2024-09-16T01:00:45.720242+0000","last_clean":"2024-09-16T01:00:45.720242+0000","last_became_active":"2024-09-16T00:58:43.609868+0000","last_became_peered":"2024-09-16T00:58:43.609868+0000","last_unstale":"2024-09-16T01:00:45.720242+0000","last_undegraded":"2024-09-16T01:00:45.720242+0000","last_fullsized":"2024-09-16T01:00:45.720242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:54.689332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897423+0000","last_change":"2024-09-16T00:58:36.512801+0000","last_active":"2024-09-16T01:00:45.897423+0000","last_peered":"2024-09-16T01:00:45.897423+0000","last_clean":"2024-09-16T01:00:45.897423+0000","last_became_active":"2024-09-16T00:58:36.512469+0000","last_became_peered":"2024-09-16T00:58:36.512469+0000","last_unstale":"2024-09-16T01:00:45.897423+0000","last_undegraded":"2024-09-16T01:00:45.897423+0000","last_fullsized":"2024-09-16T01:00:45.897423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:57.951743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967904+0000","last_change":"2024-09-16T00:58:34.471498+0000","last_active":"2024-09-16T01:00:46.967904+0000","last_peered":"2024-09-16T01:00:46.967904+0000","last_clean":"2024-09-16T01:00:46.967904+0000","last_became_active":"2024-09-16T00:58:34.471093+0000","last_became_peered":"2024-09-16T00:58:34.471093+0000","last_unstale":"2024-09-16T01:00:46.967904+0000","last_undegraded":"2024-09-16T01:00:46.967904+0000","last_fullsized":"2024-09-16T01:00:46.967904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:35.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624262+0000","last_change":"2024-09-16T00:58:43.616376+0000","last_active":"2024-09-16T01:00:45.624262+0000","last_peered":"2024-09-16T01:00:45.624262+0000","last_clean":"2024-09-16T01:00:45.624262+0000","last_became_active":"2024-09-16T00:58:43.616029+0000","last_became_peered":"2024-09-16T00:58:43.616029+0000","last_unstale":"2024-09-16T01:00:45.624262+0000","last_undegraded":"2024-09-16T01:00:45.624262+0000","last_fullsized":"2024-09-16T01:00:45.624262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:54.776250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714062+0000","last_change":"2024-09-16T00:58:36.506625+0000","last_active":"2024-09-16T01:00:45.714062+0000","last_peered":"2024-09-16T01:00:45.714062+0000","last_clean":"2024-09-16T01:00:45.714062+0000","last_became_active":"2024-09-16T00:58:36.506337+0000","last_became_peered":"2024-09-16T00:58:36.506337+0000","last_unstale":"2024-09-16T01:00:45.714062+0000","last_undegraded":"2024-09-16T01:00:45.714062+0000","last_fullsized":"2024-09-16T01:00:45.714062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:22.080165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.901530+0000","last_change":"2024-09-16T01:00:45.901112+0000","last_active":"2024-09-16T01:00:45.901530+0000","last_peered":"2024-09-16T01:00:45.901530+0000","last_clean":"2024-09-16T01:00:45.901530+0000","last_became_active":"2024-09-16T01:00:45.898274+0000","last_became_peered":"2024-09-16T01:00:45.898274+0000","last_unstale":"2024-09-16T01:00:45.901530+0000","last_undegraded":"2024-09-16T01:00:45.901530+0000","last_fullsized":"2024-09-16T01:00:45.901530+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:55.626391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720033+0000","last_change":"2024-09-16T00:58:43.609399+0000","last_active":"2024-09-16T01:00:45.720033+0000","last_peered":"2024-09-16T01:00:45.720033+0000","last_clean":"2024-09-16T01:00:45.720033+0000","last_became_active":"2024-09-16T00:58:43.608988+0000","last_became_peered":"2024-09-16T00:58:43.608988+0000","last_unstale":"2024-09-16T01:00:45.720033+0000","last_undegraded":"2024-09-16T01:00:45.720033+0000","last_fullsized":"2024-09-16T01:00:45.720033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.500071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627256+0000","last_change":"2024-09-16T00:58:36.515930+0000","last_active":"2024-09-16T01:00:45.627256+0000","last_peered":"2024-09-16T01:00:45.627256+0000","last_clean":"2024-09-16T01:00:45.627256+0000","last_became_active":"2024-09-16T00:58:36.515625+0000","last_became_peered":"2024-09-16T00:58:36.515625+0000","last_unstale":"2024-09-16T01:00:45.627256+0000","last_undegraded":"2024-09-16T01:00:45.627256+0000","last_fullsized":"2024-09-16T01:00:45.627256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:55.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720365+0000","last_change":"2024-09-16T00:58:34.508686+0000","last_active":"2024-09-16T01:00:45.720365+0000","last_peered":"2024-09-16T01:00:45.720365+0000","last_clean":"2024-09-16T01:00:45.720365+0000","last_became_active":"2024-09-16T00:58:34.508284+0000","last_became_peered":"2024-09-16T00:58:34.508284+0000","last_unstale":"2024-09-16T01:00:45.720365+0000","last_undegraded":"2024-09-16T01:00:45.720365+0000","last_fullsized":"2024-09-16T01:00:45.720365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:47.545949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627558+0000","last_change":"2024-09-16T00:58:43.615852+0000","last_active":"2024-09-16T01:00:45.627558+0000","last_peered":"2024-09-16T01:00:45.627558+0000","last_clean":"2024-09-16T01:00:45.627558+0000","last_became_active":"2024-09-16T00:58:43.615474+0000","last_became_peered":"2024-09-16T00:58:43.615474+0000","last_unstale":"2024-09-16T01:00:45.627558+0000","last_undegraded":"2024-09-16T01:00:45.627558+0000","last_fullsized":"2024-09-16T01:00:45.627558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:39.596924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968316+0000","last_change":"2024-09-16T00:58:36.513820+0000","last_active":"2024-09-16T01:00:46.968316+0000","last_peered":"2024-09-16T01:00:46.968316+0000","last_clean":"2024-09-16T01:00:46.968316+0000","last_became_active":"2024-09-16T00:58:36.513513+0000","last_became_peered":"2024-09-16T00:58:36.513513+0000","last_unstale":"2024-09-16T01:00:46.968316+0000","last_undegraded":"2024-09-16T01:00:46.968316+0000","last_fullsized":"2024-09-16T01:00:46.968316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:34.584214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'16","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624208+0000","last_change":"2024-09-16T00:58:34.462794+0000","last_active":"2024-09-16T01:00:45.624208+0000","last_peered":"2024-09-16T01:00:45.624208+0000","last_clean":"2024-09-16T01:00:45.624208+0000","last_became_active":"2024-09-16T00:58:34.462471+0000","last_became_peered":"2024-09-16T00:58:34.462471+0000","last_unstale":"2024-09-16T01:00:45.624208+0000","last_undegraded":"2024-09-16T01:00:45.624208+0000","last_fullsized":"2024-09-16T01:00:45.624208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:13.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967564+0000","last_change":"2024-09-16T00:58:43.607718+0000","last_active":"2024-09-16T01:00:46.967564+0000","last_peered":"2024-09-16T01:00:46.967564+0000","last_clean":"2024-09-16T01:00:46.967564+0000","last_became_active":"2024-09-16T00:58:43.607347+0000","last_became_peered":"2024-09-16T00:58:43.607347+0000","last_unstale":"2024-09-16T01:00:46.967564+0000","last_undegraded":"2024-09-16T01:00:46.967564+0000","last_fullsized":"2024-09-16T01:00:46.967564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:12.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.507161+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.504062+0000","last_became_peered":"2024-09-16T00:58:36.504062+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:58:34.829848+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:58:34.829439+0000","last_became_peered":"2024-09-16T00:58:34.829439+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:06.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897267+0000","last_change":"2024-09-16T00:58:43.618334+0000","last_active":"2024-09-16T01:00:45.897267+0000","last_peered":"2024-09-16T01:00:45.897267+0000","last_clean":"2024-09-16T01:00:45.897267+0000","last_became_active":"2024-09-16T00:58:43.617810+0000","last_became_peered":"2024-09-16T00:58:43.617810+0000","last_unstale":"2024-09-16T01:00:45.897267+0000","last_undegraded":"2024-09-16T01:00:45.897267+0000","last_fullsized":"2024-09-16T01:00:45.897267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:58.202973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711427+0000","last_change":"2024-09-16T00:58:36.509025+0000","last_active":"2024-09-16T01:00:45.711427+0000","last_peered":"2024-09-16T01:00:45.711427+0000","last_clean":"2024-09-16T01:00:45.711427+0000","last_became_active":"2024-09-16T00:58:36.508660+0000","last_became_peered":"2024-09-16T00:58:36.508660+0000","last_unstale":"2024-09-16T01:00:45.711427+0000","last_undegraded":"2024-09-16T01:00:45.711427+0000","last_fullsized":"2024-09-16T01:00:45.711427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:01.433486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624046+0000","last_change":"2024-09-16T00:58:34.829899+0000","last_active":"2024-09-16T01:00:45.624046+0000","last_peered":"2024-09-16T01:00:45.624046+0000","last_clean":"2024-09-16T01:00:45.624046+0000","last_became_active":"2024-09-16T00:58:34.829546+0000","last_became_peered":"2024-09-16T00:58:34.829546+0000","last_unstale":"2024-09-16T01:00:45.624046+0000","last_undegraded":"2024-09-16T01:00:45.624046+0000","last_fullsized":"2024-09-16T01:00:45.624046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:21.253829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714080+0000","last_change":"2024-09-16T00:58:43.610143+0000","last_active":"2024-09-16T01:00:45.714080+0000","last_peered":"2024-09-16T01:00:45.714080+0000","last_clean":"2024-09-16T01:00:45.714080+0000","last_became_active":"2024-09-16T00:58:43.609739+0000","last_became_peered":"2024-09-16T00:58:43.609739+0000","last_unstale":"2024-09-16T01:00:45.714080+0000","last_undegraded":"2024-09-16T01:00:45.714080+0000","last_fullsized":"2024-09-16T01:00:45.714080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:28.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711421+0000","last_change":"2024-09-16T00:58:36.520423+0000","last_active":"2024-09-16T01:00:45.711421+0000","last_peered":"2024-09-16T01:00:45.711421+0000","last_clean":"2024-09-16T01:00:45.711421+0000","last_became_active":"2024-09-16T00:58:36.520117+0000","last_became_peered":"2024-09-16T00:58:36.520117+0000","last_unstale":"2024-09-16T01:00:45.711421+0000","last_undegraded":"2024-09-16T01:00:45.711421+0000","last_fullsized":"2024-09-16T01:00:45.711421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.652142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:04.945968+0000","last_change":"2024-09-16T00:58:34.475161+0000","last_active":"2024-09-16T01:01:04.945968+0000","last_peered":"2024-09-16T01:01:04.945968+0000","last_clean":"2024-09-16T01:01:04.945968+0000","last_became_active":"2024-09-16T00:58:34.474755+0000","last_became_peered":"2024-09-16T00:58:34.474755+0000","last_unstale":"2024-09-16T01:01:04.945968+0000","last_undegraded":"2024-09-16T01:01:04.945968+0000","last_fullsized":"2024-09-16T01:01:04.945968+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:12.884466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717746+0000","last_change":"2024-09-16T00:58:43.609042+0000","last_active":"2024-09-16T01:00:45.717746+0000","last_peered":"2024-09-16T01:00:45.717746+0000","last_clean":"2024-09-16T01:00:45.717746+0000","last_became_active":"2024-09-16T00:58:43.608596+0000","last_became_peered":"2024-09-16T00:58:43.608596+0000","last_unstale":"2024-09-16T01:00:45.717746+0000","last_undegraded":"2024-09-16T01:00:45.717746+0000","last_fullsized":"2024-09-16T01:00:45.717746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:47.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625659+0000","last_change":"2024-09-16T00:59:44.838583+0000","last_active":"2024-09-16T01:00:45.625659+0000","last_peered":"2024-09-16T01:00:45.625659+0000","last_clean":"2024-09-16T01:00:45.625659+0000","last_became_active":"2024-09-16T00:59:44.838221+0000","last_became_peered":"2024-09-16T00:59:44.838221+0000","last_unstale":"2024-09-16T01:00:45.625659+0000","last_undegraded":"2024-09-16T01:00:45.625659+0000","last_fullsized":"2024-09-16T01:00:45.625659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:27.562118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:02.744039+0000","last_change":"2024-09-16T00:58:34.829452+0000","last_active":"2024-09-16T01:01:02.744039+0000","last_peered":"2024-09-16T01:01:02.744039+0000","last_clean":"2024-09-16T01:01:02.744039+0000","last_became_active":"2024-09-16T00:58:34.829129+0000","last_became_peered":"2024-09-16T00:58:34.829129+0000","last_unstale":"2024-09-16T01:01:02.744039+0000","last_undegraded":"2024-09-16T01:01:02.744039+0000","last_fullsized":"2024-09-16T01:01:02.744039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718001+0000","last_change":"2024-09-16T00:58:43.609230+0000","last_active":"2024-09-16T01:00:45.718001+0000","last_peered":"2024-09-16T01:00:45.718001+0000","last_clean":"2024-09-16T01:00:45.718001+0000","last_became_active":"2024-09-16T00:58:43.608879+0000","last_became_peered":"2024-09-16T00:58:43.608879+0000","last_unstale":"2024-09-16T01:00:45.718001+0000","last_undegraded":"2024-09-16T01:00:45.718001+0000","last_fullsized":"2024-09-16T01:00:45.718001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.112878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717141+0000","last_change":"2024-09-16T00:58:36.503412+0000","last_active":"2024-09-16T01:00:45.717141+0000","last_peered":"2024-09-16T01:00:45.717141+0000","last_clean":"2024-09-16T01:00:45.717141+0000","last_became_active":"2024-09-16T00:58:36.503043+0000","last_became_peered":"2024-09-16T00:58:36.503043+0000","last_unstale":"2024-09-16T01:00:45.717141+0000","last_undegraded":"2024-09-16T01:00:45.717141+0000","last_fullsized":"2024-09-16T01:00:45.717141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:18.495669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919328+0000","last_change":"2024-09-16T00:58:34.468460+0000","last_active":"2024-09-16T01:00:45.919328+0000","last_peered":"2024-09-16T01:00:45.919328+0000","last_clean":"2024-09-16T01:00:45.919328+0000","last_became_active":"2024-09-16T00:58:34.468104+0000","last_became_peered":"2024-09-16T00:58:34.468104+0000","last_unstale":"2024-09-16T01:00:45.919328+0000","last_undegraded":"2024-09-16T01:00:45.919328+0000","last_fullsized":"2024-09-16T01:00:45.919328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:13.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714467+0000","last_change":"2024-09-16T00:59:44.863609+0000","last_active":"2024-09-16T01:00:45.714467+0000","last_peered":"2024-09-16T01:00:45.714467+0000","last_clean":"2024-09-16T01:00:45.714467+0000","last_became_active":"2024-09-16T00:59:44.863152+0000","last_became_peered":"2024-09-16T00:59:44.863152+0000","last_unstale":"2024-09-16T01:00:45.714467+0000","last_undegraded":"2024-09-16T01:00:45.714467+0000","last_fullsized":"2024-09-16T01:00:45.714467+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:51.312612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967875+0000","last_change":"2024-09-16T00:58:36.509749+0000","last_active":"2024-09-16T01:00:46.967875+0000","last_peered":"2024-09-16T01:00:46.967875+0000","last_clean":"2024-09-16T01:00:46.967875+0000","last_became_active":"2024-09-16T00:58:36.509411+0000","last_became_peered":"2024-09-16T00:58:36.509411+0000","last_unstale":"2024-09-16T01:00:46.967875+0000","last_undegraded":"2024-09-16T01:00:46.967875+0000","last_fullsized":"2024-09-16T01:00:46.967875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:14.291956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720026+0000","last_change":"2024-09-16T00:58:34.470190+0000","last_active":"2024-09-16T01:00:45.720026+0000","last_peered":"2024-09-16T01:00:45.720026+0000","last_clean":"2024-09-16T01:00:45.720026+0000","last_became_active":"2024-09-16T00:58:34.469832+0000","last_became_peered":"2024-09-16T00:58:34.469832+0000","last_unstale":"2024-09-16T01:00:45.720026+0000","last_undegraded":"2024-09-16T01:00:45.720026+0000","last_fullsized":"2024-09-16T01:00:45.720026+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:03.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919482+0000","last_change":"2024-09-16T00:57:23.502001+0000","last_active":"2024-09-16T01:00:45.919482+0000","last_peered":"2024-09-16T01:00:45.919482+0000","last_clean":"2024-09-16T01:00:45.919482+0000","last_became_active":"2024-09-16T00:57:23.501465+0000","last_became_peered":"2024-09-16T00:57:23.501465+0000","last_unstale":"2024-09-16T01:00:45.919482+0000","last_undegraded":"2024-09-16T01:00:45.919482+0000","last_fullsized":"2024-09-16T01:00:45.919482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_clean_scrub_stamp":"2024-09-16T00:53:57.344038+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:22.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919823+0000","last_change":"2024-09-16T00:58:43.609572+0000","last_active":"2024-09-16T01:00:45.919823+0000","last_peered":"2024-09-16T01:00:45.919823+0000","last_clean":"2024-09-16T01:00:45.919823+0000","last_became_active":"2024-09-16T00:58:43.609185+0000","last_became_peered":"2024-09-16T00:58:43.609185+0000","last_unstale":"2024-09-16T01:00:45.919823+0000","last_undegraded":"2024-09-16T01:00:45.919823+0000","last_fullsized":"2024-09-16T01:00:45.919823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.199976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919987+0000","last_change":"2024-09-16T00:58:36.510761+0000","last_active":"2024-09-16T01:00:45.919987+0000","last_peered":"2024-09-16T01:00:45.919987+0000","last_clean":"2024-09-16T01:00:45.919987+0000","last_became_active":"2024-09-16T00:58:36.510456+0000","last_became_peered":"2024-09-16T00:58:36.510456+0000","last_unstale":"2024-09-16T01:00:45.919987+0000","last_undegraded":"2024-09-16T01:00:45.919987+0000","last_fullsized":"2024-09-16T01:00:45.919987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:02.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'8","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:04.744929+0000","last_change":"2024-09-16T00:58:34.830238+0000","last_active":"2024-09-16T01:01:04.744929+0000","last_peered":"2024-09-16T01:01:04.744929+0000","last_clean":"2024-09-16T01:01:04.744929+0000","last_became_active":"2024-09-16T00:58:34.829558+0000","last_became_peered":"2024-09-16T00:58:34.829558+0000","last_unstale":"2024-09-16T01:01:04.744929+0000","last_undegraded":"2024-09-16T01:01:04.744929+0000","last_fullsized":"2024-09-16T01:01:04.744929+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.347122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624541+0000","last_change":"2024-09-16T00:58:43.613179+0000","last_active":"2024-09-16T01:00:45.624541+0000","last_peered":"2024-09-16T01:00:45.624541+0000","last_clean":"2024-09-16T01:00:45.624541+0000","last_became_active":"2024-09-16T00:58:43.612794+0000","last_became_peered":"2024-09-16T00:58:43.612794+0000","last_unstale":"2024-09-16T01:00:45.624541+0000","last_undegraded":"2024-09-16T01:00:45.624541+0000","last_fullsized":"2024-09-16T01:00:45.624541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:04:24.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919741+0000","last_change":"2024-09-16T00:58:36.512600+0000","last_active":"2024-09-16T01:00:45.919741+0000","last_peered":"2024-09-16T01:00:45.919741+0000","last_clean":"2024-09-16T01:00:45.919741+0000","last_became_active":"2024-09-16T00:58:36.512309+0000","last_became_peered":"2024-09-16T00:58:36.512309+0000","last_unstale":"2024-09-16T01:00:45.919741+0000","last_undegraded":"2024-09-16T01:00:45.919741+0000","last_fullsized":"2024-09-16T01:00:45.919741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.790755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626294+0000","last_change":"2024-09-16T00:58:34.471787+0000","last_active":"2024-09-16T01:00:45.626294+0000","last_peered":"2024-09-16T01:00:45.626294+0000","last_clean":"2024-09-16T01:00:45.626294+0000","last_became_active":"2024-09-16T00:58:34.471119+0000","last_became_peered":"2024-09-16T00:58:34.471119+0000","last_unstale":"2024-09-16T01:00:45.626294+0000","last_undegraded":"2024-09-16T01:00:45.626294+0000","last_fullsized":"2024-09-16T01:00:45.626294+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:26.121669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626989+0000","last_change":"2024-09-16T00:58:43.609676+0000","last_active":"2024-09-16T01:00:45.626989+0000","last_peered":"2024-09-16T01:00:45.626989+0000","last_clean":"2024-09-16T01:00:45.626989+0000","last_became_active":"2024-09-16T00:58:43.609313+0000","last_became_peered":"2024-09-16T00:58:43.609313+0000","last_unstale":"2024-09-16T01:00:45.626989+0000","last_undegraded":"2024-09-16T01:00:45.626989+0000","last_fullsized":"2024-09-16T01:00:45.626989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:53.339070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919903+0000","last_change":"2024-09-16T00:58:36.514621+0000","last_active":"2024-09-16T01:00:45.919903+0000","last_peered":"2024-09-16T01:00:45.919903+0000","last_clean":"2024-09-16T01:00:45.919903+0000","last_became_active":"2024-09-16T00:58:36.514259+0000","last_became_peered":"2024-09-16T00:58:36.514259+0000","last_unstale":"2024-09-16T01:00:45.919903+0000","last_undegraded":"2024-09-16T01:00:45.919903+0000","last_fullsized":"2024-09-16T01:00:45.919903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:11.411742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718006+0000","last_change":"2024-09-16T00:58:34.470512+0000","last_active":"2024-09-16T01:00:45.718006+0000","last_peered":"2024-09-16T01:00:45.718006+0000","last_clean":"2024-09-16T01:00:45.718006+0000","last_became_active":"2024-09-16T00:58:34.470140+0000","last_became_peered":"2024-09-16T00:58:34.470140+0000","last_unstale":"2024-09-16T01:00:45.718006+0000","last_undegraded":"2024-09-16T01:00:45.718006+0000","last_fullsized":"2024-09-16T01:00:45.718006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:04.068901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625516+0000","last_change":"2024-09-16T00:58:43.615221+0000","last_active":"2024-09-16T01:00:45.625516+0000","last_peered":"2024-09-16T01:00:45.625516+0000","last_clean":"2024-09-16T01:00:45.625516+0000","last_became_active":"2024-09-16T00:58:43.614820+0000","last_became_peered":"2024-09-16T00:58:43.614820+0000","last_unstale":"2024-09-16T01:00:45.625516+0000","last_undegraded":"2024-09-16T01:00:45.625516+0000","last_fullsized":"2024-09-16T01:00:45.625516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:31.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897390+0000","last_change":"2024-09-16T00:58:36.515470+0000","last_active":"2024-09-16T01:00:45.897390+0000","last_peered":"2024-09-16T01:00:45.897390+0000","last_clean":"2024-09-16T01:00:45.897390+0000","last_became_active":"2024-09-16T00:58:36.515145+0000","last_became_peered":"2024-09-16T00:58:36.515145+0000","last_unstale":"2024-09-16T01:00:45.897390+0000","last_undegraded":"2024-09-16T01:00:45.897390+0000","last_fullsized":"2024-09-16T01:00:45.897390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:10.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714720+0000","last_change":"2024-09-16T00:58:34.464865+0000","last_active":"2024-09-16T01:00:45.714720+0000","last_peered":"2024-09-16T01:00:45.714720+0000","last_clean":"2024-09-16T01:00:45.714720+0000","last_became_active":"2024-09-16T00:58:34.464448+0000","last_became_peered":"2024-09-16T00:58:34.464448+0000","last_unstale":"2024-09-16T01:00:45.714720+0000","last_undegraded":"2024-09-16T01:00:45.714720+0000","last_fullsized":"2024-09-16T01:00:45.714720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:47.454251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625710+0000","last_change":"2024-09-16T00:58:43.610348+0000","last_active":"2024-09-16T01:00:45.625710+0000","last_peered":"2024-09-16T01:00:45.625710+0000","last_clean":"2024-09-16T01:00:45.625710+0000","last_became_active":"2024-09-16T00:58:43.609497+0000","last_became_peered":"2024-09-16T00:58:43.609497+0000","last_unstale":"2024-09-16T01:00:45.625710+0000","last_undegraded":"2024-09-16T01:00:45.625710+0000","last_fullsized":"2024-09-16T01:00:45.625710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:52.931325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626081+0000","last_change":"2024-09-16T00:58:36.517412+0000","last_active":"2024-09-16T01:00:45.626081+0000","last_peered":"2024-09-16T01:00:45.626081+0000","last_clean":"2024-09-16T01:00:45.626081+0000","last_became_active":"2024-09-16T00:58:36.516600+0000","last_became_peered":"2024-09-16T00:58:36.516600+0000","last_unstale":"2024-09-16T01:00:45.626081+0000","last_undegraded":"2024-09-16T01:00:45.626081+0000","last_fullsized":"2024-09-16T01:00:45.626081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:39.445454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714191+0000","last_change":"2024-09-16T00:58:34.831420+0000","last_active":"2024-09-16T01:00:45.714191+0000","last_peered":"2024-09-16T01:00:45.714191+0000","last_clean":"2024-09-16T01:00:45.714191+0000","last_became_active":"2024-09-16T00:58:34.830991+0000","last_became_peered":"2024-09-16T00:58:34.830991+0000","last_unstale":"2024-09-16T01:00:45.714191+0000","last_undegraded":"2024-09-16T01:00:45.714191+0000","last_fullsized":"2024-09-16T01:00:45.714191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:13.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717963+0000","last_change":"2024-09-16T00:58:43.611781+0000","last_active":"2024-09-16T01:00:45.717963+0000","last_peered":"2024-09-16T01:00:45.717963+0000","last_clean":"2024-09-16T01:00:45.717963+0000","last_became_active":"2024-09-16T00:58:43.610332+0000","last_became_peered":"2024-09-16T00:58:43.610332+0000","last_unstale":"2024-09-16T01:00:45.717963+0000","last_undegraded":"2024-09-16T01:00:45.717963+0000","last_fullsized":"2024-09-16T01:00:45.717963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:18.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919291+0000","last_change":"2024-09-16T00:58:36.514395+0000","last_active":"2024-09-16T01:00:45.919291+0000","last_peered":"2024-09-16T01:00:45.919291+0000","last_clean":"2024-09-16T01:00:45.919291+0000","last_became_active":"2024-09-16T00:58:36.513570+0000","last_became_peered":"2024-09-16T00:58:36.513570+0000","last_unstale":"2024-09-16T01:00:45.919291+0000","last_undegraded":"2024-09-16T01:00:45.919291+0000","last_fullsized":"2024-09-16T01:00:45.919291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:56.148815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:01.743150+0000","last_change":"2024-09-16T00:58:34.473583+0000","last_active":"2024-09-16T01:01:01.743150+0000","last_peered":"2024-09-16T01:01:01.743150+0000","last_clean":"2024-09-16T01:01:01.743150+0000","last_became_active":"2024-09-16T00:58:34.473259+0000","last_became_peered":"2024-09-16T00:58:34.473259+0000","last_unstale":"2024-09-16T01:01:01.743150+0000","last_undegraded":"2024-09-16T01:01:01.743150+0000","last_fullsized":"2024-09-16T01:01:01.743150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:55.622609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:59:44.835446+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:41.254621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919524+0000","last_change":"2024-09-16T00:59:44.863645+0000","last_active":"2024-09-16T01:00:45.919524+0000","last_peered":"2024-09-16T01:00:45.919524+0000","last_clean":"2024-09-16T01:00:45.919524+0000","last_became_active":"2024-09-16T00:59:44.863207+0000","last_became_peered":"2024-09-16T00:59:44.863207+0000","last_unstale":"2024-09-16T01:00:45.919524+0000","last_undegraded":"2024-09-16T01:00:45.919524+0000","last_fullsized":"2024-09-16T01:00:45.919524+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:27.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626418+0000","last_change":"2024-09-16T00:58:34.470326+0000","last_active":"2024-09-16T01:00:45.626418+0000","last_peered":"2024-09-16T01:00:45.626418+0000","last_clean":"2024-09-16T01:00:45.626418+0000","last_became_active":"2024-09-16T00:58:34.469920+0000","last_became_peered":"2024-09-16T00:58:34.469920+0000","last_unstale":"2024-09-16T01:00:45.626418+0000","last_undegraded":"2024-09-16T01:00:45.626418+0000","last_fullsized":"2024-09-16T01:00:45.626418+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:58.718004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897319+0000","last_change":"2024-09-16T00:58:43.616324+0000","last_active":"2024-09-16T01:00:45.897319+0000","last_peered":"2024-09-16T01:00:45.897319+0000","last_clean":"2024-09-16T01:00:45.897319+0000","last_became_active":"2024-09-16T00:58:43.615903+0000","last_became_peered":"2024-09-16T00:58:43.615903+0000","last_unstale":"2024-09-16T01:00:45.897319+0000","last_undegraded":"2024-09-16T01:00:45.897319+0000","last_fullsized":"2024-09-16T01:00:45.897319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.683788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717440+0000","last_change":"2024-09-16T00:58:36.512490+0000","last_active":"2024-09-16T01:00:45.717440+0000","last_peered":"2024-09-16T01:00:45.717440+0000","last_clean":"2024-09-16T01:00:45.717440+0000","last_became_active":"2024-09-16T00:58:36.512167+0000","last_became_peered":"2024-09-16T00:58:36.512167+0000","last_unstale":"2024-09-16T01:00:45.717440+0000","last_undegraded":"2024-09-16T01:00:45.717440+0000","last_fullsized":"2024-09-16T01:00:45.717440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627945+0000","last_change":"2024-09-16T00:58:34.471603+0000","last_active":"2024-09-16T01:00:45.627945+0000","last_peered":"2024-09-16T01:00:45.627945+0000","last_clean":"2024-09-16T01:00:45.627945+0000","last_became_active":"2024-09-16T00:58:34.471241+0000","last_became_peered":"2024-09-16T00:58:34.471241+0000","last_unstale":"2024-09-16T01:00:45.627945+0000","last_undegraded":"2024-09-16T01:00:45.627945+0000","last_fullsized":"2024-09-16T01:00:45.627945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:33.756759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625999+0000","last_change":"2024-09-16T00:58:43.607428+0000","last_active":"2024-09-16T01:00:45.625999+0000","last_peered":"2024-09-16T01:00:45.625999+0000","last_clean":"2024-09-16T01:00:45.625999+0000","last_became_active":"2024-09-16T00:58:43.606990+0000","last_became_peered":"2024-09-16T00:58:43.606990+0000","last_unstale":"2024-09-16T01:00:45.625999+0000","last_undegraded":"2024-09-16T01:00:45.625999+0000","last_fullsized":"2024-09-16T01:00:45.625999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:52.367384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714506+0000","last_change":"2024-09-16T00:58:36.513967+0000","last_active":"2024-09-16T01:00:45.714506+0000","last_peered":"2024-09-16T01:00:45.714506+0000","last_clean":"2024-09-16T01:00:45.714506+0000","last_became_active":"2024-09-16T00:58:36.513610+0000","last_became_peered":"2024-09-16T00:58:36.513610+0000","last_unstale":"2024-09-16T01:00:45.714506+0000","last_undegraded":"2024-09-16T01:00:45.714506+0000","last_fullsized":"2024-09-16T01:00:45.714506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:22.763430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'40","reported_seq":295,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:03.742753+0000","last_change":"2024-09-16T00:58:34.471511+0000","last_active":"2024-09-16T01:01:03.742753+0000","last_peered":"2024-09-16T01:01:03.742753+0000","last_clean":"2024-09-16T01:01:03.742753+0000","last_became_active":"2024-09-16T00:58:34.470597+0000","last_became_peered":"2024-09-16T00:58:34.470597+0000","last_unstale":"2024-09-16T01:01:03.742753+0000","last_undegraded":"2024-09-16T01:01:03.742753+0000","last_fullsized":"2024-09-16T01:01:03.742753+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.782592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64041,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":171,"num_write":42,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623834+0000","last_change":"2024-09-16T00:58:43.612177+0000","last_active":"2024-09-16T01:00:45.623834+0000","last_peered":"2024-09-16T01:00:45.623834+0000","last_clean":"2024-09-16T01:00:45.623834+0000","last_became_active":"2024-09-16T00:58:43.611801+0000","last_became_peered":"2024-09-16T00:58:43.611801+0000","last_unstale":"2024-09-16T01:00:45.623834+0000","last_undegraded":"2024-09-16T01:00:45.623834+0000","last_fullsized":"2024-09-16T01:00:45.623834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.781429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624875+0000","last_change":"2024-09-16T00:58:36.502231+0000","last_active":"2024-09-16T01:00:45.624875+0000","last_peered":"2024-09-16T01:00:45.624875+0000","last_clean":"2024-09-16T01:00:45.624875+0000","last_became_active":"2024-09-16T00:58:36.501934+0000","last_became_peered":"2024-09-16T00:58:36.501934+0000","last_unstale":"2024-09-16T01:00:45.624875+0000","last_undegraded":"2024-09-16T01:00:45.624875+0000","last_fullsized":"2024-09-16T01:00:45.624875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:29.769186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626236+0000","last_change":"2024-09-16T00:58:34.829872+0000","last_active":"2024-09-16T01:00:45.626236+0000","last_peered":"2024-09-16T01:00:45.626236+0000","last_clean":"2024-09-16T01:00:45.626236+0000","last_became_active":"2024-09-16T00:58:34.829496+0000","last_became_peered":"2024-09-16T00:58:34.829496+0000","last_unstale":"2024-09-16T01:00:45.626236+0000","last_undegraded":"2024-09-16T01:00:45.626236+0000","last_fullsized":"2024-09-16T01:00:45.626236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:47.035177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720036+0000","last_change":"2024-09-16T00:58:43.615560+0000","last_active":"2024-09-16T01:00:45.720036+0000","last_peered":"2024-09-16T01:00:45.720036+0000","last_clean":"2024-09-16T01:00:45.720036+0000","last_became_active":"2024-09-16T00:58:43.615124+0000","last_became_peered":"2024-09-16T00:58:43.615124+0000","last_unstale":"2024-09-16T01:00:45.720036+0000","last_undegraded":"2024-09-16T01:00:45.720036+0000","last_fullsized":"2024-09-16T01:00:45.720036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.455528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627428+0000","last_change":"2024-09-16T00:58:36.514456+0000","last_active":"2024-09-16T01:00:45.627428+0000","last_peered":"2024-09-16T01:00:45.627428+0000","last_clean":"2024-09-16T01:00:45.627428+0000","last_became_active":"2024-09-16T00:58:36.514146+0000","last_became_peered":"2024-09-16T00:58:36.514146+0000","last_unstale":"2024-09-16T01:00:45.627428+0000","last_undegraded":"2024-09-16T01:00:45.627428+0000","last_fullsized":"2024-09-16T01:00:45.627428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:06.760121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919878+0000","last_change":"2024-09-16T00:58:34.471316+0000","last_active":"2024-09-16T01:00:45.919878+0000","last_peered":"2024-09-16T01:00:45.919878+0000","last_clean":"2024-09-16T01:00:45.919878+0000","last_became_active":"2024-09-16T00:58:34.470991+0000","last_became_peered":"2024-09-16T00:58:34.470991+0000","last_unstale":"2024-09-16T01:00:45.919878+0000","last_undegraded":"2024-09-16T01:00:45.919878+0000","last_fullsized":"2024-09-16T01:00:45.919878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:44.492439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623687+0000","last_change":"2024-09-16T00:58:43.617202+0000","last_active":"2024-09-16T01:00:45.623687+0000","last_peered":"2024-09-16T01:00:45.623687+0000","last_clean":"2024-09-16T01:00:45.623687+0000","last_became_active":"2024-09-16T00:58:43.616824+0000","last_became_peered":"2024-09-16T00:58:43.616824+0000","last_unstale":"2024-09-16T01:00:45.623687+0000","last_undegraded":"2024-09-16T01:00:45.623687+0000","last_fullsized":"2024-09-16T01:00:45.623687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:43.035003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625210+0000","last_change":"2024-09-16T00:58:36.512079+0000","last_active":"2024-09-16T01:00:45.625210+0000","last_peered":"2024-09-16T01:00:45.625210+0000","last_clean":"2024-09-16T01:00:45.625210+0000","last_became_active":"2024-09-16T00:58:36.511220+0000","last_became_peered":"2024-09-16T00:58:36.511220+0000","last_unstale":"2024-09-16T01:00:45.625210+0000","last_undegraded":"2024-09-16T01:00:45.625210+0000","last_fullsized":"2024-09-16T01:00:45.625210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:49.798132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'6","reported_seq":251,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:03.742205+0000","last_change":"2024-09-16T00:58:34.470682+0000","last_active":"2024-09-16T01:01:03.742205+0000","last_peered":"2024-09-16T01:01:03.742205+0000","last_clean":"2024-09-16T01:01:03.742205+0000","last_became_active":"2024-09-16T00:58:34.470323+0000","last_became_peered":"2024-09-16T00:58:34.470323+0000","last_unstale":"2024-09-16T01:01:03.742205+0000","last_undegraded":"2024-09-16T01:01:03.742205+0000","last_fullsized":"2024-09-16T01:01:03.742205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.361374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967738+0000","last_change":"2024-09-16T00:58:43.608941+0000","last_active":"2024-09-16T01:00:46.967738+0000","last_peered":"2024-09-16T01:00:46.967738+0000","last_clean":"2024-09-16T01:00:46.967738+0000","last_became_active":"2024-09-16T00:58:43.607406+0000","last_became_peered":"2024-09-16T00:58:43.607406+0000","last_unstale":"2024-09-16T01:00:46.967738+0000","last_undegraded":"2024-09-16T01:00:46.967738+0000","last_fullsized":"2024-09-16T01:00:46.967738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:10.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627074+0000","last_change":"2024-09-16T00:58:43.613902+0000","last_active":"2024-09-16T01:00:45.627074+0000","last_peered":"2024-09-16T01:00:45.627074+0000","last_clean":"2024-09-16T01:00:45.627074+0000","last_became_active":"2024-09-16T00:58:43.613530+0000","last_became_peered":"2024-09-16T00:58:43.613530+0000","last_unstale":"2024-09-16T01:00:45.627074+0000","last_undegraded":"2024-09-16T01:00:45.627074+0000","last_fullsized":"2024-09-16T01:00:45.627074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:34.774810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623790+0000","last_change":"2024-09-16T00:58:36.504745+0000","last_active":"2024-09-16T01:00:45.623790+0000","last_peered":"2024-09-16T01:00:45.623790+0000","last_clean":"2024-09-16T01:00:45.623790+0000","last_became_active":"2024-09-16T00:58:36.504400+0000","last_became_peered":"2024-09-16T00:58:36.504400+0000","last_unstale":"2024-09-16T01:00:45.623790+0000","last_undegraded":"2024-09-16T01:00:45.623790+0000","last_fullsized":"2024-09-16T01:00:45.623790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:34.444019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626135+0000","last_change":"2024-09-16T00:58:34.470285+0000","last_active":"2024-09-16T01:00:45.626135+0000","last_peered":"2024-09-16T01:00:45.626135+0000","last_clean":"2024-09-16T01:00:45.626135+0000","last_became_active":"2024-09-16T00:58:34.469948+0000","last_became_peered":"2024-09-16T00:58:34.469948+0000","last_unstale":"2024-09-16T01:00:45.626135+0000","last_undegraded":"2024-09-16T01:00:45.626135+0000","last_fullsized":"2024-09-16T01:00:45.626135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:28.553863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897172+0000","last_change":"2024-09-16T00:58:43.614818+0000","last_active":"2024-09-16T01:00:45.897172+0000","last_peered":"2024-09-16T01:00:45.897172+0000","last_clean":"2024-09-16T01:00:45.897172+0000","last_became_active":"2024-09-16T00:58:43.614376+0000","last_became_peered":"2024-09-16T00:58:43.614376+0000","last_unstale":"2024-09-16T01:00:45.897172+0000","last_undegraded":"2024-09-16T01:00:45.897172+0000","last_fullsized":"2024-09-16T01:00:45.897172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:41.699930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967770+0000","last_change":"2024-09-16T00:58:36.505127+0000","last_active":"2024-09-16T01:00:46.967770+0000","last_peered":"2024-09-16T01:00:46.967770+0000","last_clean":"2024-09-16T01:00:46.967770+0000","last_became_active":"2024-09-16T00:58:36.504552+0000","last_became_peered":"2024-09-16T00:58:36.504552+0000","last_unstale":"2024-09-16T01:00:46.967770+0000","last_undegraded":"2024-09-16T01:00:46.967770+0000","last_fullsized":"2024-09-16T01:00:46.967770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:48.104109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717213+0000","last_change":"2024-09-16T00:58:34.462231+0000","last_active":"2024-09-16T01:00:45.717213+0000","last_peered":"2024-09-16T01:00:45.717213+0000","last_clean":"2024-09-16T01:00:45.717213+0000","last_became_active":"2024-09-16T00:58:34.461891+0000","last_became_peered":"2024-09-16T00:58:34.461891+0000","last_unstale":"2024-09-16T01:00:45.717213+0000","last_undegraded":"2024-09-16T01:00:45.717213+0000","last_fullsized":"2024-09-16T01:00:45.717213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.483996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711498+0000","last_change":"2024-09-16T00:58:34.472457+0000","last_active":"2024-09-16T01:00:45.711498+0000","last_peered":"2024-09-16T01:00:45.711498+0000","last_clean":"2024-09-16T01:00:45.711498+0000","last_became_active":"2024-09-16T00:58:34.472084+0000","last_became_peered":"2024-09-16T00:58:34.472084+0000","last_unstale":"2024-09-16T01:00:45.711498+0000","last_undegraded":"2024-09-16T01:00:45.711498+0000","last_fullsized":"2024-09-16T01:00:45.711498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:08.005195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626019+0000","last_change":"2024-09-16T00:58:36.508791+0000","last_active":"2024-09-16T01:00:45.626019+0000","last_peered":"2024-09-16T01:00:45.626019+0000","last_clean":"2024-09-16T01:00:45.626019+0000","last_became_active":"2024-09-16T00:58:36.508461+0000","last_became_peered":"2024-09-16T00:58:36.508461+0000","last_unstale":"2024-09-16T01:00:45.626019+0000","last_undegraded":"2024-09-16T01:00:45.626019+0000","last_fullsized":"2024-09-16T01:00:45.626019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.938067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627838+0000","last_change":"2024-09-16T00:58:43.620439+0000","last_active":"2024-09-16T01:00:45.627838+0000","last_peered":"2024-09-16T01:00:45.627838+0000","last_clean":"2024-09-16T01:00:45.627838+0000","last_became_active":"2024-09-16T00:58:43.619952+0000","last_became_peered":"2024-09-16T00:58:43.619952+0000","last_unstale":"2024-09-16T01:00:45.627838+0000","last_undegraded":"2024-09-16T01:00:45.627838+0000","last_fullsized":"2024-09-16T01:00:45.627838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:00.737693+0000","last_change":"2024-09-16T00:58:34.473169+0000","last_active":"2024-09-16T01:01:00.737693+0000","last_peered":"2024-09-16T01:01:00.737693+0000","last_clean":"2024-09-16T01:01:00.737693+0000","last_became_active":"2024-09-16T00:58:34.472839+0000","last_became_peered":"2024-09-16T00:58:34.472839+0000","last_unstale":"2024-09-16T01:01:00.737693+0000","last_undegraded":"2024-09-16T01:01:00.737693+0000","last_fullsized":"2024-09-16T01:01:00.737693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:03.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714120+0000","last_change":"2024-09-16T00:58:36.508719+0000","last_active":"2024-09-16T01:00:45.714120+0000","last_peered":"2024-09-16T01:00:45.714120+0000","last_clean":"2024-09-16T01:00:45.714120+0000","last_became_active":"2024-09-16T00:58:36.508427+0000","last_became_peered":"2024-09-16T00:58:36.508427+0000","last_unstale":"2024-09-16T01:00:45.714120+0000","last_undegraded":"2024-09-16T01:00:45.714120+0000","last_fullsized":"2024-09-16T01:00:45.714120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:44.134558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627784+0000","last_change":"2024-09-16T00:58:43.616532+0000","last_active":"2024-09-16T01:00:45.627784+0000","last_peered":"2024-09-16T01:00:45.627784+0000","last_clean":"2024-09-16T01:00:45.627784+0000","last_became_active":"2024-09-16T00:58:43.616146+0000","last_became_peered":"2024-09-16T00:58:43.616146+0000","last_unstale":"2024-09-16T01:00:45.627784+0000","last_undegraded":"2024-09-16T01:00:45.627784+0000","last_fullsized":"2024-09-16T01:00:45.627784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:50.904766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897283+0000","last_change":"2024-09-16T00:58:36.513232+0000","last_active":"2024-09-16T01:00:45.897283+0000","last_peered":"2024-09-16T01:00:45.897283+0000","last_clean":"2024-09-16T01:00:45.897283+0000","last_became_active":"2024-09-16T00:58:36.512239+0000","last_became_peered":"2024-09-16T00:58:36.512239+0000","last_unstale":"2024-09-16T01:00:45.897283+0000","last_undegraded":"2024-09-16T01:00:45.897283+0000","last_fullsized":"2024-09-16T01:00:45.897283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627619+0000","last_change":"2024-09-16T00:58:36.513160+0000","last_active":"2024-09-16T01:00:45.627619+0000","last_peered":"2024-09-16T01:00:45.627619+0000","last_clean":"2024-09-16T01:00:45.627619+0000","last_became_active":"2024-09-16T00:58:36.512523+0000","last_became_peered":"2024-09-16T00:58:36.512523+0000","last_unstale":"2024-09-16T01:00:45.627619+0000","last_undegraded":"2024-09-16T01:00:45.627619+0000","last_fullsized":"2024-09-16T01:00:45.627619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:20.934937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627648+0000","last_change":"2024-09-16T00:58:36.516416+0000","last_active":"2024-09-16T01:00:45.627648+0000","last_peered":"2024-09-16T01:00:45.627648+0000","last_clean":"2024-09-16T01:00:45.627648+0000","last_became_active":"2024-09-16T00:58:36.516121+0000","last_became_peered":"2024-09-16T00:58:36.516121+0000","last_unstale":"2024-09-16T01:00:45.627648+0000","last_undegraded":"2024-09-16T01:00:45.627648+0000","last_fullsized":"2024-09-16T01:00:45.627648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:28.848616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627011+0000","last_change":"2024-09-16T00:58:36.510854+0000","last_active":"2024-09-16T01:00:45.627011+0000","last_peered":"2024-09-16T01:00:45.627011+0000","last_clean":"2024-09-16T01:00:45.627011+0000","last_became_active":"2024-09-16T00:58:36.510505+0000","last_became_peered":"2024-09-16T00:58:36.510505+0000","last_unstale":"2024-09-16T01:00:45.627011+0000","last_undegraded":"2024-09-16T01:00:45.627011+0000","last_fullsized":"2024-09-16T01:00:45.627011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.699942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.509016+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.508690+0000","last_became_peered":"2024-09-16T00:58:36.508690+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:41.425016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897266+0000","last_change":"2024-09-16T00:58:36.511659+0000","last_active":"2024-09-16T01:00:45.897266+0000","last_peered":"2024-09-16T01:00:45.897266+0000","last_clean":"2024-09-16T01:00:45.897266+0000","last_became_active":"2024-09-16T00:58:36.511225+0000","last_became_peered":"2024-09-16T00:58:36.511225+0000","last_unstale":"2024-09-16T01:00:45.897266+0000","last_undegraded":"2024-09-16T01:00:45.897266+0000","last_fullsized":"2024-09-16T01:00:45.897266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:43.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628196+0000","last_change":"2024-09-16T00:58:36.511614+0000","last_active":"2024-09-16T01:00:45.628196+0000","last_peered":"2024-09-16T01:00:45.628196+0000","last_clean":"2024-09-16T01:00:45.628196+0000","last_became_active":"2024-09-16T00:58:36.511304+0000","last_became_peered":"2024-09-16T00:58:36.511304+0000","last_unstale":"2024-09-16T01:00:45.628196+0000","last_undegraded":"2024-09-16T01:00:45.628196+0000","last_fullsized":"2024-09-16T01:00:45.628196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:20.755419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968311+0000","last_change":"2024-09-16T00:58:36.509399+0000","last_active":"2024-09-16T01:00:46.968311+0000","last_peered":"2024-09-16T01:00:46.968311+0000","last_clean":"2024-09-16T01:00:46.968311+0000","last_became_active":"2024-09-16T00:58:36.509072+0000","last_became_peered":"2024-09-16T00:58:36.509072+0000","last_unstale":"2024-09-16T01:00:46.968311+0000","last_undegraded":"2024-09-16T01:00:46.968311+0000","last_fullsized":"2024-09-16T01:00:46.968311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:29.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625679+0000","last_change":"2024-09-16T00:58:36.506252+0000","last_active":"2024-09-16T01:00:45.625679+0000","last_peered":"2024-09-16T01:00:45.625679+0000","last_clean":"2024-09-16T01:00:45.625679+0000","last_became_active":"2024-09-16T00:58:36.505923+0000","last_became_peered":"2024-09-16T00:58:36.505923+0000","last_unstale":"2024-09-16T01:00:45.625679+0000","last_undegraded":"2024-09-16T01:00:45.625679+0000","last_fullsized":"2024-09-16T01:00:45.625679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:05.332472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967824+0000","last_change":"2024-09-16T00:58:36.506598+0000","last_active":"2024-09-16T01:00:46.967824+0000","last_peered":"2024-09-16T01:00:46.967824+0000","last_clean":"2024-09-16T01:00:46.967824+0000","last_became_active":"2024-09-16T00:58:36.506299+0000","last_became_peered":"2024-09-16T00:58:36.506299+0000","last_unstale":"2024-09-16T01:00:46.967824+0000","last_undegraded":"2024-09-16T01:00:46.967824+0000","last_fullsized":"2024-09-16T01:00:46.967824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.327225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624647+0000","last_change":"2024-09-16T00:58:36.517050+0000","last_active":"2024-09-16T01:00:45.624647+0000","last_peered":"2024-09-16T01:00:45.624647+0000","last_clean":"2024-09-16T01:00:45.624647+0000","last_became_active":"2024-09-16T00:58:36.516745+0000","last_became_peered":"2024-09-16T00:58:36.516745+0000","last_unstale":"2024-09-16T01:00:45.624647+0000","last_undegraded":"2024-09-16T01:00:45.624647+0000","last_fullsized":"2024-09-16T01:00:45.624647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:59.981792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717660+0000","last_change":"2024-09-16T00:58:36.512442+0000","last_active":"2024-09-16T01:00:45.717660+0000","last_peered":"2024-09-16T01:00:45.717660+0000","last_clean":"2024-09-16T01:00:45.717660+0000","last_became_active":"2024-09-16T00:58:36.512132+0000","last_became_peered":"2024-09-16T00:58:36.512132+0000","last_unstale":"2024-09-16T01:00:45.717660+0000","last_undegraded":"2024-09-16T01:00:45.717660+0000","last_fullsized":"2024-09-16T01:00:45.717660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:06.511257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897210+0000","last_change":"2024-09-16T00:58:36.519754+0000","last_active":"2024-09-16T01:00:45.897210+0000","last_peered":"2024-09-16T01:00:45.897210+0000","last_clean":"2024-09-16T01:00:45.897210+0000","last_became_active":"2024-09-16T00:58:36.519378+0000","last_became_peered":"2024-09-16T00:58:36.519378+0000","last_unstale":"2024-09-16T01:00:45.897210+0000","last_undegraded":"2024-09-16T01:00:45.897210+0000","last_fullsized":"2024-09-16T01:00:45.897210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:51.076588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628046+0000","last_change":"2024-09-16T00:58:36.504627+0000","last_active":"2024-09-16T01:00:45.628046+0000","last_peered":"2024-09-16T01:00:45.628046+0000","last_clean":"2024-09-16T01:00:45.628046+0000","last_became_active":"2024-09-16T00:58:36.504282+0000","last_became_peered":"2024-09-16T00:58:36.504282+0000","last_unstale":"2024-09-16T01:00:45.628046+0000","last_undegraded":"2024-09-16T01:00:45.628046+0000","last_fullsized":"2024-09-16T01:00:45.628046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.857181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624140+0000","last_change":"2024-09-16T00:58:36.508971+0000","last_active":"2024-09-16T01:00:45.624140+0000","last_peered":"2024-09-16T01:00:45.624140+0000","last_clean":"2024-09-16T01:00:45.624140+0000","last_became_active":"2024-09-16T00:58:36.508631+0000","last_became_peered":"2024-09-16T00:58:36.508631+0000","last_unstale":"2024-09-16T01:00:45.624140+0000","last_undegraded":"2024-09-16T01:00:45.624140+0000","last_fullsized":"2024-09-16T01:00:45.624140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:17.092613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897604+0000","last_change":"2024-09-16T00:58:36.517255+0000","last_active":"2024-09-16T01:00:45.897604+0000","last_peered":"2024-09-16T01:00:45.897604+0000","last_clean":"2024-09-16T01:00:45.897604+0000","last_became_active":"2024-09-16T00:58:36.516957+0000","last_became_peered":"2024-09-16T00:58:36.516957+0000","last_unstale":"2024-09-16T01:00:45.897604+0000","last_undegraded":"2024-09-16T01:00:45.897604+0000","last_fullsized":"2024-09-16T01:00:45.897604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:34.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624283+0000","last_change":"2024-09-16T00:58:36.516429+0000","last_active":"2024-09-16T01:00:45.624283+0000","last_peered":"2024-09-16T01:00:45.624283+0000","last_clean":"2024-09-16T01:00:45.624283+0000","last_became_active":"2024-09-16T00:58:36.516111+0000","last_became_peered":"2024-09-16T00:58:36.516111+0000","last_unstale":"2024-09-16T01:00:45.624283+0000","last_undegraded":"2024-09-16T01:00:45.624283+0000","last_fullsized":"2024-09-16T01:00:45.624283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:06.120653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626784+0000","last_change":"2024-09-16T00:58:36.512873+0000","last_active":"2024-09-16T01:00:45.626784+0000","last_peered":"2024-09-16T01:00:45.626784+0000","last_clean":"2024-09-16T01:00:45.626784+0000","last_became_active":"2024-09-16T00:58:36.511761+0000","last_became_peered":"2024-09-16T00:58:36.511761+0000","last_unstale":"2024-09-16T01:00:45.626784+0000","last_undegraded":"2024-09-16T01:00:45.626784+0000","last_fullsized":"2024-09-16T01:00:45.626784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:51.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626810+0000","last_change":"2024-09-16T00:58:36.511585+0000","last_active":"2024-09-16T01:00:45.626810+0000","last_peered":"2024-09-16T01:00:45.626810+0000","last_clean":"2024-09-16T01:00:45.626810+0000","last_became_active":"2024-09-16T00:58:36.510479+0000","last_became_peered":"2024-09-16T00:58:36.510479+0000","last_unstale":"2024-09-16T01:00:45.626810+0000","last_undegraded":"2024-09-16T01:00:45.626810+0000","last_fullsized":"2024-09-16T01:00:45.626810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:58.017132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717650+0000","last_change":"2024-09-16T00:58:36.508263+0000","last_active":"2024-09-16T01:00:45.717650+0000","last_peered":"2024-09-16T01:00:45.717650+0000","last_clean":"2024-09-16T01:00:45.717650+0000","last_became_active":"2024-09-16T00:58:36.507979+0000","last_became_peered":"2024-09-16T00:58:36.507979+0000","last_unstale":"2024-09-16T01:00:45.717650+0000","last_undegraded":"2024-09-16T01:00:45.717650+0000","last_fullsized":"2024-09-16T01:00:45.717650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:07.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720241+0000","last_change":"2024-09-16T00:58:36.514981+0000","last_active":"2024-09-16T01:00:45.720241+0000","last_peered":"2024-09-16T01:00:45.720241+0000","last_clean":"2024-09-16T01:00:45.720241+0000","last_became_active":"2024-09-16T00:58:36.510433+0000","last_became_peered":"2024-09-16T00:58:36.510433+0000","last_unstale":"2024-09-16T01:00:45.720241+0000","last_undegraded":"2024-09-16T01:00:45.720241+0000","last_fullsized":"2024-09-16T01:00:45.720241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:10.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919996+0000","last_change":"2024-09-16T00:58:36.521336+0000","last_active":"2024-09-16T01:00:45.919996+0000","last_peered":"2024-09-16T01:00:45.919996+0000","last_clean":"2024-09-16T01:00:45.919996+0000","last_became_active":"2024-09-16T00:58:36.521026+0000","last_became_peered":"2024-09-16T00:58:36.521026+0000","last_unstale":"2024-09-16T01:00:45.919996+0000","last_undegraded":"2024-09-16T01:00:45.919996+0000","last_fullsized":"2024-09-16T01:00:45.919996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:29.409024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711912+0000","last_change":"2024-09-16T00:58:36.518724+0000","last_active":"2024-09-16T01:00:45.711912+0000","last_peered":"2024-09-16T01:00:45.711912+0000","last_clean":"2024-09-16T01:00:45.711912+0000","last_became_active":"2024-09-16T00:58:36.518428+0000","last_became_peered":"2024-09-16T00:58:36.518428+0000","last_unstale":"2024-09-16T01:00:45.711912+0000","last_undegraded":"2024-09-16T01:00:45.711912+0000","last_fullsized":"2024-09-16T01:00:45.711912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:06.486299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625258+0000","last_change":"2024-09-16T00:58:36.514347+0000","last_active":"2024-09-16T01:00:45.625258+0000","last_peered":"2024-09-16T01:00:45.625258+0000","last_clean":"2024-09-16T01:00:45.625258+0000","last_became_active":"2024-09-16T00:58:36.512243+0000","last_became_peered":"2024-09-16T00:58:36.512243+0000","last_unstale":"2024-09-16T01:00:45.625258+0000","last_undegraded":"2024-09-16T01:00:45.625258+0000","last_fullsized":"2024-09-16T01:00:45.625258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.289541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623615+0000","last_change":"2024-09-16T00:59:44.837828+0000","last_active":"2024-09-16T01:00:45.623615+0000","last_peered":"2024-09-16T01:00:45.623615+0000","last_clean":"2024-09-16T01:00:45.623615+0000","last_became_active":"2024-09-16T00:59:44.837486+0000","last_became_peered":"2024-09-16T00:59:44.837486+0000","last_unstale":"2024-09-16T01:00:45.623615+0000","last_undegraded":"2024-09-16T01:00:45.623615+0000","last_fullsized":"2024-09-16T01:00:45.623615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:46.914056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919570+0000","last_change":"2024-09-16T00:58:36.516797+0000","last_active":"2024-09-16T01:00:45.919570+0000","last_peered":"2024-09-16T01:00:45.919570+0000","last_clean":"2024-09-16T01:00:45.919570+0000","last_became_active":"2024-09-16T00:58:36.516480+0000","last_became_peered":"2024-09-16T00:58:36.516480+0000","last_unstale":"2024-09-16T01:00:45.919570+0000","last_undegraded":"2024-09-16T01:00:45.919570+0000","last_fullsized":"2024-09-16T01:00:45.919570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:55.262528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711362+0000","last_change":"2024-09-16T00:58:36.517973+0000","last_active":"2024-09-16T01:00:45.711362+0000","last_peered":"2024-09-16T01:00:45.711362+0000","last_clean":"2024-09-16T01:00:45.711362+0000","last_became_active":"2024-09-16T00:58:36.517634+0000","last_became_peered":"2024-09-16T00:58:36.517634+0000","last_unstale":"2024-09-16T01:00:45.711362+0000","last_undegraded":"2024-09-16T01:00:45.711362+0000","last_fullsized":"2024-09-16T01:00:45.711362+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:19.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714090+0000","last_change":"2024-09-16T00:58:36.507643+0000","last_active":"2024-09-16T01:00:45.714090+0000","last_peered":"2024-09-16T01:00:45.714090+0000","last_clean":"2024-09-16T01:00:45.714090+0000","last_became_active":"2024-09-16T00:58:36.507263+0000","last_became_peered":"2024-09-16T00:58:36.507263+0000","last_unstale":"2024-09-16T01:00:45.714090+0000","last_undegraded":"2024-09-16T01:00:45.714090+0000","last_fullsized":"2024-09-16T01:00:45.714090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:24.317490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720025+0000","last_change":"2024-09-16T00:58:36.508798+0000","last_active":"2024-09-16T01:00:45.720025+0000","last_peered":"2024-09-16T01:00:45.720025+0000","last_clean":"2024-09-16T01:00:45.720025+0000","last_became_active":"2024-09-16T00:58:36.508490+0000","last_became_peered":"2024-09-16T00:58:36.508490+0000","last_unstale":"2024-09-16T01:00:45.720025+0000","last_undegraded":"2024-09-16T01:00:45.720025+0000","last_fullsized":"2024-09-16T01:00:45.720025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:44.282270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627327+0000","last_change":"2024-09-16T00:58:36.519065+0000","last_active":"2024-09-16T01:00:45.627327+0000","last_peered":"2024-09-16T01:00:45.627327+0000","last_clean":"2024-09-16T01:00:45.627327+0000","last_became_active":"2024-09-16T00:58:36.518708+0000","last_became_peered":"2024-09-16T00:58:36.518708+0000","last_unstale":"2024-09-16T01:00:45.627327+0000","last_undegraded":"2024-09-16T01:00:45.627327+0000","last_fullsized":"2024-09-16T01:00:45.627327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:10.290341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627159+0000","last_change":"2024-09-16T00:58:36.513018+0000","last_active":"2024-09-16T01:00:45.627159+0000","last_peered":"2024-09-16T01:00:45.627159+0000","last_clean":"2024-09-16T01:00:45.627159+0000","last_became_active":"2024-09-16T00:58:36.511730+0000","last_became_peered":"2024-09-16T00:58:36.511730+0000","last_unstale":"2024-09-16T01:00:45.627159+0000","last_undegraded":"2024-09-16T01:00:45.627159+0000","last_fullsized":"2024-09-16T01:00:45.627159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:20.852121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897471+0000","last_change":"2024-09-16T00:58:36.518265+0000","last_active":"2024-09-16T01:00:45.897471+0000","last_peered":"2024-09-16T01:00:45.897471+0000","last_clean":"2024-09-16T01:00:45.897471+0000","last_became_active":"2024-09-16T00:58:36.517906+0000","last_became_peered":"2024-09-16T00:58:36.517906+0000","last_unstale":"2024-09-16T01:00:45.897471+0000","last_undegraded":"2024-09-16T01:00:45.897471+0000","last_fullsized":"2024-09-16T01:00:45.897471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.255849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71305,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1066,"num_read_kb":609,"num_write":261,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":217613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282150,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612652,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":513588,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32300,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712852,"statfs":{"total":95995035648,"available":95961960448,"internally_reserved":0,"allocated":1142784,"data_stored":1163603,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005110,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":516772,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234043,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1003520,"data_stored":512382,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462976,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":1109160,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626501,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":991232,"data_stored":508180,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855433,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":1104742,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018959,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":512926,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247893,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":507888,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444122,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":578627,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607646,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1060864,"data_stored":572943,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":510170,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:01:08.575 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-16T01:01:08.575 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.712+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/128837053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d28100a10 msgr2=0x7f4d28100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.712+0000 7f4d2e4e6640 1 --2- 172.21.15.12:0/128837053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d28100a10 0x7f4d28100e10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009900 tx=0x7f4d1802a410 comp rx=0 tx=0).stop 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.712+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/128837053 shutdown_connections 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.712+0000 7f4d2e4e6640 1 --2- 172.21.15.12:0/128837053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d281025c0 0x7f4d28108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.712+0000 7f4d2e4e6640 1 --2- 172.21.15.12:0/128837053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d28101c00 0x7f4d28102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.712+0000 7f4d2e4e6640 1 --2- 172.21.15.12:0/128837053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d28100a10 0x7f4d28100e10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.712+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/128837053 >> 172.21.15.12:0/128837053 conn(0x7f4d280fc170 msgr2=0x7f4d280fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.712+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/128837053 shutdown_connections 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.712+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/128837053 wait complete. 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.713+0000 7f4d2e4e6640 1 Processor -- start 2024-09-16T01:01:08.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.713+0000 7f4d2e4e6640 1 -- start start 2024-09-16T01:01:08.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.713+0000 7f4d2e4e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d28100a10 0x7f4d2810b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.713+0000 7f4d2e4e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d28101c00 0x7f4d281099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.713+0000 7f4d2e4e6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d281025c0 0x7f4d28109f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.713+0000 7f4d2e4e6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2810d7e0 con 0x7f4d28101c00 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.713+0000 7f4d2e4e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2810d660 con 0x7f4d28100a10 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.713+0000 7f4d2e4e6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2810d960 con 0x7f4d281025c0 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d277fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d28101c00 0x7f4d281099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d277fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d28101c00 0x7f4d281099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33110/0 (socket says 172.21.15.12:33110) 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d277fe640 1 -- 172.21.15.12:0/2392601825 learned_addr learned my addr 172.21.15.12:0/2392601825 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d27fff640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d28100a10 0x7f4d2810b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d2ca83640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d281025c0 0x7f4d28109f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d277fe640 1 -- 172.21.15.12:0/2392601825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d281025c0 msgr2=0x7f4d28109f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d277fe640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d281025c0 0x7f4d28109f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d277fe640 1 -- 172.21.15.12:0/2392601825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d28100a10 msgr2=0x7f4d2810b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d277fe640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d28100a10 0x7f4d2810b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d277fe640 1 -- 172.21.15.12:0/2392601825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2810a7a0 con 0x7f4d28101c00 2024-09-16T01:01:08.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d277fe640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d28101c00 0x7f4d281099d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00c970 tx=0x7f4d1c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d257fa640 1 -- 172.21.15.12:0/2392601825 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c007bb0 con 0x7f4d28101c00 2024-09-16T01:01:08.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d257fa640 1 -- 172.21.15.12:0/2392601825 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d1c007d50 con 0x7f4d28101c00 2024-09-16T01:01:08.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/2392601825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d281a1fe0 con 0x7f4d28101c00 2024-09-16T01:01:08.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d257fa640 1 -- 172.21.15.12:0/2392601825 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00f450 con 0x7f4d28101c00 2024-09-16T01:01:08.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.714+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/2392601825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d281a23f0 con 0x7f4d28101c00 2024-09-16T01:01:08.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.715+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/2392601825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d28107e50 con 0x7f4d28101c00 2024-09-16T01:01:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.716+0000 7f4d257fa640 1 -- 172.21.15.12:0/2392601825 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4d1c005020 con 0x7f4d28101c00 2024-09-16T01:01:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.717+0000 7f4d257fa640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d100a3250 0x7f4d100a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.717+0000 7f4d27fff640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d100a3250 0x7f4d100a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.717+0000 7f4d257fa640 1 -- 172.21.15.12:0/2392601825 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f4d1c0cfb60 con 0x7f4d28101c00 2024-09-16T01:01:08.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.718+0000 7f4d27fff640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d100a3250 0x7f4d100a5710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d18006010 tx=0x7f4d18000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.721+0000 7f4d257fa640 1 -- 172.21.15.12:0/2392601825 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d1c014030 con 0x7f4d28101c00 2024-09-16T01:01:08.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:08 smithi012 ceph-mon[31197]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-16T01:01:08.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.896+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/2392601825 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d28062630 con 0x7f4d100a3250 2024-09-16T01:01:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.904+0000 7f4d257fa640 1 -- 172.21.15.12:0/2392601825 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340798 (secure 0 0 0) 0x7f4d28062630 con 0x7f4d100a3250 2024-09-16T01:01:08.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/2392601825 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d100a3250 msgr2=0x7f4d100a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d100a3250 0x7f4d100a5710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d18006010 tx=0x7f4d18000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/2392601825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d28101c00 msgr2=0x7f4d281099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d28101c00 0x7f4d281099d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00c970 tx=0x7f4d1c00ce30 comp rx=0 tx=0).stop 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/2392601825 shutdown_connections 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f4d100a3250 0x7f4d100a5710 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d281025c0 0x7f4d28109f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d28101c00 0x7f4d281099d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 --2- 172.21.15.12:0/2392601825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d28100a10 0x7f4d2810b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/2392601825 >> 172.21.15.12:0/2392601825 conn(0x7f4d280fc170 msgr2=0x7f4d28105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/2392601825 shutdown_connections 2024-09-16T01:01:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:08.907+0000 7f4d2e4e6640 1 -- 172.21.15.12:0/2392601825 wait complete. 2024-09-16T01:01:08.919 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-16T01:01:06.936017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661907,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1192,"num_read_kb":718,"num_write":444,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373940,"kb_used_data":12168,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567884,"statfs":{"total":1151940427776,"available":1151557513216,"internally_reserved":0,"allocated":12460032,"data_stored":8110981,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":52,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003050"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:02.942810+0000","last_change":"2024-09-16T00:59:44.862009+0000","last_active":"2024-09-16T01:01:02.942810+0000","last_peered":"2024-09-16T01:01:02.942810+0000","last_clean":"2024-09-16T01:01:02.942810+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:01:02.942810+0000","last_undegraded":"2024-09-16T01:01:02.942810+0000","last_fullsized":"2024-09-16T01:01:02.942810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:11.209907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968087+0000","last_change":"2024-09-16T00:58:36.507955+0000","last_active":"2024-09-16T01:00:46.968087+0000","last_peered":"2024-09-16T01:00:46.968087+0000","last_clean":"2024-09-16T01:00:46.968087+0000","last_became_active":"2024-09-16T00:58:36.507660+0000","last_became_peered":"2024-09-16T00:58:36.507660+0000","last_unstale":"2024-09-16T01:00:46.968087+0000","last_undegraded":"2024-09-16T01:00:46.968087+0000","last_fullsized":"2024-09-16T01:00:46.968087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:05.408460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627372+0000","last_change":"2024-09-16T00:58:43.620365+0000","last_active":"2024-09-16T01:00:45.627372+0000","last_peered":"2024-09-16T01:00:45.627372+0000","last_clean":"2024-09-16T01:00:45.627372+0000","last_became_active":"2024-09-16T00:58:43.619976+0000","last_became_peered":"2024-09-16T00:58:43.619976+0000","last_unstale":"2024-09-16T01:00:45.627372+0000","last_undegraded":"2024-09-16T01:00:45.627372+0000","last_fullsized":"2024-09-16T01:00:45.627372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:37.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968248+0000","last_change":"2024-09-16T00:58:34.829549+0000","last_active":"2024-09-16T01:00:46.968248+0000","last_peered":"2024-09-16T01:00:46.968248+0000","last_clean":"2024-09-16T01:00:46.968248+0000","last_became_active":"2024-09-16T00:58:34.829180+0000","last_became_peered":"2024-09-16T00:58:34.829180+0000","last_unstale":"2024-09-16T01:00:46.968248+0000","last_undegraded":"2024-09-16T01:00:46.968248+0000","last_fullsized":"2024-09-16T01:00:46.968248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:40.731288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627338+0000","last_change":"2024-09-16T00:58:36.517190+0000","last_active":"2024-09-16T01:00:45.627338+0000","last_peered":"2024-09-16T01:00:45.627338+0000","last_clean":"2024-09-16T01:00:45.627338+0000","last_became_active":"2024-09-16T00:58:36.516877+0000","last_became_peered":"2024-09-16T00:58:36.516877+0000","last_unstale":"2024-09-16T01:00:45.627338+0000","last_undegraded":"2024-09-16T01:00:45.627338+0000","last_fullsized":"2024-09-16T01:00:45.627338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.408011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719567+0000","last_change":"2024-09-16T00:59:44.863832+0000","last_active":"2024-09-16T01:00:45.719567+0000","last_peered":"2024-09-16T01:00:45.719567+0000","last_clean":"2024-09-16T01:00:45.719567+0000","last_became_active":"2024-09-16T00:59:44.863298+0000","last_became_peered":"2024-09-16T00:59:44.863298+0000","last_unstale":"2024-09-16T01:00:45.719567+0000","last_undegraded":"2024-09-16T01:00:45.719567+0000","last_fullsized":"2024-09-16T01:00:45.719567+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:55.449728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714641+0000","last_change":"2024-09-16T00:58:34.472375+0000","last_active":"2024-09-16T01:00:45.714641+0000","last_peered":"2024-09-16T01:00:45.714641+0000","last_clean":"2024-09-16T01:00:45.714641+0000","last_became_active":"2024-09-16T00:58:34.471990+0000","last_became_peered":"2024-09-16T00:58:34.471990+0000","last_unstale":"2024-09-16T01:00:45.714641+0000","last_undegraded":"2024-09-16T01:00:45.714641+0000","last_fullsized":"2024-09-16T01:00:45.714641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:15.746005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624613+0000","last_change":"2024-09-16T00:58:36.513747+0000","last_active":"2024-09-16T01:00:45.624613+0000","last_peered":"2024-09-16T01:00:45.624613+0000","last_clean":"2024-09-16T01:00:45.624613+0000","last_became_active":"2024-09-16T00:58:36.512635+0000","last_became_peered":"2024-09-16T00:58:36.512635+0000","last_unstale":"2024-09-16T01:00:45.624613+0000","last_undegraded":"2024-09-16T01:00:45.624613+0000","last_fullsized":"2024-09-16T01:00:45.624613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:39.014961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719783+0000","last_change":"2024-09-16T00:58:43.609355+0000","last_active":"2024-09-16T01:00:45.719783+0000","last_peered":"2024-09-16T01:00:45.719783+0000","last_clean":"2024-09-16T01:00:45.719783+0000","last_became_active":"2024-09-16T00:58:43.608892+0000","last_became_peered":"2024-09-16T00:58:43.608892+0000","last_unstale":"2024-09-16T01:00:45.719783+0000","last_undegraded":"2024-09-16T01:00:45.719783+0000","last_fullsized":"2024-09-16T01:00:45.719783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:20.718163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714484+0000","last_change":"2024-09-16T00:58:34.469650+0000","last_active":"2024-09-16T01:00:45.714484+0000","last_peered":"2024-09-16T01:00:45.714484+0000","last_clean":"2024-09-16T01:00:45.714484+0000","last_became_active":"2024-09-16T00:58:34.468939+0000","last_became_peered":"2024-09-16T00:58:34.468939+0000","last_unstale":"2024-09-16T01:00:45.714484+0000","last_undegraded":"2024-09-16T01:00:45.714484+0000","last_fullsized":"2024-09-16T01:00:45.714484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:34.511111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623914+0000","last_change":"2024-09-16T00:59:45.097454+0000","last_active":"2024-09-16T01:00:45.623914+0000","last_peered":"2024-09-16T01:00:45.623914+0000","last_clean":"2024-09-16T01:00:45.623914+0000","last_became_active":"2024-09-16T00:59:45.096985+0000","last_became_peered":"2024-09-16T00:59:45.096985+0000","last_unstale":"2024-09-16T01:00:45.623914+0000","last_undegraded":"2024-09-16T01:00:45.623914+0000","last_fullsized":"2024-09-16T01:00:45.623914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:03.247850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719638+0000","last_change":"2024-09-16T00:58:43.612479+0000","last_active":"2024-09-16T01:00:45.719638+0000","last_peered":"2024-09-16T01:00:45.719638+0000","last_clean":"2024-09-16T01:00:45.719638+0000","last_became_active":"2024-09-16T00:58:43.612001+0000","last_became_peered":"2024-09-16T00:58:43.612001+0000","last_unstale":"2024-09-16T01:00:45.719638+0000","last_undegraded":"2024-09-16T01:00:45.719638+0000","last_fullsized":"2024-09-16T01:00:45.719638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:33.056052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919590+0000","last_change":"2024-09-16T00:58:36.519407+0000","last_active":"2024-09-16T01:00:45.919590+0000","last_peered":"2024-09-16T01:00:45.919590+0000","last_clean":"2024-09-16T01:00:45.919590+0000","last_became_active":"2024-09-16T00:58:36.519108+0000","last_became_peered":"2024-09-16T00:58:36.519108+0000","last_unstale":"2024-09-16T01:00:45.919590+0000","last_undegraded":"2024-09-16T01:00:45.919590+0000","last_fullsized":"2024-09-16T01:00:45.919590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:28.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714187+0000","last_change":"2024-09-16T00:58:34.472295+0000","last_active":"2024-09-16T01:00:45.714187+0000","last_peered":"2024-09-16T01:00:45.714187+0000","last_clean":"2024-09-16T01:00:45.714187+0000","last_became_active":"2024-09-16T00:58:34.471968+0000","last_became_peered":"2024-09-16T00:58:34.471968+0000","last_unstale":"2024-09-16T01:00:45.714187+0000","last_undegraded":"2024-09-16T01:00:45.714187+0000","last_fullsized":"2024-09-16T01:00:45.714187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:44.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720006+0000","last_change":"2024-09-16T00:58:43.615870+0000","last_active":"2024-09-16T01:00:45.720006+0000","last_peered":"2024-09-16T01:00:45.720006+0000","last_clean":"2024-09-16T01:00:45.720006+0000","last_became_active":"2024-09-16T00:58:43.615116+0000","last_became_peered":"2024-09-16T00:58:43.615116+0000","last_unstale":"2024-09-16T01:00:45.720006+0000","last_undegraded":"2024-09-16T01:00:45.720006+0000","last_fullsized":"2024-09-16T01:00:45.720006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:44.742792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967891+0000","last_change":"2024-09-16T00:58:36.512485+0000","last_active":"2024-09-16T01:00:46.967891+0000","last_peered":"2024-09-16T01:00:46.967891+0000","last_clean":"2024-09-16T01:00:46.967891+0000","last_became_active":"2024-09-16T00:58:36.512175+0000","last_became_peered":"2024-09-16T00:58:36.512175+0000","last_unstale":"2024-09-16T01:00:46.967891+0000","last_undegraded":"2024-09-16T01:00:46.967891+0000","last_fullsized":"2024-09-16T01:00:46.967891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.328409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'4","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.896964+0000","last_change":"2024-09-16T00:59:44.841052+0000","last_active":"2024-09-16T01:00:45.896964+0000","last_peered":"2024-09-16T01:00:45.896964+0000","last_clean":"2024-09-16T01:00:45.896964+0000","last_became_active":"2024-09-16T00:59:44.834033+0000","last_became_peered":"2024-09-16T00:59:44.834033+0000","last_unstale":"2024-09-16T01:00:45.896964+0000","last_undegraded":"2024-09-16T01:00:45.896964+0000","last_fullsized":"2024-09-16T01:00:45.896964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:09.696435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720242+0000","last_change":"2024-09-16T00:58:43.610265+0000","last_active":"2024-09-16T01:00:45.720242+0000","last_peered":"2024-09-16T01:00:45.720242+0000","last_clean":"2024-09-16T01:00:45.720242+0000","last_became_active":"2024-09-16T00:58:43.609868+0000","last_became_peered":"2024-09-16T00:58:43.609868+0000","last_unstale":"2024-09-16T01:00:45.720242+0000","last_undegraded":"2024-09-16T01:00:45.720242+0000","last_fullsized":"2024-09-16T01:00:45.720242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:54.689332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897423+0000","last_change":"2024-09-16T00:58:36.512801+0000","last_active":"2024-09-16T01:00:45.897423+0000","last_peered":"2024-09-16T01:00:45.897423+0000","last_clean":"2024-09-16T01:00:45.897423+0000","last_became_active":"2024-09-16T00:58:36.512469+0000","last_became_peered":"2024-09-16T00:58:36.512469+0000","last_unstale":"2024-09-16T01:00:45.897423+0000","last_undegraded":"2024-09-16T01:00:45.897423+0000","last_fullsized":"2024-09-16T01:00:45.897423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:57.951743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967904+0000","last_change":"2024-09-16T00:58:34.471498+0000","last_active":"2024-09-16T01:00:46.967904+0000","last_peered":"2024-09-16T01:00:46.967904+0000","last_clean":"2024-09-16T01:00:46.967904+0000","last_became_active":"2024-09-16T00:58:34.471093+0000","last_became_peered":"2024-09-16T00:58:34.471093+0000","last_unstale":"2024-09-16T01:00:46.967904+0000","last_undegraded":"2024-09-16T01:00:46.967904+0000","last_fullsized":"2024-09-16T01:00:46.967904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:35.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624262+0000","last_change":"2024-09-16T00:58:43.616376+0000","last_active":"2024-09-16T01:00:45.624262+0000","last_peered":"2024-09-16T01:00:45.624262+0000","last_clean":"2024-09-16T01:00:45.624262+0000","last_became_active":"2024-09-16T00:58:43.616029+0000","last_became_peered":"2024-09-16T00:58:43.616029+0000","last_unstale":"2024-09-16T01:00:45.624262+0000","last_undegraded":"2024-09-16T01:00:45.624262+0000","last_fullsized":"2024-09-16T01:00:45.624262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:54.776250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714062+0000","last_change":"2024-09-16T00:58:36.506625+0000","last_active":"2024-09-16T01:00:45.714062+0000","last_peered":"2024-09-16T01:00:45.714062+0000","last_clean":"2024-09-16T01:00:45.714062+0000","last_became_active":"2024-09-16T00:58:36.506337+0000","last_became_peered":"2024-09-16T00:58:36.506337+0000","last_unstale":"2024-09-16T01:00:45.714062+0000","last_undegraded":"2024-09-16T01:00:45.714062+0000","last_fullsized":"2024-09-16T01:00:45.714062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:22.080165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.901530+0000","last_change":"2024-09-16T01:00:45.901112+0000","last_active":"2024-09-16T01:00:45.901530+0000","last_peered":"2024-09-16T01:00:45.901530+0000","last_clean":"2024-09-16T01:00:45.901530+0000","last_became_active":"2024-09-16T01:00:45.898274+0000","last_became_peered":"2024-09-16T01:00:45.898274+0000","last_unstale":"2024-09-16T01:00:45.901530+0000","last_undegraded":"2024-09-16T01:00:45.901530+0000","last_fullsized":"2024-09-16T01:00:45.901530+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:55.626391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720033+0000","last_change":"2024-09-16T00:58:43.609399+0000","last_active":"2024-09-16T01:00:45.720033+0000","last_peered":"2024-09-16T01:00:45.720033+0000","last_clean":"2024-09-16T01:00:45.720033+0000","last_became_active":"2024-09-16T00:58:43.608988+0000","last_became_peered":"2024-09-16T00:58:43.608988+0000","last_unstale":"2024-09-16T01:00:45.720033+0000","last_undegraded":"2024-09-16T01:00:45.720033+0000","last_fullsized":"2024-09-16T01:00:45.720033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.500071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627256+0000","last_change":"2024-09-16T00:58:36.515930+0000","last_active":"2024-09-16T01:00:45.627256+0000","last_peered":"2024-09-16T01:00:45.627256+0000","last_clean":"2024-09-16T01:00:45.627256+0000","last_became_active":"2024-09-16T00:58:36.515625+0000","last_became_peered":"2024-09-16T00:58:36.515625+0000","last_unstale":"2024-09-16T01:00:45.627256+0000","last_undegraded":"2024-09-16T01:00:45.627256+0000","last_fullsized":"2024-09-16T01:00:45.627256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:55.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720365+0000","last_change":"2024-09-16T00:58:34.508686+0000","last_active":"2024-09-16T01:00:45.720365+0000","last_peered":"2024-09-16T01:00:45.720365+0000","last_clean":"2024-09-16T01:00:45.720365+0000","last_became_active":"2024-09-16T00:58:34.508284+0000","last_became_peered":"2024-09-16T00:58:34.508284+0000","last_unstale":"2024-09-16T01:00:45.720365+0000","last_undegraded":"2024-09-16T01:00:45.720365+0000","last_fullsized":"2024-09-16T01:00:45.720365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:47.545949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627558+0000","last_change":"2024-09-16T00:58:43.615852+0000","last_active":"2024-09-16T01:00:45.627558+0000","last_peered":"2024-09-16T01:00:45.627558+0000","last_clean":"2024-09-16T01:00:45.627558+0000","last_became_active":"2024-09-16T00:58:43.615474+0000","last_became_peered":"2024-09-16T00:58:43.615474+0000","last_unstale":"2024-09-16T01:00:45.627558+0000","last_undegraded":"2024-09-16T01:00:45.627558+0000","last_fullsized":"2024-09-16T01:00:45.627558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:39.596924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968316+0000","last_change":"2024-09-16T00:58:36.513820+0000","last_active":"2024-09-16T01:00:46.968316+0000","last_peered":"2024-09-16T01:00:46.968316+0000","last_clean":"2024-09-16T01:00:46.968316+0000","last_became_active":"2024-09-16T00:58:36.513513+0000","last_became_peered":"2024-09-16T00:58:36.513513+0000","last_unstale":"2024-09-16T01:00:46.968316+0000","last_undegraded":"2024-09-16T01:00:46.968316+0000","last_fullsized":"2024-09-16T01:00:46.968316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:34.584214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'16","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624208+0000","last_change":"2024-09-16T00:58:34.462794+0000","last_active":"2024-09-16T01:00:45.624208+0000","last_peered":"2024-09-16T01:00:45.624208+0000","last_clean":"2024-09-16T01:00:45.624208+0000","last_became_active":"2024-09-16T00:58:34.462471+0000","last_became_peered":"2024-09-16T00:58:34.462471+0000","last_unstale":"2024-09-16T01:00:45.624208+0000","last_undegraded":"2024-09-16T01:00:45.624208+0000","last_fullsized":"2024-09-16T01:00:45.624208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:13.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967564+0000","last_change":"2024-09-16T00:58:43.607718+0000","last_active":"2024-09-16T01:00:46.967564+0000","last_peered":"2024-09-16T01:00:46.967564+0000","last_clean":"2024-09-16T01:00:46.967564+0000","last_became_active":"2024-09-16T00:58:43.607347+0000","last_became_peered":"2024-09-16T00:58:43.607347+0000","last_unstale":"2024-09-16T01:00:46.967564+0000","last_undegraded":"2024-09-16T01:00:46.967564+0000","last_fullsized":"2024-09-16T01:00:46.967564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:12.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.507161+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.504062+0000","last_became_peered":"2024-09-16T00:58:36.504062+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:58:34.829848+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:58:34.829439+0000","last_became_peered":"2024-09-16T00:58:34.829439+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:06.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897267+0000","last_change":"2024-09-16T00:58:43.618334+0000","last_active":"2024-09-16T01:00:45.897267+0000","last_peered":"2024-09-16T01:00:45.897267+0000","last_clean":"2024-09-16T01:00:45.897267+0000","last_became_active":"2024-09-16T00:58:43.617810+0000","last_became_peered":"2024-09-16T00:58:43.617810+0000","last_unstale":"2024-09-16T01:00:45.897267+0000","last_undegraded":"2024-09-16T01:00:45.897267+0000","last_fullsized":"2024-09-16T01:00:45.897267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:58.202973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711427+0000","last_change":"2024-09-16T00:58:36.509025+0000","last_active":"2024-09-16T01:00:45.711427+0000","last_peered":"2024-09-16T01:00:45.711427+0000","last_clean":"2024-09-16T01:00:45.711427+0000","last_became_active":"2024-09-16T00:58:36.508660+0000","last_became_peered":"2024-09-16T00:58:36.508660+0000","last_unstale":"2024-09-16T01:00:45.711427+0000","last_undegraded":"2024-09-16T01:00:45.711427+0000","last_fullsized":"2024-09-16T01:00:45.711427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:01.433486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624046+0000","last_change":"2024-09-16T00:58:34.829899+0000","last_active":"2024-09-16T01:00:45.624046+0000","last_peered":"2024-09-16T01:00:45.624046+0000","last_clean":"2024-09-16T01:00:45.624046+0000","last_became_active":"2024-09-16T00:58:34.829546+0000","last_became_peered":"2024-09-16T00:58:34.829546+0000","last_unstale":"2024-09-16T01:00:45.624046+0000","last_undegraded":"2024-09-16T01:00:45.624046+0000","last_fullsized":"2024-09-16T01:00:45.624046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:21.253829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714080+0000","last_change":"2024-09-16T00:58:43.610143+0000","last_active":"2024-09-16T01:00:45.714080+0000","last_peered":"2024-09-16T01:00:45.714080+0000","last_clean":"2024-09-16T01:00:45.714080+0000","last_became_active":"2024-09-16T00:58:43.609739+0000","last_became_peered":"2024-09-16T00:58:43.609739+0000","last_unstale":"2024-09-16T01:00:45.714080+0000","last_undegraded":"2024-09-16T01:00:45.714080+0000","last_fullsized":"2024-09-16T01:00:45.714080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:28.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711421+0000","last_change":"2024-09-16T00:58:36.520423+0000","last_active":"2024-09-16T01:00:45.711421+0000","last_peered":"2024-09-16T01:00:45.711421+0000","last_clean":"2024-09-16T01:00:45.711421+0000","last_became_active":"2024-09-16T00:58:36.520117+0000","last_became_peered":"2024-09-16T00:58:36.520117+0000","last_unstale":"2024-09-16T01:00:45.711421+0000","last_undegraded":"2024-09-16T01:00:45.711421+0000","last_fullsized":"2024-09-16T01:00:45.711421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.652142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:04.945968+0000","last_change":"2024-09-16T00:58:34.475161+0000","last_active":"2024-09-16T01:01:04.945968+0000","last_peered":"2024-09-16T01:01:04.945968+0000","last_clean":"2024-09-16T01:01:04.945968+0000","last_became_active":"2024-09-16T00:58:34.474755+0000","last_became_peered":"2024-09-16T00:58:34.474755+0000","last_unstale":"2024-09-16T01:01:04.945968+0000","last_undegraded":"2024-09-16T01:01:04.945968+0000","last_fullsized":"2024-09-16T01:01:04.945968+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:12.884466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717746+0000","last_change":"2024-09-16T00:58:43.609042+0000","last_active":"2024-09-16T01:00:45.717746+0000","last_peered":"2024-09-16T01:00:45.717746+0000","last_clean":"2024-09-16T01:00:45.717746+0000","last_became_active":"2024-09-16T00:58:43.608596+0000","last_became_peered":"2024-09-16T00:58:43.608596+0000","last_unstale":"2024-09-16T01:00:45.717746+0000","last_undegraded":"2024-09-16T01:00:45.717746+0000","last_fullsized":"2024-09-16T01:00:45.717746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:47.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625659+0000","last_change":"2024-09-16T00:59:44.838583+0000","last_active":"2024-09-16T01:00:45.625659+0000","last_peered":"2024-09-16T01:00:45.625659+0000","last_clean":"2024-09-16T01:00:45.625659+0000","last_became_active":"2024-09-16T00:59:44.838221+0000","last_became_peered":"2024-09-16T00:59:44.838221+0000","last_unstale":"2024-09-16T01:00:45.625659+0000","last_undegraded":"2024-09-16T01:00:45.625659+0000","last_fullsized":"2024-09-16T01:00:45.625659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:27.562118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:02.744039+0000","last_change":"2024-09-16T00:58:34.829452+0000","last_active":"2024-09-16T01:01:02.744039+0000","last_peered":"2024-09-16T01:01:02.744039+0000","last_clean":"2024-09-16T01:01:02.744039+0000","last_became_active":"2024-09-16T00:58:34.829129+0000","last_became_peered":"2024-09-16T00:58:34.829129+0000","last_unstale":"2024-09-16T01:01:02.744039+0000","last_undegraded":"2024-09-16T01:01:02.744039+0000","last_fullsized":"2024-09-16T01:01:02.744039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718001+0000","last_change":"2024-09-16T00:58:43.609230+0000","last_active":"2024-09-16T01:00:45.718001+0000","last_peered":"2024-09-16T01:00:45.718001+0000","last_clean":"2024-09-16T01:00:45.718001+0000","last_became_active":"2024-09-16T00:58:43.608879+0000","last_became_peered":"2024-09-16T00:58:43.608879+0000","last_unstale":"2024-09-16T01:00:45.718001+0000","last_undegraded":"2024-09-16T01:00:45.718001+0000","last_fullsized":"2024-09-16T01:00:45.718001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.112878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717141+0000","last_change":"2024-09-16T00:58:36.503412+0000","last_active":"2024-09-16T01:00:45.717141+0000","last_peered":"2024-09-16T01:00:45.717141+0000","last_clean":"2024-09-16T01:00:45.717141+0000","last_became_active":"2024-09-16T00:58:36.503043+0000","last_became_peered":"2024-09-16T00:58:36.503043+0000","last_unstale":"2024-09-16T01:00:45.717141+0000","last_undegraded":"2024-09-16T01:00:45.717141+0000","last_fullsized":"2024-09-16T01:00:45.717141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:18.495669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919328+0000","last_change":"2024-09-16T00:58:34.468460+0000","last_active":"2024-09-16T01:00:45.919328+0000","last_peered":"2024-09-16T01:00:45.919328+0000","last_clean":"2024-09-16T01:00:45.919328+0000","last_became_active":"2024-09-16T00:58:34.468104+0000","last_became_peered":"2024-09-16T00:58:34.468104+0000","last_unstale":"2024-09-16T01:00:45.919328+0000","last_undegraded":"2024-09-16T01:00:45.919328+0000","last_fullsized":"2024-09-16T01:00:45.919328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:13.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714467+0000","last_change":"2024-09-16T00:59:44.863609+0000","last_active":"2024-09-16T01:00:45.714467+0000","last_peered":"2024-09-16T01:00:45.714467+0000","last_clean":"2024-09-16T01:00:45.714467+0000","last_became_active":"2024-09-16T00:59:44.863152+0000","last_became_peered":"2024-09-16T00:59:44.863152+0000","last_unstale":"2024-09-16T01:00:45.714467+0000","last_undegraded":"2024-09-16T01:00:45.714467+0000","last_fullsized":"2024-09-16T01:00:45.714467+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:51.312612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967875+0000","last_change":"2024-09-16T00:58:36.509749+0000","last_active":"2024-09-16T01:00:46.967875+0000","last_peered":"2024-09-16T01:00:46.967875+0000","last_clean":"2024-09-16T01:00:46.967875+0000","last_became_active":"2024-09-16T00:58:36.509411+0000","last_became_peered":"2024-09-16T00:58:36.509411+0000","last_unstale":"2024-09-16T01:00:46.967875+0000","last_undegraded":"2024-09-16T01:00:46.967875+0000","last_fullsized":"2024-09-16T01:00:46.967875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:14.291956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720026+0000","last_change":"2024-09-16T00:58:34.470190+0000","last_active":"2024-09-16T01:00:45.720026+0000","last_peered":"2024-09-16T01:00:45.720026+0000","last_clean":"2024-09-16T01:00:45.720026+0000","last_became_active":"2024-09-16T00:58:34.469832+0000","last_became_peered":"2024-09-16T00:58:34.469832+0000","last_unstale":"2024-09-16T01:00:45.720026+0000","last_undegraded":"2024-09-16T01:00:45.720026+0000","last_fullsized":"2024-09-16T01:00:45.720026+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:03.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919482+0000","last_change":"2024-09-16T00:57:23.502001+0000","last_active":"2024-09-16T01:00:45.919482+0000","last_peered":"2024-09-16T01:00:45.919482+0000","last_clean":"2024-09-16T01:00:45.919482+0000","last_became_active":"2024-09-16T00:57:23.501465+0000","last_became_peered":"2024-09-16T00:57:23.501465+0000","last_unstale":"2024-09-16T01:00:45.919482+0000","last_undegraded":"2024-09-16T01:00:45.919482+0000","last_fullsized":"2024-09-16T01:00:45.919482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_clean_scrub_stamp":"2024-09-16T00:53:57.344038+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:22.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919823+0000","last_change":"2024-09-16T00:58:43.609572+0000","last_active":"2024-09-16T01:00:45.919823+0000","last_peered":"2024-09-16T01:00:45.919823+0000","last_clean":"2024-09-16T01:00:45.919823+0000","last_became_active":"2024-09-16T00:58:43.609185+0000","last_became_peered":"2024-09-16T00:58:43.609185+0000","last_unstale":"2024-09-16T01:00:45.919823+0000","last_undegraded":"2024-09-16T01:00:45.919823+0000","last_fullsized":"2024-09-16T01:00:45.919823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.199976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919987+0000","last_change":"2024-09-16T00:58:36.510761+0000","last_active":"2024-09-16T01:00:45.919987+0000","last_peered":"2024-09-16T01:00:45.919987+0000","last_clean":"2024-09-16T01:00:45.919987+0000","last_became_active":"2024-09-16T00:58:36.510456+0000","last_became_peered":"2024-09-16T00:58:36.510456+0000","last_unstale":"2024-09-16T01:00:45.919987+0000","last_undegraded":"2024-09-16T01:00:45.919987+0000","last_fullsized":"2024-09-16T01:00:45.919987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:02.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'8","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:04.744929+0000","last_change":"2024-09-16T00:58:34.830238+0000","last_active":"2024-09-16T01:01:04.744929+0000","last_peered":"2024-09-16T01:01:04.744929+0000","last_clean":"2024-09-16T01:01:04.744929+0000","last_became_active":"2024-09-16T00:58:34.829558+0000","last_became_peered":"2024-09-16T00:58:34.829558+0000","last_unstale":"2024-09-16T01:01:04.744929+0000","last_undegraded":"2024-09-16T01:01:04.744929+0000","last_fullsized":"2024-09-16T01:01:04.744929+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.347122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624541+0000","last_change":"2024-09-16T00:58:43.613179+0000","last_active":"2024-09-16T01:00:45.624541+0000","last_peered":"2024-09-16T01:00:45.624541+0000","last_clean":"2024-09-16T01:00:45.624541+0000","last_became_active":"2024-09-16T00:58:43.612794+0000","last_became_peered":"2024-09-16T00:58:43.612794+0000","last_unstale":"2024-09-16T01:00:45.624541+0000","last_undegraded":"2024-09-16T01:00:45.624541+0000","last_fullsized":"2024-09-16T01:00:45.624541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:04:24.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919741+0000","last_change":"2024-09-16T00:58:36.512600+0000","last_active":"2024-09-16T01:00:45.919741+0000","last_peered":"2024-09-16T01:00:45.919741+0000","last_clean":"2024-09-16T01:00:45.919741+0000","last_became_active":"2024-09-16T00:58:36.512309+0000","last_became_peered":"2024-09-16T00:58:36.512309+0000","last_unstale":"2024-09-16T01:00:45.919741+0000","last_undegraded":"2024-09-16T01:00:45.919741+0000","last_fullsized":"2024-09-16T01:00:45.919741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.790755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626294+0000","last_change":"2024-09-16T00:58:34.471787+0000","last_active":"2024-09-16T01:00:45.626294+0000","last_peered":"2024-09-16T01:00:45.626294+0000","last_clean":"2024-09-16T01:00:45.626294+0000","last_became_active":"2024-09-16T00:58:34.471119+0000","last_became_peered":"2024-09-16T00:58:34.471119+0000","last_unstale":"2024-09-16T01:00:45.626294+0000","last_undegraded":"2024-09-16T01:00:45.626294+0000","last_fullsized":"2024-09-16T01:00:45.626294+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:26.121669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626989+0000","last_change":"2024-09-16T00:58:43.609676+0000","last_active":"2024-09-16T01:00:45.626989+0000","last_peered":"2024-09-16T01:00:45.626989+0000","last_clean":"2024-09-16T01:00:45.626989+0000","last_became_active":"2024-09-16T00:58:43.609313+0000","last_became_peered":"2024-09-16T00:58:43.609313+0000","last_unstale":"2024-09-16T01:00:45.626989+0000","last_undegraded":"2024-09-16T01:00:45.626989+0000","last_fullsized":"2024-09-16T01:00:45.626989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:53.339070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919903+0000","last_change":"2024-09-16T00:58:36.514621+0000","last_active":"2024-09-16T01:00:45.919903+0000","last_peered":"2024-09-16T01:00:45.919903+0000","last_clean":"2024-09-16T01:00:45.919903+0000","last_became_active":"2024-09-16T00:58:36.514259+0000","last_became_peered":"2024-09-16T00:58:36.514259+0000","last_unstale":"2024-09-16T01:00:45.919903+0000","last_undegraded":"2024-09-16T01:00:45.919903+0000","last_fullsized":"2024-09-16T01:00:45.919903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:11.411742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718006+0000","last_change":"2024-09-16T00:58:34.470512+0000","last_active":"2024-09-16T01:00:45.718006+0000","last_peered":"2024-09-16T01:00:45.718006+0000","last_clean":"2024-09-16T01:00:45.718006+0000","last_became_active":"2024-09-16T00:58:34.470140+0000","last_became_peered":"2024-09-16T00:58:34.470140+0000","last_unstale":"2024-09-16T01:00:45.718006+0000","last_undegraded":"2024-09-16T01:00:45.718006+0000","last_fullsized":"2024-09-16T01:00:45.718006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:04.068901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625516+0000","last_change":"2024-09-16T00:58:43.615221+0000","last_active":"2024-09-16T01:00:45.625516+0000","last_peered":"2024-09-16T01:00:45.625516+0000","last_clean":"2024-09-16T01:00:45.625516+0000","last_became_active":"2024-09-16T00:58:43.614820+0000","last_became_peered":"2024-09-16T00:58:43.614820+0000","last_unstale":"2024-09-16T01:00:45.625516+0000","last_undegraded":"2024-09-16T01:00:45.625516+0000","last_fullsized":"2024-09-16T01:00:45.625516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:31.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897390+0000","last_change":"2024-09-16T00:58:36.515470+0000","last_active":"2024-09-16T01:00:45.897390+0000","last_peered":"2024-09-16T01:00:45.897390+0000","last_clean":"2024-09-16T01:00:45.897390+0000","last_became_active":"2024-09-16T00:58:36.515145+0000","last_became_peered":"2024-09-16T00:58:36.515145+0000","last_unstale":"2024-09-16T01:00:45.897390+0000","last_undegraded":"2024-09-16T01:00:45.897390+0000","last_fullsized":"2024-09-16T01:00:45.897390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:10.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714720+0000","last_change":"2024-09-16T00:58:34.464865+0000","last_active":"2024-09-16T01:00:45.714720+0000","last_peered":"2024-09-16T01:00:45.714720+0000","last_clean":"2024-09-16T01:00:45.714720+0000","last_became_active":"2024-09-16T00:58:34.464448+0000","last_became_peered":"2024-09-16T00:58:34.464448+0000","last_unstale":"2024-09-16T01:00:45.714720+0000","last_undegraded":"2024-09-16T01:00:45.714720+0000","last_fullsized":"2024-09-16T01:00:45.714720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:47.454251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625710+0000","last_change":"2024-09-16T00:58:43.610348+0000","last_active":"2024-09-16T01:00:45.625710+0000","last_peered":"2024-09-16T01:00:45.625710+0000","last_clean":"2024-09-16T01:00:45.625710+0000","last_became_active":"2024-09-16T00:58:43.609497+0000","last_became_peered":"2024-09-16T00:58:43.609497+0000","last_unstale":"2024-09-16T01:00:45.625710+0000","last_undegraded":"2024-09-16T01:00:45.625710+0000","last_fullsized":"2024-09-16T01:00:45.625710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:52.931325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626081+0000","last_change":"2024-09-16T00:58:36.517412+0000","last_active":"2024-09-16T01:00:45.626081+0000","last_peered":"2024-09-16T01:00:45.626081+0000","last_clean":"2024-09-16T01:00:45.626081+0000","last_became_active":"2024-09-16T00:58:36.516600+0000","last_became_peered":"2024-09-16T00:58:36.516600+0000","last_unstale":"2024-09-16T01:00:45.626081+0000","last_undegraded":"2024-09-16T01:00:45.626081+0000","last_fullsized":"2024-09-16T01:00:45.626081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:39.445454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714191+0000","last_change":"2024-09-16T00:58:34.831420+0000","last_active":"2024-09-16T01:00:45.714191+0000","last_peered":"2024-09-16T01:00:45.714191+0000","last_clean":"2024-09-16T01:00:45.714191+0000","last_became_active":"2024-09-16T00:58:34.830991+0000","last_became_peered":"2024-09-16T00:58:34.830991+0000","last_unstale":"2024-09-16T01:00:45.714191+0000","last_undegraded":"2024-09-16T01:00:45.714191+0000","last_fullsized":"2024-09-16T01:00:45.714191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:13.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717963+0000","last_change":"2024-09-16T00:58:43.611781+0000","last_active":"2024-09-16T01:00:45.717963+0000","last_peered":"2024-09-16T01:00:45.717963+0000","last_clean":"2024-09-16T01:00:45.717963+0000","last_became_active":"2024-09-16T00:58:43.610332+0000","last_became_peered":"2024-09-16T00:58:43.610332+0000","last_unstale":"2024-09-16T01:00:45.717963+0000","last_undegraded":"2024-09-16T01:00:45.717963+0000","last_fullsized":"2024-09-16T01:00:45.717963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:18.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919291+0000","last_change":"2024-09-16T00:58:36.514395+0000","last_active":"2024-09-16T01:00:45.919291+0000","last_peered":"2024-09-16T01:00:45.919291+0000","last_clean":"2024-09-16T01:00:45.919291+0000","last_became_active":"2024-09-16T00:58:36.513570+0000","last_became_peered":"2024-09-16T00:58:36.513570+0000","last_unstale":"2024-09-16T01:00:45.919291+0000","last_undegraded":"2024-09-16T01:00:45.919291+0000","last_fullsized":"2024-09-16T01:00:45.919291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:56.148815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:01.743150+0000","last_change":"2024-09-16T00:58:34.473583+0000","last_active":"2024-09-16T01:01:01.743150+0000","last_peered":"2024-09-16T01:01:01.743150+0000","last_clean":"2024-09-16T01:01:01.743150+0000","last_became_active":"2024-09-16T00:58:34.473259+0000","last_became_peered":"2024-09-16T00:58:34.473259+0000","last_unstale":"2024-09-16T01:01:01.743150+0000","last_undegraded":"2024-09-16T01:01:01.743150+0000","last_fullsized":"2024-09-16T01:01:01.743150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:55.622609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:59:44.835446+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:41.254621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919524+0000","last_change":"2024-09-16T00:59:44.863645+0000","last_active":"2024-09-16T01:00:45.919524+0000","last_peered":"2024-09-16T01:00:45.919524+0000","last_clean":"2024-09-16T01:00:45.919524+0000","last_became_active":"2024-09-16T00:59:44.863207+0000","last_became_peered":"2024-09-16T00:59:44.863207+0000","last_unstale":"2024-09-16T01:00:45.919524+0000","last_undegraded":"2024-09-16T01:00:45.919524+0000","last_fullsized":"2024-09-16T01:00:45.919524+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:27.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626418+0000","last_change":"2024-09-16T00:58:34.470326+0000","last_active":"2024-09-16T01:00:45.626418+0000","last_peered":"2024-09-16T01:00:45.626418+0000","last_clean":"2024-09-16T01:00:45.626418+0000","last_became_active":"2024-09-16T00:58:34.469920+0000","last_became_peered":"2024-09-16T00:58:34.469920+0000","last_unstale":"2024-09-16T01:00:45.626418+0000","last_undegraded":"2024-09-16T01:00:45.626418+0000","last_fullsized":"2024-09-16T01:00:45.626418+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:58.718004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897319+0000","last_change":"2024-09-16T00:58:43.616324+0000","last_active":"2024-09-16T01:00:45.897319+0000","last_peered":"2024-09-16T01:00:45.897319+0000","last_clean":"2024-09-16T01:00:45.897319+0000","last_became_active":"2024-09-16T00:58:43.615903+0000","last_became_peered":"2024-09-16T00:58:43.615903+0000","last_unstale":"2024-09-16T01:00:45.897319+0000","last_undegraded":"2024-09-16T01:00:45.897319+0000","last_fullsized":"2024-09-16T01:00:45.897319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.683788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717440+0000","last_change":"2024-09-16T00:58:36.512490+0000","last_active":"2024-09-16T01:00:45.717440+0000","last_peered":"2024-09-16T01:00:45.717440+0000","last_clean":"2024-09-16T01:00:45.717440+0000","last_became_active":"2024-09-16T00:58:36.512167+0000","last_became_peered":"2024-09-16T00:58:36.512167+0000","last_unstale":"2024-09-16T01:00:45.717440+0000","last_undegraded":"2024-09-16T01:00:45.717440+0000","last_fullsized":"2024-09-16T01:00:45.717440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627945+0000","last_change":"2024-09-16T00:58:34.471603+0000","last_active":"2024-09-16T01:00:45.627945+0000","last_peered":"2024-09-16T01:00:45.627945+0000","last_clean":"2024-09-16T01:00:45.627945+0000","last_became_active":"2024-09-16T00:58:34.471241+0000","last_became_peered":"2024-09-16T00:58:34.471241+0000","last_unstale":"2024-09-16T01:00:45.627945+0000","last_undegraded":"2024-09-16T01:00:45.627945+0000","last_fullsized":"2024-09-16T01:00:45.627945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:33.756759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625999+0000","last_change":"2024-09-16T00:58:43.607428+0000","last_active":"2024-09-16T01:00:45.625999+0000","last_peered":"2024-09-16T01:00:45.625999+0000","last_clean":"2024-09-16T01:00:45.625999+0000","last_became_active":"2024-09-16T00:58:43.606990+0000","last_became_peered":"2024-09-16T00:58:43.606990+0000","last_unstale":"2024-09-16T01:00:45.625999+0000","last_undegraded":"2024-09-16T01:00:45.625999+0000","last_fullsized":"2024-09-16T01:00:45.625999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:52.367384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714506+0000","last_change":"2024-09-16T00:58:36.513967+0000","last_active":"2024-09-16T01:00:45.714506+0000","last_peered":"2024-09-16T01:00:45.714506+0000","last_clean":"2024-09-16T01:00:45.714506+0000","last_became_active":"2024-09-16T00:58:36.513610+0000","last_became_peered":"2024-09-16T00:58:36.513610+0000","last_unstale":"2024-09-16T01:00:45.714506+0000","last_undegraded":"2024-09-16T01:00:45.714506+0000","last_fullsized":"2024-09-16T01:00:45.714506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:22.763430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'40","reported_seq":295,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:03.742753+0000","last_change":"2024-09-16T00:58:34.471511+0000","last_active":"2024-09-16T01:01:03.742753+0000","last_peered":"2024-09-16T01:01:03.742753+0000","last_clean":"2024-09-16T01:01:03.742753+0000","last_became_active":"2024-09-16T00:58:34.470597+0000","last_became_peered":"2024-09-16T00:58:34.470597+0000","last_unstale":"2024-09-16T01:01:03.742753+0000","last_undegraded":"2024-09-16T01:01:03.742753+0000","last_fullsized":"2024-09-16T01:01:03.742753+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.782592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64041,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":171,"num_write":42,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623834+0000","last_change":"2024-09-16T00:58:43.612177+0000","last_active":"2024-09-16T01:00:45.623834+0000","last_peered":"2024-09-16T01:00:45.623834+0000","last_clean":"2024-09-16T01:00:45.623834+0000","last_became_active":"2024-09-16T00:58:43.611801+0000","last_became_peered":"2024-09-16T00:58:43.611801+0000","last_unstale":"2024-09-16T01:00:45.623834+0000","last_undegraded":"2024-09-16T01:00:45.623834+0000","last_fullsized":"2024-09-16T01:00:45.623834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.781429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624875+0000","last_change":"2024-09-16T00:58:36.502231+0000","last_active":"2024-09-16T01:00:45.624875+0000","last_peered":"2024-09-16T01:00:45.624875+0000","last_clean":"2024-09-16T01:00:45.624875+0000","last_became_active":"2024-09-16T00:58:36.501934+0000","last_became_peered":"2024-09-16T00:58:36.501934+0000","last_unstale":"2024-09-16T01:00:45.624875+0000","last_undegraded":"2024-09-16T01:00:45.624875+0000","last_fullsized":"2024-09-16T01:00:45.624875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:29.769186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626236+0000","last_change":"2024-09-16T00:58:34.829872+0000","last_active":"2024-09-16T01:00:45.626236+0000","last_peered":"2024-09-16T01:00:45.626236+0000","last_clean":"2024-09-16T01:00:45.626236+0000","last_became_active":"2024-09-16T00:58:34.829496+0000","last_became_peered":"2024-09-16T00:58:34.829496+0000","last_unstale":"2024-09-16T01:00:45.626236+0000","last_undegraded":"2024-09-16T01:00:45.626236+0000","last_fullsized":"2024-09-16T01:00:45.626236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:47.035177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720036+0000","last_change":"2024-09-16T00:58:43.615560+0000","last_active":"2024-09-16T01:00:45.720036+0000","last_peered":"2024-09-16T01:00:45.720036+0000","last_clean":"2024-09-16T01:00:45.720036+0000","last_became_active":"2024-09-16T00:58:43.615124+0000","last_became_peered":"2024-09-16T00:58:43.615124+0000","last_unstale":"2024-09-16T01:00:45.720036+0000","last_undegraded":"2024-09-16T01:00:45.720036+0000","last_fullsized":"2024-09-16T01:00:45.720036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.455528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627428+0000","last_change":"2024-09-16T00:58:36.514456+0000","last_active":"2024-09-16T01:00:45.627428+0000","last_peered":"2024-09-16T01:00:45.627428+0000","last_clean":"2024-09-16T01:00:45.627428+0000","last_became_active":"2024-09-16T00:58:36.514146+0000","last_became_peered":"2024-09-16T00:58:36.514146+0000","last_unstale":"2024-09-16T01:00:45.627428+0000","last_undegraded":"2024-09-16T01:00:45.627428+0000","last_fullsized":"2024-09-16T01:00:45.627428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:06.760121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919878+0000","last_change":"2024-09-16T00:58:34.471316+0000","last_active":"2024-09-16T01:00:45.919878+0000","last_peered":"2024-09-16T01:00:45.919878+0000","last_clean":"2024-09-16T01:00:45.919878+0000","last_became_active":"2024-09-16T00:58:34.470991+0000","last_became_peered":"2024-09-16T00:58:34.470991+0000","last_unstale":"2024-09-16T01:00:45.919878+0000","last_undegraded":"2024-09-16T01:00:45.919878+0000","last_fullsized":"2024-09-16T01:00:45.919878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:44.492439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623687+0000","last_change":"2024-09-16T00:58:43.617202+0000","last_active":"2024-09-16T01:00:45.623687+0000","last_peered":"2024-09-16T01:00:45.623687+0000","last_clean":"2024-09-16T01:00:45.623687+0000","last_became_active":"2024-09-16T00:58:43.616824+0000","last_became_peered":"2024-09-16T00:58:43.616824+0000","last_unstale":"2024-09-16T01:00:45.623687+0000","last_undegraded":"2024-09-16T01:00:45.623687+0000","last_fullsized":"2024-09-16T01:00:45.623687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:43.035003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625210+0000","last_change":"2024-09-16T00:58:36.512079+0000","last_active":"2024-09-16T01:00:45.625210+0000","last_peered":"2024-09-16T01:00:45.625210+0000","last_clean":"2024-09-16T01:00:45.625210+0000","last_became_active":"2024-09-16T00:58:36.511220+0000","last_became_peered":"2024-09-16T00:58:36.511220+0000","last_unstale":"2024-09-16T01:00:45.625210+0000","last_undegraded":"2024-09-16T01:00:45.625210+0000","last_fullsized":"2024-09-16T01:00:45.625210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:49.798132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'6","reported_seq":251,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:03.742205+0000","last_change":"2024-09-16T00:58:34.470682+0000","last_active":"2024-09-16T01:01:03.742205+0000","last_peered":"2024-09-16T01:01:03.742205+0000","last_clean":"2024-09-16T01:01:03.742205+0000","last_became_active":"2024-09-16T00:58:34.470323+0000","last_became_peered":"2024-09-16T00:58:34.470323+0000","last_unstale":"2024-09-16T01:01:03.742205+0000","last_undegraded":"2024-09-16T01:01:03.742205+0000","last_fullsized":"2024-09-16T01:01:03.742205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.361374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967738+0000","last_change":"2024-09-16T00:58:43.608941+0000","last_active":"2024-09-16T01:00:46.967738+0000","last_peered":"2024-09-16T01:00:46.967738+0000","last_clean":"2024-09-16T01:00:46.967738+0000","last_became_active":"2024-09-16T00:58:43.607406+0000","last_became_peered":"2024-09-16T00:58:43.607406+0000","last_unstale":"2024-09-16T01:00:46.967738+0000","last_undegraded":"2024-09-16T01:00:46.967738+0000","last_fullsized":"2024-09-16T01:00:46.967738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:10.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627074+0000","last_change":"2024-09-16T00:58:43.613902+0000","last_active":"2024-09-16T01:00:45.627074+0000","last_peered":"2024-09-16T01:00:45.627074+0000","last_clean":"2024-09-16T01:00:45.627074+0000","last_became_active":"2024-09-16T00:58:43.613530+0000","last_became_peered":"2024-09-16T00:58:43.613530+0000","last_unstale":"2024-09-16T01:00:45.627074+0000","last_undegraded":"2024-09-16T01:00:45.627074+0000","last_fullsized":"2024-09-16T01:00:45.627074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:34.774810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623790+0000","last_change":"2024-09-16T00:58:36.504745+0000","last_active":"2024-09-16T01:00:45.623790+0000","last_peered":"2024-09-16T01:00:45.623790+0000","last_clean":"2024-09-16T01:00:45.623790+0000","last_became_active":"2024-09-16T00:58:36.504400+0000","last_became_peered":"2024-09-16T00:58:36.504400+0000","last_unstale":"2024-09-16T01:00:45.623790+0000","last_undegraded":"2024-09-16T01:00:45.623790+0000","last_fullsized":"2024-09-16T01:00:45.623790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:34.444019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626135+0000","last_change":"2024-09-16T00:58:34.470285+0000","last_active":"2024-09-16T01:00:45.626135+0000","last_peered":"2024-09-16T01:00:45.626135+0000","last_clean":"2024-09-16T01:00:45.626135+0000","last_became_active":"2024-09-16T00:58:34.469948+0000","last_became_peered":"2024-09-16T00:58:34.469948+0000","last_unstale":"2024-09-16T01:00:45.626135+0000","last_undegraded":"2024-09-16T01:00:45.626135+0000","last_fullsized":"2024-09-16T01:00:45.626135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:28.553863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897172+0000","last_change":"2024-09-16T00:58:43.614818+0000","last_active":"2024-09-16T01:00:45.897172+0000","last_peered":"2024-09-16T01:00:45.897172+0000","last_clean":"2024-09-16T01:00:45.897172+0000","last_became_active":"2024-09-16T00:58:43.614376+0000","last_became_peered":"2024-09-16T00:58:43.614376+0000","last_unstale":"2024-09-16T01:00:45.897172+0000","last_undegraded":"2024-09-16T01:00:45.897172+0000","last_fullsized":"2024-09-16T01:00:45.897172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:41.699930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967770+0000","last_change":"2024-09-16T00:58:36.505127+0000","last_active":"2024-09-16T01:00:46.967770+0000","last_peered":"2024-09-16T01:00:46.967770+0000","last_clean":"2024-09-16T01:00:46.967770+0000","last_became_active":"2024-09-16T00:58:36.504552+0000","last_became_peered":"2024-09-16T00:58:36.504552+0000","last_unstale":"2024-09-16T01:00:46.967770+0000","last_undegraded":"2024-09-16T01:00:46.967770+0000","last_fullsized":"2024-09-16T01:00:46.967770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:48.104109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717213+0000","last_change":"2024-09-16T00:58:34.462231+0000","last_active":"2024-09-16T01:00:45.717213+0000","last_peered":"2024-09-16T01:00:45.717213+0000","last_clean":"2024-09-16T01:00:45.717213+0000","last_became_active":"2024-09-16T00:58:34.461891+0000","last_became_peered":"2024-09-16T00:58:34.461891+0000","last_unstale":"2024-09-16T01:00:45.717213+0000","last_undegraded":"2024-09-16T01:00:45.717213+0000","last_fullsized":"2024-09-16T01:00:45.717213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.483996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711498+0000","last_change":"2024-09-16T00:58:34.472457+0000","last_active":"2024-09-16T01:00:45.711498+0000","last_peered":"2024-09-16T01:00:45.711498+0000","last_clean":"2024-09-16T01:00:45.711498+0000","last_became_active":"2024-09-16T00:58:34.472084+0000","last_became_peered":"2024-09-16T00:58:34.472084+0000","last_unstale":"2024-09-16T01:00:45.711498+0000","last_undegraded":"2024-09-16T01:00:45.711498+0000","last_fullsized":"2024-09-16T01:00:45.711498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:08.005195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626019+0000","last_change":"2024-09-16T00:58:36.508791+0000","last_active":"2024-09-16T01:00:45.626019+0000","last_peered":"2024-09-16T01:00:45.626019+0000","last_clean":"2024-09-16T01:00:45.626019+0000","last_became_active":"2024-09-16T00:58:36.508461+0000","last_became_peered":"2024-09-16T00:58:36.508461+0000","last_unstale":"2024-09-16T01:00:45.626019+0000","last_undegraded":"2024-09-16T01:00:45.626019+0000","last_fullsized":"2024-09-16T01:00:45.626019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.938067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627838+0000","last_change":"2024-09-16T00:58:43.620439+0000","last_active":"2024-09-16T01:00:45.627838+0000","last_peered":"2024-09-16T01:00:45.627838+0000","last_clean":"2024-09-16T01:00:45.627838+0000","last_became_active":"2024-09-16T00:58:43.619952+0000","last_became_peered":"2024-09-16T00:58:43.619952+0000","last_unstale":"2024-09-16T01:00:45.627838+0000","last_undegraded":"2024-09-16T01:00:45.627838+0000","last_fullsized":"2024-09-16T01:00:45.627838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:00.737693+0000","last_change":"2024-09-16T00:58:34.473169+0000","last_active":"2024-09-16T01:01:00.737693+0000","last_peered":"2024-09-16T01:01:00.737693+0000","last_clean":"2024-09-16T01:01:00.737693+0000","last_became_active":"2024-09-16T00:58:34.472839+0000","last_became_peered":"2024-09-16T00:58:34.472839+0000","last_unstale":"2024-09-16T01:01:00.737693+0000","last_undegraded":"2024-09-16T01:01:00.737693+0000","last_fullsized":"2024-09-16T01:01:00.737693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:03.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714120+0000","last_change":"2024-09-16T00:58:36.508719+0000","last_active":"2024-09-16T01:00:45.714120+0000","last_peered":"2024-09-16T01:00:45.714120+0000","last_clean":"2024-09-16T01:00:45.714120+0000","last_became_active":"2024-09-16T00:58:36.508427+0000","last_became_peered":"2024-09-16T00:58:36.508427+0000","last_unstale":"2024-09-16T01:00:45.714120+0000","last_undegraded":"2024-09-16T01:00:45.714120+0000","last_fullsized":"2024-09-16T01:00:45.714120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:44.134558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627784+0000","last_change":"2024-09-16T00:58:43.616532+0000","last_active":"2024-09-16T01:00:45.627784+0000","last_peered":"2024-09-16T01:00:45.627784+0000","last_clean":"2024-09-16T01:00:45.627784+0000","last_became_active":"2024-09-16T00:58:43.616146+0000","last_became_peered":"2024-09-16T00:58:43.616146+0000","last_unstale":"2024-09-16T01:00:45.627784+0000","last_undegraded":"2024-09-16T01:00:45.627784+0000","last_fullsized":"2024-09-16T01:00:45.627784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:50.904766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897283+0000","last_change":"2024-09-16T00:58:36.513232+0000","last_active":"2024-09-16T01:00:45.897283+0000","last_peered":"2024-09-16T01:00:45.897283+0000","last_clean":"2024-09-16T01:00:45.897283+0000","last_became_active":"2024-09-16T00:58:36.512239+0000","last_became_peered":"2024-09-16T00:58:36.512239+0000","last_unstale":"2024-09-16T01:00:45.897283+0000","last_undegraded":"2024-09-16T01:00:45.897283+0000","last_fullsized":"2024-09-16T01:00:45.897283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627619+0000","last_change":"2024-09-16T00:58:36.513160+0000","last_active":"2024-09-16T01:00:45.627619+0000","last_peered":"2024-09-16T01:00:45.627619+0000","last_clean":"2024-09-16T01:00:45.627619+0000","last_became_active":"2024-09-16T00:58:36.512523+0000","last_became_peered":"2024-09-16T00:58:36.512523+0000","last_unstale":"2024-09-16T01:00:45.627619+0000","last_undegraded":"2024-09-16T01:00:45.627619+0000","last_fullsized":"2024-09-16T01:00:45.627619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:20.934937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627648+0000","last_change":"2024-09-16T00:58:36.516416+0000","last_active":"2024-09-16T01:00:45.627648+0000","last_peered":"2024-09-16T01:00:45.627648+0000","last_clean":"2024-09-16T01:00:45.627648+0000","last_became_active":"2024-09-16T00:58:36.516121+0000","last_became_peered":"2024-09-16T00:58:36.516121+0000","last_unstale":"2024-09-16T01:00:45.627648+0000","last_undegraded":"2024-09-16T01:00:45.627648+0000","last_fullsized":"2024-09-16T01:00:45.627648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:28.848616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627011+0000","last_change":"2024-09-16T00:58:36.510854+0000","last_active":"2024-09-16T01:00:45.627011+0000","last_peered":"2024-09-16T01:00:45.627011+0000","last_clean":"2024-09-16T01:00:45.627011+0000","last_became_active":"2024-09-16T00:58:36.510505+0000","last_became_peered":"2024-09-16T00:58:36.510505+0000","last_unstale":"2024-09-16T01:00:45.627011+0000","last_undegraded":"2024-09-16T01:00:45.627011+0000","last_fullsized":"2024-09-16T01:00:45.627011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.699942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.509016+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.508690+0000","last_became_peered":"2024-09-16T00:58:36.508690+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:41.425016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897266+0000","last_change":"2024-09-16T00:58:36.511659+0000","last_active":"2024-09-16T01:00:45.897266+0000","last_peered":"2024-09-16T01:00:45.897266+0000","last_clean":"2024-09-16T01:00:45.897266+0000","last_became_active":"2024-09-16T00:58:36.511225+0000","last_became_peered":"2024-09-16T00:58:36.511225+0000","last_unstale":"2024-09-16T01:00:45.897266+0000","last_undegraded":"2024-09-16T01:00:45.897266+0000","last_fullsized":"2024-09-16T01:00:45.897266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:43.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628196+0000","last_change":"2024-09-16T00:58:36.511614+0000","last_active":"2024-09-16T01:00:45.628196+0000","last_peered":"2024-09-16T01:00:45.628196+0000","last_clean":"2024-09-16T01:00:45.628196+0000","last_became_active":"2024-09-16T00:58:36.511304+0000","last_became_peered":"2024-09-16T00:58:36.511304+0000","last_unstale":"2024-09-16T01:00:45.628196+0000","last_undegraded":"2024-09-16T01:00:45.628196+0000","last_fullsized":"2024-09-16T01:00:45.628196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:20.755419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968311+0000","last_change":"2024-09-16T00:58:36.509399+0000","last_active":"2024-09-16T01:00:46.968311+0000","last_peered":"2024-09-16T01:00:46.968311+0000","last_clean":"2024-09-16T01:00:46.968311+0000","last_became_active":"2024-09-16T00:58:36.509072+0000","last_became_peered":"2024-09-16T00:58:36.509072+0000","last_unstale":"2024-09-16T01:00:46.968311+0000","last_undegraded":"2024-09-16T01:00:46.968311+0000","last_fullsized":"2024-09-16T01:00:46.968311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:29.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625679+0000","last_change":"2024-09-16T00:58:36.506252+0000","last_active":"2024-09-16T01:00:45.625679+0000","last_peered":"2024-09-16T01:00:45.625679+0000","last_clean":"2024-09-16T01:00:45.625679+0000","last_became_active":"2024-09-16T00:58:36.505923+0000","last_became_peered":"2024-09-16T00:58:36.505923+0000","last_unstale":"2024-09-16T01:00:45.625679+0000","last_undegraded":"2024-09-16T01:00:45.625679+0000","last_fullsized":"2024-09-16T01:00:45.625679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:05.332472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967824+0000","last_change":"2024-09-16T00:58:36.506598+0000","last_active":"2024-09-16T01:00:46.967824+0000","last_peered":"2024-09-16T01:00:46.967824+0000","last_clean":"2024-09-16T01:00:46.967824+0000","last_became_active":"2024-09-16T00:58:36.506299+0000","last_became_peered":"2024-09-16T00:58:36.506299+0000","last_unstale":"2024-09-16T01:00:46.967824+0000","last_undegraded":"2024-09-16T01:00:46.967824+0000","last_fullsized":"2024-09-16T01:00:46.967824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.327225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624647+0000","last_change":"2024-09-16T00:58:36.517050+0000","last_active":"2024-09-16T01:00:45.624647+0000","last_peered":"2024-09-16T01:00:45.624647+0000","last_clean":"2024-09-16T01:00:45.624647+0000","last_became_active":"2024-09-16T00:58:36.516745+0000","last_became_peered":"2024-09-16T00:58:36.516745+0000","last_unstale":"2024-09-16T01:00:45.624647+0000","last_undegraded":"2024-09-16T01:00:45.624647+0000","last_fullsized":"2024-09-16T01:00:45.624647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:59.981792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717660+0000","last_change":"2024-09-16T00:58:36.512442+0000","last_active":"2024-09-16T01:00:45.717660+0000","last_peered":"2024-09-16T01:00:45.717660+0000","last_clean":"2024-09-16T01:00:45.717660+0000","last_became_active":"2024-09-16T00:58:36.512132+0000","last_became_peered":"2024-09-16T00:58:36.512132+0000","last_unstale":"2024-09-16T01:00:45.717660+0000","last_undegraded":"2024-09-16T01:00:45.717660+0000","last_fullsized":"2024-09-16T01:00:45.717660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:06.511257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897210+0000","last_change":"2024-09-16T00:58:36.519754+0000","last_active":"2024-09-16T01:00:45.897210+0000","last_peered":"2024-09-16T01:00:45.897210+0000","last_clean":"2024-09-16T01:00:45.897210+0000","last_became_active":"2024-09-16T00:58:36.519378+0000","last_became_peered":"2024-09-16T00:58:36.519378+0000","last_unstale":"2024-09-16T01:00:45.897210+0000","last_undegraded":"2024-09-16T01:00:45.897210+0000","last_fullsized":"2024-09-16T01:00:45.897210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:51.076588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628046+0000","last_change":"2024-09-16T00:58:36.504627+0000","last_active":"2024-09-16T01:00:45.628046+0000","last_peered":"2024-09-16T01:00:45.628046+0000","last_clean":"2024-09-16T01:00:45.628046+0000","last_became_active":"2024-09-16T00:58:36.504282+0000","last_became_peered":"2024-09-16T00:58:36.504282+0000","last_unstale":"2024-09-16T01:00:45.628046+0000","last_undegraded":"2024-09-16T01:00:45.628046+0000","last_fullsized":"2024-09-16T01:00:45.628046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.857181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624140+0000","last_change":"2024-09-16T00:58:36.508971+0000","last_active":"2024-09-16T01:00:45.624140+0000","last_peered":"2024-09-16T01:00:45.624140+0000","last_clean":"2024-09-16T01:00:45.624140+0000","last_became_active":"2024-09-16T00:58:36.508631+0000","last_became_peered":"2024-09-16T00:58:36.508631+0000","last_unstale":"2024-09-16T01:00:45.624140+0000","last_undegraded":"2024-09-16T01:00:45.624140+0000","last_fullsized":"2024-09-16T01:00:45.624140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:17.092613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897604+0000","last_change":"2024-09-16T00:58:36.517255+0000","last_active":"2024-09-16T01:00:45.897604+0000","last_peered":"2024-09-16T01:00:45.897604+0000","last_clean":"2024-09-16T01:00:45.897604+0000","last_became_active":"2024-09-16T00:58:36.516957+0000","last_became_peered":"2024-09-16T00:58:36.516957+0000","last_unstale":"2024-09-16T01:00:45.897604+0000","last_undegraded":"2024-09-16T01:00:45.897604+0000","last_fullsized":"2024-09-16T01:00:45.897604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:34.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624283+0000","last_change":"2024-09-16T00:58:36.516429+0000","last_active":"2024-09-16T01:00:45.624283+0000","last_peered":"2024-09-16T01:00:45.624283+0000","last_clean":"2024-09-16T01:00:45.624283+0000","last_became_active":"2024-09-16T00:58:36.516111+0000","last_became_peered":"2024-09-16T00:58:36.516111+0000","last_unstale":"2024-09-16T01:00:45.624283+0000","last_undegraded":"2024-09-16T01:00:45.624283+0000","last_fullsized":"2024-09-16T01:00:45.624283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:06.120653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626784+0000","last_change":"2024-09-16T00:58:36.512873+0000","last_active":"2024-09-16T01:00:45.626784+0000","last_peered":"2024-09-16T01:00:45.626784+0000","last_clean":"2024-09-16T01:00:45.626784+0000","last_became_active":"2024-09-16T00:58:36.511761+0000","last_became_peered":"2024-09-16T00:58:36.511761+0000","last_unstale":"2024-09-16T01:00:45.626784+0000","last_undegraded":"2024-09-16T01:00:45.626784+0000","last_fullsized":"2024-09-16T01:00:45.626784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:51.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626810+0000","last_change":"2024-09-16T00:58:36.511585+0000","last_active":"2024-09-16T01:00:45.626810+0000","last_peered":"2024-09-16T01:00:45.626810+0000","last_clean":"2024-09-16T01:00:45.626810+0000","last_became_active":"2024-09-16T00:58:36.510479+0000","last_became_peered":"2024-09-16T00:58:36.510479+0000","last_unstale":"2024-09-16T01:00:45.626810+0000","last_undegraded":"2024-09-16T01:00:45.626810+0000","last_fullsized":"2024-09-16T01:00:45.626810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:58.017132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717650+0000","last_change":"2024-09-16T00:58:36.508263+0000","last_active":"2024-09-16T01:00:45.717650+0000","last_peered":"2024-09-16T01:00:45.717650+0000","last_clean":"2024-09-16T01:00:45.717650+0000","last_became_active":"2024-09-16T00:58:36.507979+0000","last_became_peered":"2024-09-16T00:58:36.507979+0000","last_unstale":"2024-09-16T01:00:45.717650+0000","last_undegraded":"2024-09-16T01:00:45.717650+0000","last_fullsized":"2024-09-16T01:00:45.717650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:07.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720241+0000","last_change":"2024-09-16T00:58:36.514981+0000","last_active":"2024-09-16T01:00:45.720241+0000","last_peered":"2024-09-16T01:00:45.720241+0000","last_clean":"2024-09-16T01:00:45.720241+0000","last_became_active":"2024-09-16T00:58:36.510433+0000","last_became_peered":"2024-09-16T00:58:36.510433+0000","last_unstale":"2024-09-16T01:00:45.720241+0000","last_undegraded":"2024-09-16T01:00:45.720241+0000","last_fullsized":"2024-09-16T01:00:45.720241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:10.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919996+0000","last_change":"2024-09-16T00:58:36.521336+0000","last_active":"2024-09-16T01:00:45.919996+0000","last_peered":"2024-09-16T01:00:45.919996+0000","last_clean":"2024-09-16T01:00:45.919996+0000","last_became_active":"2024-09-16T00:58:36.521026+0000","last_became_peered":"2024-09-16T00:58:36.521026+0000","last_unstale":"2024-09-16T01:00:45.919996+0000","last_undegraded":"2024-09-16T01:00:45.919996+0000","last_fullsized":"2024-09-16T01:00:45.919996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:29.409024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711912+0000","last_change":"2024-09-16T00:58:36.518724+0000","last_active":"2024-09-16T01:00:45.711912+0000","last_peered":"2024-09-16T01:00:45.711912+0000","last_clean":"2024-09-16T01:00:45.711912+0000","last_became_active":"2024-09-16T00:58:36.518428+0000","last_became_peered":"2024-09-16T00:58:36.518428+0000","last_unstale":"2024-09-16T01:00:45.711912+0000","last_undegraded":"2024-09-16T01:00:45.711912+0000","last_fullsized":"2024-09-16T01:00:45.711912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:06.486299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625258+0000","last_change":"2024-09-16T00:58:36.514347+0000","last_active":"2024-09-16T01:00:45.625258+0000","last_peered":"2024-09-16T01:00:45.625258+0000","last_clean":"2024-09-16T01:00:45.625258+0000","last_became_active":"2024-09-16T00:58:36.512243+0000","last_became_peered":"2024-09-16T00:58:36.512243+0000","last_unstale":"2024-09-16T01:00:45.625258+0000","last_undegraded":"2024-09-16T01:00:45.625258+0000","last_fullsized":"2024-09-16T01:00:45.625258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.289541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623615+0000","last_change":"2024-09-16T00:59:44.837828+0000","last_active":"2024-09-16T01:00:45.623615+0000","last_peered":"2024-09-16T01:00:45.623615+0000","last_clean":"2024-09-16T01:00:45.623615+0000","last_became_active":"2024-09-16T00:59:44.837486+0000","last_became_peered":"2024-09-16T00:59:44.837486+0000","last_unstale":"2024-09-16T01:00:45.623615+0000","last_undegraded":"2024-09-16T01:00:45.623615+0000","last_fullsized":"2024-09-16T01:00:45.623615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:46.914056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919570+0000","last_change":"2024-09-16T00:58:36.516797+0000","last_active":"2024-09-16T01:00:45.919570+0000","last_peered":"2024-09-16T01:00:45.919570+0000","last_clean":"2024-09-16T01:00:45.919570+0000","last_became_active":"2024-09-16T00:58:36.516480+0000","last_became_peered":"2024-09-16T00:58:36.516480+0000","last_unstale":"2024-09-16T01:00:45.919570+0000","last_undegraded":"2024-09-16T01:00:45.919570+0000","last_fullsized":"2024-09-16T01:00:45.919570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:55.262528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711362+0000","last_change":"2024-09-16T00:58:36.517973+0000","last_active":"2024-09-16T01:00:45.711362+0000","last_peered":"2024-09-16T01:00:45.711362+0000","last_clean":"2024-09-16T01:00:45.711362+0000","last_became_active":"2024-09-16T00:58:36.517634+0000","last_became_peered":"2024-09-16T00:58:36.517634+0000","last_unstale":"2024-09-16T01:00:45.711362+0000","last_undegraded":"2024-09-16T01:00:45.711362+0000","last_fullsized":"2024-09-16T01:00:45.711362+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:19.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714090+0000","last_change":"2024-09-16T00:58:36.507643+0000","last_active":"2024-09-16T01:00:45.714090+0000","last_peered":"2024-09-16T01:00:45.714090+0000","last_clean":"2024-09-16T01:00:45.714090+0000","last_became_active":"2024-09-16T00:58:36.507263+0000","last_became_peered":"2024-09-16T00:58:36.507263+0000","last_unstale":"2024-09-16T01:00:45.714090+0000","last_undegraded":"2024-09-16T01:00:45.714090+0000","last_fullsized":"2024-09-16T01:00:45.714090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:24.317490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720025+0000","last_change":"2024-09-16T00:58:36.508798+0000","last_active":"2024-09-16T01:00:45.720025+0000","last_peered":"2024-09-16T01:00:45.720025+0000","last_clean":"2024-09-16T01:00:45.720025+0000","last_became_active":"2024-09-16T00:58:36.508490+0000","last_became_peered":"2024-09-16T00:58:36.508490+0000","last_unstale":"2024-09-16T01:00:45.720025+0000","last_undegraded":"2024-09-16T01:00:45.720025+0000","last_fullsized":"2024-09-16T01:00:45.720025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:44.282270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627327+0000","last_change":"2024-09-16T00:58:36.519065+0000","last_active":"2024-09-16T01:00:45.627327+0000","last_peered":"2024-09-16T01:00:45.627327+0000","last_clean":"2024-09-16T01:00:45.627327+0000","last_became_active":"2024-09-16T00:58:36.518708+0000","last_became_peered":"2024-09-16T00:58:36.518708+0000","last_unstale":"2024-09-16T01:00:45.627327+0000","last_undegraded":"2024-09-16T01:00:45.627327+0000","last_fullsized":"2024-09-16T01:00:45.627327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:10.290341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627159+0000","last_change":"2024-09-16T00:58:36.513018+0000","last_active":"2024-09-16T01:00:45.627159+0000","last_peered":"2024-09-16T01:00:45.627159+0000","last_clean":"2024-09-16T01:00:45.627159+0000","last_became_active":"2024-09-16T00:58:36.511730+0000","last_became_peered":"2024-09-16T00:58:36.511730+0000","last_unstale":"2024-09-16T01:00:45.627159+0000","last_undegraded":"2024-09-16T01:00:45.627159+0000","last_fullsized":"2024-09-16T01:00:45.627159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:20.852121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897471+0000","last_change":"2024-09-16T00:58:36.518265+0000","last_active":"2024-09-16T01:00:45.897471+0000","last_peered":"2024-09-16T01:00:45.897471+0000","last_clean":"2024-09-16T01:00:45.897471+0000","last_became_active":"2024-09-16T00:58:36.517906+0000","last_became_peered":"2024-09-16T00:58:36.517906+0000","last_unstale":"2024-09-16T01:00:45.897471+0000","last_undegraded":"2024-09-16T01:00:45.897471+0000","last_fullsized":"2024-09-16T01:00:45.897471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.255849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71305,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1066,"num_read_kb":609,"num_write":261,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":217613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282150,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612652,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":513588,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32300,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712852,"statfs":{"total":95995035648,"available":95961960448,"internally_reserved":0,"allocated":1142784,"data_stored":1163603,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005110,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":516772,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234043,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1003520,"data_stored":512382,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462976,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":1109160,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626501,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":991232,"data_stored":508180,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855433,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":1104742,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018959,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":512926,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247893,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":507888,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444122,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":578627,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607646,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1060864,"data_stored":572943,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":510170,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:01:08.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:08.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:08 smithi098 ceph-mon[35346]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-16T01:01:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:08 smithi119 ceph-mon[35049]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-16T01:01:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:09.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 -- 172.21.15.12:0/2469979847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a68101de0 msgr2=0x7f3a681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 --2- 172.21.15.12:0/2469979847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a68101de0 0x7f3a681021c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009900 tx=0x7f3a6402a410 comp rx=0 tx=0).stop 2024-09-16T01:01:09.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 -- 172.21.15.12:0/2469979847 shutdown_connections 2024-09-16T01:01:09.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 --2- 172.21.15.12:0/2469979847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68106f10 0x7f3a6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 --2- 172.21.15.12:0/2469979847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68102790 0x7f3a681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 --2- 172.21.15.12:0/2469979847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a68101de0 0x7f3a681021c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 -- 172.21.15.12:0/2469979847 >> 172.21.15.12:0/2469979847 conn(0x7f3a680fd8c0 msgr2=0x7f3a680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:09.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 -- 172.21.15.12:0/2469979847 shutdown_connections 2024-09-16T01:01:09.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 -- 172.21.15.12:0/2469979847 wait complete. 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 Processor -- start 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.707+0000 7f3a705d0640 1 -- start start 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a705d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68101de0 0x7f3a680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a705d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68102790 0x7f3a68074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a705d0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a68106f10 0x7f3a68074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a705d0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68111fc0 con 0x7f3a68106f10 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a705d0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68111e40 con 0x7f3a68102790 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a705d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68112140 con 0x7f3a68101de0 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6eb6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a68106f10 0x7f3a68074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6eb6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a68106f10 0x7f3a68074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33116/0 (socket says 172.21.15.12:33116) 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6eb6d640 1 -- 172.21.15.12:0/3332079994 learned_addr learned my addr 172.21.15.12:0/3332079994 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6db6b640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68102790 0x7f3a68074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6e36c640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68101de0 0x7f3a680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6eb6d640 1 -- 172.21.15.12:0/3332079994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68101de0 msgr2=0x7f3a680744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6eb6d640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68101de0 0x7f3a680744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6eb6d640 1 -- 172.21.15.12:0/3332079994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68102790 msgr2=0x7f3a68074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6eb6d640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68102790 0x7f3a68074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6eb6d640 1 -- 172.21.15.12:0/3332079994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a681a68a0 con 0x7f3a68106f10 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6e36c640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68101de0 0x7f3a680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6db6b640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68102790 0x7f3a68074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a6eb6d640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a68106f10 0x7f3a68074f70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009fd0 tx=0x7f3a6000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a5f7fe640 1 -- 172.21.15.12:0/3332079994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60017070 con 0x7f3a68106f10 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a5f7fe640 1 -- 172.21.15.12:0/3332079994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a60003e50 con 0x7f3a68106f10 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a5f7fe640 1 -- 172.21.15.12:0/3332079994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a600106c0 con 0x7f3a68106f10 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.708+0000 7f3a705d0640 1 -- 172.21.15.12:0/3332079994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a681a6b90 con 0x7f3a68106f10 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.709+0000 7f3a705d0640 1 -- 172.21.15.12:0/3332079994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a681a70d0 con 0x7f3a68106f10 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.709+0000 7f3a705d0640 1 -- 172.21.15.12:0/3332079994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a681021c0 con 0x7f3a68106f10 2024-09-16T01:01:09.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.711+0000 7f3a5f7fe640 1 -- 172.21.15.12:0/3332079994 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3a60003970 con 0x7f3a68106f10 2024-09-16T01:01:09.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.711+0000 7f3a5f7fe640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a540a32c0 0x7f3a540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.712+0000 7f3a5f7fe640 1 -- 172.21.15.12:0/3332079994 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f3a600cf9b0 con 0x7f3a68106f10 2024-09-16T01:01:09.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.712+0000 7f3a6e36c640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a540a32c0 0x7f3a540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.712+0000 7f3a6e36c640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a540a32c0 0x7f3a540a5780 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3a64005ab0 tx=0x7f3a64000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:09.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.714+0000 7f3a5f7fe640 1 -- 172.21.15.12:0/3332079994 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a6009c3f0 con 0x7f3a68106f10 2024-09-16T01:01:09.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.928+0000 7f3a705d0640 1 -- 172.21.15.12:0/3332079994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a6810a0f0 con 0x7f3a68106f10 2024-09-16T01:01:09.929 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:09 smithi012 ceph-mon[31197]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:09.929 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:09 smithi012 ceph-mon[31197]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:09.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.928+0000 7f3a5f7fe640 1 -- 172.21.15.12:0/3332079994 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f3a6009bcf0 con 0x7f3a68106f10 2024-09-16T01:01:09.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:09.933 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:01:09.933 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:01:09.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 -- 172.21.15.12:0/3332079994 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a540a32c0 msgr2=0x7f3a540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a540a32c0 0x7f3a540a5780 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3a64005ab0 tx=0x7f3a64000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 -- 172.21.15.12:0/3332079994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a68106f10 msgr2=0x7f3a68074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a68106f10 0x7f3a68074f70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009fd0 tx=0x7f3a6000b260 comp rx=0 tx=0).stop 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 -- 172.21.15.12:0/3332079994 shutdown_connections 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3a540a32c0 0x7f3a540a5780 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a68106f10 0x7f3a68074f70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68102790 0x7f3a68074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 --2- 172.21.15.12:0/3332079994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a68101de0 0x7f3a680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 -- 172.21.15.12:0/3332079994 >> 172.21.15.12:0/3332079994 conn(0x7f3a680fd8c0 msgr2=0x7f3a680feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 -- 172.21.15.12:0/3332079994 shutdown_connections 2024-09-16T01:01:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:09.931+0000 7f3a705d0640 1 -- 172.21.15.12:0/3332079994 wait complete. 2024-09-16T01:01:09.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:09 smithi098 ceph-mon[35346]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:09.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:09 smithi098 ceph-mon[35346]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:10.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:09 smithi119 ceph-mon[35049]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:10.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:09 smithi119 ceph-mon[35049]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:10.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:01:10.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:10 smithi012 ceph-mon[31197]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:10.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:10 smithi012 ceph-mon[31197]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-16T01:01:10.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:10 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3332079994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:10.873 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:10.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:10 smithi098 ceph-mon[35346]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:10.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:10 smithi098 ceph-mon[35346]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-16T01:01:10.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:10 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3332079994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:11.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:10 smithi119 ceph-mon[35049]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:11.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:10 smithi119 ceph-mon[35049]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-16T01:01:11.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:10 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3332079994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.381+0000 7ff461f06640 1 -- 172.21.15.12:0/3140817332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff45c106f10 msgr2=0x7ff45c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.381+0000 7ff461f06640 1 --2- 172.21.15.12:0/3140817332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff45c106f10 0x7ff45c10ea90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff454009900 tx=0x7ff45402a410 comp rx=0 tx=0).stop 2024-09-16T01:01:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.381+0000 7ff461f06640 1 -- 172.21.15.12:0/3140817332 shutdown_connections 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.381+0000 7ff461f06640 1 --2- 172.21.15.12:0/3140817332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff45c106f10 0x7ff45c10ea90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.381+0000 7ff461f06640 1 --2- 172.21.15.12:0/3140817332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff45c102790 0x7ff45c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.381+0000 7ff461f06640 1 --2- 172.21.15.12:0/3140817332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff45c101de0 0x7ff45c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.381+0000 7ff461f06640 1 -- 172.21.15.12:0/3140817332 >> 172.21.15.12:0/3140817332 conn(0x7ff45c0fd8c0 msgr2=0x7ff45c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.382+0000 7ff461f06640 1 -- 172.21.15.12:0/3140817332 shutdown_connections 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.382+0000 7ff461f06640 1 -- 172.21.15.12:0/3140817332 wait complete. 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.382+0000 7ff461f06640 1 Processor -- start 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.382+0000 7ff461f06640 1 -- start start 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.382+0000 7ff461f06640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff45c101de0 0x7ff45c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.382+0000 7ff461f06640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff45c102790 0x7ff45c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff461f06640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff45c106f10 0x7ff45c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff461f06640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c111f70 con 0x7ff45c101de0 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff461f06640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c111df0 con 0x7ff45c106f10 2024-09-16T01:01:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff461f06640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c1120f0 con 0x7ff45c102790 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff45c101de0 0x7ff45c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff45c101de0 0x7ff45c198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33136/0 (socket says 172.21.15.12:33136) 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45b7fe640 1 -- 172.21.15.12:0/1123413408 learned_addr learned my addr 172.21.15.12:0/1123413408 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45bfff640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff45c106f10 0x7ff45c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45affd640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff45c102790 0x7ff45c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45b7fe640 1 -- 172.21.15.12:0/1123413408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff45c102790 msgr2=0x7ff45c198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45b7fe640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff45c102790 0x7ff45c198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45b7fe640 1 -- 172.21.15.12:0/1123413408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff45c106f10 msgr2=0x7ff45c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45b7fe640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff45c106f10 0x7ff45c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45b7fe640 1 -- 172.21.15.12:0/1123413408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c19d2f0 con 0x7ff45c101de0 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff45b7fe640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff45c101de0 0x7ff45c198340 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00db80 tx=0x7ff44c00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff458ff9640 1 -- 172.21.15.12:0/1123413408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c017070 con 0x7ff45c101de0 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff461f06640 1 -- 172.21.15.12:0/1123413408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c19d5e0 con 0x7ff45c101de0 2024-09-16T01:01:11.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff458ff9640 1 -- 172.21.15.12:0/1123413408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff44c003e50 con 0x7ff45c101de0 2024-09-16T01:01:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff458ff9640 1 -- 172.21.15.12:0/1123413408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c010480 con 0x7ff45c101de0 2024-09-16T01:01:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.383+0000 7ff461f06640 1 -- 172.21.15.12:0/1123413408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c1a4ec0 con 0x7ff45c101de0 2024-09-16T01:01:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.385+0000 7ff461f06640 1 -- 172.21.15.12:0/1123413408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45c1021c0 con 0x7ff45c101de0 2024-09-16T01:01:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.386+0000 7ff458ff9640 1 -- 172.21.15.12:0/1123413408 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff44c003970 con 0x7ff45c101de0 2024-09-16T01:01:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.386+0000 7ff458ff9640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff4440a3240 0x7ff4440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.387+0000 7ff45affd640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff4440a3240 0x7ff4440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.387+0000 7ff458ff9640 1 -- 172.21.15.12:0/1123413408 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7ff44c0cfbe0 con 0x7ff45c101de0 2024-09-16T01:01:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.387+0000 7ff45affd640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff4440a3240 0x7ff4440a5700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff45c108880 tx=0x7ff45000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.391+0000 7ff458ff9640 1 -- 172.21.15.12:0/1123413408 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff44c09c5a0 con 0x7ff45c101de0 2024-09-16T01:01:11.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.568+0000 7ff461f06640 1 -- 172.21.15.12:0/1123413408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff45c109bc0 con 0x7ff45c101de0 2024-09-16T01:01:11.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.570+0000 7ff458ff9640 1 -- 172.21.15.12:0/1123413408 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24678 (secure 0 0 0) 0x7ff44c09bea0 con 0x7ff45c101de0 2024-09-16T01:01:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:11.571 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T01:00:45.617096+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:01:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 -- 172.21.15.12:0/1123413408 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff4440a3240 msgr2=0x7ff4440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff4440a3240 0x7ff4440a5700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff45c108880 tx=0x7ff45000a2d0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 -- 172.21.15.12:0/1123413408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff45c101de0 msgr2=0x7ff45c198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff45c101de0 0x7ff45c198340 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00db80 tx=0x7ff44c00df80 comp rx=0 tx=0).stop 2024-09-16T01:01:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 -- 172.21.15.12:0/1123413408 shutdown_connections 2024-09-16T01:01:11.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff4440a3240 0x7ff4440a5700 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff45c106f10 0x7ff45c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff45c102790 0x7ff45c198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 --2- 172.21.15.12:0/1123413408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff45c101de0 0x7ff45c198340 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 -- 172.21.15.12:0/1123413408 >> 172.21.15.12:0/1123413408 conn(0x7ff45c0fd8c0 msgr2=0x7ff45c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:11.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 -- 172.21.15.12:0/1123413408 shutdown_connections 2024-09-16T01:01:11.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:11.572+0000 7ff461f06640 1 -- 172.21.15.12:0/1123413408 wait complete. 2024-09-16T01:01:11.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:11 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1123413408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:11.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:11 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1123413408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:12.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:11 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1123413408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:12.215 DEBUG:tasks.fwd_scrub:Yielding 2024-09-16T01:01:12.215 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-16T01:01:12.229 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T01:01:12.230 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:01:12.230 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-16T01:01:12.230 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-16T01:01:12.230 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-16T01:01:12.504 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:12.505 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:12.926 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:12 smithi012 ceph-mon[31197]: pgmap v363: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:01:12.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:12 smithi098 ceph-mon[35346]: pgmap v363: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:01:13.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:12 smithi119 ceph-mon[35049]: pgmap v363: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.256+0000 7f6197860640 1 -- 172.21.15.12:0/413540350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6190074620 msgr2=0x7f6190074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.256+0000 7f6197860640 1 --2- 172.21.15.12:0/413540350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6190074620 0x7f6190074a00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f618c009ca0 tx=0x7f618c02a950 comp rx=0 tx=0).stop 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.256+0000 7f6197860640 1 -- 172.21.15.12:0/413540350 shutdown_connections 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.256+0000 7f6197860640 1 --2- 172.21.15.12:0/413540350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f619010e3c0 0x7f6190110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.256+0000 7f6197860640 1 --2- 172.21.15.12:0/413540350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190074f40 0x7f619010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.256+0000 7f6197860640 1 --2- 172.21.15.12:0/413540350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6190074620 0x7f6190074a00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.256+0000 7f6197860640 1 -- 172.21.15.12:0/413540350 >> 172.21.15.12:0/413540350 conn(0x7f61900fd880 msgr2=0x7f61900ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.256+0000 7f6197860640 1 -- 172.21.15.12:0/413540350 shutdown_connections 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.256+0000 7f6197860640 1 -- 172.21.15.12:0/413540350 wait complete. 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6197860640 1 Processor -- start 2024-09-16T01:01:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6197860640 1 -- start start 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6197860640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6190074620 0x7f619019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6197860640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190074f40 0x7f619019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6197860640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f619010e3c0 0x7f619019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6197860640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6190114170 con 0x7f619010e3c0 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6197860640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6190113ff0 con 0x7f6190074f40 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6197860640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f61901142f0 con 0x7f6190074620 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6195dfd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f619010e3c0 0x7f619019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6195dfd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f619010e3c0 0x7f619019efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33142/0 (socket says 172.21.15.12:33142) 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6195dfd640 1 -- 172.21.15.12:0/1796269133 learned_addr learned my addr 172.21.15.12:0/1796269133 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.257+0000 7f6194dfb640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190074f40 0x7f619019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f61955fc640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6190074620 0x7f619019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f6195dfd640 1 -- 172.21.15.12:0/1796269133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6190074620 msgr2=0x7f619019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f6195dfd640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6190074620 0x7f619019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f6195dfd640 1 -- 172.21.15.12:0/1796269133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190074f40 msgr2=0x7f619019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f6195dfd640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190074f40 0x7f619019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f6195dfd640 1 -- 172.21.15.12:0/1796269133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619019f6c0 con 0x7f619010e3c0 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f6195dfd640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f619010e3c0 0x7f619019efe0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f618800c970 tx=0x7f618800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f61827fc640 1 -- 172.21.15.12:0/1796269133 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6188007bb0 con 0x7f619010e3c0 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f6197860640 1 -- 172.21.15.12:0/1796269133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619019f9b0 con 0x7f619010e3c0 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f61827fc640 1 -- 172.21.15.12:0/1796269133 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6188007d50 con 0x7f619010e3c0 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f61827fc640 1 -- 172.21.15.12:0/1796269133 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618800f450 con 0x7f619010e3c0 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.258+0000 7f6197860640 1 -- 172.21.15.12:0/1796269133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61901a7290 con 0x7f619010e3c0 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.259+0000 7f6197860640 1 -- 172.21.15.12:0/1796269133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6190074a00 con 0x7f619010e3c0 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.261+0000 7f61827fc640 1 -- 172.21.15.12:0/1796269133 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6188004f00 con 0x7f619010e3c0 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.262+0000 7f61827fc640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f617c0a3240 0x7f617c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.262+0000 7f61955fc640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f617c0a3240 0x7f617c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.262+0000 7f61827fc640 1 -- 172.21.15.12:0/1796269133 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f61880cfce0 con 0x7f619010e3c0 2024-09-16T01:01:13.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.262+0000 7f61955fc640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f617c0a3240 0x7f617c0a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f618c000f80 tx=0x7f618c02fea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.265+0000 7f61827fc640 1 -- 172.21.15.12:0/1796269133 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6188014030 con 0x7f619010e3c0 2024-09-16T01:01:13.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.440+0000 7f6197860640 1 -- 172.21.15.12:0/1796269133 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6190062630 con 0x7f617c0a3240 2024-09-16T01:01:13.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.448+0000 7f61827fc640 1 -- 172.21.15.12:0/1796269133 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340826 (secure 0 0 0) 0x7f6190062630 con 0x7f617c0a3240 2024-09-16T01:01:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-16T01:01:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.453+0000 7f6197860640 1 -- 172.21.15.12:0/1796269133 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f617c0a3240 msgr2=0x7f617c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.453+0000 7f6197860640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f617c0a3240 0x7f617c0a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f618c000f80 tx=0x7f618c02fea0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.453+0000 7f6197860640 1 -- 172.21.15.12:0/1796269133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f619010e3c0 msgr2=0x7f619019efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.453+0000 7f6197860640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f619010e3c0 0x7f619019efe0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f618800c970 tx=0x7f618800ce30 comp rx=0 tx=0).stop 2024-09-16T01:01:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.453+0000 7f6197860640 1 -- 172.21.15.12:0/1796269133 shutdown_connections 2024-09-16T01:01:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.453+0000 7f6197860640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f617c0a3240 0x7f617c0a5700 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.453+0000 7f6197860640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f619010e3c0 0x7f619019efe0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.453+0000 7f6197860640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6190074f40 0x7f619019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.453+0000 7f6197860640 1 --2- 172.21.15.12:0/1796269133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6190074620 0x7f619019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.453+0000 7f6197860640 1 -- 172.21.15.12:0/1796269133 >> 172.21.15.12:0/1796269133 conn(0x7f61900fd880 msgr2=0x7f61900fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.454+0000 7f6197860640 1 -- 172.21.15.12:0/1796269133 shutdown_connections 2024-09-16T01:01:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.454+0000 7f6197860640 1 -- 172.21.15.12:0/1796269133 wait complete. 2024-09-16T01:01:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.513+0000 7f85a0dd8640 1 -- 172.21.15.12:0/510058819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f859c102d30 msgr2=0x7f859c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.513+0000 7f85a0dd8640 1 --2- 172.21.15.12:0/510058819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f859c102d30 0x7f859c103110 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f858c009930 tx=0x7f858c02a420 comp rx=0 tx=0).stop 2024-09-16T01:01:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.513+0000 7f85a0dd8640 1 -- 172.21.15.12:0/510058819 shutdown_connections 2024-09-16T01:01:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.513+0000 7f85a0dd8640 1 --2- 172.21.15.12:0/510058819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c1082a0 0x7f859c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.513+0000 7f85a0dd8640 1 --2- 172.21.15.12:0/510058819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c1036e0 0x7f859c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.513+0000 7f85a0dd8640 1 --2- 172.21.15.12:0/510058819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f859c102d30 0x7f859c103110 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.513+0000 7f85a0dd8640 1 -- 172.21.15.12:0/510058819 >> 172.21.15.12:0/510058819 conn(0x7f859c0fc7d0 msgr2=0x7f859c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.513+0000 7f85a0dd8640 1 -- 172.21.15.12:0/510058819 shutdown_connections 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.513+0000 7f85a0dd8640 1 -- 172.21.15.12:0/510058819 wait complete. 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f85a0dd8640 1 Processor -- start 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f85a0dd8640 1 -- start start 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f85a0dd8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c102d30 0x7f859c10bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f85a0dd8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c1036e0 0x7f859c10c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f85a0dd8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f859c1082a0 0x7f859c10c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f85a0dd8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f859c102670 con 0x7f859c1082a0 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f85a0dd8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1024f0 con 0x7f859c102d30 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f85a0dd8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1027f0 con 0x7f859c1036e0 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f859ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f859c1082a0 0x7f859c10c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f859ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f859c1082a0 0x7f859c10c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33162/0 (socket says 172.21.15.12:33162) 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f859ad9d640 1 -- 172.21.15.12:0/3130177165 learned_addr learned my addr 172.21.15.12:0/3130177165 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f8599d9b640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c1036e0 0x7f859c10c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.514+0000 7f859a59c640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c102d30 0x7f859c10bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f859ad9d640 1 -- 172.21.15.12:0/3130177165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c1036e0 msgr2=0x7f859c10c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f859ad9d640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c1036e0 0x7f859c10c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f859ad9d640 1 -- 172.21.15.12:0/3130177165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c102d30 msgr2=0x7f859c10bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f859ad9d640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c102d30 0x7f859c10bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f859ad9d640 1 -- 172.21.15.12:0/3130177165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c1aae70 con 0x7f859c1082a0 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f859ad9d640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f859c1082a0 0x7f859c10c9e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f859400eb10 tx=0x7f859400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f858b7fe640 1 -- 172.21.15.12:0/3130177165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594004b20 con 0x7f859c1082a0 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f858b7fe640 1 -- 172.21.15.12:0/3130177165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8594004cc0 con 0x7f859c1082a0 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f85a0dd8640 1 -- 172.21.15.12:0/3130177165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859c1ab160 con 0x7f859c1082a0 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f858b7fe640 1 -- 172.21.15.12:0/3130177165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594010760 con 0x7f859c1082a0 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.515+0000 7f85a0dd8640 1 -- 172.21.15.12:0/3130177165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859c1ab6f0 con 0x7f859c1082a0 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.518+0000 7f858b7fe640 1 -- 172.21.15.12:0/3130177165 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8594005020 con 0x7f859c1082a0 2024-09-16T01:01:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.518+0000 7f85a31b1740 1 Processor -- start 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.518+0000 7f85a31b1740 1 -- start start 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 0x55bade0f5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0f5d40 0x55bade0f8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f85a31b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bade050280 con 0x55bade0eab60 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f85a31b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55baddff7b10 con 0x55bade0f5d40 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f85a31b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bade04c240 con 0x55bade0eb480 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f8599d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f858b7fe640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f85840a32c0 0x7f85840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f8599d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0eaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33172/0 (socket says 172.21.15.12:33172) 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f8599d9b640 1 -- 172.21.15.12:0/3727664435 learned_addr learned my addr 172.21.15.12:0/3727664435 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f859ad9d640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f85840a32c0 0x7f85840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f859a59c640 1 --2- 172.21.15.12:0/3727664435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 0x55bade0f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f858b7fe640 1 -- 172.21.15.12:0/3130177165 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f85940d0280 con 0x7f859c1082a0 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.519+0000 7f8599d9b640 1 --2- 172.21.15.12:0/3727664435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0f5d40 0x55bade0f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.520+0000 7f859a59c640 1 -- 172.21.15.12:0/3727664435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0f5d40 msgr2=0x55bade0f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.520+0000 7f859a59c640 1 --2- 172.21.15.12:0/3727664435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0f5d40 0x55bade0f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.520+0000 7f859ad9d640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f85840a32c0 0x7f85840a5780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8594021000 tx=0x7f859400efd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.520+0000 7f859a59c640 1 -- 172.21.15.12:0/3727664435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 msgr2=0x55bade0eaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.520+0000 7f859a59c640 1 --2- 172.21.15.12:0/3727664435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0eaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.520+0000 7f859a59c640 1 -- 172.21.15.12:0/3727664435 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bade0041f0 con 0x55bade0eb480 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.520+0000 7f8599d9b640 1 --2- 172.21.15.12:0/3727664435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0eaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.520+0000 7f859a59c640 1 --2- 172.21.15.12:0/3727664435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 0x55bade0f5800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f858c005940 tx=0x7f858c005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=153c4b7c7e0edeec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.520+0000 7f8588ff9640 1 -- 172.21.15.12:0/3727664435 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c040070 con 0x55bade0eb480 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f8588ff9640 1 -- 172.21.15.12:0/3727664435 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f858c031870 con 0x55bade0eb480 2024-09-16T01:01:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f8588ff9640 1 -- 172.21.15.12:0/3727664435 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c035040 con 0x55bade0eb480 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f85a31b1740 1 -- 172.21.15.12:0/3727664435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 msgr2=0x55bade0f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f85a31b1740 1 --2- 172.21.15.12:0/3727664435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 0x55bade0f5800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f858c005940 tx=0x7f858c005bd0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f85a31b1740 1 -- 172.21.15.12:0/3727664435 shutdown_connections 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f85a31b1740 1 --2- 172.21.15.12:0/3727664435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0f5d40 0x55bade0f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f85a31b1740 1 --2- 172.21.15.12:0/3727664435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 0x55bade0f5800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f85a31b1740 1 --2- 172.21.15.12:0/3727664435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0eaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f85a31b1740 1 -- 172.21.15.12:0/3727664435 >> 172.21.15.12:0/3727664435 conn(0x55bade0e70f0 msgr2=0x55bade0e74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f85a31b1740 1 -- 172.21.15.12:0/3727664435 shutdown_connections 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.521+0000 7f85a31b1740 1 -- 172.21.15.12:0/3727664435 wait complete. 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f85a31b1740 1 -- start start 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f85a31b1740 1 Processor -- start 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0eb480 0x55bade0f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0f5d40 0x55bade0f3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f85a31b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bade0f8910 con 0x55bade0eab60 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f85a31b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bade00af10 con 0x55bade0eb480 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f85a31b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bade0f8a90 con 0x55bade0f5d40 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f85a31b1740 10 client.0 _ll_register_callbacks cb 0x55baddfd3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f8599d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f8599d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33174/0 (socket says 172.21.15.12:33174) 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f8599d9b640 1 -- 172.21.15.12:0/759041715 learned_addr learned my addr 172.21.15.12:0/759041715 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f8599d9b640 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0f5d40 0x55bade0f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.522+0000 7f859a59c640 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0eb480 0x55bade0f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f8599d9b640 1 -- 172.21.15.12:0/759041715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0f5d40 msgr2=0x55bade0f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f8599d9b640 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0f5d40 0x55bade0f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f8599d9b640 1 -- 172.21.15.12:0/759041715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0eb480 msgr2=0x55bade0f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f8599d9b640 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0eb480 0x55bade0f30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f8599d9b640 1 -- 172.21.15.12:0/759041715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55badddc16a0 con 0x55bade0eab60 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f8599d9b640 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0f2ba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8590003940 tx=0x7f8590015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a749a73c8be105c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f8581ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f8581ffb640 1 -- 172.21.15.12:0/759041715 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590005020 con 0x55bade0eab60 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f8581ffb640 1 -- 172.21.15.12:0/759041715 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f85900051c0 con 0x55bade0eab60 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f85a31b1740 1 -- 172.21.15.12:0/759041715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f858c031870 con 0x55bade0eab60 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f8581ffb640 1 -- 172.21.15.12:0/759041715 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8590029050 con 0x55bade0eab60 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f85a31b1740 10 client.15378 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.523+0000 7f85a31b1740 1 -- 172.21.15.12:0/759041715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bade1044a0 con 0x55bade0eab60 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.524+0000 7f8581ffb640 1 -- 172.21.15.12:0/759041715 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f858c031870 con 0x55bade0eab60 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.524+0000 7f8581ffb640 1 -- 172.21.15.12:0/759041715 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8590010460 con 0x55bade0eab60 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.524+0000 7f85a31b1740 10 client.15378 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.524+0000 7f85a31b1740 10 client.15378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.524+0000 7f85a31b1740 20 client.15378 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.524+0000 7f85a31b1740 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55bade105960 0x55bade107de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.524+0000 7f85a31b1740 4 client.15378 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.524+0000 7f85a31b1740 1 -- 172.21.15.12:0/759041715 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bade05d7f0 con 0x55bade105960 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.524+0000 7f859a59c640 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55bade105960 0x55bade107de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.525+0000 7f8581ffb640 10 client.15378 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.525+0000 7f859a59c640 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55bade105960 0x55bade107de0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=693aaa70702e8a34 server_cookie=26ced6348f6773c8 in_seq=0 out_seq=0 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.525+0000 7f8581ffb640 1 -- 172.21.15.12:0/759041715 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bade05d7f0 con 0x55bade105960 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.525+0000 7f8581ffb640 10 client.15378 handle_command_reply: tid=0 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.525+0000 7f85a31b1740 1 client.15378 shutdown 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 1 -- 172.21.15.12:0/759041715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 msgr2=0x55bade0f2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0f2ba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8590003940 tx=0x7f8590015040 comp rx=0 tx=0).stop 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 1 -- 172.21.15.12:0/759041715 shutdown_connections 2024-09-16T01:01:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55bade105960 0x55bade107de0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f8581ffb640 0 client.15378 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0f5d40 0x55bade0f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0eb480 0x55bade0f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 1 --2- 172.21.15.12:0/759041715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0f2ba0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 1 -- 172.21.15.12:0/759041715 >> 172.21.15.12:0/759041715 conn(0x55bade0e70f0 msgr2=0x55bade0ece20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 1 -- 172.21.15.12:0/759041715 shutdown_connections 2024-09-16T01:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 1 -- 172.21.15.12:0/759041715 wait complete. 2024-09-16T01:01:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.526+0000 7f85a31b1740 20 client.15378 trim_cache size 0 max 16384 2024-09-16T01:01:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.544+0000 7f85a31b1740 1 Processor -- start 2024-09-16T01:01:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.544+0000 7f85a31b1740 1 -- start start 2024-09-16T01:01:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0eb480 0x55bade0f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0f5d40 0x55bade10d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f85a31b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1b5250 con 0x55bade0eab60 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f85a31b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1b6d90 con 0x55bade0eb480 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f85a31b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1b5920 con 0x55bade0f5d40 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f8599d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f8599d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0ed5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33188/0 (socket says 172.21.15.12:33188) 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f8599d9b640 1 -- 172.21.15.12:0/2337350534 learned_addr learned my addr 172.21.15.12:0/2337350534 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f859a59c640 1 --2- 172.21.15.12:0/2337350534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0eb480 0x55bade0f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f8599d9b640 1 --2- 172.21.15.12:0/2337350534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0f5d40 0x55bade10d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f8599d9b640 1 -- 172.21.15.12:0/2337350534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0f5d40 msgr2=0x55bade10d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f8599d9b640 1 --2- 172.21.15.12:0/2337350534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0f5d40 0x55bade10d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f8599d9b640 1 -- 172.21.15.12:0/2337350534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0eb480 msgr2=0x55bade0f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f8599d9b640 1 --2- 172.21.15.12:0/2337350534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0eb480 0x55bade0f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f8599d9b640 1 -- 172.21.15.12:0/2337350534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bade0e6f20 con 0x55bade0eab60 2024-09-16T01:01:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.545+0000 7f8599d9b640 1 --2- 172.21.15.12:0/2337350534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0ed5c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8590003690 tx=0x7f8590003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481ba95a7fa99439 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.546+0000 7f8583fff640 1 -- 172.21.15.12:0/2337350534 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590005040 con 0x55bade0eab60 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.546+0000 7f8583fff640 1 -- 172.21.15.12:0/2337350534 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85900056c0 con 0x55bade0eab60 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.546+0000 7f8583fff640 1 -- 172.21.15.12:0/2337350534 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590004e00 con 0x55bade0eab60 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 -- 172.21.15.12:0/2337350534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 msgr2=0x55bade0ed5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 --2- 172.21.15.12:0/2337350534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0ed5c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8590003690 tx=0x7f8590003f80 comp rx=0 tx=0).stop 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 -- 172.21.15.12:0/2337350534 shutdown_connections 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 --2- 172.21.15.12:0/2337350534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0f5d40 0x55bade10d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 --2- 172.21.15.12:0/2337350534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0eb480 0x55bade0f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 --2- 172.21.15.12:0/2337350534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade0eab60 0x55bade0ed5c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 -- 172.21.15.12:0/2337350534 >> 172.21.15.12:0/2337350534 conn(0x55bade0e70f0 msgr2=0x55bade0f42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 -- 172.21.15.12:0/2337350534 shutdown_connections 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 -- 172.21.15.12:0/2337350534 wait complete. 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 -- start start 2024-09-16T01:01:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.547+0000 7f85a31b1740 1 Processor -- start 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 0x55bade0fa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0f5d40 0x55bade0fa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f85a31b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade105960 0x55bade16f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f85a31b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1b66c0 con 0x55bade105960 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f85a31b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1b5ff0 con 0x55bade0f5d40 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f85a31b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f859c1b3230 con 0x55bade0eb480 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f85a31b1740 10 client.0 _ll_register_callbacks cb 0x7f8590009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f8599d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade105960 0x55bade16f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f8599d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade105960 0x55bade16f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33190/0 (socket says 172.21.15.12:33190) 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f8599d9b640 1 -- 172.21.15.12:0/4277192861 learned_addr learned my addr 172.21.15.12:0/4277192861 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f8599d9b640 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 0x55bade0fa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f859a59c640 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0f5d40 0x55bade0fa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f8599d9b640 1 -- 172.21.15.12:0/4277192861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 msgr2=0x55bade0fa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f8599d9b640 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 0x55bade0fa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f8599d9b640 1 -- 172.21.15.12:0/4277192861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0f5d40 msgr2=0x55bade0fa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f8599d9b640 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0f5d40 0x55bade0fa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.548+0000 7f8599d9b640 1 -- 172.21.15.12:0/4277192861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bade0e2830 con 0x55bade105960 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.549+0000 7f8599d9b640 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade105960 0x55bade16f6d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f85900109a0 tx=0x7f85900049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1e63a1d9c571be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.549+0000 7f8581ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.549+0000 7f8581ffb640 1 -- 172.21.15.12:0/4277192861 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590005240 con 0x55bade105960 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.549+0000 7f8581ffb640 1 -- 172.21.15.12:0/4277192861 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f85900053e0 con 0x55bade105960 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.549+0000 7f85a31b1740 1 -- 172.21.15.12:0/4277192861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85900056c0 con 0x55bade105960 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.549+0000 7f8581ffb640 1 -- 172.21.15.12:0/4277192861 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8590004c90 con 0x55bade105960 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.549+0000 7f85a31b1740 10 client.15384 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.549+0000 7f85a31b1740 1 -- 172.21.15.12:0/4277192861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bade170d90 con 0x55bade105960 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.549+0000 7f8581ffb640 1 -- 172.21.15.12:0/4277192861 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85900056c0 con 0x55bade105960 2024-09-16T01:01:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.550+0000 7f8581ffb640 1 -- 172.21.15.12:0/4277192861 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f859002d8e0 con 0x55bade105960 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.550+0000 7f85a31b1740 10 client.15384 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.550+0000 7f85a31b1740 10 client.15384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.550+0000 7f85a31b1740 20 client.15384 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.550+0000 7f85a31b1740 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55bade1713a0 0x55bade173790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.550+0000 7f85a31b1740 4 client.15384 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.550+0000 7f85a31b1740 1 -- 172.21.15.12:0/4277192861 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bade057d00 con 0x55bade1713a0 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.550+0000 7f859a59c640 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55bade1713a0 0x55bade173790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.550+0000 7f859a59c640 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55bade1713a0 0x55bade173790 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=844a0fd4a384a42a server_cookie=6ad0d61cbdf02f8c in_seq=0 out_seq=0 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.550+0000 7f8581ffb640 10 client.15384 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.551+0000 7f8581ffb640 1 -- 172.21.15.12:0/4277192861 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bade057d00 con 0x55bade1713a0 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.551+0000 7f8581ffb640 10 client.15384 handle_command_reply: tid=0 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.551+0000 7f85a31b1740 1 client.15384 shutdown 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 1 -- 172.21.15.12:0/4277192861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade105960 msgr2=0x55bade16f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade105960 0x55bade16f6d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f85900109a0 tx=0x7f85900049c0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 1 -- 172.21.15.12:0/4277192861 shutdown_connections 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55bade1713a0 0x55bade173790 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bade105960 0x55bade16f6d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bade0f5d40 0x55bade0fa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 1 --2- 172.21.15.12:0/4277192861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bade0eb480 0x55bade0fa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 1 -- 172.21.15.12:0/4277192861 >> 172.21.15.12:0/4277192861 conn(0x55bade0e70f0 msgr2=0x55bade0e6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f8581ffb640 0 client.15384 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 1 -- 172.21.15.12:0/4277192861 shutdown_connections 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 1 -- 172.21.15.12:0/4277192861 wait complete. 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.552+0000 7f85a31b1740 20 client.15384 trim_cache size 0 max 16384 2024-09-16T01:01:13.561 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:01:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-16T01:01:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "ef8c7ea6-ee3b-4167-8541-ee6b67676af6", 2024-09-16T01:01:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-16T01:01:13.562 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 -- 172.21.15.12:0/3130177165 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f85840a32c0 msgr2=0x7f85840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f85840a32c0 0x7f85840a5780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8594021000 tx=0x7f859400efd0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 -- 172.21.15.12:0/3130177165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f859c1082a0 msgr2=0x7f859c10c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f859c1082a0 0x7f859c10c9e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f859400eb10 tx=0x7f859400c2d0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 -- 172.21.15.12:0/3130177165 shutdown_connections 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f85840a32c0 0x7f85840a5780 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f859c1082a0 0x7f859c10c9e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c1036e0 0x7f859c10c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 --2- 172.21.15.12:0/3130177165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f859c102d30 0x7f859c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 -- 172.21.15.12:0/3130177165 >> 172.21.15.12:0/3130177165 conn(0x7f859c0fc7d0 msgr2=0x7f859c104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 -- 172.21.15.12:0/3130177165 shutdown_connections 2024-09-16T01:01:13.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:13.553+0000 7f85a0dd8640 1 -- 172.21.15.12:0/3130177165 wait complete. 2024-09-16T01:01:14.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:01:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:14 smithi098 ceph-mon[35346]: pgmap v364: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:01:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:14 smithi098 ceph-mon[35346]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:14 smithi098 ceph-mon[35346]: scrub queued for path: / 2024-09-16T01:01:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:14 smithi098 ceph-mon[35346]: scrub summary: idle+waiting paths [/] 2024-09-16T01:01:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:14 smithi098 ceph-mon[35346]: scrub summary: active paths [/] 2024-09-16T01:01:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:14 smithi098 ceph-mon[35346]: scrub summary: idle+waiting paths [/] 2024-09-16T01:01:14.971 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:14 smithi012 ceph-mon[31197]: pgmap v364: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:01:14.971 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:14 smithi012 ceph-mon[31197]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:14.971 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:14 smithi012 ceph-mon[31197]: scrub queued for path: / 2024-09-16T01:01:14.971 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:14 smithi012 ceph-mon[31197]: scrub summary: idle+waiting paths [/] 2024-09-16T01:01:14.971 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:14 smithi012 ceph-mon[31197]: scrub summary: active paths [/] 2024-09-16T01:01:14.972 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:14 smithi012 ceph-mon[31197]: scrub summary: idle+waiting paths [/] 2024-09-16T01:01:14.973 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-09-16T01:01:12.937693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666221,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1253,"num_read_kb":748,"num_write":445,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373932,"kb_used_data":12176,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567892,"statfs":{"total":1151940427776,"available":1151557521408,"internally_reserved":0,"allocated":12468224,"data_stored":8120225,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":57,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003199"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:07.949216+0000","last_change":"2024-09-16T00:59:44.862009+0000","last_active":"2024-09-16T01:01:07.949216+0000","last_peered":"2024-09-16T01:01:07.949216+0000","last_clean":"2024-09-16T01:01:07.949216+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:01:07.949216+0000","last_undegraded":"2024-09-16T01:01:07.949216+0000","last_fullsized":"2024-09-16T01:01:07.949216+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:11.209907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968087+0000","last_change":"2024-09-16T00:58:36.507955+0000","last_active":"2024-09-16T01:00:46.968087+0000","last_peered":"2024-09-16T01:00:46.968087+0000","last_clean":"2024-09-16T01:00:46.968087+0000","last_became_active":"2024-09-16T00:58:36.507660+0000","last_became_peered":"2024-09-16T00:58:36.507660+0000","last_unstale":"2024-09-16T01:00:46.968087+0000","last_undegraded":"2024-09-16T01:00:46.968087+0000","last_fullsized":"2024-09-16T01:00:46.968087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:05.408460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627429+0000","last_change":"2024-09-16T00:58:43.620365+0000","last_active":"2024-09-16T01:00:45.627429+0000","last_peered":"2024-09-16T01:00:45.627429+0000","last_clean":"2024-09-16T01:00:45.627429+0000","last_became_active":"2024-09-16T00:58:43.619976+0000","last_became_peered":"2024-09-16T00:58:43.619976+0000","last_unstale":"2024-09-16T01:00:45.627429+0000","last_undegraded":"2024-09-16T01:00:45.627429+0000","last_fullsized":"2024-09-16T01:00:45.627429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:37.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968248+0000","last_change":"2024-09-16T00:58:34.829549+0000","last_active":"2024-09-16T01:00:46.968248+0000","last_peered":"2024-09-16T01:00:46.968248+0000","last_clean":"2024-09-16T01:00:46.968248+0000","last_became_active":"2024-09-16T00:58:34.829180+0000","last_became_peered":"2024-09-16T00:58:34.829180+0000","last_unstale":"2024-09-16T01:00:46.968248+0000","last_undegraded":"2024-09-16T01:00:46.968248+0000","last_fullsized":"2024-09-16T01:00:46.968248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:40.731288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627338+0000","last_change":"2024-09-16T00:58:36.517190+0000","last_active":"2024-09-16T01:00:45.627338+0000","last_peered":"2024-09-16T01:00:45.627338+0000","last_clean":"2024-09-16T01:00:45.627338+0000","last_became_active":"2024-09-16T00:58:36.516877+0000","last_became_peered":"2024-09-16T00:58:36.516877+0000","last_unstale":"2024-09-16T01:00:45.627338+0000","last_undegraded":"2024-09-16T01:00:45.627338+0000","last_fullsized":"2024-09-16T01:00:45.627338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.408011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719645+0000","last_change":"2024-09-16T00:59:44.863832+0000","last_active":"2024-09-16T01:00:45.719645+0000","last_peered":"2024-09-16T01:00:45.719645+0000","last_clean":"2024-09-16T01:00:45.719645+0000","last_became_active":"2024-09-16T00:59:44.863298+0000","last_became_peered":"2024-09-16T00:59:44.863298+0000","last_unstale":"2024-09-16T01:00:45.719645+0000","last_undegraded":"2024-09-16T01:00:45.719645+0000","last_fullsized":"2024-09-16T01:00:45.719645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:55.449728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714641+0000","last_change":"2024-09-16T00:58:34.472375+0000","last_active":"2024-09-16T01:00:45.714641+0000","last_peered":"2024-09-16T01:00:45.714641+0000","last_clean":"2024-09-16T01:00:45.714641+0000","last_became_active":"2024-09-16T00:58:34.471990+0000","last_became_peered":"2024-09-16T00:58:34.471990+0000","last_unstale":"2024-09-16T01:00:45.714641+0000","last_undegraded":"2024-09-16T01:00:45.714641+0000","last_fullsized":"2024-09-16T01:00:45.714641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:15.746005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624668+0000","last_change":"2024-09-16T00:58:36.513747+0000","last_active":"2024-09-16T01:00:45.624668+0000","last_peered":"2024-09-16T01:00:45.624668+0000","last_clean":"2024-09-16T01:00:45.624668+0000","last_became_active":"2024-09-16T00:58:36.512635+0000","last_became_peered":"2024-09-16T00:58:36.512635+0000","last_unstale":"2024-09-16T01:00:45.624668+0000","last_undegraded":"2024-09-16T01:00:45.624668+0000","last_fullsized":"2024-09-16T01:00:45.624668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:39.014961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719864+0000","last_change":"2024-09-16T00:58:43.609355+0000","last_active":"2024-09-16T01:00:45.719864+0000","last_peered":"2024-09-16T01:00:45.719864+0000","last_clean":"2024-09-16T01:00:45.719864+0000","last_became_active":"2024-09-16T00:58:43.608892+0000","last_became_peered":"2024-09-16T00:58:43.608892+0000","last_unstale":"2024-09-16T01:00:45.719864+0000","last_undegraded":"2024-09-16T01:00:45.719864+0000","last_fullsized":"2024-09-16T01:00:45.719864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:20.718163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714484+0000","last_change":"2024-09-16T00:58:34.469650+0000","last_active":"2024-09-16T01:00:45.714484+0000","last_peered":"2024-09-16T01:00:45.714484+0000","last_clean":"2024-09-16T01:00:45.714484+0000","last_became_active":"2024-09-16T00:58:34.468939+0000","last_became_peered":"2024-09-16T00:58:34.468939+0000","last_unstale":"2024-09-16T01:00:45.714484+0000","last_undegraded":"2024-09-16T01:00:45.714484+0000","last_fullsized":"2024-09-16T01:00:45.714484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:34.511111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623914+0000","last_change":"2024-09-16T00:59:45.097454+0000","last_active":"2024-09-16T01:00:45.623914+0000","last_peered":"2024-09-16T01:00:45.623914+0000","last_clean":"2024-09-16T01:00:45.623914+0000","last_became_active":"2024-09-16T00:59:45.096985+0000","last_became_peered":"2024-09-16T00:59:45.096985+0000","last_unstale":"2024-09-16T01:00:45.623914+0000","last_undegraded":"2024-09-16T01:00:45.623914+0000","last_fullsized":"2024-09-16T01:00:45.623914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:03.247850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719801+0000","last_change":"2024-09-16T00:58:43.612479+0000","last_active":"2024-09-16T01:00:45.719801+0000","last_peered":"2024-09-16T01:00:45.719801+0000","last_clean":"2024-09-16T01:00:45.719801+0000","last_became_active":"2024-09-16T00:58:43.612001+0000","last_became_peered":"2024-09-16T00:58:43.612001+0000","last_unstale":"2024-09-16T01:00:45.719801+0000","last_undegraded":"2024-09-16T01:00:45.719801+0000","last_fullsized":"2024-09-16T01:00:45.719801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:33.056052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919590+0000","last_change":"2024-09-16T00:58:36.519407+0000","last_active":"2024-09-16T01:00:45.919590+0000","last_peered":"2024-09-16T01:00:45.919590+0000","last_clean":"2024-09-16T01:00:45.919590+0000","last_became_active":"2024-09-16T00:58:36.519108+0000","last_became_peered":"2024-09-16T00:58:36.519108+0000","last_unstale":"2024-09-16T01:00:45.919590+0000","last_undegraded":"2024-09-16T01:00:45.919590+0000","last_fullsized":"2024-09-16T01:00:45.919590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:28.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714187+0000","last_change":"2024-09-16T00:58:34.472295+0000","last_active":"2024-09-16T01:00:45.714187+0000","last_peered":"2024-09-16T01:00:45.714187+0000","last_clean":"2024-09-16T01:00:45.714187+0000","last_became_active":"2024-09-16T00:58:34.471968+0000","last_became_peered":"2024-09-16T00:58:34.471968+0000","last_unstale":"2024-09-16T01:00:45.714187+0000","last_undegraded":"2024-09-16T01:00:45.714187+0000","last_fullsized":"2024-09-16T01:00:45.714187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:44.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720006+0000","last_change":"2024-09-16T00:58:43.615870+0000","last_active":"2024-09-16T01:00:45.720006+0000","last_peered":"2024-09-16T01:00:45.720006+0000","last_clean":"2024-09-16T01:00:45.720006+0000","last_became_active":"2024-09-16T00:58:43.615116+0000","last_became_peered":"2024-09-16T00:58:43.615116+0000","last_unstale":"2024-09-16T01:00:45.720006+0000","last_undegraded":"2024-09-16T01:00:45.720006+0000","last_fullsized":"2024-09-16T01:00:45.720006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:44.742792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967891+0000","last_change":"2024-09-16T00:58:36.512485+0000","last_active":"2024-09-16T01:00:46.967891+0000","last_peered":"2024-09-16T01:00:46.967891+0000","last_clean":"2024-09-16T01:00:46.967891+0000","last_became_active":"2024-09-16T00:58:36.512175+0000","last_became_peered":"2024-09-16T00:58:36.512175+0000","last_unstale":"2024-09-16T01:00:46.967891+0000","last_undegraded":"2024-09-16T01:00:46.967891+0000","last_fullsized":"2024-09-16T01:00:46.967891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.328409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'4","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.896964+0000","last_change":"2024-09-16T00:59:44.841052+0000","last_active":"2024-09-16T01:00:45.896964+0000","last_peered":"2024-09-16T01:00:45.896964+0000","last_clean":"2024-09-16T01:00:45.896964+0000","last_became_active":"2024-09-16T00:59:44.834033+0000","last_became_peered":"2024-09-16T00:59:44.834033+0000","last_unstale":"2024-09-16T01:00:45.896964+0000","last_undegraded":"2024-09-16T01:00:45.896964+0000","last_fullsized":"2024-09-16T01:00:45.896964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:09.696435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720242+0000","last_change":"2024-09-16T00:58:43.610265+0000","last_active":"2024-09-16T01:00:45.720242+0000","last_peered":"2024-09-16T01:00:45.720242+0000","last_clean":"2024-09-16T01:00:45.720242+0000","last_became_active":"2024-09-16T00:58:43.609868+0000","last_became_peered":"2024-09-16T00:58:43.609868+0000","last_unstale":"2024-09-16T01:00:45.720242+0000","last_undegraded":"2024-09-16T01:00:45.720242+0000","last_fullsized":"2024-09-16T01:00:45.720242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:54.689332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897423+0000","last_change":"2024-09-16T00:58:36.512801+0000","last_active":"2024-09-16T01:00:45.897423+0000","last_peered":"2024-09-16T01:00:45.897423+0000","last_clean":"2024-09-16T01:00:45.897423+0000","last_became_active":"2024-09-16T00:58:36.512469+0000","last_became_peered":"2024-09-16T00:58:36.512469+0000","last_unstale":"2024-09-16T01:00:45.897423+0000","last_undegraded":"2024-09-16T01:00:45.897423+0000","last_fullsized":"2024-09-16T01:00:45.897423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:57.951743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967904+0000","last_change":"2024-09-16T00:58:34.471498+0000","last_active":"2024-09-16T01:00:46.967904+0000","last_peered":"2024-09-16T01:00:46.967904+0000","last_clean":"2024-09-16T01:00:46.967904+0000","last_became_active":"2024-09-16T00:58:34.471093+0000","last_became_peered":"2024-09-16T00:58:34.471093+0000","last_unstale":"2024-09-16T01:00:46.967904+0000","last_undegraded":"2024-09-16T01:00:46.967904+0000","last_fullsized":"2024-09-16T01:00:46.967904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:35.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624262+0000","last_change":"2024-09-16T00:58:43.616376+0000","last_active":"2024-09-16T01:00:45.624262+0000","last_peered":"2024-09-16T01:00:45.624262+0000","last_clean":"2024-09-16T01:00:45.624262+0000","last_became_active":"2024-09-16T00:58:43.616029+0000","last_became_peered":"2024-09-16T00:58:43.616029+0000","last_unstale":"2024-09-16T01:00:45.624262+0000","last_undegraded":"2024-09-16T01:00:45.624262+0000","last_fullsized":"2024-09-16T01:00:45.624262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:54.776250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714062+0000","last_change":"2024-09-16T00:58:36.506625+0000","last_active":"2024-09-16T01:00:45.714062+0000","last_peered":"2024-09-16T01:00:45.714062+0000","last_clean":"2024-09-16T01:00:45.714062+0000","last_became_active":"2024-09-16T00:58:36.506337+0000","last_became_peered":"2024-09-16T00:58:36.506337+0000","last_unstale":"2024-09-16T01:00:45.714062+0000","last_undegraded":"2024-09-16T01:00:45.714062+0000","last_fullsized":"2024-09-16T01:00:45.714062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:22.080165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.901530+0000","last_change":"2024-09-16T01:00:45.901112+0000","last_active":"2024-09-16T01:00:45.901530+0000","last_peered":"2024-09-16T01:00:45.901530+0000","last_clean":"2024-09-16T01:00:45.901530+0000","last_became_active":"2024-09-16T01:00:45.898274+0000","last_became_peered":"2024-09-16T01:00:45.898274+0000","last_unstale":"2024-09-16T01:00:45.901530+0000","last_undegraded":"2024-09-16T01:00:45.901530+0000","last_fullsized":"2024-09-16T01:00:45.901530+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:55.626391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720033+0000","last_change":"2024-09-16T00:58:43.609399+0000","last_active":"2024-09-16T01:00:45.720033+0000","last_peered":"2024-09-16T01:00:45.720033+0000","last_clean":"2024-09-16T01:00:45.720033+0000","last_became_active":"2024-09-16T00:58:43.608988+0000","last_became_peered":"2024-09-16T00:58:43.608988+0000","last_unstale":"2024-09-16T01:00:45.720033+0000","last_undegraded":"2024-09-16T01:00:45.720033+0000","last_fullsized":"2024-09-16T01:00:45.720033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.500071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627256+0000","last_change":"2024-09-16T00:58:36.515930+0000","last_active":"2024-09-16T01:00:45.627256+0000","last_peered":"2024-09-16T01:00:45.627256+0000","last_clean":"2024-09-16T01:00:45.627256+0000","last_became_active":"2024-09-16T00:58:36.515625+0000","last_became_peered":"2024-09-16T00:58:36.515625+0000","last_unstale":"2024-09-16T01:00:45.627256+0000","last_undegraded":"2024-09-16T01:00:45.627256+0000","last_fullsized":"2024-09-16T01:00:45.627256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:55.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720365+0000","last_change":"2024-09-16T00:58:34.508686+0000","last_active":"2024-09-16T01:00:45.720365+0000","last_peered":"2024-09-16T01:00:45.720365+0000","last_clean":"2024-09-16T01:00:45.720365+0000","last_became_active":"2024-09-16T00:58:34.508284+0000","last_became_peered":"2024-09-16T00:58:34.508284+0000","last_unstale":"2024-09-16T01:00:45.720365+0000","last_undegraded":"2024-09-16T01:00:45.720365+0000","last_fullsized":"2024-09-16T01:00:45.720365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:47.545949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627558+0000","last_change":"2024-09-16T00:58:43.615852+0000","last_active":"2024-09-16T01:00:45.627558+0000","last_peered":"2024-09-16T01:00:45.627558+0000","last_clean":"2024-09-16T01:00:45.627558+0000","last_became_active":"2024-09-16T00:58:43.615474+0000","last_became_peered":"2024-09-16T00:58:43.615474+0000","last_unstale":"2024-09-16T01:00:45.627558+0000","last_undegraded":"2024-09-16T01:00:45.627558+0000","last_fullsized":"2024-09-16T01:00:45.627558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:39.596924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968316+0000","last_change":"2024-09-16T00:58:36.513820+0000","last_active":"2024-09-16T01:00:46.968316+0000","last_peered":"2024-09-16T01:00:46.968316+0000","last_clean":"2024-09-16T01:00:46.968316+0000","last_became_active":"2024-09-16T00:58:36.513513+0000","last_became_peered":"2024-09-16T00:58:36.513513+0000","last_unstale":"2024-09-16T01:00:46.968316+0000","last_undegraded":"2024-09-16T01:00:46.968316+0000","last_fullsized":"2024-09-16T01:00:46.968316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:34.584214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'16","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624208+0000","last_change":"2024-09-16T00:58:34.462794+0000","last_active":"2024-09-16T01:00:45.624208+0000","last_peered":"2024-09-16T01:00:45.624208+0000","last_clean":"2024-09-16T01:00:45.624208+0000","last_became_active":"2024-09-16T00:58:34.462471+0000","last_became_peered":"2024-09-16T00:58:34.462471+0000","last_unstale":"2024-09-16T01:00:45.624208+0000","last_undegraded":"2024-09-16T01:00:45.624208+0000","last_fullsized":"2024-09-16T01:00:45.624208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:13.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967564+0000","last_change":"2024-09-16T00:58:43.607718+0000","last_active":"2024-09-16T01:00:46.967564+0000","last_peered":"2024-09-16T01:00:46.967564+0000","last_clean":"2024-09-16T01:00:46.967564+0000","last_became_active":"2024-09-16T00:58:43.607347+0000","last_became_peered":"2024-09-16T00:58:43.607347+0000","last_unstale":"2024-09-16T01:00:46.967564+0000","last_undegraded":"2024-09-16T01:00:46.967564+0000","last_fullsized":"2024-09-16T01:00:46.967564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:12.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.507161+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.504062+0000","last_became_peered":"2024-09-16T00:58:36.504062+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:58:34.829848+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:58:34.829439+0000","last_became_peered":"2024-09-16T00:58:34.829439+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:06.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897267+0000","last_change":"2024-09-16T00:58:43.618334+0000","last_active":"2024-09-16T01:00:45.897267+0000","last_peered":"2024-09-16T01:00:45.897267+0000","last_clean":"2024-09-16T01:00:45.897267+0000","last_became_active":"2024-09-16T00:58:43.617810+0000","last_became_peered":"2024-09-16T00:58:43.617810+0000","last_unstale":"2024-09-16T01:00:45.897267+0000","last_undegraded":"2024-09-16T01:00:45.897267+0000","last_fullsized":"2024-09-16T01:00:45.897267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:58.202973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711427+0000","last_change":"2024-09-16T00:58:36.509025+0000","last_active":"2024-09-16T01:00:45.711427+0000","last_peered":"2024-09-16T01:00:45.711427+0000","last_clean":"2024-09-16T01:00:45.711427+0000","last_became_active":"2024-09-16T00:58:36.508660+0000","last_became_peered":"2024-09-16T00:58:36.508660+0000","last_unstale":"2024-09-16T01:00:45.711427+0000","last_undegraded":"2024-09-16T01:00:45.711427+0000","last_fullsized":"2024-09-16T01:00:45.711427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:01.433486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624046+0000","last_change":"2024-09-16T00:58:34.829899+0000","last_active":"2024-09-16T01:00:45.624046+0000","last_peered":"2024-09-16T01:00:45.624046+0000","last_clean":"2024-09-16T01:00:45.624046+0000","last_became_active":"2024-09-16T00:58:34.829546+0000","last_became_peered":"2024-09-16T00:58:34.829546+0000","last_unstale":"2024-09-16T01:00:45.624046+0000","last_undegraded":"2024-09-16T01:00:45.624046+0000","last_fullsized":"2024-09-16T01:00:45.624046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:21.253829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714080+0000","last_change":"2024-09-16T00:58:43.610143+0000","last_active":"2024-09-16T01:00:45.714080+0000","last_peered":"2024-09-16T01:00:45.714080+0000","last_clean":"2024-09-16T01:00:45.714080+0000","last_became_active":"2024-09-16T00:58:43.609739+0000","last_became_peered":"2024-09-16T00:58:43.609739+0000","last_unstale":"2024-09-16T01:00:45.714080+0000","last_undegraded":"2024-09-16T01:00:45.714080+0000","last_fullsized":"2024-09-16T01:00:45.714080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:28.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711421+0000","last_change":"2024-09-16T00:58:36.520423+0000","last_active":"2024-09-16T01:00:45.711421+0000","last_peered":"2024-09-16T01:00:45.711421+0000","last_clean":"2024-09-16T01:00:45.711421+0000","last_became_active":"2024-09-16T00:58:36.520117+0000","last_became_peered":"2024-09-16T00:58:36.520117+0000","last_unstale":"2024-09-16T01:00:45.711421+0000","last_undegraded":"2024-09-16T01:00:45.711421+0000","last_fullsized":"2024-09-16T01:00:45.711421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.652142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:09.952749+0000","last_change":"2024-09-16T00:58:34.475161+0000","last_active":"2024-09-16T01:01:09.952749+0000","last_peered":"2024-09-16T01:01:09.952749+0000","last_clean":"2024-09-16T01:01:09.952749+0000","last_became_active":"2024-09-16T00:58:34.474755+0000","last_became_peered":"2024-09-16T00:58:34.474755+0000","last_unstale":"2024-09-16T01:01:09.952749+0000","last_undegraded":"2024-09-16T01:01:09.952749+0000","last_fullsized":"2024-09-16T01:01:09.952749+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:12.884466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717746+0000","last_change":"2024-09-16T00:58:43.609042+0000","last_active":"2024-09-16T01:00:45.717746+0000","last_peered":"2024-09-16T01:00:45.717746+0000","last_clean":"2024-09-16T01:00:45.717746+0000","last_became_active":"2024-09-16T00:58:43.608596+0000","last_became_peered":"2024-09-16T00:58:43.608596+0000","last_unstale":"2024-09-16T01:00:45.717746+0000","last_undegraded":"2024-09-16T01:00:45.717746+0000","last_fullsized":"2024-09-16T01:00:45.717746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:47.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625659+0000","last_change":"2024-09-16T00:59:44.838583+0000","last_active":"2024-09-16T01:00:45.625659+0000","last_peered":"2024-09-16T01:00:45.625659+0000","last_clean":"2024-09-16T01:00:45.625659+0000","last_became_active":"2024-09-16T00:59:44.838221+0000","last_became_peered":"2024-09-16T00:59:44.838221+0000","last_unstale":"2024-09-16T01:00:45.625659+0000","last_undegraded":"2024-09-16T01:00:45.625659+0000","last_fullsized":"2024-09-16T01:00:45.625659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:27.562118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:07.750731+0000","last_change":"2024-09-16T00:58:34.829452+0000","last_active":"2024-09-16T01:01:07.750731+0000","last_peered":"2024-09-16T01:01:07.750731+0000","last_clean":"2024-09-16T01:01:07.750731+0000","last_became_active":"2024-09-16T00:58:34.829129+0000","last_became_peered":"2024-09-16T00:58:34.829129+0000","last_unstale":"2024-09-16T01:01:07.750731+0000","last_undegraded":"2024-09-16T01:01:07.750731+0000","last_fullsized":"2024-09-16T01:01:07.750731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718001+0000","last_change":"2024-09-16T00:58:43.609230+0000","last_active":"2024-09-16T01:00:45.718001+0000","last_peered":"2024-09-16T01:00:45.718001+0000","last_clean":"2024-09-16T01:00:45.718001+0000","last_became_active":"2024-09-16T00:58:43.608879+0000","last_became_peered":"2024-09-16T00:58:43.608879+0000","last_unstale":"2024-09-16T01:00:45.718001+0000","last_undegraded":"2024-09-16T01:00:45.718001+0000","last_fullsized":"2024-09-16T01:00:45.718001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.112878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717141+0000","last_change":"2024-09-16T00:58:36.503412+0000","last_active":"2024-09-16T01:00:45.717141+0000","last_peered":"2024-09-16T01:00:45.717141+0000","last_clean":"2024-09-16T01:00:45.717141+0000","last_became_active":"2024-09-16T00:58:36.503043+0000","last_became_peered":"2024-09-16T00:58:36.503043+0000","last_unstale":"2024-09-16T01:00:45.717141+0000","last_undegraded":"2024-09-16T01:00:45.717141+0000","last_fullsized":"2024-09-16T01:00:45.717141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:18.495669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919328+0000","last_change":"2024-09-16T00:58:34.468460+0000","last_active":"2024-09-16T01:00:45.919328+0000","last_peered":"2024-09-16T01:00:45.919328+0000","last_clean":"2024-09-16T01:00:45.919328+0000","last_became_active":"2024-09-16T00:58:34.468104+0000","last_became_peered":"2024-09-16T00:58:34.468104+0000","last_unstale":"2024-09-16T01:00:45.919328+0000","last_undegraded":"2024-09-16T01:00:45.919328+0000","last_fullsized":"2024-09-16T01:00:45.919328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:13.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714467+0000","last_change":"2024-09-16T00:59:44.863609+0000","last_active":"2024-09-16T01:00:45.714467+0000","last_peered":"2024-09-16T01:00:45.714467+0000","last_clean":"2024-09-16T01:00:45.714467+0000","last_became_active":"2024-09-16T00:59:44.863152+0000","last_became_peered":"2024-09-16T00:59:44.863152+0000","last_unstale":"2024-09-16T01:00:45.714467+0000","last_undegraded":"2024-09-16T01:00:45.714467+0000","last_fullsized":"2024-09-16T01:00:45.714467+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:51.312612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967875+0000","last_change":"2024-09-16T00:58:36.509749+0000","last_active":"2024-09-16T01:00:46.967875+0000","last_peered":"2024-09-16T01:00:46.967875+0000","last_clean":"2024-09-16T01:00:46.967875+0000","last_became_active":"2024-09-16T00:58:36.509411+0000","last_became_peered":"2024-09-16T00:58:36.509411+0000","last_unstale":"2024-09-16T01:00:46.967875+0000","last_undegraded":"2024-09-16T01:00:46.967875+0000","last_fullsized":"2024-09-16T01:00:46.967875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:14.291956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720026+0000","last_change":"2024-09-16T00:58:34.470190+0000","last_active":"2024-09-16T01:00:45.720026+0000","last_peered":"2024-09-16T01:00:45.720026+0000","last_clean":"2024-09-16T01:00:45.720026+0000","last_became_active":"2024-09-16T00:58:34.469832+0000","last_became_peered":"2024-09-16T00:58:34.469832+0000","last_unstale":"2024-09-16T01:00:45.720026+0000","last_undegraded":"2024-09-16T01:00:45.720026+0000","last_fullsized":"2024-09-16T01:00:45.720026+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:03.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919482+0000","last_change":"2024-09-16T00:57:23.502001+0000","last_active":"2024-09-16T01:00:45.919482+0000","last_peered":"2024-09-16T01:00:45.919482+0000","last_clean":"2024-09-16T01:00:45.919482+0000","last_became_active":"2024-09-16T00:57:23.501465+0000","last_became_peered":"2024-09-16T00:57:23.501465+0000","last_unstale":"2024-09-16T01:00:45.919482+0000","last_undegraded":"2024-09-16T01:00:45.919482+0000","last_fullsized":"2024-09-16T01:00:45.919482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_clean_scrub_stamp":"2024-09-16T00:53:57.344038+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:22.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919823+0000","last_change":"2024-09-16T00:58:43.609572+0000","last_active":"2024-09-16T01:00:45.919823+0000","last_peered":"2024-09-16T01:00:45.919823+0000","last_clean":"2024-09-16T01:00:45.919823+0000","last_became_active":"2024-09-16T00:58:43.609185+0000","last_became_peered":"2024-09-16T00:58:43.609185+0000","last_unstale":"2024-09-16T01:00:45.919823+0000","last_undegraded":"2024-09-16T01:00:45.919823+0000","last_fullsized":"2024-09-16T01:00:45.919823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.199976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919987+0000","last_change":"2024-09-16T00:58:36.510761+0000","last_active":"2024-09-16T01:00:45.919987+0000","last_peered":"2024-09-16T01:00:45.919987+0000","last_clean":"2024-09-16T01:00:45.919987+0000","last_became_active":"2024-09-16T00:58:36.510456+0000","last_became_peered":"2024-09-16T00:58:36.510456+0000","last_unstale":"2024-09-16T01:00:45.919987+0000","last_undegraded":"2024-09-16T01:00:45.919987+0000","last_fullsized":"2024-09-16T01:00:45.919987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:02.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'8","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:09.753205+0000","last_change":"2024-09-16T00:58:34.830238+0000","last_active":"2024-09-16T01:01:09.753205+0000","last_peered":"2024-09-16T01:01:09.753205+0000","last_clean":"2024-09-16T01:01:09.753205+0000","last_became_active":"2024-09-16T00:58:34.829558+0000","last_became_peered":"2024-09-16T00:58:34.829558+0000","last_unstale":"2024-09-16T01:01:09.753205+0000","last_undegraded":"2024-09-16T01:01:09.753205+0000","last_fullsized":"2024-09-16T01:01:09.753205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.347122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624541+0000","last_change":"2024-09-16T00:58:43.613179+0000","last_active":"2024-09-16T01:00:45.624541+0000","last_peered":"2024-09-16T01:00:45.624541+0000","last_clean":"2024-09-16T01:00:45.624541+0000","last_became_active":"2024-09-16T00:58:43.612794+0000","last_became_peered":"2024-09-16T00:58:43.612794+0000","last_unstale":"2024-09-16T01:00:45.624541+0000","last_undegraded":"2024-09-16T01:00:45.624541+0000","last_fullsized":"2024-09-16T01:00:45.624541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:04:24.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919741+0000","last_change":"2024-09-16T00:58:36.512600+0000","last_active":"2024-09-16T01:00:45.919741+0000","last_peered":"2024-09-16T01:00:45.919741+0000","last_clean":"2024-09-16T01:00:45.919741+0000","last_became_active":"2024-09-16T00:58:36.512309+0000","last_became_peered":"2024-09-16T00:58:36.512309+0000","last_unstale":"2024-09-16T01:00:45.919741+0000","last_undegraded":"2024-09-16T01:00:45.919741+0000","last_fullsized":"2024-09-16T01:00:45.919741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.790755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626294+0000","last_change":"2024-09-16T00:58:34.471787+0000","last_active":"2024-09-16T01:00:45.626294+0000","last_peered":"2024-09-16T01:00:45.626294+0000","last_clean":"2024-09-16T01:00:45.626294+0000","last_became_active":"2024-09-16T00:58:34.471119+0000","last_became_peered":"2024-09-16T00:58:34.471119+0000","last_unstale":"2024-09-16T01:00:45.626294+0000","last_undegraded":"2024-09-16T01:00:45.626294+0000","last_fullsized":"2024-09-16T01:00:45.626294+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:26.121669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626989+0000","last_change":"2024-09-16T00:58:43.609676+0000","last_active":"2024-09-16T01:00:45.626989+0000","last_peered":"2024-09-16T01:00:45.626989+0000","last_clean":"2024-09-16T01:00:45.626989+0000","last_became_active":"2024-09-16T00:58:43.609313+0000","last_became_peered":"2024-09-16T00:58:43.609313+0000","last_unstale":"2024-09-16T01:00:45.626989+0000","last_undegraded":"2024-09-16T01:00:45.626989+0000","last_fullsized":"2024-09-16T01:00:45.626989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:53.339070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919903+0000","last_change":"2024-09-16T00:58:36.514621+0000","last_active":"2024-09-16T01:00:45.919903+0000","last_peered":"2024-09-16T01:00:45.919903+0000","last_clean":"2024-09-16T01:00:45.919903+0000","last_became_active":"2024-09-16T00:58:36.514259+0000","last_became_peered":"2024-09-16T00:58:36.514259+0000","last_unstale":"2024-09-16T01:00:45.919903+0000","last_undegraded":"2024-09-16T01:00:45.919903+0000","last_fullsized":"2024-09-16T01:00:45.919903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:11.411742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718006+0000","last_change":"2024-09-16T00:58:34.470512+0000","last_active":"2024-09-16T01:00:45.718006+0000","last_peered":"2024-09-16T01:00:45.718006+0000","last_clean":"2024-09-16T01:00:45.718006+0000","last_became_active":"2024-09-16T00:58:34.470140+0000","last_became_peered":"2024-09-16T00:58:34.470140+0000","last_unstale":"2024-09-16T01:00:45.718006+0000","last_undegraded":"2024-09-16T01:00:45.718006+0000","last_fullsized":"2024-09-16T01:00:45.718006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:04.068901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625516+0000","last_change":"2024-09-16T00:58:43.615221+0000","last_active":"2024-09-16T01:00:45.625516+0000","last_peered":"2024-09-16T01:00:45.625516+0000","last_clean":"2024-09-16T01:00:45.625516+0000","last_became_active":"2024-09-16T00:58:43.614820+0000","last_became_peered":"2024-09-16T00:58:43.614820+0000","last_unstale":"2024-09-16T01:00:45.625516+0000","last_undegraded":"2024-09-16T01:00:45.625516+0000","last_fullsized":"2024-09-16T01:00:45.625516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:31.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897390+0000","last_change":"2024-09-16T00:58:36.515470+0000","last_active":"2024-09-16T01:00:45.897390+0000","last_peered":"2024-09-16T01:00:45.897390+0000","last_clean":"2024-09-16T01:00:45.897390+0000","last_became_active":"2024-09-16T00:58:36.515145+0000","last_became_peered":"2024-09-16T00:58:36.515145+0000","last_unstale":"2024-09-16T01:00:45.897390+0000","last_undegraded":"2024-09-16T01:00:45.897390+0000","last_fullsized":"2024-09-16T01:00:45.897390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:10.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714720+0000","last_change":"2024-09-16T00:58:34.464865+0000","last_active":"2024-09-16T01:00:45.714720+0000","last_peered":"2024-09-16T01:00:45.714720+0000","last_clean":"2024-09-16T01:00:45.714720+0000","last_became_active":"2024-09-16T00:58:34.464448+0000","last_became_peered":"2024-09-16T00:58:34.464448+0000","last_unstale":"2024-09-16T01:00:45.714720+0000","last_undegraded":"2024-09-16T01:00:45.714720+0000","last_fullsized":"2024-09-16T01:00:45.714720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:47.454251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625710+0000","last_change":"2024-09-16T00:58:43.610348+0000","last_active":"2024-09-16T01:00:45.625710+0000","last_peered":"2024-09-16T01:00:45.625710+0000","last_clean":"2024-09-16T01:00:45.625710+0000","last_became_active":"2024-09-16T00:58:43.609497+0000","last_became_peered":"2024-09-16T00:58:43.609497+0000","last_unstale":"2024-09-16T01:00:45.625710+0000","last_undegraded":"2024-09-16T01:00:45.625710+0000","last_fullsized":"2024-09-16T01:00:45.625710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:52.931325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626081+0000","last_change":"2024-09-16T00:58:36.517412+0000","last_active":"2024-09-16T01:00:45.626081+0000","last_peered":"2024-09-16T01:00:45.626081+0000","last_clean":"2024-09-16T01:00:45.626081+0000","last_became_active":"2024-09-16T00:58:36.516600+0000","last_became_peered":"2024-09-16T00:58:36.516600+0000","last_unstale":"2024-09-16T01:00:45.626081+0000","last_undegraded":"2024-09-16T01:00:45.626081+0000","last_fullsized":"2024-09-16T01:00:45.626081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:39.445454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714191+0000","last_change":"2024-09-16T00:58:34.831420+0000","last_active":"2024-09-16T01:00:45.714191+0000","last_peered":"2024-09-16T01:00:45.714191+0000","last_clean":"2024-09-16T01:00:45.714191+0000","last_became_active":"2024-09-16T00:58:34.830991+0000","last_became_peered":"2024-09-16T00:58:34.830991+0000","last_unstale":"2024-09-16T01:00:45.714191+0000","last_undegraded":"2024-09-16T01:00:45.714191+0000","last_fullsized":"2024-09-16T01:00:45.714191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:13.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718011+0000","last_change":"2024-09-16T00:58:43.611781+0000","last_active":"2024-09-16T01:00:45.718011+0000","last_peered":"2024-09-16T01:00:45.718011+0000","last_clean":"2024-09-16T01:00:45.718011+0000","last_became_active":"2024-09-16T00:58:43.610332+0000","last_became_peered":"2024-09-16T00:58:43.610332+0000","last_unstale":"2024-09-16T01:00:45.718011+0000","last_undegraded":"2024-09-16T01:00:45.718011+0000","last_fullsized":"2024-09-16T01:00:45.718011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:18.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919291+0000","last_change":"2024-09-16T00:58:36.514395+0000","last_active":"2024-09-16T01:00:45.919291+0000","last_peered":"2024-09-16T01:00:45.919291+0000","last_clean":"2024-09-16T01:00:45.919291+0000","last_became_active":"2024-09-16T00:58:36.513570+0000","last_became_peered":"2024-09-16T00:58:36.513570+0000","last_unstale":"2024-09-16T01:00:45.919291+0000","last_undegraded":"2024-09-16T01:00:45.919291+0000","last_fullsized":"2024-09-16T01:00:45.919291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:56.148815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:11.756066+0000","last_change":"2024-09-16T00:58:34.473583+0000","last_active":"2024-09-16T01:01:11.756066+0000","last_peered":"2024-09-16T01:01:11.756066+0000","last_clean":"2024-09-16T01:01:11.756066+0000","last_became_active":"2024-09-16T00:58:34.473259+0000","last_became_peered":"2024-09-16T00:58:34.473259+0000","last_unstale":"2024-09-16T01:01:11.756066+0000","last_undegraded":"2024-09-16T01:01:11.756066+0000","last_fullsized":"2024-09-16T01:01:11.756066+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:55.622609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:59:44.835446+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:41.254621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919524+0000","last_change":"2024-09-16T00:59:44.863645+0000","last_active":"2024-09-16T01:00:45.919524+0000","last_peered":"2024-09-16T01:00:45.919524+0000","last_clean":"2024-09-16T01:00:45.919524+0000","last_became_active":"2024-09-16T00:59:44.863207+0000","last_became_peered":"2024-09-16T00:59:44.863207+0000","last_unstale":"2024-09-16T01:00:45.919524+0000","last_undegraded":"2024-09-16T01:00:45.919524+0000","last_fullsized":"2024-09-16T01:00:45.919524+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:27.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626418+0000","last_change":"2024-09-16T00:58:34.470326+0000","last_active":"2024-09-16T01:00:45.626418+0000","last_peered":"2024-09-16T01:00:45.626418+0000","last_clean":"2024-09-16T01:00:45.626418+0000","last_became_active":"2024-09-16T00:58:34.469920+0000","last_became_peered":"2024-09-16T00:58:34.469920+0000","last_unstale":"2024-09-16T01:00:45.626418+0000","last_undegraded":"2024-09-16T01:00:45.626418+0000","last_fullsized":"2024-09-16T01:00:45.626418+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:58.718004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897319+0000","last_change":"2024-09-16T00:58:43.616324+0000","last_active":"2024-09-16T01:00:45.897319+0000","last_peered":"2024-09-16T01:00:45.897319+0000","last_clean":"2024-09-16T01:00:45.897319+0000","last_became_active":"2024-09-16T00:58:43.615903+0000","last_became_peered":"2024-09-16T00:58:43.615903+0000","last_unstale":"2024-09-16T01:00:45.897319+0000","last_undegraded":"2024-09-16T01:00:45.897319+0000","last_fullsized":"2024-09-16T01:00:45.897319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.683788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717440+0000","last_change":"2024-09-16T00:58:36.512490+0000","last_active":"2024-09-16T01:00:45.717440+0000","last_peered":"2024-09-16T01:00:45.717440+0000","last_clean":"2024-09-16T01:00:45.717440+0000","last_became_active":"2024-09-16T00:58:36.512167+0000","last_became_peered":"2024-09-16T00:58:36.512167+0000","last_unstale":"2024-09-16T01:00:45.717440+0000","last_undegraded":"2024-09-16T01:00:45.717440+0000","last_fullsized":"2024-09-16T01:00:45.717440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627945+0000","last_change":"2024-09-16T00:58:34.471603+0000","last_active":"2024-09-16T01:00:45.627945+0000","last_peered":"2024-09-16T01:00:45.627945+0000","last_clean":"2024-09-16T01:00:45.627945+0000","last_became_active":"2024-09-16T00:58:34.471241+0000","last_became_peered":"2024-09-16T00:58:34.471241+0000","last_unstale":"2024-09-16T01:00:45.627945+0000","last_undegraded":"2024-09-16T01:00:45.627945+0000","last_fullsized":"2024-09-16T01:00:45.627945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:33.756759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626074+0000","last_change":"2024-09-16T00:58:43.607428+0000","last_active":"2024-09-16T01:00:45.626074+0000","last_peered":"2024-09-16T01:00:45.626074+0000","last_clean":"2024-09-16T01:00:45.626074+0000","last_became_active":"2024-09-16T00:58:43.606990+0000","last_became_peered":"2024-09-16T00:58:43.606990+0000","last_unstale":"2024-09-16T01:00:45.626074+0000","last_undegraded":"2024-09-16T01:00:45.626074+0000","last_fullsized":"2024-09-16T01:00:45.626074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:52.367384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714506+0000","last_change":"2024-09-16T00:58:36.513967+0000","last_active":"2024-09-16T01:00:45.714506+0000","last_peered":"2024-09-16T01:00:45.714506+0000","last_clean":"2024-09-16T01:00:45.714506+0000","last_became_active":"2024-09-16T00:58:36.513610+0000","last_became_peered":"2024-09-16T00:58:36.513610+0000","last_unstale":"2024-09-16T01:00:45.714506+0000","last_undegraded":"2024-09-16T01:00:45.714506+0000","last_fullsized":"2024-09-16T01:00:45.714506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:22.763430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'41","reported_seq":307,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:08.750856+0000","last_change":"2024-09-16T00:58:34.471511+0000","last_active":"2024-09-16T01:01:08.750856+0000","last_peered":"2024-09-16T01:01:08.750856+0000","last_clean":"2024-09-16T01:01:08.750856+0000","last_became_active":"2024-09-16T00:58:34.470597+0000","last_became_peered":"2024-09-16T00:58:34.470597+0000","last_unstale":"2024-09-16T01:01:08.750856+0000","last_undegraded":"2024-09-16T01:01:08.750856+0000","last_fullsized":"2024-09-16T01:01:08.750856+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.782592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68355,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":227,"num_read_kb":181,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623834+0000","last_change":"2024-09-16T00:58:43.612177+0000","last_active":"2024-09-16T01:00:45.623834+0000","last_peered":"2024-09-16T01:00:45.623834+0000","last_clean":"2024-09-16T01:00:45.623834+0000","last_became_active":"2024-09-16T00:58:43.611801+0000","last_became_peered":"2024-09-16T00:58:43.611801+0000","last_unstale":"2024-09-16T01:00:45.623834+0000","last_undegraded":"2024-09-16T01:00:45.623834+0000","last_fullsized":"2024-09-16T01:00:45.623834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.781429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624875+0000","last_change":"2024-09-16T00:58:36.502231+0000","last_active":"2024-09-16T01:00:45.624875+0000","last_peered":"2024-09-16T01:00:45.624875+0000","last_clean":"2024-09-16T01:00:45.624875+0000","last_became_active":"2024-09-16T00:58:36.501934+0000","last_became_peered":"2024-09-16T00:58:36.501934+0000","last_unstale":"2024-09-16T01:00:45.624875+0000","last_undegraded":"2024-09-16T01:00:45.624875+0000","last_fullsized":"2024-09-16T01:00:45.624875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:29.769186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626236+0000","last_change":"2024-09-16T00:58:34.829872+0000","last_active":"2024-09-16T01:00:45.626236+0000","last_peered":"2024-09-16T01:00:45.626236+0000","last_clean":"2024-09-16T01:00:45.626236+0000","last_became_active":"2024-09-16T00:58:34.829496+0000","last_became_peered":"2024-09-16T00:58:34.829496+0000","last_unstale":"2024-09-16T01:00:45.626236+0000","last_undegraded":"2024-09-16T01:00:45.626236+0000","last_fullsized":"2024-09-16T01:00:45.626236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:47.035177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720036+0000","last_change":"2024-09-16T00:58:43.615560+0000","last_active":"2024-09-16T01:00:45.720036+0000","last_peered":"2024-09-16T01:00:45.720036+0000","last_clean":"2024-09-16T01:00:45.720036+0000","last_became_active":"2024-09-16T00:58:43.615124+0000","last_became_peered":"2024-09-16T00:58:43.615124+0000","last_unstale":"2024-09-16T01:00:45.720036+0000","last_undegraded":"2024-09-16T01:00:45.720036+0000","last_fullsized":"2024-09-16T01:00:45.720036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.455528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627428+0000","last_change":"2024-09-16T00:58:36.514456+0000","last_active":"2024-09-16T01:00:45.627428+0000","last_peered":"2024-09-16T01:00:45.627428+0000","last_clean":"2024-09-16T01:00:45.627428+0000","last_became_active":"2024-09-16T00:58:36.514146+0000","last_became_peered":"2024-09-16T00:58:36.514146+0000","last_unstale":"2024-09-16T01:00:45.627428+0000","last_undegraded":"2024-09-16T01:00:45.627428+0000","last_fullsized":"2024-09-16T01:00:45.627428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:06.760121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919878+0000","last_change":"2024-09-16T00:58:34.471316+0000","last_active":"2024-09-16T01:00:45.919878+0000","last_peered":"2024-09-16T01:00:45.919878+0000","last_clean":"2024-09-16T01:00:45.919878+0000","last_became_active":"2024-09-16T00:58:34.470991+0000","last_became_peered":"2024-09-16T00:58:34.470991+0000","last_unstale":"2024-09-16T01:00:45.919878+0000","last_undegraded":"2024-09-16T01:00:45.919878+0000","last_fullsized":"2024-09-16T01:00:45.919878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:44.492439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623687+0000","last_change":"2024-09-16T00:58:43.617202+0000","last_active":"2024-09-16T01:00:45.623687+0000","last_peered":"2024-09-16T01:00:45.623687+0000","last_clean":"2024-09-16T01:00:45.623687+0000","last_became_active":"2024-09-16T00:58:43.616824+0000","last_became_peered":"2024-09-16T00:58:43.616824+0000","last_unstale":"2024-09-16T01:00:45.623687+0000","last_undegraded":"2024-09-16T01:00:45.623687+0000","last_fullsized":"2024-09-16T01:00:45.623687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:43.035003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625210+0000","last_change":"2024-09-16T00:58:36.512079+0000","last_active":"2024-09-16T01:00:45.625210+0000","last_peered":"2024-09-16T01:00:45.625210+0000","last_clean":"2024-09-16T01:00:45.625210+0000","last_became_active":"2024-09-16T00:58:36.511220+0000","last_became_peered":"2024-09-16T00:58:36.511220+0000","last_unstale":"2024-09-16T01:00:45.625210+0000","last_undegraded":"2024-09-16T01:00:45.625210+0000","last_fullsized":"2024-09-16T01:00:45.625210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:49.798132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'6","reported_seq":261,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:08.750854+0000","last_change":"2024-09-16T00:58:34.470682+0000","last_active":"2024-09-16T01:01:08.750854+0000","last_peered":"2024-09-16T01:01:08.750854+0000","last_clean":"2024-09-16T01:01:08.750854+0000","last_became_active":"2024-09-16T00:58:34.470323+0000","last_became_peered":"2024-09-16T00:58:34.470323+0000","last_unstale":"2024-09-16T01:01:08.750854+0000","last_undegraded":"2024-09-16T01:01:08.750854+0000","last_fullsized":"2024-09-16T01:01:08.750854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.361374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967738+0000","last_change":"2024-09-16T00:58:43.608941+0000","last_active":"2024-09-16T01:00:46.967738+0000","last_peered":"2024-09-16T01:00:46.967738+0000","last_clean":"2024-09-16T01:00:46.967738+0000","last_became_active":"2024-09-16T00:58:43.607406+0000","last_became_peered":"2024-09-16T00:58:43.607406+0000","last_unstale":"2024-09-16T01:00:46.967738+0000","last_undegraded":"2024-09-16T01:00:46.967738+0000","last_fullsized":"2024-09-16T01:00:46.967738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:10.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627074+0000","last_change":"2024-09-16T00:58:43.613902+0000","last_active":"2024-09-16T01:00:45.627074+0000","last_peered":"2024-09-16T01:00:45.627074+0000","last_clean":"2024-09-16T01:00:45.627074+0000","last_became_active":"2024-09-16T00:58:43.613530+0000","last_became_peered":"2024-09-16T00:58:43.613530+0000","last_unstale":"2024-09-16T01:00:45.627074+0000","last_undegraded":"2024-09-16T01:00:45.627074+0000","last_fullsized":"2024-09-16T01:00:45.627074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:34.774810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623790+0000","last_change":"2024-09-16T00:58:36.504745+0000","last_active":"2024-09-16T01:00:45.623790+0000","last_peered":"2024-09-16T01:00:45.623790+0000","last_clean":"2024-09-16T01:00:45.623790+0000","last_became_active":"2024-09-16T00:58:36.504400+0000","last_became_peered":"2024-09-16T00:58:36.504400+0000","last_unstale":"2024-09-16T01:00:45.623790+0000","last_undegraded":"2024-09-16T01:00:45.623790+0000","last_fullsized":"2024-09-16T01:00:45.623790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:34.444019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626135+0000","last_change":"2024-09-16T00:58:34.470285+0000","last_active":"2024-09-16T01:00:45.626135+0000","last_peered":"2024-09-16T01:00:45.626135+0000","last_clean":"2024-09-16T01:00:45.626135+0000","last_became_active":"2024-09-16T00:58:34.469948+0000","last_became_peered":"2024-09-16T00:58:34.469948+0000","last_unstale":"2024-09-16T01:00:45.626135+0000","last_undegraded":"2024-09-16T01:00:45.626135+0000","last_fullsized":"2024-09-16T01:00:45.626135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:28.553863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897172+0000","last_change":"2024-09-16T00:58:43.614818+0000","last_active":"2024-09-16T01:00:45.897172+0000","last_peered":"2024-09-16T01:00:45.897172+0000","last_clean":"2024-09-16T01:00:45.897172+0000","last_became_active":"2024-09-16T00:58:43.614376+0000","last_became_peered":"2024-09-16T00:58:43.614376+0000","last_unstale":"2024-09-16T01:00:45.897172+0000","last_undegraded":"2024-09-16T01:00:45.897172+0000","last_fullsized":"2024-09-16T01:00:45.897172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:41.699930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967770+0000","last_change":"2024-09-16T00:58:36.505127+0000","last_active":"2024-09-16T01:00:46.967770+0000","last_peered":"2024-09-16T01:00:46.967770+0000","last_clean":"2024-09-16T01:00:46.967770+0000","last_became_active":"2024-09-16T00:58:36.504552+0000","last_became_peered":"2024-09-16T00:58:36.504552+0000","last_unstale":"2024-09-16T01:00:46.967770+0000","last_undegraded":"2024-09-16T01:00:46.967770+0000","last_fullsized":"2024-09-16T01:00:46.967770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:48.104109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717213+0000","last_change":"2024-09-16T00:58:34.462231+0000","last_active":"2024-09-16T01:00:45.717213+0000","last_peered":"2024-09-16T01:00:45.717213+0000","last_clean":"2024-09-16T01:00:45.717213+0000","last_became_active":"2024-09-16T00:58:34.461891+0000","last_became_peered":"2024-09-16T00:58:34.461891+0000","last_unstale":"2024-09-16T01:00:45.717213+0000","last_undegraded":"2024-09-16T01:00:45.717213+0000","last_fullsized":"2024-09-16T01:00:45.717213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.483996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711498+0000","last_change":"2024-09-16T00:58:34.472457+0000","last_active":"2024-09-16T01:00:45.711498+0000","last_peered":"2024-09-16T01:00:45.711498+0000","last_clean":"2024-09-16T01:00:45.711498+0000","last_became_active":"2024-09-16T00:58:34.472084+0000","last_became_peered":"2024-09-16T00:58:34.472084+0000","last_unstale":"2024-09-16T01:00:45.711498+0000","last_undegraded":"2024-09-16T01:00:45.711498+0000","last_fullsized":"2024-09-16T01:00:45.711498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:08.005195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626072+0000","last_change":"2024-09-16T00:58:36.508791+0000","last_active":"2024-09-16T01:00:45.626072+0000","last_peered":"2024-09-16T01:00:45.626072+0000","last_clean":"2024-09-16T01:00:45.626072+0000","last_became_active":"2024-09-16T00:58:36.508461+0000","last_became_peered":"2024-09-16T00:58:36.508461+0000","last_unstale":"2024-09-16T01:00:45.626072+0000","last_undegraded":"2024-09-16T01:00:45.626072+0000","last_fullsized":"2024-09-16T01:00:45.626072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.938067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627838+0000","last_change":"2024-09-16T00:58:43.620439+0000","last_active":"2024-09-16T01:00:45.627838+0000","last_peered":"2024-09-16T01:00:45.627838+0000","last_clean":"2024-09-16T01:00:45.627838+0000","last_became_active":"2024-09-16T00:58:43.619952+0000","last_became_peered":"2024-09-16T00:58:43.619952+0000","last_unstale":"2024-09-16T01:00:45.627838+0000","last_undegraded":"2024-09-16T01:00:45.627838+0000","last_fullsized":"2024-09-16T01:00:45.627838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:10.755023+0000","last_change":"2024-09-16T00:58:34.473169+0000","last_active":"2024-09-16T01:01:10.755023+0000","last_peered":"2024-09-16T01:01:10.755023+0000","last_clean":"2024-09-16T01:01:10.755023+0000","last_became_active":"2024-09-16T00:58:34.472839+0000","last_became_peered":"2024-09-16T00:58:34.472839+0000","last_unstale":"2024-09-16T01:01:10.755023+0000","last_undegraded":"2024-09-16T01:01:10.755023+0000","last_fullsized":"2024-09-16T01:01:10.755023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:03.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714165+0000","last_change":"2024-09-16T00:58:36.508719+0000","last_active":"2024-09-16T01:00:45.714165+0000","last_peered":"2024-09-16T01:00:45.714165+0000","last_clean":"2024-09-16T01:00:45.714165+0000","last_became_active":"2024-09-16T00:58:36.508427+0000","last_became_peered":"2024-09-16T00:58:36.508427+0000","last_unstale":"2024-09-16T01:00:45.714165+0000","last_undegraded":"2024-09-16T01:00:45.714165+0000","last_fullsized":"2024-09-16T01:00:45.714165+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:44.134558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627784+0000","last_change":"2024-09-16T00:58:43.616532+0000","last_active":"2024-09-16T01:00:45.627784+0000","last_peered":"2024-09-16T01:00:45.627784+0000","last_clean":"2024-09-16T01:00:45.627784+0000","last_became_active":"2024-09-16T00:58:43.616146+0000","last_became_peered":"2024-09-16T00:58:43.616146+0000","last_unstale":"2024-09-16T01:00:45.627784+0000","last_undegraded":"2024-09-16T01:00:45.627784+0000","last_fullsized":"2024-09-16T01:00:45.627784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:50.904766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897283+0000","last_change":"2024-09-16T00:58:36.513232+0000","last_active":"2024-09-16T01:00:45.897283+0000","last_peered":"2024-09-16T01:00:45.897283+0000","last_clean":"2024-09-16T01:00:45.897283+0000","last_became_active":"2024-09-16T00:58:36.512239+0000","last_became_peered":"2024-09-16T00:58:36.512239+0000","last_unstale":"2024-09-16T01:00:45.897283+0000","last_undegraded":"2024-09-16T01:00:45.897283+0000","last_fullsized":"2024-09-16T01:00:45.897283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627619+0000","last_change":"2024-09-16T00:58:36.513160+0000","last_active":"2024-09-16T01:00:45.627619+0000","last_peered":"2024-09-16T01:00:45.627619+0000","last_clean":"2024-09-16T01:00:45.627619+0000","last_became_active":"2024-09-16T00:58:36.512523+0000","last_became_peered":"2024-09-16T00:58:36.512523+0000","last_unstale":"2024-09-16T01:00:45.627619+0000","last_undegraded":"2024-09-16T01:00:45.627619+0000","last_fullsized":"2024-09-16T01:00:45.627619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:20.934937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627648+0000","last_change":"2024-09-16T00:58:36.516416+0000","last_active":"2024-09-16T01:00:45.627648+0000","last_peered":"2024-09-16T01:00:45.627648+0000","last_clean":"2024-09-16T01:00:45.627648+0000","last_became_active":"2024-09-16T00:58:36.516121+0000","last_became_peered":"2024-09-16T00:58:36.516121+0000","last_unstale":"2024-09-16T01:00:45.627648+0000","last_undegraded":"2024-09-16T01:00:45.627648+0000","last_fullsized":"2024-09-16T01:00:45.627648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:28.848616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627011+0000","last_change":"2024-09-16T00:58:36.510854+0000","last_active":"2024-09-16T01:00:45.627011+0000","last_peered":"2024-09-16T01:00:45.627011+0000","last_clean":"2024-09-16T01:00:45.627011+0000","last_became_active":"2024-09-16T00:58:36.510505+0000","last_became_peered":"2024-09-16T00:58:36.510505+0000","last_unstale":"2024-09-16T01:00:45.627011+0000","last_undegraded":"2024-09-16T01:00:45.627011+0000","last_fullsized":"2024-09-16T01:00:45.627011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.699942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.509016+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.508690+0000","last_became_peered":"2024-09-16T00:58:36.508690+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:41.425016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897266+0000","last_change":"2024-09-16T00:58:36.511659+0000","last_active":"2024-09-16T01:00:45.897266+0000","last_peered":"2024-09-16T01:00:45.897266+0000","last_clean":"2024-09-16T01:00:45.897266+0000","last_became_active":"2024-09-16T00:58:36.511225+0000","last_became_peered":"2024-09-16T00:58:36.511225+0000","last_unstale":"2024-09-16T01:00:45.897266+0000","last_undegraded":"2024-09-16T01:00:45.897266+0000","last_fullsized":"2024-09-16T01:00:45.897266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:43.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628196+0000","last_change":"2024-09-16T00:58:36.511614+0000","last_active":"2024-09-16T01:00:45.628196+0000","last_peered":"2024-09-16T01:00:45.628196+0000","last_clean":"2024-09-16T01:00:45.628196+0000","last_became_active":"2024-09-16T00:58:36.511304+0000","last_became_peered":"2024-09-16T00:58:36.511304+0000","last_unstale":"2024-09-16T01:00:45.628196+0000","last_undegraded":"2024-09-16T01:00:45.628196+0000","last_fullsized":"2024-09-16T01:00:45.628196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:20.755419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968311+0000","last_change":"2024-09-16T00:58:36.509399+0000","last_active":"2024-09-16T01:00:46.968311+0000","last_peered":"2024-09-16T01:00:46.968311+0000","last_clean":"2024-09-16T01:00:46.968311+0000","last_became_active":"2024-09-16T00:58:36.509072+0000","last_became_peered":"2024-09-16T00:58:36.509072+0000","last_unstale":"2024-09-16T01:00:46.968311+0000","last_undegraded":"2024-09-16T01:00:46.968311+0000","last_fullsized":"2024-09-16T01:00:46.968311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:29.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625679+0000","last_change":"2024-09-16T00:58:36.506252+0000","last_active":"2024-09-16T01:00:45.625679+0000","last_peered":"2024-09-16T01:00:45.625679+0000","last_clean":"2024-09-16T01:00:45.625679+0000","last_became_active":"2024-09-16T00:58:36.505923+0000","last_became_peered":"2024-09-16T00:58:36.505923+0000","last_unstale":"2024-09-16T01:00:45.625679+0000","last_undegraded":"2024-09-16T01:00:45.625679+0000","last_fullsized":"2024-09-16T01:00:45.625679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:05.332472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967824+0000","last_change":"2024-09-16T00:58:36.506598+0000","last_active":"2024-09-16T01:00:46.967824+0000","last_peered":"2024-09-16T01:00:46.967824+0000","last_clean":"2024-09-16T01:00:46.967824+0000","last_became_active":"2024-09-16T00:58:36.506299+0000","last_became_peered":"2024-09-16T00:58:36.506299+0000","last_unstale":"2024-09-16T01:00:46.967824+0000","last_undegraded":"2024-09-16T01:00:46.967824+0000","last_fullsized":"2024-09-16T01:00:46.967824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.327225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624647+0000","last_change":"2024-09-16T00:58:36.517050+0000","last_active":"2024-09-16T01:00:45.624647+0000","last_peered":"2024-09-16T01:00:45.624647+0000","last_clean":"2024-09-16T01:00:45.624647+0000","last_became_active":"2024-09-16T00:58:36.516745+0000","last_became_peered":"2024-09-16T00:58:36.516745+0000","last_unstale":"2024-09-16T01:00:45.624647+0000","last_undegraded":"2024-09-16T01:00:45.624647+0000","last_fullsized":"2024-09-16T01:00:45.624647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:59.981792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717660+0000","last_change":"2024-09-16T00:58:36.512442+0000","last_active":"2024-09-16T01:00:45.717660+0000","last_peered":"2024-09-16T01:00:45.717660+0000","last_clean":"2024-09-16T01:00:45.717660+0000","last_became_active":"2024-09-16T00:58:36.512132+0000","last_became_peered":"2024-09-16T00:58:36.512132+0000","last_unstale":"2024-09-16T01:00:45.717660+0000","last_undegraded":"2024-09-16T01:00:45.717660+0000","last_fullsized":"2024-09-16T01:00:45.717660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:06.511257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897210+0000","last_change":"2024-09-16T00:58:36.519754+0000","last_active":"2024-09-16T01:00:45.897210+0000","last_peered":"2024-09-16T01:00:45.897210+0000","last_clean":"2024-09-16T01:00:45.897210+0000","last_became_active":"2024-09-16T00:58:36.519378+0000","last_became_peered":"2024-09-16T00:58:36.519378+0000","last_unstale":"2024-09-16T01:00:45.897210+0000","last_undegraded":"2024-09-16T01:00:45.897210+0000","last_fullsized":"2024-09-16T01:00:45.897210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:51.076588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628046+0000","last_change":"2024-09-16T00:58:36.504627+0000","last_active":"2024-09-16T01:00:45.628046+0000","last_peered":"2024-09-16T01:00:45.628046+0000","last_clean":"2024-09-16T01:00:45.628046+0000","last_became_active":"2024-09-16T00:58:36.504282+0000","last_became_peered":"2024-09-16T00:58:36.504282+0000","last_unstale":"2024-09-16T01:00:45.628046+0000","last_undegraded":"2024-09-16T01:00:45.628046+0000","last_fullsized":"2024-09-16T01:00:45.628046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.857181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624140+0000","last_change":"2024-09-16T00:58:36.508971+0000","last_active":"2024-09-16T01:00:45.624140+0000","last_peered":"2024-09-16T01:00:45.624140+0000","last_clean":"2024-09-16T01:00:45.624140+0000","last_became_active":"2024-09-16T00:58:36.508631+0000","last_became_peered":"2024-09-16T00:58:36.508631+0000","last_unstale":"2024-09-16T01:00:45.624140+0000","last_undegraded":"2024-09-16T01:00:45.624140+0000","last_fullsized":"2024-09-16T01:00:45.624140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:17.092613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897604+0000","last_change":"2024-09-16T00:58:36.517255+0000","last_active":"2024-09-16T01:00:45.897604+0000","last_peered":"2024-09-16T01:00:45.897604+0000","last_clean":"2024-09-16T01:00:45.897604+0000","last_became_active":"2024-09-16T00:58:36.516957+0000","last_became_peered":"2024-09-16T00:58:36.516957+0000","last_unstale":"2024-09-16T01:00:45.897604+0000","last_undegraded":"2024-09-16T01:00:45.897604+0000","last_fullsized":"2024-09-16T01:00:45.897604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:34.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624283+0000","last_change":"2024-09-16T00:58:36.516429+0000","last_active":"2024-09-16T01:00:45.624283+0000","last_peered":"2024-09-16T01:00:45.624283+0000","last_clean":"2024-09-16T01:00:45.624283+0000","last_became_active":"2024-09-16T00:58:36.516111+0000","last_became_peered":"2024-09-16T00:58:36.516111+0000","last_unstale":"2024-09-16T01:00:45.624283+0000","last_undegraded":"2024-09-16T01:00:45.624283+0000","last_fullsized":"2024-09-16T01:00:45.624283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:06.120653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626784+0000","last_change":"2024-09-16T00:58:36.512873+0000","last_active":"2024-09-16T01:00:45.626784+0000","last_peered":"2024-09-16T01:00:45.626784+0000","last_clean":"2024-09-16T01:00:45.626784+0000","last_became_active":"2024-09-16T00:58:36.511761+0000","last_became_peered":"2024-09-16T00:58:36.511761+0000","last_unstale":"2024-09-16T01:00:45.626784+0000","last_undegraded":"2024-09-16T01:00:45.626784+0000","last_fullsized":"2024-09-16T01:00:45.626784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:51.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626810+0000","last_change":"2024-09-16T00:58:36.511585+0000","last_active":"2024-09-16T01:00:45.626810+0000","last_peered":"2024-09-16T01:00:45.626810+0000","last_clean":"2024-09-16T01:00:45.626810+0000","last_became_active":"2024-09-16T00:58:36.510479+0000","last_became_peered":"2024-09-16T00:58:36.510479+0000","last_unstale":"2024-09-16T01:00:45.626810+0000","last_undegraded":"2024-09-16T01:00:45.626810+0000","last_fullsized":"2024-09-16T01:00:45.626810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:58.017132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717650+0000","last_change":"2024-09-16T00:58:36.508263+0000","last_active":"2024-09-16T01:00:45.717650+0000","last_peered":"2024-09-16T01:00:45.717650+0000","last_clean":"2024-09-16T01:00:45.717650+0000","last_became_active":"2024-09-16T00:58:36.507979+0000","last_became_peered":"2024-09-16T00:58:36.507979+0000","last_unstale":"2024-09-16T01:00:45.717650+0000","last_undegraded":"2024-09-16T01:00:45.717650+0000","last_fullsized":"2024-09-16T01:00:45.717650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:07.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720241+0000","last_change":"2024-09-16T00:58:36.514981+0000","last_active":"2024-09-16T01:00:45.720241+0000","last_peered":"2024-09-16T01:00:45.720241+0000","last_clean":"2024-09-16T01:00:45.720241+0000","last_became_active":"2024-09-16T00:58:36.510433+0000","last_became_peered":"2024-09-16T00:58:36.510433+0000","last_unstale":"2024-09-16T01:00:45.720241+0000","last_undegraded":"2024-09-16T01:00:45.720241+0000","last_fullsized":"2024-09-16T01:00:45.720241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:10.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919996+0000","last_change":"2024-09-16T00:58:36.521336+0000","last_active":"2024-09-16T01:00:45.919996+0000","last_peered":"2024-09-16T01:00:45.919996+0000","last_clean":"2024-09-16T01:00:45.919996+0000","last_became_active":"2024-09-16T00:58:36.521026+0000","last_became_peered":"2024-09-16T00:58:36.521026+0000","last_unstale":"2024-09-16T01:00:45.919996+0000","last_undegraded":"2024-09-16T01:00:45.919996+0000","last_fullsized":"2024-09-16T01:00:45.919996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:29.409024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711912+0000","last_change":"2024-09-16T00:58:36.518724+0000","last_active":"2024-09-16T01:00:45.711912+0000","last_peered":"2024-09-16T01:00:45.711912+0000","last_clean":"2024-09-16T01:00:45.711912+0000","last_became_active":"2024-09-16T00:58:36.518428+0000","last_became_peered":"2024-09-16T00:58:36.518428+0000","last_unstale":"2024-09-16T01:00:45.711912+0000","last_undegraded":"2024-09-16T01:00:45.711912+0000","last_fullsized":"2024-09-16T01:00:45.711912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:06.486299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625258+0000","last_change":"2024-09-16T00:58:36.514347+0000","last_active":"2024-09-16T01:00:45.625258+0000","last_peered":"2024-09-16T01:00:45.625258+0000","last_clean":"2024-09-16T01:00:45.625258+0000","last_became_active":"2024-09-16T00:58:36.512243+0000","last_became_peered":"2024-09-16T00:58:36.512243+0000","last_unstale":"2024-09-16T01:00:45.625258+0000","last_undegraded":"2024-09-16T01:00:45.625258+0000","last_fullsized":"2024-09-16T01:00:45.625258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.289541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623615+0000","last_change":"2024-09-16T00:59:44.837828+0000","last_active":"2024-09-16T01:00:45.623615+0000","last_peered":"2024-09-16T01:00:45.623615+0000","last_clean":"2024-09-16T01:00:45.623615+0000","last_became_active":"2024-09-16T00:59:44.837486+0000","last_became_peered":"2024-09-16T00:59:44.837486+0000","last_unstale":"2024-09-16T01:00:45.623615+0000","last_undegraded":"2024-09-16T01:00:45.623615+0000","last_fullsized":"2024-09-16T01:00:45.623615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:46.914056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919570+0000","last_change":"2024-09-16T00:58:36.516797+0000","last_active":"2024-09-16T01:00:45.919570+0000","last_peered":"2024-09-16T01:00:45.919570+0000","last_clean":"2024-09-16T01:00:45.919570+0000","last_became_active":"2024-09-16T00:58:36.516480+0000","last_became_peered":"2024-09-16T00:58:36.516480+0000","last_unstale":"2024-09-16T01:00:45.919570+0000","last_undegraded":"2024-09-16T01:00:45.919570+0000","last_fullsized":"2024-09-16T01:00:45.919570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:55.262528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711421+0000","last_change":"2024-09-16T00:58:36.517973+0000","last_active":"2024-09-16T01:00:45.711421+0000","last_peered":"2024-09-16T01:00:45.711421+0000","last_clean":"2024-09-16T01:00:45.711421+0000","last_became_active":"2024-09-16T00:58:36.517634+0000","last_became_peered":"2024-09-16T00:58:36.517634+0000","last_unstale":"2024-09-16T01:00:45.711421+0000","last_undegraded":"2024-09-16T01:00:45.711421+0000","last_fullsized":"2024-09-16T01:00:45.711421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:19.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714158+0000","last_change":"2024-09-16T00:58:36.507643+0000","last_active":"2024-09-16T01:00:45.714158+0000","last_peered":"2024-09-16T01:00:45.714158+0000","last_clean":"2024-09-16T01:00:45.714158+0000","last_became_active":"2024-09-16T00:58:36.507263+0000","last_became_peered":"2024-09-16T00:58:36.507263+0000","last_unstale":"2024-09-16T01:00:45.714158+0000","last_undegraded":"2024-09-16T01:00:45.714158+0000","last_fullsized":"2024-09-16T01:00:45.714158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:24.317490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720025+0000","last_change":"2024-09-16T00:58:36.508798+0000","last_active":"2024-09-16T01:00:45.720025+0000","last_peered":"2024-09-16T01:00:45.720025+0000","last_clean":"2024-09-16T01:00:45.720025+0000","last_became_active":"2024-09-16T00:58:36.508490+0000","last_became_peered":"2024-09-16T00:58:36.508490+0000","last_unstale":"2024-09-16T01:00:45.720025+0000","last_undegraded":"2024-09-16T01:00:45.720025+0000","last_fullsized":"2024-09-16T01:00:45.720025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:44.282270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627327+0000","last_change":"2024-09-16T00:58:36.519065+0000","last_active":"2024-09-16T01:00:45.627327+0000","last_peered":"2024-09-16T01:00:45.627327+0000","last_clean":"2024-09-16T01:00:45.627327+0000","last_became_active":"2024-09-16T00:58:36.518708+0000","last_became_peered":"2024-09-16T00:58:36.518708+0000","last_unstale":"2024-09-16T01:00:45.627327+0000","last_undegraded":"2024-09-16T01:00:45.627327+0000","last_fullsized":"2024-09-16T01:00:45.627327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:10.290341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627159+0000","last_change":"2024-09-16T00:58:36.513018+0000","last_active":"2024-09-16T01:00:45.627159+0000","last_peered":"2024-09-16T01:00:45.627159+0000","last_clean":"2024-09-16T01:00:45.627159+0000","last_became_active":"2024-09-16T00:58:36.511730+0000","last_became_peered":"2024-09-16T00:58:36.511730+0000","last_unstale":"2024-09-16T01:00:45.627159+0000","last_undegraded":"2024-09-16T01:00:45.627159+0000","last_fullsized":"2024-09-16T01:00:45.627159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:20.852121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897471+0000","last_change":"2024-09-16T00:58:36.518265+0000","last_active":"2024-09-16T01:00:45.897471+0000","last_peered":"2024-09-16T01:00:45.897471+0000","last_clean":"2024-09-16T01:00:45.897471+0000","last_became_active":"2024-09-16T00:58:36.517906+0000","last_became_peered":"2024-09-16T00:58:36.517906+0000","last_unstale":"2024-09-16T01:00:45.897471+0000","last_undegraded":"2024-09-16T01:00:45.897471+0000","last_fullsized":"2024-09-16T01:00:45.897471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.255849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75619,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1127,"num_read_kb":639,"num_write":262,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":226857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282150,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612653,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":513588,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841584,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1146880,"data_stored":1167917,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005111,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":516772,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":512382,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462977,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":1109160,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626502,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":991232,"data_stored":508180,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855435,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":1104742,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018961,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":512926,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247894,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":507888,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444123,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":578627,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607648,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":577565,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738469,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":510478,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:01:14.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:01:15.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:14 smithi119 ceph-mon[35049]: pgmap v364: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:01:15.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:14 smithi119 ceph-mon[35049]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:15.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:14 smithi119 ceph-mon[35049]: scrub queued for path: / 2024-09-16T01:01:15.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:14 smithi119 ceph-mon[35049]: scrub summary: idle+waiting paths [/] 2024-09-16T01:01:15.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:14 smithi119 ceph-mon[35049]: scrub summary: active paths [/] 2024-09-16T01:01:15.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:14 smithi119 ceph-mon[35049]: scrub summary: idle+waiting paths [/] 2024-09-16T01:01:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.592+0000 7f11656a9640 1 -- 172.21.15.12:0/950856164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1160101de0 msgr2=0x7f11601021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.592+0000 7f11656a9640 1 --2- 172.21.15.12:0/950856164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1160101de0 0x7f11601021c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1150009900 tx=0x7f115002a410 comp rx=0 tx=0).stop 2024-09-16T01:01:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.592+0000 7f11656a9640 1 -- 172.21.15.12:0/950856164 shutdown_connections 2024-09-16T01:01:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.592+0000 7f11656a9640 1 --2- 172.21.15.12:0/950856164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1160106f10 0x7f116010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.592+0000 7f11656a9640 1 --2- 172.21.15.12:0/950856164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1160102790 0x7f11601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.592+0000 7f11656a9640 1 --2- 172.21.15.12:0/950856164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1160101de0 0x7f11601021c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.592+0000 7f11656a9640 1 -- 172.21.15.12:0/950856164 >> 172.21.15.12:0/950856164 conn(0x7f11600fd8c0 msgr2=0x7f11600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.592+0000 7f11656a9640 1 -- 172.21.15.12:0/950856164 shutdown_connections 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.592+0000 7f11656a9640 1 -- 172.21.15.12:0/950856164 wait complete. 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f11656a9640 1 Processor -- start 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f11656a9640 1 -- start start 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f11656a9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1160101de0 0x7f1160198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f11656a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1160102790 0x7f1160198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f11656a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1160106f10 0x7f116019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f11656a9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1160111f70 con 0x7f1160106f10 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f11656a9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1160111df0 con 0x7f1160102790 2024-09-16T01:01:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f11656a9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f11601120f0 con 0x7f1160101de0 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f115f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1160106f10 0x7f116019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f115f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1160106f10 0x7f116019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33210/0 (socket says 172.21.15.12:33210) 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f115f7fe640 1 -- 172.21.15.12:0/2968524090 learned_addr learned my addr 172.21.15.12:0/2968524090 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.593+0000 7f115effd640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1160101de0 0x7f1160198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f115e7fc640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1160102790 0x7f1160198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f115f7fe640 1 -- 172.21.15.12:0/2968524090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1160101de0 msgr2=0x7f1160198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f115f7fe640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1160101de0 0x7f1160198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f115f7fe640 1 -- 172.21.15.12:0/2968524090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1160102790 msgr2=0x7f1160198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f115f7fe640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1160102790 0x7f1160198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f115f7fe640 1 -- 172.21.15.12:0/2968524090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116019d3e0 con 0x7f1160106f10 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f115f7fe640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1160106f10 0x7f116019cd00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f115800eaa0 tx=0x7f115800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f1147fff640 1 -- 172.21.15.12:0/2968524090 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115800cdb0 con 0x7f1160106f10 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f11656a9640 1 -- 172.21.15.12:0/2968524090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116019d6d0 con 0x7f1160106f10 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f1147fff640 1 -- 172.21.15.12:0/2968524090 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1158005020 con 0x7f1160106f10 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f1147fff640 1 -- 172.21.15.12:0/2968524090 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11580116d0 con 0x7f1160106f10 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.594+0000 7f11656a9640 1 -- 172.21.15.12:0/2968524090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11601a4fb0 con 0x7f1160106f10 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.597+0000 7f1147fff640 1 -- 172.21.15.12:0/2968524090 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f11580054d0 con 0x7f1160106f10 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.597+0000 7f1167a82740 1 Processor -- start 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.597+0000 7f1167a82740 1 -- start start 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.597+0000 7f1167a82740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b058880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.597+0000 7f1167a82740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b063140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.597+0000 7f1167a82740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b063680 0x56254b065a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.597+0000 7f1167a82740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56254afbe2e0 con 0x56254b0584a0 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.597+0000 7f1167a82740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56254af65ce0 con 0x56254b058dc0 2024-09-16T01:01:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.597+0000 7f1167a82740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56254afba2a0 con 0x56254b063680 2024-09-16T01:01:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b058880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b058880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33222/0 (socket says 172.21.15.12:33222) 2024-09-16T01:01:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b063140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115e7fc640 1 -- 172.21.15.12:0/2259943395 learned_addr learned my addr 172.21.15.12:0/2259943395 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115e7fc640 1 --2- 172.21.15.12:0/2259943395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b063680 0x56254b065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f1147fff640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11480a3240 0x7f11480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115effd640 1 -- 172.21.15.12:0/2259943395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b063680 msgr2=0x56254b065a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115effd640 1 --2- 172.21.15.12:0/2259943395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b063680 0x56254b065a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115effd640 1 -- 172.21.15.12:0/2259943395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 msgr2=0x56254b058880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115effd640 1 --2- 172.21.15.12:0/2259943395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b058880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115effd640 1 -- 172.21.15.12:0/2259943395 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56254af4a440 con 0x56254b058dc0 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f1147fff640 1 -- 172.21.15.12:0/2968524090 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f11580cfdc0 con 0x7f1160106f10 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115f7fe640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11480a3240 0x7f11480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115effd640 1 --2- 172.21.15.12:0/2259943395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b063140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1150005940 tx=0x7f1150031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=755274511b5cd300 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f115f7fe640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11480a3240 0x7f11480a5700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f115800efd0 tx=0x7f1158000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.598+0000 7f11457fa640 1 -- 172.21.15.12:0/2259943395 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150040070 con 0x56254b058dc0 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f11457fa640 1 -- 172.21.15.12:0/2259943395 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1150005020 con 0x56254b058dc0 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f11457fa640 1 -- 172.21.15.12:0/2259943395 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150035040 con 0x56254b058dc0 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f1167a82740 1 -- 172.21.15.12:0/2259943395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 msgr2=0x56254b063140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f1167a82740 1 --2- 172.21.15.12:0/2259943395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b063140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1150005940 tx=0x7f1150031630 comp rx=0 tx=0).stop 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f1167a82740 1 -- 172.21.15.12:0/2259943395 shutdown_connections 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f1167a82740 1 --2- 172.21.15.12:0/2259943395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b063680 0x56254b065a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f1167a82740 1 --2- 172.21.15.12:0/2259943395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b063140 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f1167a82740 1 --2- 172.21.15.12:0/2259943395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b058880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f1167a82740 1 -- 172.21.15.12:0/2259943395 >> 172.21.15.12:0/2259943395 conn(0x56254b054a30 msgr2=0x56254b054e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f1167a82740 1 -- 172.21.15.12:0/2259943395 shutdown_connections 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.599+0000 7f1167a82740 1 -- 172.21.15.12:0/2259943395 wait complete. 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f1167a82740 1 -- start start 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f1167a82740 1 Processor -- start 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f1167a82740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b0584a0 0x56254b062f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f1167a82740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b058dc0 0x56254b060210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f1167a82740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b063680 0x56254b060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f1167a82740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56254b066250 con 0x56254b063680 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f1167a82740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56254af79050 con 0x56254b0584a0 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f1167a82740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56254b0663d0 con 0x56254b058dc0 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f1167a82740 10 client.0 _ll_register_callbacks cb 0x56254afb9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f115e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b063680 0x56254b060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f115e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b063680 0x56254b060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33228/0 (socket says 172.21.15.12:33228) 2024-09-16T01:01:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f115e7fc640 1 -- 172.21.15.12:0/1690998231 learned_addr learned my addr 172.21.15.12:0/1690998231 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f115effd640 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b058dc0 0x56254b060210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f115e7fc640 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b0584a0 0x56254b062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f115e7fc640 1 -- 172.21.15.12:0/1690998231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b058dc0 msgr2=0x56254b060210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f115e7fc640 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b058dc0 0x56254b060210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f115e7fc640 1 -- 172.21.15.12:0/1690998231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b0584a0 msgr2=0x56254b062f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.600+0000 7f115e7fc640 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b0584a0 0x56254b062f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f115e7fc640 1 -- 172.21.15.12:0/1690998231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56254ad2f3c0 con 0x56254b063680 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f115e7fc640 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b063680 0x56254b060750 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1154012ee0 tx=0x7f115400a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ecc08d30fa8932 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1142ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1142ff5640 1 -- 172.21.15.12:0/1690998231 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11540110d0 con 0x56254b063680 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1167a82740 1 -- 172.21.15.12:0/1690998231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1150005020 con 0x56254b063680 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1142ff5640 1 -- 172.21.15.12:0/1690998231 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f115400f420 con 0x56254b063680 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1142ff5640 1 -- 172.21.15.12:0/1690998231 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1154029050 con 0x56254b063680 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1167a82740 10 client.15396 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1167a82740 1 -- 172.21.15.12:0/1690998231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56254b071bc0 con 0x56254b063680 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1142ff5640 1 -- 172.21.15.12:0/1690998231 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1150005020 con 0x56254b063680 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1142ff5640 1 -- 172.21.15.12:0/1690998231 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f11540234c0 con 0x56254b063680 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1167a82740 10 client.15396 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1167a82740 10 client.15396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.601+0000 7f1167a82740 20 client.15396 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.602+0000 7f1167a82740 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56254b072fd0 0x56254b0753e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.602+0000 7f1167a82740 4 client.15396 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.602+0000 7f1167a82740 1 -- 172.21.15.12:0/1690998231 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56254afcb850 con 0x56254b072fd0 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.602+0000 7f115effd640 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56254b072fd0 0x56254b0753e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.602+0000 7f1142ff5640 10 client.15396 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.602+0000 7f115effd640 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56254b072fd0 0x56254b0753e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=974548d52e4eb4ed server_cookie=9bc13ba9e765a873 in_seq=0 out_seq=0 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1142ff5640 1 -- 172.21.15.12:0/1690998231 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56254afcb850 con 0x56254b072fd0 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1142ff5640 10 client.15396 handle_command_reply: tid=0 2024-09-16T01:01:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 client.15396 shutdown 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 -- 172.21.15.12:0/1690998231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b063680 msgr2=0x56254b060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b063680 0x56254b060750 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1154012ee0 tx=0x7f115400a2d0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 -- 172.21.15.12:0/1690998231 shutdown_connections 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56254b072fd0 0x56254b0753e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b063680 0x56254b060750 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b058dc0 0x56254b060210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1142ff5640 0 client.15396 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 --2- 172.21.15.12:0/1690998231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b0584a0 0x56254b062f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 -- 172.21.15.12:0/1690998231 >> 172.21.15.12:0/1690998231 conn(0x56254b054a30 msgr2=0x56254b053b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 -- 172.21.15.12:0/1690998231 shutdown_connections 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 1 -- 172.21.15.12:0/1690998231 wait complete. 2024-09-16T01:01:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.603+0000 7f1167a82740 20 client.15396 trim_cache size 0 max 16384 2024-09-16T01:01:15.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.623+0000 7f1167a82740 1 Processor -- start 2024-09-16T01:01:15.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.623+0000 7f1167a82740 1 -- start start 2024-09-16T01:01:15.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.623+0000 7f1167a82740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b062180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.623+0000 7f1167a82740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b07acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.623+0000 7f1167a82740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b063680 0x56254b07b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.623+0000 7f1167a82740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f11601aec10 con 0x56254b0584a0 2024-09-16T01:01:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.623+0000 7f1167a82740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f11601b0750 con 0x56254b058dc0 2024-09-16T01:01:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.623+0000 7f1167a82740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f11601af2e0 con 0x56254b063680 2024-09-16T01:01:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.623+0000 7f115e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f115effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b07acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f115effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b07acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:54364/0 (socket says 172.21.15.12:54364) 2024-09-16T01:01:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f115effd640 1 -- 172.21.15.12:0/3505454149 learned_addr learned my addr 172.21.15.12:0/3505454149 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f115e7fc640 1 --2- 172.21.15.12:0/3505454149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b063680 0x56254b07b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f115effd640 1 -- 172.21.15.12:0/3505454149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b063680 msgr2=0x56254b07b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f115effd640 1 --2- 172.21.15.12:0/3505454149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b063680 0x56254b07b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f115effd640 1 -- 172.21.15.12:0/3505454149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 msgr2=0x56254b062180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f115effd640 1 --2- 172.21.15.12:0/3505454149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b062180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f115effd640 1 -- 172.21.15.12:0/3505454149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56254b058bf0 con 0x56254b058dc0 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f115effd640 1 --2- 172.21.15.12:0/3505454149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b07acb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1150031b20 tx=0x7f115002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd1c22fe100d283d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f1144ff9640 1 -- 172.21.15.12:0/3505454149 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150040040 con 0x56254b058dc0 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f1144ff9640 1 -- 172.21.15.12:0/3505454149 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11500035f0 con 0x56254b058dc0 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.624+0000 7f1144ff9640 1 -- 172.21.15.12:0/3505454149 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150035040 con 0x56254b058dc0 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.625+0000 7f1167a82740 1 -- 172.21.15.12:0/3505454149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 msgr2=0x56254b07acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.625+0000 7f1167a82740 1 --2- 172.21.15.12:0/3505454149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b07acb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1150031b20 tx=0x7f115002a410 comp rx=0 tx=0).stop 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.625+0000 7f1167a82740 1 -- 172.21.15.12:0/3505454149 shutdown_connections 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.625+0000 7f1167a82740 1 --2- 172.21.15.12:0/3505454149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b063680 0x56254b07b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.625+0000 7f1167a82740 1 --2- 172.21.15.12:0/3505454149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b058dc0 0x56254b07acb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.625+0000 7f1167a82740 1 --2- 172.21.15.12:0/3505454149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b062180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.625+0000 7f1167a82740 1 -- 172.21.15.12:0/3505454149 >> 172.21.15.12:0/3505454149 conn(0x56254b054a30 msgr2=0x56254b061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.625+0000 7f1167a82740 1 -- 172.21.15.12:0/3505454149 shutdown_connections 2024-09-16T01:01:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.625+0000 7f1167a82740 1 -- 172.21.15.12:0/3505454149 wait complete. 2024-09-16T01:01:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.626+0000 7f1167a82740 1 -- start start 2024-09-16T01:01:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.626+0000 7f1167a82740 1 Processor -- start 2024-09-16T01:01:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.626+0000 7f1167a82740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f1167a82740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b058dc0 0x56254b068f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f1167a82740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b063680 0x56254b0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f115e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f115e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b06bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33238/0 (socket says 172.21.15.12:33238) 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f1167a82740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f11601b0080 con 0x56254b0584a0 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f115e7fc640 1 -- 172.21.15.12:0/919649249 learned_addr learned my addr 172.21.15.12:0/919649249 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f1167a82740 1 -- 172.21.15.12:0/919649249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f11601af9b0 con 0x56254b063680 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f1167a82740 1 -- 172.21.15.12:0/919649249 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f11601acbf0 con 0x56254b058dc0 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f115effd640 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b058dc0 0x56254b068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f1167a82740 10 client.0 _ll_register_callbacks cb 0x7f1154012b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f115e7fc640 1 -- 172.21.15.12:0/919649249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b058dc0 msgr2=0x56254b068f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f115e7fc640 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b058dc0 0x56254b068f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f115e7fc640 1 -- 172.21.15.12:0/919649249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b063680 msgr2=0x56254b0694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f115e7fc640 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b063680 0x56254b0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.627+0000 7f115e7fc640 1 -- 172.21.15.12:0/919649249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56254b069ba0 con 0x56254b0584a0 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.628+0000 7f115e7fc640 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b06bc20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f11540239e0 tx=0x7f1154012ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a48a13e03a88c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.628+0000 7f1142ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.628+0000 7f1142ff5640 1 -- 172.21.15.12:0/919649249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154023c70 con 0x56254b0584a0 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.628+0000 7f1167a82740 1 -- 172.21.15.12:0/919649249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11500035f0 con 0x56254b0584a0 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.628+0000 7f1142ff5640 1 -- 172.21.15.12:0/919649249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f1154004020 con 0x56254b0584a0 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.628+0000 7f1142ff5640 1 -- 172.21.15.12:0/919649249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1154038050 con 0x56254b0584a0 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.628+0000 7f1167a82740 10 client.15402 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.628+0000 7f1167a82740 1 -- 172.21.15.12:0/919649249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56254b0ddb20 con 0x56254b0584a0 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.628+0000 7f1142ff5640 1 -- 172.21.15.12:0/919649249 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11500035f0 con 0x56254b0584a0 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.629+0000 7f1142ff5640 1 -- 172.21.15.12:0/919649249 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1154023140 con 0x56254b0584a0 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.629+0000 7f1167a82740 10 client.15402 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.629+0000 7f1167a82740 10 client.15402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.629+0000 7f1167a82740 20 client.15402 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.629+0000 7f1167a82740 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56254b0de120 0x56254b0e0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.629+0000 7f1167a82740 4 client.15402 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:01:15.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.629+0000 7f1167a82740 1 -- 172.21.15.12:0/919649249 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56254b060ae0 con 0x56254b0de120 2024-09-16T01:01:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.629+0000 7f115effd640 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56254b0de120 0x56254b0e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f115effd640 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56254b0de120 0x56254b0e0530 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f542c3228f2add2f server_cookie=8ef9fb90c0000778 in_seq=0 out_seq=0 2024-09-16T01:01:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1142ff5640 10 client.15402 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1142ff5640 1 -- 172.21.15.12:0/919649249 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56254b060ae0 con 0x56254b0de120 2024-09-16T01:01:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1142ff5640 10 client.15402 handle_command_reply: tid=0 2024-09-16T01:01:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 client.15402 shutdown 2024-09-16T01:01:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 -- 172.21.15.12:0/919649249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 msgr2=0x56254b06bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b06bc20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f11540239e0 tx=0x7f1154012ab0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 -- 172.21.15.12:0/919649249 shutdown_connections 2024-09-16T01:01:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x56254b0de120 0x56254b0e0530 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56254b063680 0x56254b0694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56254b058dc0 0x56254b068f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 --2- 172.21.15.12:0/919649249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56254b0584a0 0x56254b06bc20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 -- 172.21.15.12:0/919649249 >> 172.21.15.12:0/919649249 conn(0x56254b054a30 msgr2=0x56254b062290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1142ff5640 0 client.15402 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 -- 172.21.15.12:0/919649249 shutdown_connections 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.630+0000 7f1167a82740 1 -- 172.21.15.12:0/919649249 wait complete. 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f1167a82740 20 client.15402 trim_cache size 0 max 16384 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: "ef8c7ea6-ee3b-4167-8541-ee6b67676af6": { 2024-09-16T01:01:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-16T01:01:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "ef8c7ea6-ee3b-4167-8541-ee6b67676af6", 2024-09-16T01:01:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-16T01:01:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:01:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:01:15.636 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:01:15.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f11656a9640 1 -- 172.21.15.12:0/2968524090 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11480a3240 msgr2=0x7f11480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f11656a9640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11480a3240 0x7f11480a5700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f115800efd0 tx=0x7f1158000f40 comp rx=0 tx=0).stop 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f11656a9640 1 -- 172.21.15.12:0/2968524090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1160106f10 msgr2=0x7f116019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f11656a9640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1160106f10 0x7f116019cd00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f115800eaa0 tx=0x7f115800ef60 comp rx=0 tx=0).stop 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f11656a9640 1 -- 172.21.15.12:0/2968524090 shutdown_connections 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f11656a9640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f11480a3240 0x7f11480a5700 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f11656a9640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1160106f10 0x7f116019cd00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f11656a9640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1160102790 0x7f1160198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f11656a9640 1 --2- 172.21.15.12:0/2968524090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1160101de0 0x7f1160198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.631+0000 7f11656a9640 1 -- 172.21.15.12:0/2968524090 >> 172.21.15.12:0/2968524090 conn(0x7f11600fd8c0 msgr2=0x7f11600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.632+0000 7f11656a9640 1 -- 172.21.15.12:0/2968524090 shutdown_connections 2024-09-16T01:01:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:15.632+0000 7f11656a9640 1 -- 172.21.15.12:0/2968524090 wait complete. 2024-09-16T01:01:16.379 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:16.387 INFO:tasks.cephfs.filesystem:scrub status for tag:ef8c7ea6-ee3b-4167-8541-ee6b67676af6 - {'path': '/', 'tag': 'ef8c7ea6-ee3b-4167-8541-ee6b67676af6', 'options': 'recursive,force'} 2024-09-16T01:01:16.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:16 smithi012 ceph-mon[31197]: pgmap v365: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-16T01:01:16.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:16 smithi098 ceph-mon[35346]: pgmap v365: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-16T01:01:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.958+0000 7f8c88f51640 1 -- 172.21.15.12:0/1876847291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c84102d40 msgr2=0x7f8c84103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.958+0000 7f8c88f51640 1 --2- 172.21.15.12:0/1876847291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c84102d40 0x7f8c84103120 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009900 tx=0x7f8c7402a480 comp rx=0 tx=0).stop 2024-09-16T01:01:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.958+0000 7f8c88f51640 1 -- 172.21.15.12:0/1876847291 shutdown_connections 2024-09-16T01:01:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.958+0000 7f8c88f51640 1 --2- 172.21.15.12:0/1876847291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c8410c170 0x7f8c8410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.958+0000 7f8c88f51640 1 --2- 172.21.15.12:0/1876847291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c84103660 0x7f8c8410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.958+0000 7f8c88f51640 1 --2- 172.21.15.12:0/1876847291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c84102d40 0x7f8c84103120 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.958+0000 7f8c88f51640 1 -- 172.21.15.12:0/1876847291 >> 172.21.15.12:0/1876847291 conn(0x7f8c840fc7a0 msgr2=0x7f8c840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.958+0000 7f8c88f51640 1 -- 172.21.15.12:0/1876847291 shutdown_connections 2024-09-16T01:01:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.958+0000 7f8c88f51640 1 -- 172.21.15.12:0/1876847291 wait complete. 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.959+0000 7f8c88f51640 1 Processor -- start 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.959+0000 7f8c88f51640 1 -- start start 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.959+0000 7f8c88f51640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c84102d40 0x7f8c841009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.959+0000 7f8c88f51640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c84103660 0x7f8c84100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.959+0000 7f8c88f51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8410c170 0x7f8c84101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.959+0000 7f8c88f51640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84111f70 con 0x7f8c8410c170 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.959+0000 7f8c88f51640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84111df0 con 0x7f8c84102d40 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.959+0000 7f8c88f51640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841120f0 con 0x7f8c84103660 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c82d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8410c170 0x7f8c84101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c82d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8410c170 0x7f8c84101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57206/0 (socket says 172.21.15.12:57206) 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c82d9d640 1 -- 172.21.15.12:0/3206833799 learned_addr learned my addr 172.21.15.12:0/3206833799 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c8259c640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c84102d40 0x7f8c841009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c81d9b640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c84103660 0x7f8c84100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c82d9d640 1 -- 172.21.15.12:0/3206833799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c84103660 msgr2=0x7f8c84100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c82d9d640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c84103660 0x7f8c84100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c82d9d640 1 -- 172.21.15.12:0/3206833799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c84102d40 msgr2=0x7f8c841009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c82d9d640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c84102d40 0x7f8c841009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c82d9d640 1 -- 172.21.15.12:0/3206833799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c841a6910 con 0x7f8c8410c170 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c81d9b640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c84103660 0x7f8c84100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c8259c640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c84102d40 0x7f8c841009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c82d9d640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8410c170 0x7f8c84101420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00eaa0 tx=0x7f8c7c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c737fe640 1 -- 172.21.15.12:0/3206833799 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00cdb0 con 0x7f8c8410c170 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c737fe640 1 -- 172.21.15.12:0/3206833799 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c7c005020 con 0x7f8c8410c170 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c737fe640 1 -- 172.21.15.12:0/3206833799 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0116b0 con 0x7f8c8410c170 2024-09-16T01:01:16.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.960+0000 7f8c88f51640 1 -- 172.21.15.12:0/3206833799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c841a6c00 con 0x7f8c8410c170 2024-09-16T01:01:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.961+0000 7f8c88f51640 1 -- 172.21.15.12:0/3206833799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c841a70f0 con 0x7f8c8410c170 2024-09-16T01:01:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.962+0000 7f8c88f51640 1 -- 172.21.15.12:0/3206833799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c84103120 con 0x7f8c8410c170 2024-09-16T01:01:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.963+0000 7f8c737fe640 1 -- 172.21.15.12:0/3206833799 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8c7c005560 con 0x7f8c8410c170 2024-09-16T01:01:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.963+0000 7f8c737fe640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8c6c0a3240 0x7f8c6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.963+0000 7f8c737fe640 1 -- 172.21.15.12:0/3206833799 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f8c7c0cfec0 con 0x7f8c8410c170 2024-09-16T01:01:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.963+0000 7f8c8259c640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8c6c0a3240 0x7f8c6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.964+0000 7f8c8259c640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8c6c0a3240 0x7f8c6c0a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8c74005ab0 tx=0x7f8c74005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:16.968+0000 7f8c737fe640 1 -- 172.21.15.12:0/3206833799 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c7c016030 con 0x7f8c8410c170 2024-09-16T01:01:17.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:16 smithi119 ceph-mon[35049]: pgmap v365: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-16T01:01:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.141+0000 7f8c88f51640 1 -- 172.21.15.12:0/3206833799 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8c84062630 con 0x7f8c6c0a3240 2024-09-16T01:01:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.149+0000 7f8c737fe640 1 -- 172.21.15.12:0/3206833799 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340801 (secure 0 0 0) 0x7f8c84062630 con 0x7f8c6c0a3240 2024-09-16T01:01:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:17.154 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-16T01:01:17.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 -- 172.21.15.12:0/3206833799 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8c6c0a3240 msgr2=0x7f8c6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:17.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8c6c0a3240 0x7f8c6c0a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8c74005ab0 tx=0x7f8c74005a20 comp rx=0 tx=0).stop 2024-09-16T01:01:17.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 -- 172.21.15.12:0/3206833799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8410c170 msgr2=0x7f8c84101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8410c170 0x7f8c84101420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00eaa0 tx=0x7f8c7c00ef60 comp rx=0 tx=0).stop 2024-09-16T01:01:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 -- 172.21.15.12:0/3206833799 shutdown_connections 2024-09-16T01:01:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8c6c0a3240 0x7f8c6c0a5700 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8410c170 0x7f8c84101420 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c84103660 0x7f8c84100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 --2- 172.21.15.12:0/3206833799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c84102d40 0x7f8c841009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 -- 172.21.15.12:0/3206833799 >> 172.21.15.12:0/3206833799 conn(0x7f8c840fc7a0 msgr2=0x7f8c840fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 -- 172.21.15.12:0/3206833799 shutdown_connections 2024-09-16T01:01:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:17.152+0000 7f8c88f51640 1 -- 172.21.15.12:0/3206833799 wait complete. 2024-09-16T01:01:17.832 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-09-16T01:01:16.938904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667359,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1296,"num_read_kb":777,"num_write":446,"num_write_kb":3099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373932,"kb_used_data":12176,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567892,"statfs":{"total":1151940427776,"available":1151557521408,"internally_reserved":0,"allocated":12468224,"data_stored":8122501,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5760,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003468"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":185,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:13.552195+0000","last_change":"2024-09-16T00:59:44.862009+0000","last_active":"2024-09-16T01:01:13.552195+0000","last_peered":"2024-09-16T01:01:13.552195+0000","last_clean":"2024-09-16T01:01:13.552195+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:01:13.552195+0000","last_undegraded":"2024-09-16T01:01:13.552195+0000","last_fullsized":"2024-09-16T01:01:13.552195+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:11.209907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968087+0000","last_change":"2024-09-16T00:58:36.507955+0000","last_active":"2024-09-16T01:00:46.968087+0000","last_peered":"2024-09-16T01:00:46.968087+0000","last_clean":"2024-09-16T01:00:46.968087+0000","last_became_active":"2024-09-16T00:58:36.507660+0000","last_became_peered":"2024-09-16T00:58:36.507660+0000","last_unstale":"2024-09-16T01:00:46.968087+0000","last_undegraded":"2024-09-16T01:00:46.968087+0000","last_fullsized":"2024-09-16T01:00:46.968087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:05.408460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627429+0000","last_change":"2024-09-16T00:58:43.620365+0000","last_active":"2024-09-16T01:00:45.627429+0000","last_peered":"2024-09-16T01:00:45.627429+0000","last_clean":"2024-09-16T01:00:45.627429+0000","last_became_active":"2024-09-16T00:58:43.619976+0000","last_became_peered":"2024-09-16T00:58:43.619976+0000","last_unstale":"2024-09-16T01:00:45.627429+0000","last_undegraded":"2024-09-16T01:00:45.627429+0000","last_fullsized":"2024-09-16T01:00:45.627429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:37.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968248+0000","last_change":"2024-09-16T00:58:34.829549+0000","last_active":"2024-09-16T01:00:46.968248+0000","last_peered":"2024-09-16T01:00:46.968248+0000","last_clean":"2024-09-16T01:00:46.968248+0000","last_became_active":"2024-09-16T00:58:34.829180+0000","last_became_peered":"2024-09-16T00:58:34.829180+0000","last_unstale":"2024-09-16T01:00:46.968248+0000","last_undegraded":"2024-09-16T01:00:46.968248+0000","last_fullsized":"2024-09-16T01:00:46.968248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:40.731288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627338+0000","last_change":"2024-09-16T00:58:36.517190+0000","last_active":"2024-09-16T01:00:45.627338+0000","last_peered":"2024-09-16T01:00:45.627338+0000","last_clean":"2024-09-16T01:00:45.627338+0000","last_became_active":"2024-09-16T00:58:36.516877+0000","last_became_peered":"2024-09-16T00:58:36.516877+0000","last_unstale":"2024-09-16T01:00:45.627338+0000","last_undegraded":"2024-09-16T01:00:45.627338+0000","last_fullsized":"2024-09-16T01:00:45.627338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.408011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719645+0000","last_change":"2024-09-16T00:59:44.863832+0000","last_active":"2024-09-16T01:00:45.719645+0000","last_peered":"2024-09-16T01:00:45.719645+0000","last_clean":"2024-09-16T01:00:45.719645+0000","last_became_active":"2024-09-16T00:59:44.863298+0000","last_became_peered":"2024-09-16T00:59:44.863298+0000","last_unstale":"2024-09-16T01:00:45.719645+0000","last_undegraded":"2024-09-16T01:00:45.719645+0000","last_fullsized":"2024-09-16T01:00:45.719645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:55.449728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714641+0000","last_change":"2024-09-16T00:58:34.472375+0000","last_active":"2024-09-16T01:00:45.714641+0000","last_peered":"2024-09-16T01:00:45.714641+0000","last_clean":"2024-09-16T01:00:45.714641+0000","last_became_active":"2024-09-16T00:58:34.471990+0000","last_became_peered":"2024-09-16T00:58:34.471990+0000","last_unstale":"2024-09-16T01:00:45.714641+0000","last_undegraded":"2024-09-16T01:00:45.714641+0000","last_fullsized":"2024-09-16T01:00:45.714641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:15.746005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624668+0000","last_change":"2024-09-16T00:58:36.513747+0000","last_active":"2024-09-16T01:00:45.624668+0000","last_peered":"2024-09-16T01:00:45.624668+0000","last_clean":"2024-09-16T01:00:45.624668+0000","last_became_active":"2024-09-16T00:58:36.512635+0000","last_became_peered":"2024-09-16T00:58:36.512635+0000","last_unstale":"2024-09-16T01:00:45.624668+0000","last_undegraded":"2024-09-16T01:00:45.624668+0000","last_fullsized":"2024-09-16T01:00:45.624668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:39.014961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719864+0000","last_change":"2024-09-16T00:58:43.609355+0000","last_active":"2024-09-16T01:00:45.719864+0000","last_peered":"2024-09-16T01:00:45.719864+0000","last_clean":"2024-09-16T01:00:45.719864+0000","last_became_active":"2024-09-16T00:58:43.608892+0000","last_became_peered":"2024-09-16T00:58:43.608892+0000","last_unstale":"2024-09-16T01:00:45.719864+0000","last_undegraded":"2024-09-16T01:00:45.719864+0000","last_fullsized":"2024-09-16T01:00:45.719864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:20.718163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714484+0000","last_change":"2024-09-16T00:58:34.469650+0000","last_active":"2024-09-16T01:00:45.714484+0000","last_peered":"2024-09-16T01:00:45.714484+0000","last_clean":"2024-09-16T01:00:45.714484+0000","last_became_active":"2024-09-16T00:58:34.468939+0000","last_became_peered":"2024-09-16T00:58:34.468939+0000","last_unstale":"2024-09-16T01:00:45.714484+0000","last_undegraded":"2024-09-16T01:00:45.714484+0000","last_fullsized":"2024-09-16T01:00:45.714484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:34.511111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623914+0000","last_change":"2024-09-16T00:59:45.097454+0000","last_active":"2024-09-16T01:00:45.623914+0000","last_peered":"2024-09-16T01:00:45.623914+0000","last_clean":"2024-09-16T01:00:45.623914+0000","last_became_active":"2024-09-16T00:59:45.096985+0000","last_became_peered":"2024-09-16T00:59:45.096985+0000","last_unstale":"2024-09-16T01:00:45.623914+0000","last_undegraded":"2024-09-16T01:00:45.623914+0000","last_fullsized":"2024-09-16T01:00:45.623914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:03.247850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719801+0000","last_change":"2024-09-16T00:58:43.612479+0000","last_active":"2024-09-16T01:00:45.719801+0000","last_peered":"2024-09-16T01:00:45.719801+0000","last_clean":"2024-09-16T01:00:45.719801+0000","last_became_active":"2024-09-16T00:58:43.612001+0000","last_became_peered":"2024-09-16T00:58:43.612001+0000","last_unstale":"2024-09-16T01:00:45.719801+0000","last_undegraded":"2024-09-16T01:00:45.719801+0000","last_fullsized":"2024-09-16T01:00:45.719801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:33.056052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919590+0000","last_change":"2024-09-16T00:58:36.519407+0000","last_active":"2024-09-16T01:00:45.919590+0000","last_peered":"2024-09-16T01:00:45.919590+0000","last_clean":"2024-09-16T01:00:45.919590+0000","last_became_active":"2024-09-16T00:58:36.519108+0000","last_became_peered":"2024-09-16T00:58:36.519108+0000","last_unstale":"2024-09-16T01:00:45.919590+0000","last_undegraded":"2024-09-16T01:00:45.919590+0000","last_fullsized":"2024-09-16T01:00:45.919590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:28.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714187+0000","last_change":"2024-09-16T00:58:34.472295+0000","last_active":"2024-09-16T01:00:45.714187+0000","last_peered":"2024-09-16T01:00:45.714187+0000","last_clean":"2024-09-16T01:00:45.714187+0000","last_became_active":"2024-09-16T00:58:34.471968+0000","last_became_peered":"2024-09-16T00:58:34.471968+0000","last_unstale":"2024-09-16T01:00:45.714187+0000","last_undegraded":"2024-09-16T01:00:45.714187+0000","last_fullsized":"2024-09-16T01:00:45.714187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:44.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720006+0000","last_change":"2024-09-16T00:58:43.615870+0000","last_active":"2024-09-16T01:00:45.720006+0000","last_peered":"2024-09-16T01:00:45.720006+0000","last_clean":"2024-09-16T01:00:45.720006+0000","last_became_active":"2024-09-16T00:58:43.615116+0000","last_became_peered":"2024-09-16T00:58:43.615116+0000","last_unstale":"2024-09-16T01:00:45.720006+0000","last_undegraded":"2024-09-16T01:00:45.720006+0000","last_fullsized":"2024-09-16T01:00:45.720006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:44.742792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967891+0000","last_change":"2024-09-16T00:58:36.512485+0000","last_active":"2024-09-16T01:00:46.967891+0000","last_peered":"2024-09-16T01:00:46.967891+0000","last_clean":"2024-09-16T01:00:46.967891+0000","last_became_active":"2024-09-16T00:58:36.512175+0000","last_became_peered":"2024-09-16T00:58:36.512175+0000","last_unstale":"2024-09-16T01:00:46.967891+0000","last_undegraded":"2024-09-16T01:00:46.967891+0000","last_fullsized":"2024-09-16T01:00:46.967891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.328409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'4","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.896964+0000","last_change":"2024-09-16T00:59:44.841052+0000","last_active":"2024-09-16T01:00:45.896964+0000","last_peered":"2024-09-16T01:00:45.896964+0000","last_clean":"2024-09-16T01:00:45.896964+0000","last_became_active":"2024-09-16T00:59:44.834033+0000","last_became_peered":"2024-09-16T00:59:44.834033+0000","last_unstale":"2024-09-16T01:00:45.896964+0000","last_undegraded":"2024-09-16T01:00:45.896964+0000","last_fullsized":"2024-09-16T01:00:45.896964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:09.696435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720242+0000","last_change":"2024-09-16T00:58:43.610265+0000","last_active":"2024-09-16T01:00:45.720242+0000","last_peered":"2024-09-16T01:00:45.720242+0000","last_clean":"2024-09-16T01:00:45.720242+0000","last_became_active":"2024-09-16T00:58:43.609868+0000","last_became_peered":"2024-09-16T00:58:43.609868+0000","last_unstale":"2024-09-16T01:00:45.720242+0000","last_undegraded":"2024-09-16T01:00:45.720242+0000","last_fullsized":"2024-09-16T01:00:45.720242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:54.689332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897423+0000","last_change":"2024-09-16T00:58:36.512801+0000","last_active":"2024-09-16T01:00:45.897423+0000","last_peered":"2024-09-16T01:00:45.897423+0000","last_clean":"2024-09-16T01:00:45.897423+0000","last_became_active":"2024-09-16T00:58:36.512469+0000","last_became_peered":"2024-09-16T00:58:36.512469+0000","last_unstale":"2024-09-16T01:00:45.897423+0000","last_undegraded":"2024-09-16T01:00:45.897423+0000","last_fullsized":"2024-09-16T01:00:45.897423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:57.951743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967904+0000","last_change":"2024-09-16T00:58:34.471498+0000","last_active":"2024-09-16T01:00:46.967904+0000","last_peered":"2024-09-16T01:00:46.967904+0000","last_clean":"2024-09-16T01:00:46.967904+0000","last_became_active":"2024-09-16T00:58:34.471093+0000","last_became_peered":"2024-09-16T00:58:34.471093+0000","last_unstale":"2024-09-16T01:00:46.967904+0000","last_undegraded":"2024-09-16T01:00:46.967904+0000","last_fullsized":"2024-09-16T01:00:46.967904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:35.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624262+0000","last_change":"2024-09-16T00:58:43.616376+0000","last_active":"2024-09-16T01:00:45.624262+0000","last_peered":"2024-09-16T01:00:45.624262+0000","last_clean":"2024-09-16T01:00:45.624262+0000","last_became_active":"2024-09-16T00:58:43.616029+0000","last_became_peered":"2024-09-16T00:58:43.616029+0000","last_unstale":"2024-09-16T01:00:45.624262+0000","last_undegraded":"2024-09-16T01:00:45.624262+0000","last_fullsized":"2024-09-16T01:00:45.624262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:54.776250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714062+0000","last_change":"2024-09-16T00:58:36.506625+0000","last_active":"2024-09-16T01:00:45.714062+0000","last_peered":"2024-09-16T01:00:45.714062+0000","last_clean":"2024-09-16T01:00:45.714062+0000","last_became_active":"2024-09-16T00:58:36.506337+0000","last_became_peered":"2024-09-16T00:58:36.506337+0000","last_unstale":"2024-09-16T01:00:45.714062+0000","last_undegraded":"2024-09-16T01:00:45.714062+0000","last_fullsized":"2024-09-16T01:00:45.714062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:22.080165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.901530+0000","last_change":"2024-09-16T01:00:45.901112+0000","last_active":"2024-09-16T01:00:45.901530+0000","last_peered":"2024-09-16T01:00:45.901530+0000","last_clean":"2024-09-16T01:00:45.901530+0000","last_became_active":"2024-09-16T01:00:45.898274+0000","last_became_peered":"2024-09-16T01:00:45.898274+0000","last_unstale":"2024-09-16T01:00:45.901530+0000","last_undegraded":"2024-09-16T01:00:45.901530+0000","last_fullsized":"2024-09-16T01:00:45.901530+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:55.626391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720033+0000","last_change":"2024-09-16T00:58:43.609399+0000","last_active":"2024-09-16T01:00:45.720033+0000","last_peered":"2024-09-16T01:00:45.720033+0000","last_clean":"2024-09-16T01:00:45.720033+0000","last_became_active":"2024-09-16T00:58:43.608988+0000","last_became_peered":"2024-09-16T00:58:43.608988+0000","last_unstale":"2024-09-16T01:00:45.720033+0000","last_undegraded":"2024-09-16T01:00:45.720033+0000","last_fullsized":"2024-09-16T01:00:45.720033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.500071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627256+0000","last_change":"2024-09-16T00:58:36.515930+0000","last_active":"2024-09-16T01:00:45.627256+0000","last_peered":"2024-09-16T01:00:45.627256+0000","last_clean":"2024-09-16T01:00:45.627256+0000","last_became_active":"2024-09-16T00:58:36.515625+0000","last_became_peered":"2024-09-16T00:58:36.515625+0000","last_unstale":"2024-09-16T01:00:45.627256+0000","last_undegraded":"2024-09-16T01:00:45.627256+0000","last_fullsized":"2024-09-16T01:00:45.627256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:55.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720365+0000","last_change":"2024-09-16T00:58:34.508686+0000","last_active":"2024-09-16T01:00:45.720365+0000","last_peered":"2024-09-16T01:00:45.720365+0000","last_clean":"2024-09-16T01:00:45.720365+0000","last_became_active":"2024-09-16T00:58:34.508284+0000","last_became_peered":"2024-09-16T00:58:34.508284+0000","last_unstale":"2024-09-16T01:00:45.720365+0000","last_undegraded":"2024-09-16T01:00:45.720365+0000","last_fullsized":"2024-09-16T01:00:45.720365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:47.545949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627558+0000","last_change":"2024-09-16T00:58:43.615852+0000","last_active":"2024-09-16T01:00:45.627558+0000","last_peered":"2024-09-16T01:00:45.627558+0000","last_clean":"2024-09-16T01:00:45.627558+0000","last_became_active":"2024-09-16T00:58:43.615474+0000","last_became_peered":"2024-09-16T00:58:43.615474+0000","last_unstale":"2024-09-16T01:00:45.627558+0000","last_undegraded":"2024-09-16T01:00:45.627558+0000","last_fullsized":"2024-09-16T01:00:45.627558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:39.596924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968316+0000","last_change":"2024-09-16T00:58:36.513820+0000","last_active":"2024-09-16T01:00:46.968316+0000","last_peered":"2024-09-16T01:00:46.968316+0000","last_clean":"2024-09-16T01:00:46.968316+0000","last_became_active":"2024-09-16T00:58:36.513513+0000","last_became_peered":"2024-09-16T00:58:36.513513+0000","last_unstale":"2024-09-16T01:00:46.968316+0000","last_undegraded":"2024-09-16T01:00:46.968316+0000","last_fullsized":"2024-09-16T01:00:46.968316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:34.584214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'16","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624208+0000","last_change":"2024-09-16T00:58:34.462794+0000","last_active":"2024-09-16T01:00:45.624208+0000","last_peered":"2024-09-16T01:00:45.624208+0000","last_clean":"2024-09-16T01:00:45.624208+0000","last_became_active":"2024-09-16T00:58:34.462471+0000","last_became_peered":"2024-09-16T00:58:34.462471+0000","last_unstale":"2024-09-16T01:00:45.624208+0000","last_undegraded":"2024-09-16T01:00:45.624208+0000","last_fullsized":"2024-09-16T01:00:45.624208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:13.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967564+0000","last_change":"2024-09-16T00:58:43.607718+0000","last_active":"2024-09-16T01:00:46.967564+0000","last_peered":"2024-09-16T01:00:46.967564+0000","last_clean":"2024-09-16T01:00:46.967564+0000","last_became_active":"2024-09-16T00:58:43.607347+0000","last_became_peered":"2024-09-16T00:58:43.607347+0000","last_unstale":"2024-09-16T01:00:46.967564+0000","last_undegraded":"2024-09-16T01:00:46.967564+0000","last_fullsized":"2024-09-16T01:00:46.967564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:12.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.507161+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.504062+0000","last_became_peered":"2024-09-16T00:58:36.504062+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:58:34.829848+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:58:34.829439+0000","last_became_peered":"2024-09-16T00:58:34.829439+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:06.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897267+0000","last_change":"2024-09-16T00:58:43.618334+0000","last_active":"2024-09-16T01:00:45.897267+0000","last_peered":"2024-09-16T01:00:45.897267+0000","last_clean":"2024-09-16T01:00:45.897267+0000","last_became_active":"2024-09-16T00:58:43.617810+0000","last_became_peered":"2024-09-16T00:58:43.617810+0000","last_unstale":"2024-09-16T01:00:45.897267+0000","last_undegraded":"2024-09-16T01:00:45.897267+0000","last_fullsized":"2024-09-16T01:00:45.897267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:58.202973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711427+0000","last_change":"2024-09-16T00:58:36.509025+0000","last_active":"2024-09-16T01:00:45.711427+0000","last_peered":"2024-09-16T01:00:45.711427+0000","last_clean":"2024-09-16T01:00:45.711427+0000","last_became_active":"2024-09-16T00:58:36.508660+0000","last_became_peered":"2024-09-16T00:58:36.508660+0000","last_unstale":"2024-09-16T01:00:45.711427+0000","last_undegraded":"2024-09-16T01:00:45.711427+0000","last_fullsized":"2024-09-16T01:00:45.711427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:01.433486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624046+0000","last_change":"2024-09-16T00:58:34.829899+0000","last_active":"2024-09-16T01:00:45.624046+0000","last_peered":"2024-09-16T01:00:45.624046+0000","last_clean":"2024-09-16T01:00:45.624046+0000","last_became_active":"2024-09-16T00:58:34.829546+0000","last_became_peered":"2024-09-16T00:58:34.829546+0000","last_unstale":"2024-09-16T01:00:45.624046+0000","last_undegraded":"2024-09-16T01:00:45.624046+0000","last_fullsized":"2024-09-16T01:00:45.624046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:21.253829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714080+0000","last_change":"2024-09-16T00:58:43.610143+0000","last_active":"2024-09-16T01:00:45.714080+0000","last_peered":"2024-09-16T01:00:45.714080+0000","last_clean":"2024-09-16T01:00:45.714080+0000","last_became_active":"2024-09-16T00:58:43.609739+0000","last_became_peered":"2024-09-16T00:58:43.609739+0000","last_unstale":"2024-09-16T01:00:45.714080+0000","last_undegraded":"2024-09-16T01:00:45.714080+0000","last_fullsized":"2024-09-16T01:00:45.714080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:28.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711421+0000","last_change":"2024-09-16T00:58:36.520423+0000","last_active":"2024-09-16T01:00:45.711421+0000","last_peered":"2024-09-16T01:00:45.711421+0000","last_clean":"2024-09-16T01:00:45.711421+0000","last_became_active":"2024-09-16T00:58:36.520117+0000","last_became_peered":"2024-09-16T00:58:36.520117+0000","last_unstale":"2024-09-16T01:00:45.711421+0000","last_undegraded":"2024-09-16T01:00:45.711421+0000","last_fullsized":"2024-09-16T01:00:45.711421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.652142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:14.959504+0000","last_change":"2024-09-16T00:58:34.475161+0000","last_active":"2024-09-16T01:01:14.959504+0000","last_peered":"2024-09-16T01:01:14.959504+0000","last_clean":"2024-09-16T01:01:14.959504+0000","last_became_active":"2024-09-16T00:58:34.474755+0000","last_became_peered":"2024-09-16T00:58:34.474755+0000","last_unstale":"2024-09-16T01:01:14.959504+0000","last_undegraded":"2024-09-16T01:01:14.959504+0000","last_fullsized":"2024-09-16T01:01:14.959504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:12.884466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717746+0000","last_change":"2024-09-16T00:58:43.609042+0000","last_active":"2024-09-16T01:00:45.717746+0000","last_peered":"2024-09-16T01:00:45.717746+0000","last_clean":"2024-09-16T01:00:45.717746+0000","last_became_active":"2024-09-16T00:58:43.608596+0000","last_became_peered":"2024-09-16T00:58:43.608596+0000","last_unstale":"2024-09-16T01:00:45.717746+0000","last_undegraded":"2024-09-16T01:00:45.717746+0000","last_fullsized":"2024-09-16T01:00:45.717746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:47.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625659+0000","last_change":"2024-09-16T00:59:44.838583+0000","last_active":"2024-09-16T01:00:45.625659+0000","last_peered":"2024-09-16T01:00:45.625659+0000","last_clean":"2024-09-16T01:00:45.625659+0000","last_became_active":"2024-09-16T00:59:44.838221+0000","last_became_peered":"2024-09-16T00:59:44.838221+0000","last_unstale":"2024-09-16T01:00:45.625659+0000","last_undegraded":"2024-09-16T01:00:45.625659+0000","last_fullsized":"2024-09-16T01:00:45.625659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:27.562118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:12.756950+0000","last_change":"2024-09-16T00:58:34.829452+0000","last_active":"2024-09-16T01:01:12.756950+0000","last_peered":"2024-09-16T01:01:12.756950+0000","last_clean":"2024-09-16T01:01:12.756950+0000","last_became_active":"2024-09-16T00:58:34.829129+0000","last_became_peered":"2024-09-16T00:58:34.829129+0000","last_unstale":"2024-09-16T01:01:12.756950+0000","last_undegraded":"2024-09-16T01:01:12.756950+0000","last_fullsized":"2024-09-16T01:01:12.756950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718001+0000","last_change":"2024-09-16T00:58:43.609230+0000","last_active":"2024-09-16T01:00:45.718001+0000","last_peered":"2024-09-16T01:00:45.718001+0000","last_clean":"2024-09-16T01:00:45.718001+0000","last_became_active":"2024-09-16T00:58:43.608879+0000","last_became_peered":"2024-09-16T00:58:43.608879+0000","last_unstale":"2024-09-16T01:00:45.718001+0000","last_undegraded":"2024-09-16T01:00:45.718001+0000","last_fullsized":"2024-09-16T01:00:45.718001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.112878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717141+0000","last_change":"2024-09-16T00:58:36.503412+0000","last_active":"2024-09-16T01:00:45.717141+0000","last_peered":"2024-09-16T01:00:45.717141+0000","last_clean":"2024-09-16T01:00:45.717141+0000","last_became_active":"2024-09-16T00:58:36.503043+0000","last_became_peered":"2024-09-16T00:58:36.503043+0000","last_unstale":"2024-09-16T01:00:45.717141+0000","last_undegraded":"2024-09-16T01:00:45.717141+0000","last_fullsized":"2024-09-16T01:00:45.717141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:18.495669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919328+0000","last_change":"2024-09-16T00:58:34.468460+0000","last_active":"2024-09-16T01:00:45.919328+0000","last_peered":"2024-09-16T01:00:45.919328+0000","last_clean":"2024-09-16T01:00:45.919328+0000","last_became_active":"2024-09-16T00:58:34.468104+0000","last_became_peered":"2024-09-16T00:58:34.468104+0000","last_unstale":"2024-09-16T01:00:45.919328+0000","last_undegraded":"2024-09-16T01:00:45.919328+0000","last_fullsized":"2024-09-16T01:00:45.919328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:13.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714467+0000","last_change":"2024-09-16T00:59:44.863609+0000","last_active":"2024-09-16T01:00:45.714467+0000","last_peered":"2024-09-16T01:00:45.714467+0000","last_clean":"2024-09-16T01:00:45.714467+0000","last_became_active":"2024-09-16T00:59:44.863152+0000","last_became_peered":"2024-09-16T00:59:44.863152+0000","last_unstale":"2024-09-16T01:00:45.714467+0000","last_undegraded":"2024-09-16T01:00:45.714467+0000","last_fullsized":"2024-09-16T01:00:45.714467+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:51.312612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967875+0000","last_change":"2024-09-16T00:58:36.509749+0000","last_active":"2024-09-16T01:00:46.967875+0000","last_peered":"2024-09-16T01:00:46.967875+0000","last_clean":"2024-09-16T01:00:46.967875+0000","last_became_active":"2024-09-16T00:58:36.509411+0000","last_became_peered":"2024-09-16T00:58:36.509411+0000","last_unstale":"2024-09-16T01:00:46.967875+0000","last_undegraded":"2024-09-16T01:00:46.967875+0000","last_fullsized":"2024-09-16T01:00:46.967875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:14.291956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720026+0000","last_change":"2024-09-16T00:58:34.470190+0000","last_active":"2024-09-16T01:00:45.720026+0000","last_peered":"2024-09-16T01:00:45.720026+0000","last_clean":"2024-09-16T01:00:45.720026+0000","last_became_active":"2024-09-16T00:58:34.469832+0000","last_became_peered":"2024-09-16T00:58:34.469832+0000","last_unstale":"2024-09-16T01:00:45.720026+0000","last_undegraded":"2024-09-16T01:00:45.720026+0000","last_fullsized":"2024-09-16T01:00:45.720026+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:03.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919482+0000","last_change":"2024-09-16T00:57:23.502001+0000","last_active":"2024-09-16T01:00:45.919482+0000","last_peered":"2024-09-16T01:00:45.919482+0000","last_clean":"2024-09-16T01:00:45.919482+0000","last_became_active":"2024-09-16T00:57:23.501465+0000","last_became_peered":"2024-09-16T00:57:23.501465+0000","last_unstale":"2024-09-16T01:00:45.919482+0000","last_undegraded":"2024-09-16T01:00:45.919482+0000","last_fullsized":"2024-09-16T01:00:45.919482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_clean_scrub_stamp":"2024-09-16T00:53:57.344038+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:22.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919823+0000","last_change":"2024-09-16T00:58:43.609572+0000","last_active":"2024-09-16T01:00:45.919823+0000","last_peered":"2024-09-16T01:00:45.919823+0000","last_clean":"2024-09-16T01:00:45.919823+0000","last_became_active":"2024-09-16T00:58:43.609185+0000","last_became_peered":"2024-09-16T00:58:43.609185+0000","last_unstale":"2024-09-16T01:00:45.919823+0000","last_undegraded":"2024-09-16T01:00:45.919823+0000","last_fullsized":"2024-09-16T01:00:45.919823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.199976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919987+0000","last_change":"2024-09-16T00:58:36.510761+0000","last_active":"2024-09-16T01:00:45.919987+0000","last_peered":"2024-09-16T01:00:45.919987+0000","last_clean":"2024-09-16T01:00:45.919987+0000","last_became_active":"2024-09-16T00:58:36.510456+0000","last_became_peered":"2024-09-16T00:58:36.510456+0000","last_unstale":"2024-09-16T01:00:45.919987+0000","last_undegraded":"2024-09-16T01:00:45.919987+0000","last_fullsized":"2024-09-16T01:00:45.919987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:02.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'8","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:14.761188+0000","last_change":"2024-09-16T00:58:34.830238+0000","last_active":"2024-09-16T01:01:14.761188+0000","last_peered":"2024-09-16T01:01:14.761188+0000","last_clean":"2024-09-16T01:01:14.761188+0000","last_became_active":"2024-09-16T00:58:34.829558+0000","last_became_peered":"2024-09-16T00:58:34.829558+0000","last_unstale":"2024-09-16T01:01:14.761188+0000","last_undegraded":"2024-09-16T01:01:14.761188+0000","last_fullsized":"2024-09-16T01:01:14.761188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.347122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624541+0000","last_change":"2024-09-16T00:58:43.613179+0000","last_active":"2024-09-16T01:00:45.624541+0000","last_peered":"2024-09-16T01:00:45.624541+0000","last_clean":"2024-09-16T01:00:45.624541+0000","last_became_active":"2024-09-16T00:58:43.612794+0000","last_became_peered":"2024-09-16T00:58:43.612794+0000","last_unstale":"2024-09-16T01:00:45.624541+0000","last_undegraded":"2024-09-16T01:00:45.624541+0000","last_fullsized":"2024-09-16T01:00:45.624541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:04:24.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919741+0000","last_change":"2024-09-16T00:58:36.512600+0000","last_active":"2024-09-16T01:00:45.919741+0000","last_peered":"2024-09-16T01:00:45.919741+0000","last_clean":"2024-09-16T01:00:45.919741+0000","last_became_active":"2024-09-16T00:58:36.512309+0000","last_became_peered":"2024-09-16T00:58:36.512309+0000","last_unstale":"2024-09-16T01:00:45.919741+0000","last_undegraded":"2024-09-16T01:00:45.919741+0000","last_fullsized":"2024-09-16T01:00:45.919741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.790755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626294+0000","last_change":"2024-09-16T00:58:34.471787+0000","last_active":"2024-09-16T01:00:45.626294+0000","last_peered":"2024-09-16T01:00:45.626294+0000","last_clean":"2024-09-16T01:00:45.626294+0000","last_became_active":"2024-09-16T00:58:34.471119+0000","last_became_peered":"2024-09-16T00:58:34.471119+0000","last_unstale":"2024-09-16T01:00:45.626294+0000","last_undegraded":"2024-09-16T01:00:45.626294+0000","last_fullsized":"2024-09-16T01:00:45.626294+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:26.121669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626989+0000","last_change":"2024-09-16T00:58:43.609676+0000","last_active":"2024-09-16T01:00:45.626989+0000","last_peered":"2024-09-16T01:00:45.626989+0000","last_clean":"2024-09-16T01:00:45.626989+0000","last_became_active":"2024-09-16T00:58:43.609313+0000","last_became_peered":"2024-09-16T00:58:43.609313+0000","last_unstale":"2024-09-16T01:00:45.626989+0000","last_undegraded":"2024-09-16T01:00:45.626989+0000","last_fullsized":"2024-09-16T01:00:45.626989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:53.339070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919903+0000","last_change":"2024-09-16T00:58:36.514621+0000","last_active":"2024-09-16T01:00:45.919903+0000","last_peered":"2024-09-16T01:00:45.919903+0000","last_clean":"2024-09-16T01:00:45.919903+0000","last_became_active":"2024-09-16T00:58:36.514259+0000","last_became_peered":"2024-09-16T00:58:36.514259+0000","last_unstale":"2024-09-16T01:00:45.919903+0000","last_undegraded":"2024-09-16T01:00:45.919903+0000","last_fullsized":"2024-09-16T01:00:45.919903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:11.411742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718006+0000","last_change":"2024-09-16T00:58:34.470512+0000","last_active":"2024-09-16T01:00:45.718006+0000","last_peered":"2024-09-16T01:00:45.718006+0000","last_clean":"2024-09-16T01:00:45.718006+0000","last_became_active":"2024-09-16T00:58:34.470140+0000","last_became_peered":"2024-09-16T00:58:34.470140+0000","last_unstale":"2024-09-16T01:00:45.718006+0000","last_undegraded":"2024-09-16T01:00:45.718006+0000","last_fullsized":"2024-09-16T01:00:45.718006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:04.068901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625516+0000","last_change":"2024-09-16T00:58:43.615221+0000","last_active":"2024-09-16T01:00:45.625516+0000","last_peered":"2024-09-16T01:00:45.625516+0000","last_clean":"2024-09-16T01:00:45.625516+0000","last_became_active":"2024-09-16T00:58:43.614820+0000","last_became_peered":"2024-09-16T00:58:43.614820+0000","last_unstale":"2024-09-16T01:00:45.625516+0000","last_undegraded":"2024-09-16T01:00:45.625516+0000","last_fullsized":"2024-09-16T01:00:45.625516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:31.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897390+0000","last_change":"2024-09-16T00:58:36.515470+0000","last_active":"2024-09-16T01:00:45.897390+0000","last_peered":"2024-09-16T01:00:45.897390+0000","last_clean":"2024-09-16T01:00:45.897390+0000","last_became_active":"2024-09-16T00:58:36.515145+0000","last_became_peered":"2024-09-16T00:58:36.515145+0000","last_unstale":"2024-09-16T01:00:45.897390+0000","last_undegraded":"2024-09-16T01:00:45.897390+0000","last_fullsized":"2024-09-16T01:00:45.897390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:10.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714720+0000","last_change":"2024-09-16T00:58:34.464865+0000","last_active":"2024-09-16T01:00:45.714720+0000","last_peered":"2024-09-16T01:00:45.714720+0000","last_clean":"2024-09-16T01:00:45.714720+0000","last_became_active":"2024-09-16T00:58:34.464448+0000","last_became_peered":"2024-09-16T00:58:34.464448+0000","last_unstale":"2024-09-16T01:00:45.714720+0000","last_undegraded":"2024-09-16T01:00:45.714720+0000","last_fullsized":"2024-09-16T01:00:45.714720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:47.454251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625710+0000","last_change":"2024-09-16T00:58:43.610348+0000","last_active":"2024-09-16T01:00:45.625710+0000","last_peered":"2024-09-16T01:00:45.625710+0000","last_clean":"2024-09-16T01:00:45.625710+0000","last_became_active":"2024-09-16T00:58:43.609497+0000","last_became_peered":"2024-09-16T00:58:43.609497+0000","last_unstale":"2024-09-16T01:00:45.625710+0000","last_undegraded":"2024-09-16T01:00:45.625710+0000","last_fullsized":"2024-09-16T01:00:45.625710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:52.931325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626081+0000","last_change":"2024-09-16T00:58:36.517412+0000","last_active":"2024-09-16T01:00:45.626081+0000","last_peered":"2024-09-16T01:00:45.626081+0000","last_clean":"2024-09-16T01:00:45.626081+0000","last_became_active":"2024-09-16T00:58:36.516600+0000","last_became_peered":"2024-09-16T00:58:36.516600+0000","last_unstale":"2024-09-16T01:00:45.626081+0000","last_undegraded":"2024-09-16T01:00:45.626081+0000","last_fullsized":"2024-09-16T01:00:45.626081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:39.445454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714191+0000","last_change":"2024-09-16T00:58:34.831420+0000","last_active":"2024-09-16T01:00:45.714191+0000","last_peered":"2024-09-16T01:00:45.714191+0000","last_clean":"2024-09-16T01:00:45.714191+0000","last_became_active":"2024-09-16T00:58:34.830991+0000","last_became_peered":"2024-09-16T00:58:34.830991+0000","last_unstale":"2024-09-16T01:00:45.714191+0000","last_undegraded":"2024-09-16T01:00:45.714191+0000","last_fullsized":"2024-09-16T01:00:45.714191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:13.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718011+0000","last_change":"2024-09-16T00:58:43.611781+0000","last_active":"2024-09-16T01:00:45.718011+0000","last_peered":"2024-09-16T01:00:45.718011+0000","last_clean":"2024-09-16T01:00:45.718011+0000","last_became_active":"2024-09-16T00:58:43.610332+0000","last_became_peered":"2024-09-16T00:58:43.610332+0000","last_unstale":"2024-09-16T01:00:45.718011+0000","last_undegraded":"2024-09-16T01:00:45.718011+0000","last_fullsized":"2024-09-16T01:00:45.718011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:18.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919291+0000","last_change":"2024-09-16T00:58:36.514395+0000","last_active":"2024-09-16T01:00:45.919291+0000","last_peered":"2024-09-16T01:00:45.919291+0000","last_clean":"2024-09-16T01:00:45.919291+0000","last_became_active":"2024-09-16T00:58:36.513570+0000","last_became_peered":"2024-09-16T00:58:36.513570+0000","last_unstale":"2024-09-16T01:00:45.919291+0000","last_undegraded":"2024-09-16T01:00:45.919291+0000","last_fullsized":"2024-09-16T01:00:45.919291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:56.148815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:11.756066+0000","last_change":"2024-09-16T00:58:34.473583+0000","last_active":"2024-09-16T01:01:11.756066+0000","last_peered":"2024-09-16T01:01:11.756066+0000","last_clean":"2024-09-16T01:01:11.756066+0000","last_became_active":"2024-09-16T00:58:34.473259+0000","last_became_peered":"2024-09-16T00:58:34.473259+0000","last_unstale":"2024-09-16T01:01:11.756066+0000","last_undegraded":"2024-09-16T01:01:11.756066+0000","last_fullsized":"2024-09-16T01:01:11.756066+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:55.622609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:59:44.835446+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:41.254621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919524+0000","last_change":"2024-09-16T00:59:44.863645+0000","last_active":"2024-09-16T01:00:45.919524+0000","last_peered":"2024-09-16T01:00:45.919524+0000","last_clean":"2024-09-16T01:00:45.919524+0000","last_became_active":"2024-09-16T00:59:44.863207+0000","last_became_peered":"2024-09-16T00:59:44.863207+0000","last_unstale":"2024-09-16T01:00:45.919524+0000","last_undegraded":"2024-09-16T01:00:45.919524+0000","last_fullsized":"2024-09-16T01:00:45.919524+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:27.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626418+0000","last_change":"2024-09-16T00:58:34.470326+0000","last_active":"2024-09-16T01:00:45.626418+0000","last_peered":"2024-09-16T01:00:45.626418+0000","last_clean":"2024-09-16T01:00:45.626418+0000","last_became_active":"2024-09-16T00:58:34.469920+0000","last_became_peered":"2024-09-16T00:58:34.469920+0000","last_unstale":"2024-09-16T01:00:45.626418+0000","last_undegraded":"2024-09-16T01:00:45.626418+0000","last_fullsized":"2024-09-16T01:00:45.626418+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:58.718004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897319+0000","last_change":"2024-09-16T00:58:43.616324+0000","last_active":"2024-09-16T01:00:45.897319+0000","last_peered":"2024-09-16T01:00:45.897319+0000","last_clean":"2024-09-16T01:00:45.897319+0000","last_became_active":"2024-09-16T00:58:43.615903+0000","last_became_peered":"2024-09-16T00:58:43.615903+0000","last_unstale":"2024-09-16T01:00:45.897319+0000","last_undegraded":"2024-09-16T01:00:45.897319+0000","last_fullsized":"2024-09-16T01:00:45.897319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.683788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717440+0000","last_change":"2024-09-16T00:58:36.512490+0000","last_active":"2024-09-16T01:00:45.717440+0000","last_peered":"2024-09-16T01:00:45.717440+0000","last_clean":"2024-09-16T01:00:45.717440+0000","last_became_active":"2024-09-16T00:58:36.512167+0000","last_became_peered":"2024-09-16T00:58:36.512167+0000","last_unstale":"2024-09-16T01:00:45.717440+0000","last_undegraded":"2024-09-16T01:00:45.717440+0000","last_fullsized":"2024-09-16T01:00:45.717440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627945+0000","last_change":"2024-09-16T00:58:34.471603+0000","last_active":"2024-09-16T01:00:45.627945+0000","last_peered":"2024-09-16T01:00:45.627945+0000","last_clean":"2024-09-16T01:00:45.627945+0000","last_became_active":"2024-09-16T00:58:34.471241+0000","last_became_peered":"2024-09-16T00:58:34.471241+0000","last_unstale":"2024-09-16T01:00:45.627945+0000","last_undegraded":"2024-09-16T01:00:45.627945+0000","last_fullsized":"2024-09-16T01:00:45.627945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:33.756759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626074+0000","last_change":"2024-09-16T00:58:43.607428+0000","last_active":"2024-09-16T01:00:45.626074+0000","last_peered":"2024-09-16T01:00:45.626074+0000","last_clean":"2024-09-16T01:00:45.626074+0000","last_became_active":"2024-09-16T00:58:43.606990+0000","last_became_peered":"2024-09-16T00:58:43.606990+0000","last_unstale":"2024-09-16T01:00:45.626074+0000","last_undegraded":"2024-09-16T01:00:45.626074+0000","last_fullsized":"2024-09-16T01:00:45.626074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:52.367384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714506+0000","last_change":"2024-09-16T00:58:36.513967+0000","last_active":"2024-09-16T01:00:45.714506+0000","last_peered":"2024-09-16T01:00:45.714506+0000","last_clean":"2024-09-16T01:00:45.714506+0000","last_became_active":"2024-09-16T00:58:36.513610+0000","last_became_peered":"2024-09-16T00:58:36.513610+0000","last_unstale":"2024-09-16T01:00:45.714506+0000","last_undegraded":"2024-09-16T01:00:45.714506+0000","last_fullsized":"2024-09-16T01:00:45.714506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:22.763430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'42","reported_seq":320,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:13.759322+0000","last_change":"2024-09-16T00:58:34.471511+0000","last_active":"2024-09-16T01:01:13.759322+0000","last_peered":"2024-09-16T01:01:13.759322+0000","last_clean":"2024-09-16T01:01:13.759322+0000","last_became_active":"2024-09-16T00:58:34.470597+0000","last_became_peered":"2024-09-16T00:58:34.470597+0000","last_unstale":"2024-09-16T01:01:13.759322+0000","last_undegraded":"2024-09-16T01:01:13.759322+0000","last_fullsized":"2024-09-16T01:01:13.759322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.782592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69493,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":239,"num_read_kb":189,"num_write":44,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623834+0000","last_change":"2024-09-16T00:58:43.612177+0000","last_active":"2024-09-16T01:00:45.623834+0000","last_peered":"2024-09-16T01:00:45.623834+0000","last_clean":"2024-09-16T01:00:45.623834+0000","last_became_active":"2024-09-16T00:58:43.611801+0000","last_became_peered":"2024-09-16T00:58:43.611801+0000","last_unstale":"2024-09-16T01:00:45.623834+0000","last_undegraded":"2024-09-16T01:00:45.623834+0000","last_fullsized":"2024-09-16T01:00:45.623834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.781429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624875+0000","last_change":"2024-09-16T00:58:36.502231+0000","last_active":"2024-09-16T01:00:45.624875+0000","last_peered":"2024-09-16T01:00:45.624875+0000","last_clean":"2024-09-16T01:00:45.624875+0000","last_became_active":"2024-09-16T00:58:36.501934+0000","last_became_peered":"2024-09-16T00:58:36.501934+0000","last_unstale":"2024-09-16T01:00:45.624875+0000","last_undegraded":"2024-09-16T01:00:45.624875+0000","last_fullsized":"2024-09-16T01:00:45.624875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:29.769186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626236+0000","last_change":"2024-09-16T00:58:34.829872+0000","last_active":"2024-09-16T01:00:45.626236+0000","last_peered":"2024-09-16T01:00:45.626236+0000","last_clean":"2024-09-16T01:00:45.626236+0000","last_became_active":"2024-09-16T00:58:34.829496+0000","last_became_peered":"2024-09-16T00:58:34.829496+0000","last_unstale":"2024-09-16T01:00:45.626236+0000","last_undegraded":"2024-09-16T01:00:45.626236+0000","last_fullsized":"2024-09-16T01:00:45.626236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:47.035177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720036+0000","last_change":"2024-09-16T00:58:43.615560+0000","last_active":"2024-09-16T01:00:45.720036+0000","last_peered":"2024-09-16T01:00:45.720036+0000","last_clean":"2024-09-16T01:00:45.720036+0000","last_became_active":"2024-09-16T00:58:43.615124+0000","last_became_peered":"2024-09-16T00:58:43.615124+0000","last_unstale":"2024-09-16T01:00:45.720036+0000","last_undegraded":"2024-09-16T01:00:45.720036+0000","last_fullsized":"2024-09-16T01:00:45.720036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.455528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627428+0000","last_change":"2024-09-16T00:58:36.514456+0000","last_active":"2024-09-16T01:00:45.627428+0000","last_peered":"2024-09-16T01:00:45.627428+0000","last_clean":"2024-09-16T01:00:45.627428+0000","last_became_active":"2024-09-16T00:58:36.514146+0000","last_became_peered":"2024-09-16T00:58:36.514146+0000","last_unstale":"2024-09-16T01:00:45.627428+0000","last_undegraded":"2024-09-16T01:00:45.627428+0000","last_fullsized":"2024-09-16T01:00:45.627428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:06.760121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919878+0000","last_change":"2024-09-16T00:58:34.471316+0000","last_active":"2024-09-16T01:00:45.919878+0000","last_peered":"2024-09-16T01:00:45.919878+0000","last_clean":"2024-09-16T01:00:45.919878+0000","last_became_active":"2024-09-16T00:58:34.470991+0000","last_became_peered":"2024-09-16T00:58:34.470991+0000","last_unstale":"2024-09-16T01:00:45.919878+0000","last_undegraded":"2024-09-16T01:00:45.919878+0000","last_fullsized":"2024-09-16T01:00:45.919878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:44.492439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623687+0000","last_change":"2024-09-16T00:58:43.617202+0000","last_active":"2024-09-16T01:00:45.623687+0000","last_peered":"2024-09-16T01:00:45.623687+0000","last_clean":"2024-09-16T01:00:45.623687+0000","last_became_active":"2024-09-16T00:58:43.616824+0000","last_became_peered":"2024-09-16T00:58:43.616824+0000","last_unstale":"2024-09-16T01:00:45.623687+0000","last_undegraded":"2024-09-16T01:00:45.623687+0000","last_fullsized":"2024-09-16T01:00:45.623687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:43.035003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625210+0000","last_change":"2024-09-16T00:58:36.512079+0000","last_active":"2024-09-16T01:00:45.625210+0000","last_peered":"2024-09-16T01:00:45.625210+0000","last_clean":"2024-09-16T01:00:45.625210+0000","last_became_active":"2024-09-16T00:58:36.511220+0000","last_became_peered":"2024-09-16T00:58:36.511220+0000","last_unstale":"2024-09-16T01:00:45.625210+0000","last_undegraded":"2024-09-16T01:00:45.625210+0000","last_fullsized":"2024-09-16T01:00:45.625210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:49.798132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'6","reported_seq":271,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:13.758829+0000","last_change":"2024-09-16T00:58:34.470682+0000","last_active":"2024-09-16T01:01:13.758829+0000","last_peered":"2024-09-16T01:01:13.758829+0000","last_clean":"2024-09-16T01:01:13.758829+0000","last_became_active":"2024-09-16T00:58:34.470323+0000","last_became_peered":"2024-09-16T00:58:34.470323+0000","last_unstale":"2024-09-16T01:01:13.758829+0000","last_undegraded":"2024-09-16T01:01:13.758829+0000","last_fullsized":"2024-09-16T01:01:13.758829+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.361374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967738+0000","last_change":"2024-09-16T00:58:43.608941+0000","last_active":"2024-09-16T01:00:46.967738+0000","last_peered":"2024-09-16T01:00:46.967738+0000","last_clean":"2024-09-16T01:00:46.967738+0000","last_became_active":"2024-09-16T00:58:43.607406+0000","last_became_peered":"2024-09-16T00:58:43.607406+0000","last_unstale":"2024-09-16T01:00:46.967738+0000","last_undegraded":"2024-09-16T01:00:46.967738+0000","last_fullsized":"2024-09-16T01:00:46.967738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:10.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627074+0000","last_change":"2024-09-16T00:58:43.613902+0000","last_active":"2024-09-16T01:00:45.627074+0000","last_peered":"2024-09-16T01:00:45.627074+0000","last_clean":"2024-09-16T01:00:45.627074+0000","last_became_active":"2024-09-16T00:58:43.613530+0000","last_became_peered":"2024-09-16T00:58:43.613530+0000","last_unstale":"2024-09-16T01:00:45.627074+0000","last_undegraded":"2024-09-16T01:00:45.627074+0000","last_fullsized":"2024-09-16T01:00:45.627074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:34.774810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623790+0000","last_change":"2024-09-16T00:58:36.504745+0000","last_active":"2024-09-16T01:00:45.623790+0000","last_peered":"2024-09-16T01:00:45.623790+0000","last_clean":"2024-09-16T01:00:45.623790+0000","last_became_active":"2024-09-16T00:58:36.504400+0000","last_became_peered":"2024-09-16T00:58:36.504400+0000","last_unstale":"2024-09-16T01:00:45.623790+0000","last_undegraded":"2024-09-16T01:00:45.623790+0000","last_fullsized":"2024-09-16T01:00:45.623790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:34.444019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626135+0000","last_change":"2024-09-16T00:58:34.470285+0000","last_active":"2024-09-16T01:00:45.626135+0000","last_peered":"2024-09-16T01:00:45.626135+0000","last_clean":"2024-09-16T01:00:45.626135+0000","last_became_active":"2024-09-16T00:58:34.469948+0000","last_became_peered":"2024-09-16T00:58:34.469948+0000","last_unstale":"2024-09-16T01:00:45.626135+0000","last_undegraded":"2024-09-16T01:00:45.626135+0000","last_fullsized":"2024-09-16T01:00:45.626135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:28.553863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897172+0000","last_change":"2024-09-16T00:58:43.614818+0000","last_active":"2024-09-16T01:00:45.897172+0000","last_peered":"2024-09-16T01:00:45.897172+0000","last_clean":"2024-09-16T01:00:45.897172+0000","last_became_active":"2024-09-16T00:58:43.614376+0000","last_became_peered":"2024-09-16T00:58:43.614376+0000","last_unstale":"2024-09-16T01:00:45.897172+0000","last_undegraded":"2024-09-16T01:00:45.897172+0000","last_fullsized":"2024-09-16T01:00:45.897172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:41.699930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967770+0000","last_change":"2024-09-16T00:58:36.505127+0000","last_active":"2024-09-16T01:00:46.967770+0000","last_peered":"2024-09-16T01:00:46.967770+0000","last_clean":"2024-09-16T01:00:46.967770+0000","last_became_active":"2024-09-16T00:58:36.504552+0000","last_became_peered":"2024-09-16T00:58:36.504552+0000","last_unstale":"2024-09-16T01:00:46.967770+0000","last_undegraded":"2024-09-16T01:00:46.967770+0000","last_fullsized":"2024-09-16T01:00:46.967770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:48.104109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717213+0000","last_change":"2024-09-16T00:58:34.462231+0000","last_active":"2024-09-16T01:00:45.717213+0000","last_peered":"2024-09-16T01:00:45.717213+0000","last_clean":"2024-09-16T01:00:45.717213+0000","last_became_active":"2024-09-16T00:58:34.461891+0000","last_became_peered":"2024-09-16T00:58:34.461891+0000","last_unstale":"2024-09-16T01:00:45.717213+0000","last_undegraded":"2024-09-16T01:00:45.717213+0000","last_fullsized":"2024-09-16T01:00:45.717213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.483996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711498+0000","last_change":"2024-09-16T00:58:34.472457+0000","last_active":"2024-09-16T01:00:45.711498+0000","last_peered":"2024-09-16T01:00:45.711498+0000","last_clean":"2024-09-16T01:00:45.711498+0000","last_became_active":"2024-09-16T00:58:34.472084+0000","last_became_peered":"2024-09-16T00:58:34.472084+0000","last_unstale":"2024-09-16T01:00:45.711498+0000","last_undegraded":"2024-09-16T01:00:45.711498+0000","last_fullsized":"2024-09-16T01:00:45.711498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:08.005195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626072+0000","last_change":"2024-09-16T00:58:36.508791+0000","last_active":"2024-09-16T01:00:45.626072+0000","last_peered":"2024-09-16T01:00:45.626072+0000","last_clean":"2024-09-16T01:00:45.626072+0000","last_became_active":"2024-09-16T00:58:36.508461+0000","last_became_peered":"2024-09-16T00:58:36.508461+0000","last_unstale":"2024-09-16T01:00:45.626072+0000","last_undegraded":"2024-09-16T01:00:45.626072+0000","last_fullsized":"2024-09-16T01:00:45.626072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.938067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627898+0000","last_change":"2024-09-16T00:58:43.620439+0000","last_active":"2024-09-16T01:00:45.627898+0000","last_peered":"2024-09-16T01:00:45.627898+0000","last_clean":"2024-09-16T01:00:45.627898+0000","last_became_active":"2024-09-16T00:58:43.619952+0000","last_became_peered":"2024-09-16T00:58:43.619952+0000","last_unstale":"2024-09-16T01:00:45.627898+0000","last_undegraded":"2024-09-16T01:00:45.627898+0000","last_fullsized":"2024-09-16T01:00:45.627898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:10.755023+0000","last_change":"2024-09-16T00:58:34.473169+0000","last_active":"2024-09-16T01:01:10.755023+0000","last_peered":"2024-09-16T01:01:10.755023+0000","last_clean":"2024-09-16T01:01:10.755023+0000","last_became_active":"2024-09-16T00:58:34.472839+0000","last_became_peered":"2024-09-16T00:58:34.472839+0000","last_unstale":"2024-09-16T01:01:10.755023+0000","last_undegraded":"2024-09-16T01:01:10.755023+0000","last_fullsized":"2024-09-16T01:01:10.755023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:03.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714165+0000","last_change":"2024-09-16T00:58:36.508719+0000","last_active":"2024-09-16T01:00:45.714165+0000","last_peered":"2024-09-16T01:00:45.714165+0000","last_clean":"2024-09-16T01:00:45.714165+0000","last_became_active":"2024-09-16T00:58:36.508427+0000","last_became_peered":"2024-09-16T00:58:36.508427+0000","last_unstale":"2024-09-16T01:00:45.714165+0000","last_undegraded":"2024-09-16T01:00:45.714165+0000","last_fullsized":"2024-09-16T01:00:45.714165+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:44.134558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627846+0000","last_change":"2024-09-16T00:58:43.616532+0000","last_active":"2024-09-16T01:00:45.627846+0000","last_peered":"2024-09-16T01:00:45.627846+0000","last_clean":"2024-09-16T01:00:45.627846+0000","last_became_active":"2024-09-16T00:58:43.616146+0000","last_became_peered":"2024-09-16T00:58:43.616146+0000","last_unstale":"2024-09-16T01:00:45.627846+0000","last_undegraded":"2024-09-16T01:00:45.627846+0000","last_fullsized":"2024-09-16T01:00:45.627846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:50.904766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897283+0000","last_change":"2024-09-16T00:58:36.513232+0000","last_active":"2024-09-16T01:00:45.897283+0000","last_peered":"2024-09-16T01:00:45.897283+0000","last_clean":"2024-09-16T01:00:45.897283+0000","last_became_active":"2024-09-16T00:58:36.512239+0000","last_became_peered":"2024-09-16T00:58:36.512239+0000","last_unstale":"2024-09-16T01:00:45.897283+0000","last_undegraded":"2024-09-16T01:00:45.897283+0000","last_fullsized":"2024-09-16T01:00:45.897283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627619+0000","last_change":"2024-09-16T00:58:36.513160+0000","last_active":"2024-09-16T01:00:45.627619+0000","last_peered":"2024-09-16T01:00:45.627619+0000","last_clean":"2024-09-16T01:00:45.627619+0000","last_became_active":"2024-09-16T00:58:36.512523+0000","last_became_peered":"2024-09-16T00:58:36.512523+0000","last_unstale":"2024-09-16T01:00:45.627619+0000","last_undegraded":"2024-09-16T01:00:45.627619+0000","last_fullsized":"2024-09-16T01:00:45.627619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:20.934937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627648+0000","last_change":"2024-09-16T00:58:36.516416+0000","last_active":"2024-09-16T01:00:45.627648+0000","last_peered":"2024-09-16T01:00:45.627648+0000","last_clean":"2024-09-16T01:00:45.627648+0000","last_became_active":"2024-09-16T00:58:36.516121+0000","last_became_peered":"2024-09-16T00:58:36.516121+0000","last_unstale":"2024-09-16T01:00:45.627648+0000","last_undegraded":"2024-09-16T01:00:45.627648+0000","last_fullsized":"2024-09-16T01:00:45.627648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:28.848616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627011+0000","last_change":"2024-09-16T00:58:36.510854+0000","last_active":"2024-09-16T01:00:45.627011+0000","last_peered":"2024-09-16T01:00:45.627011+0000","last_clean":"2024-09-16T01:00:45.627011+0000","last_became_active":"2024-09-16T00:58:36.510505+0000","last_became_peered":"2024-09-16T00:58:36.510505+0000","last_unstale":"2024-09-16T01:00:45.627011+0000","last_undegraded":"2024-09-16T01:00:45.627011+0000","last_fullsized":"2024-09-16T01:00:45.627011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.699942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.509016+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.508690+0000","last_became_peered":"2024-09-16T00:58:36.508690+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:41.425016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897266+0000","last_change":"2024-09-16T00:58:36.511659+0000","last_active":"2024-09-16T01:00:45.897266+0000","last_peered":"2024-09-16T01:00:45.897266+0000","last_clean":"2024-09-16T01:00:45.897266+0000","last_became_active":"2024-09-16T00:58:36.511225+0000","last_became_peered":"2024-09-16T00:58:36.511225+0000","last_unstale":"2024-09-16T01:00:45.897266+0000","last_undegraded":"2024-09-16T01:00:45.897266+0000","last_fullsized":"2024-09-16T01:00:45.897266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:43.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628196+0000","last_change":"2024-09-16T00:58:36.511614+0000","last_active":"2024-09-16T01:00:45.628196+0000","last_peered":"2024-09-16T01:00:45.628196+0000","last_clean":"2024-09-16T01:00:45.628196+0000","last_became_active":"2024-09-16T00:58:36.511304+0000","last_became_peered":"2024-09-16T00:58:36.511304+0000","last_unstale":"2024-09-16T01:00:45.628196+0000","last_undegraded":"2024-09-16T01:00:45.628196+0000","last_fullsized":"2024-09-16T01:00:45.628196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:20.755419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968311+0000","last_change":"2024-09-16T00:58:36.509399+0000","last_active":"2024-09-16T01:00:46.968311+0000","last_peered":"2024-09-16T01:00:46.968311+0000","last_clean":"2024-09-16T01:00:46.968311+0000","last_became_active":"2024-09-16T00:58:36.509072+0000","last_became_peered":"2024-09-16T00:58:36.509072+0000","last_unstale":"2024-09-16T01:00:46.968311+0000","last_undegraded":"2024-09-16T01:00:46.968311+0000","last_fullsized":"2024-09-16T01:00:46.968311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:29.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625679+0000","last_change":"2024-09-16T00:58:36.506252+0000","last_active":"2024-09-16T01:00:45.625679+0000","last_peered":"2024-09-16T01:00:45.625679+0000","last_clean":"2024-09-16T01:00:45.625679+0000","last_became_active":"2024-09-16T00:58:36.505923+0000","last_became_peered":"2024-09-16T00:58:36.505923+0000","last_unstale":"2024-09-16T01:00:45.625679+0000","last_undegraded":"2024-09-16T01:00:45.625679+0000","last_fullsized":"2024-09-16T01:00:45.625679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:05.332472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967824+0000","last_change":"2024-09-16T00:58:36.506598+0000","last_active":"2024-09-16T01:00:46.967824+0000","last_peered":"2024-09-16T01:00:46.967824+0000","last_clean":"2024-09-16T01:00:46.967824+0000","last_became_active":"2024-09-16T00:58:36.506299+0000","last_became_peered":"2024-09-16T00:58:36.506299+0000","last_unstale":"2024-09-16T01:00:46.967824+0000","last_undegraded":"2024-09-16T01:00:46.967824+0000","last_fullsized":"2024-09-16T01:00:46.967824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.327225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624647+0000","last_change":"2024-09-16T00:58:36.517050+0000","last_active":"2024-09-16T01:00:45.624647+0000","last_peered":"2024-09-16T01:00:45.624647+0000","last_clean":"2024-09-16T01:00:45.624647+0000","last_became_active":"2024-09-16T00:58:36.516745+0000","last_became_peered":"2024-09-16T00:58:36.516745+0000","last_unstale":"2024-09-16T01:00:45.624647+0000","last_undegraded":"2024-09-16T01:00:45.624647+0000","last_fullsized":"2024-09-16T01:00:45.624647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:59.981792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717660+0000","last_change":"2024-09-16T00:58:36.512442+0000","last_active":"2024-09-16T01:00:45.717660+0000","last_peered":"2024-09-16T01:00:45.717660+0000","last_clean":"2024-09-16T01:00:45.717660+0000","last_became_active":"2024-09-16T00:58:36.512132+0000","last_became_peered":"2024-09-16T00:58:36.512132+0000","last_unstale":"2024-09-16T01:00:45.717660+0000","last_undegraded":"2024-09-16T01:00:45.717660+0000","last_fullsized":"2024-09-16T01:00:45.717660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:06.511257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897210+0000","last_change":"2024-09-16T00:58:36.519754+0000","last_active":"2024-09-16T01:00:45.897210+0000","last_peered":"2024-09-16T01:00:45.897210+0000","last_clean":"2024-09-16T01:00:45.897210+0000","last_became_active":"2024-09-16T00:58:36.519378+0000","last_became_peered":"2024-09-16T00:58:36.519378+0000","last_unstale":"2024-09-16T01:00:45.897210+0000","last_undegraded":"2024-09-16T01:00:45.897210+0000","last_fullsized":"2024-09-16T01:00:45.897210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:51.076588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628046+0000","last_change":"2024-09-16T00:58:36.504627+0000","last_active":"2024-09-16T01:00:45.628046+0000","last_peered":"2024-09-16T01:00:45.628046+0000","last_clean":"2024-09-16T01:00:45.628046+0000","last_became_active":"2024-09-16T00:58:36.504282+0000","last_became_peered":"2024-09-16T00:58:36.504282+0000","last_unstale":"2024-09-16T01:00:45.628046+0000","last_undegraded":"2024-09-16T01:00:45.628046+0000","last_fullsized":"2024-09-16T01:00:45.628046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.857181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624140+0000","last_change":"2024-09-16T00:58:36.508971+0000","last_active":"2024-09-16T01:00:45.624140+0000","last_peered":"2024-09-16T01:00:45.624140+0000","last_clean":"2024-09-16T01:00:45.624140+0000","last_became_active":"2024-09-16T00:58:36.508631+0000","last_became_peered":"2024-09-16T00:58:36.508631+0000","last_unstale":"2024-09-16T01:00:45.624140+0000","last_undegraded":"2024-09-16T01:00:45.624140+0000","last_fullsized":"2024-09-16T01:00:45.624140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:17.092613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897604+0000","last_change":"2024-09-16T00:58:36.517255+0000","last_active":"2024-09-16T01:00:45.897604+0000","last_peered":"2024-09-16T01:00:45.897604+0000","last_clean":"2024-09-16T01:00:45.897604+0000","last_became_active":"2024-09-16T00:58:36.516957+0000","last_became_peered":"2024-09-16T00:58:36.516957+0000","last_unstale":"2024-09-16T01:00:45.897604+0000","last_undegraded":"2024-09-16T01:00:45.897604+0000","last_fullsized":"2024-09-16T01:00:45.897604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:34.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624283+0000","last_change":"2024-09-16T00:58:36.516429+0000","last_active":"2024-09-16T01:00:45.624283+0000","last_peered":"2024-09-16T01:00:45.624283+0000","last_clean":"2024-09-16T01:00:45.624283+0000","last_became_active":"2024-09-16T00:58:36.516111+0000","last_became_peered":"2024-09-16T00:58:36.516111+0000","last_unstale":"2024-09-16T01:00:45.624283+0000","last_undegraded":"2024-09-16T01:00:45.624283+0000","last_fullsized":"2024-09-16T01:00:45.624283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:06.120653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626784+0000","last_change":"2024-09-16T00:58:36.512873+0000","last_active":"2024-09-16T01:00:45.626784+0000","last_peered":"2024-09-16T01:00:45.626784+0000","last_clean":"2024-09-16T01:00:45.626784+0000","last_became_active":"2024-09-16T00:58:36.511761+0000","last_became_peered":"2024-09-16T00:58:36.511761+0000","last_unstale":"2024-09-16T01:00:45.626784+0000","last_undegraded":"2024-09-16T01:00:45.626784+0000","last_fullsized":"2024-09-16T01:00:45.626784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:51.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626810+0000","last_change":"2024-09-16T00:58:36.511585+0000","last_active":"2024-09-16T01:00:45.626810+0000","last_peered":"2024-09-16T01:00:45.626810+0000","last_clean":"2024-09-16T01:00:45.626810+0000","last_became_active":"2024-09-16T00:58:36.510479+0000","last_became_peered":"2024-09-16T00:58:36.510479+0000","last_unstale":"2024-09-16T01:00:45.626810+0000","last_undegraded":"2024-09-16T01:00:45.626810+0000","last_fullsized":"2024-09-16T01:00:45.626810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:58.017132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717650+0000","last_change":"2024-09-16T00:58:36.508263+0000","last_active":"2024-09-16T01:00:45.717650+0000","last_peered":"2024-09-16T01:00:45.717650+0000","last_clean":"2024-09-16T01:00:45.717650+0000","last_became_active":"2024-09-16T00:58:36.507979+0000","last_became_peered":"2024-09-16T00:58:36.507979+0000","last_unstale":"2024-09-16T01:00:45.717650+0000","last_undegraded":"2024-09-16T01:00:45.717650+0000","last_fullsized":"2024-09-16T01:00:45.717650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:07.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720241+0000","last_change":"2024-09-16T00:58:36.514981+0000","last_active":"2024-09-16T01:00:45.720241+0000","last_peered":"2024-09-16T01:00:45.720241+0000","last_clean":"2024-09-16T01:00:45.720241+0000","last_became_active":"2024-09-16T00:58:36.510433+0000","last_became_peered":"2024-09-16T00:58:36.510433+0000","last_unstale":"2024-09-16T01:00:45.720241+0000","last_undegraded":"2024-09-16T01:00:45.720241+0000","last_fullsized":"2024-09-16T01:00:45.720241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:10.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919996+0000","last_change":"2024-09-16T00:58:36.521336+0000","last_active":"2024-09-16T01:00:45.919996+0000","last_peered":"2024-09-16T01:00:45.919996+0000","last_clean":"2024-09-16T01:00:45.919996+0000","last_became_active":"2024-09-16T00:58:36.521026+0000","last_became_peered":"2024-09-16T00:58:36.521026+0000","last_unstale":"2024-09-16T01:00:45.919996+0000","last_undegraded":"2024-09-16T01:00:45.919996+0000","last_fullsized":"2024-09-16T01:00:45.919996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:29.409024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711912+0000","last_change":"2024-09-16T00:58:36.518724+0000","last_active":"2024-09-16T01:00:45.711912+0000","last_peered":"2024-09-16T01:00:45.711912+0000","last_clean":"2024-09-16T01:00:45.711912+0000","last_became_active":"2024-09-16T00:58:36.518428+0000","last_became_peered":"2024-09-16T00:58:36.518428+0000","last_unstale":"2024-09-16T01:00:45.711912+0000","last_undegraded":"2024-09-16T01:00:45.711912+0000","last_fullsized":"2024-09-16T01:00:45.711912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:06.486299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625258+0000","last_change":"2024-09-16T00:58:36.514347+0000","last_active":"2024-09-16T01:00:45.625258+0000","last_peered":"2024-09-16T01:00:45.625258+0000","last_clean":"2024-09-16T01:00:45.625258+0000","last_became_active":"2024-09-16T00:58:36.512243+0000","last_became_peered":"2024-09-16T00:58:36.512243+0000","last_unstale":"2024-09-16T01:00:45.625258+0000","last_undegraded":"2024-09-16T01:00:45.625258+0000","last_fullsized":"2024-09-16T01:00:45.625258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.289541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623615+0000","last_change":"2024-09-16T00:59:44.837828+0000","last_active":"2024-09-16T01:00:45.623615+0000","last_peered":"2024-09-16T01:00:45.623615+0000","last_clean":"2024-09-16T01:00:45.623615+0000","last_became_active":"2024-09-16T00:59:44.837486+0000","last_became_peered":"2024-09-16T00:59:44.837486+0000","last_unstale":"2024-09-16T01:00:45.623615+0000","last_undegraded":"2024-09-16T01:00:45.623615+0000","last_fullsized":"2024-09-16T01:00:45.623615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:46.914056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919570+0000","last_change":"2024-09-16T00:58:36.516797+0000","last_active":"2024-09-16T01:00:45.919570+0000","last_peered":"2024-09-16T01:00:45.919570+0000","last_clean":"2024-09-16T01:00:45.919570+0000","last_became_active":"2024-09-16T00:58:36.516480+0000","last_became_peered":"2024-09-16T00:58:36.516480+0000","last_unstale":"2024-09-16T01:00:45.919570+0000","last_undegraded":"2024-09-16T01:00:45.919570+0000","last_fullsized":"2024-09-16T01:00:45.919570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:55.262528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711421+0000","last_change":"2024-09-16T00:58:36.517973+0000","last_active":"2024-09-16T01:00:45.711421+0000","last_peered":"2024-09-16T01:00:45.711421+0000","last_clean":"2024-09-16T01:00:45.711421+0000","last_became_active":"2024-09-16T00:58:36.517634+0000","last_became_peered":"2024-09-16T00:58:36.517634+0000","last_unstale":"2024-09-16T01:00:45.711421+0000","last_undegraded":"2024-09-16T01:00:45.711421+0000","last_fullsized":"2024-09-16T01:00:45.711421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:19.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714158+0000","last_change":"2024-09-16T00:58:36.507643+0000","last_active":"2024-09-16T01:00:45.714158+0000","last_peered":"2024-09-16T01:00:45.714158+0000","last_clean":"2024-09-16T01:00:45.714158+0000","last_became_active":"2024-09-16T00:58:36.507263+0000","last_became_peered":"2024-09-16T00:58:36.507263+0000","last_unstale":"2024-09-16T01:00:45.714158+0000","last_undegraded":"2024-09-16T01:00:45.714158+0000","last_fullsized":"2024-09-16T01:00:45.714158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:24.317490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720025+0000","last_change":"2024-09-16T00:58:36.508798+0000","last_active":"2024-09-16T01:00:45.720025+0000","last_peered":"2024-09-16T01:00:45.720025+0000","last_clean":"2024-09-16T01:00:45.720025+0000","last_became_active":"2024-09-16T00:58:36.508490+0000","last_became_peered":"2024-09-16T00:58:36.508490+0000","last_unstale":"2024-09-16T01:00:45.720025+0000","last_undegraded":"2024-09-16T01:00:45.720025+0000","last_fullsized":"2024-09-16T01:00:45.720025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:44.282270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627327+0000","last_change":"2024-09-16T00:58:36.519065+0000","last_active":"2024-09-16T01:00:45.627327+0000","last_peered":"2024-09-16T01:00:45.627327+0000","last_clean":"2024-09-16T01:00:45.627327+0000","last_became_active":"2024-09-16T00:58:36.518708+0000","last_became_peered":"2024-09-16T00:58:36.518708+0000","last_unstale":"2024-09-16T01:00:45.627327+0000","last_undegraded":"2024-09-16T01:00:45.627327+0000","last_fullsized":"2024-09-16T01:00:45.627327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:10.290341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627159+0000","last_change":"2024-09-16T00:58:36.513018+0000","last_active":"2024-09-16T01:00:45.627159+0000","last_peered":"2024-09-16T01:00:45.627159+0000","last_clean":"2024-09-16T01:00:45.627159+0000","last_became_active":"2024-09-16T00:58:36.511730+0000","last_became_peered":"2024-09-16T00:58:36.511730+0000","last_unstale":"2024-09-16T01:00:45.627159+0000","last_undegraded":"2024-09-16T01:00:45.627159+0000","last_fullsized":"2024-09-16T01:00:45.627159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:20.852121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897471+0000","last_change":"2024-09-16T00:58:36.518265+0000","last_active":"2024-09-16T01:00:45.897471+0000","last_peered":"2024-09-16T01:00:45.897471+0000","last_clean":"2024-09-16T01:00:45.897471+0000","last_became_active":"2024-09-16T00:58:36.517906+0000","last_became_peered":"2024-09-16T00:58:36.517906+0000","last_unstale":"2024-09-16T01:00:45.897471+0000","last_undegraded":"2024-09-16T01:00:45.897471+0000","last_fullsized":"2024-09-16T01:00:45.897471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.255849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76757,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1170,"num_read_kb":668,"num_write":263,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":229133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282150,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612654,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":513588,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841585,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1146880,"data_stored":1169055,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005112,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":516772,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234045,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":512382,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462978,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":1109160,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626503,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":991232,"data_stored":508180,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855435,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":1104742,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018961,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":512926,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247895,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":507888,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444124,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":579765,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607648,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":577565,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738469,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":510478,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":71229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:01:17.838 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T01:01:17.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:01:18.100 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:18.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.577+0000 7f57e02a0640 1 -- 172.21.15.12:0/4267468805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d8103640 msgr2=0x7f57d810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:18.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.577+0000 7f57e02a0640 1 --2- 172.21.15.12:0/4267468805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d8103640 0x7f57d810bb30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f57c8009900 tx=0x7f57c802a480 comp rx=0 tx=0).stop 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.577+0000 7f57e02a0640 1 -- 172.21.15.12:0/4267468805 shutdown_connections 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.577+0000 7f57e02a0640 1 --2- 172.21.15.12:0/4267468805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d810c150 0x7f57d810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.577+0000 7f57e02a0640 1 --2- 172.21.15.12:0/4267468805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d8103640 0x7f57d810bb30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.577+0000 7f57e02a0640 1 --2- 172.21.15.12:0/4267468805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57d8102d20 0x7f57d8103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.577+0000 7f57e02a0640 1 -- 172.21.15.12:0/4267468805 >> 172.21.15.12:0/4267468805 conn(0x7f57d80fc780 msgr2=0x7f57d80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.577+0000 7f57e02a0640 1 -- 172.21.15.12:0/4267468805 shutdown_connections 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.577+0000 7f57e02a0640 1 -- 172.21.15.12:0/4267468805 wait complete. 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.577+0000 7f57e02a0640 1 Processor -- start 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57e02a0640 1 -- start start 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57e02a0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d8102d20 0x7f57d8100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57e02a0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d8103640 0x7f57d8100ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57e02a0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57d810c150 0x7f57d8101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:18.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57e02a0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57d8111fa0 con 0x7f57d8102d20 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57e02a0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f57d8111e20 con 0x7f57d8103640 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57e02a0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f57d8112120 con 0x7f57d810c150 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57de03c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d8102d20 0x7f57d8100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57de03c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d8102d20 0x7f57d8100980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57224/0 (socket says 172.21.15.12:57224) 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57de03c640 1 -- 172.21.15.12:0/54113573 learned_addr learned my addr 172.21.15.12:0/54113573 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57de83d640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57d810c150 0x7f57d8101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57de03c640 1 -- 172.21.15.12:0/54113573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57d810c150 msgr2=0x7f57d8101400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57de03c640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57d810c150 0x7f57d8101400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57dd83b640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d8103640 0x7f57d8100ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57de03c640 1 -- 172.21.15.12:0/54113573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d8103640 msgr2=0x7f57d8100ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57de03c640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d8103640 0x7f57d8100ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57de03c640 1 -- 172.21.15.12:0/54113573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d81a6910 con 0x7f57d8102d20 2024-09-16T01:01:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.578+0000 7f57de03c640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d8102d20 0x7f57d8100980 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f57d400d770 tx=0x7f57d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.579+0000 7f57cf7fe640 1 -- 172.21.15.12:0/54113573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4017070 con 0x7f57d8102d20 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.579+0000 7f57e02a0640 1 -- 172.21.15.12:0/54113573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d81a6c00 con 0x7f57d8102d20 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.579+0000 7f57cf7fe640 1 -- 172.21.15.12:0/54113573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57d4005500 con 0x7f57d8102d20 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.579+0000 7f57cf7fe640 1 -- 172.21.15.12:0/54113573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4004e00 con 0x7f57d8102d20 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.579+0000 7f57e02a0640 1 -- 172.21.15.12:0/54113573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d81a7140 con 0x7f57d8102d20 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.580+0000 7f57e02a0640 1 -- 172.21.15.12:0/54113573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d8103100 con 0x7f57d8102d20 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.581+0000 7f57cf7fe640 1 -- 172.21.15.12:0/54113573 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f57d4004fa0 con 0x7f57d8102d20 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.581+0000 7f57cf7fe640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f57c40a3240 0x7f57c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.582+0000 7f57dd83b640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f57c40a3240 0x7f57c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.582+0000 7f57cf7fe640 1 -- 172.21.15.12:0/54113573 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f57d40cf800 con 0x7f57d8102d20 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.582+0000 7f57dd83b640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f57c40a3240 0x7f57c40a5700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f57c802a9a0 tx=0x7f57c8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.586+0000 7f57cf7fe640 1 -- 172.21.15.12:0/54113573 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57d409c160 con 0x7f57d8102d20 2024-09-16T01:01:18.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.758+0000 7f57e02a0640 1 -- 172.21.15.12:0/54113573 --> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57d8062630 con 0x7f57c40a3240 2024-09-16T01:01:18.759 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:18 smithi012 ceph-mon[31197]: pgmap v366: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-16T01:01:18.759 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:18 smithi012 ceph-mon[31197]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:18.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.766+0000 7f57cf7fe640 1 -- 172.21.15.12:0/54113573 <== mgr.14150 v2:172.21.15.12:6800/2160939611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340801 (secure 0 0 0) 0x7f57d8062630 con 0x7f57c40a3240 2024-09-16T01:01:18.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:18.772 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-16T01:01:18.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 -- 172.21.15.12:0/54113573 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f57c40a3240 msgr2=0x7f57c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:18.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f57c40a3240 0x7f57c40a5700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f57c802a9a0 tx=0x7f57c8005fd0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 -- 172.21.15.12:0/54113573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d8102d20 msgr2=0x7f57d8100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:18.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d8102d20 0x7f57d8100980 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f57d400d770 tx=0x7f57d400dc30 comp rx=0 tx=0).stop 2024-09-16T01:01:18.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 -- 172.21.15.12:0/54113573 shutdown_connections 2024-09-16T01:01:18.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f57c40a3240 0x7f57c40a5700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57d810c150 0x7f57d8101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d8103640 0x7f57d8100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 --2- 172.21.15.12:0/54113573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d8102d20 0x7f57d8100980 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 -- 172.21.15.12:0/54113573 >> 172.21.15.12:0/54113573 conn(0x7f57d80fc780 msgr2=0x7f57d80fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:18.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 -- 172.21.15.12:0/54113573 shutdown_connections 2024-09-16T01:01:18.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:18.770+0000 7f57e02a0640 1 -- 172.21.15.12:0/54113573 wait complete. 2024-09-16T01:01:18.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:18 smithi098 ceph-mon[35346]: pgmap v366: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-16T01:01:18.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:18 smithi098 ceph-mon[35346]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:19.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:18 smithi119 ceph-mon[35049]: pgmap v366: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-16T01:01:19.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:18 smithi119 ceph-mon[35049]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:19.440 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-09-16T01:01:16.938904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667359,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1296,"num_read_kb":777,"num_write":446,"num_write_kb":3099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373932,"kb_used_data":12176,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567892,"statfs":{"total":1151940427776,"available":1151557521408,"internally_reserved":0,"allocated":12468224,"data_stored":8122501,"data_compressed":463101,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5760,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003468"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":185,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:13.552195+0000","last_change":"2024-09-16T00:59:44.862009+0000","last_active":"2024-09-16T01:01:13.552195+0000","last_peered":"2024-09-16T01:01:13.552195+0000","last_clean":"2024-09-16T01:01:13.552195+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:01:13.552195+0000","last_undegraded":"2024-09-16T01:01:13.552195+0000","last_fullsized":"2024-09-16T01:01:13.552195+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:11.209907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968087+0000","last_change":"2024-09-16T00:58:36.507955+0000","last_active":"2024-09-16T01:00:46.968087+0000","last_peered":"2024-09-16T01:00:46.968087+0000","last_clean":"2024-09-16T01:00:46.968087+0000","last_became_active":"2024-09-16T00:58:36.507660+0000","last_became_peered":"2024-09-16T00:58:36.507660+0000","last_unstale":"2024-09-16T01:00:46.968087+0000","last_undegraded":"2024-09-16T01:00:46.968087+0000","last_fullsized":"2024-09-16T01:00:46.968087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:05.408460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627429+0000","last_change":"2024-09-16T00:58:43.620365+0000","last_active":"2024-09-16T01:00:45.627429+0000","last_peered":"2024-09-16T01:00:45.627429+0000","last_clean":"2024-09-16T01:00:45.627429+0000","last_became_active":"2024-09-16T00:58:43.619976+0000","last_became_peered":"2024-09-16T00:58:43.619976+0000","last_unstale":"2024-09-16T01:00:45.627429+0000","last_undegraded":"2024-09-16T01:00:45.627429+0000","last_fullsized":"2024-09-16T01:00:45.627429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:37.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968248+0000","last_change":"2024-09-16T00:58:34.829549+0000","last_active":"2024-09-16T01:00:46.968248+0000","last_peered":"2024-09-16T01:00:46.968248+0000","last_clean":"2024-09-16T01:00:46.968248+0000","last_became_active":"2024-09-16T00:58:34.829180+0000","last_became_peered":"2024-09-16T00:58:34.829180+0000","last_unstale":"2024-09-16T01:00:46.968248+0000","last_undegraded":"2024-09-16T01:00:46.968248+0000","last_fullsized":"2024-09-16T01:00:46.968248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:40.731288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627338+0000","last_change":"2024-09-16T00:58:36.517190+0000","last_active":"2024-09-16T01:00:45.627338+0000","last_peered":"2024-09-16T01:00:45.627338+0000","last_clean":"2024-09-16T01:00:45.627338+0000","last_became_active":"2024-09-16T00:58:36.516877+0000","last_became_peered":"2024-09-16T00:58:36.516877+0000","last_unstale":"2024-09-16T01:00:45.627338+0000","last_undegraded":"2024-09-16T01:00:45.627338+0000","last_fullsized":"2024-09-16T01:00:45.627338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.408011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719645+0000","last_change":"2024-09-16T00:59:44.863832+0000","last_active":"2024-09-16T01:00:45.719645+0000","last_peered":"2024-09-16T01:00:45.719645+0000","last_clean":"2024-09-16T01:00:45.719645+0000","last_became_active":"2024-09-16T00:59:44.863298+0000","last_became_peered":"2024-09-16T00:59:44.863298+0000","last_unstale":"2024-09-16T01:00:45.719645+0000","last_undegraded":"2024-09-16T01:00:45.719645+0000","last_fullsized":"2024-09-16T01:00:45.719645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:55.449728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714641+0000","last_change":"2024-09-16T00:58:34.472375+0000","last_active":"2024-09-16T01:00:45.714641+0000","last_peered":"2024-09-16T01:00:45.714641+0000","last_clean":"2024-09-16T01:00:45.714641+0000","last_became_active":"2024-09-16T00:58:34.471990+0000","last_became_peered":"2024-09-16T00:58:34.471990+0000","last_unstale":"2024-09-16T01:00:45.714641+0000","last_undegraded":"2024-09-16T01:00:45.714641+0000","last_fullsized":"2024-09-16T01:00:45.714641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:15.746005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624668+0000","last_change":"2024-09-16T00:58:36.513747+0000","last_active":"2024-09-16T01:00:45.624668+0000","last_peered":"2024-09-16T01:00:45.624668+0000","last_clean":"2024-09-16T01:00:45.624668+0000","last_became_active":"2024-09-16T00:58:36.512635+0000","last_became_peered":"2024-09-16T00:58:36.512635+0000","last_unstale":"2024-09-16T01:00:45.624668+0000","last_undegraded":"2024-09-16T01:00:45.624668+0000","last_fullsized":"2024-09-16T01:00:45.624668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:39.014961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719864+0000","last_change":"2024-09-16T00:58:43.609355+0000","last_active":"2024-09-16T01:00:45.719864+0000","last_peered":"2024-09-16T01:00:45.719864+0000","last_clean":"2024-09-16T01:00:45.719864+0000","last_became_active":"2024-09-16T00:58:43.608892+0000","last_became_peered":"2024-09-16T00:58:43.608892+0000","last_unstale":"2024-09-16T01:00:45.719864+0000","last_undegraded":"2024-09-16T01:00:45.719864+0000","last_fullsized":"2024-09-16T01:00:45.719864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:20.718163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714484+0000","last_change":"2024-09-16T00:58:34.469650+0000","last_active":"2024-09-16T01:00:45.714484+0000","last_peered":"2024-09-16T01:00:45.714484+0000","last_clean":"2024-09-16T01:00:45.714484+0000","last_became_active":"2024-09-16T00:58:34.468939+0000","last_became_peered":"2024-09-16T00:58:34.468939+0000","last_unstale":"2024-09-16T01:00:45.714484+0000","last_undegraded":"2024-09-16T01:00:45.714484+0000","last_fullsized":"2024-09-16T01:00:45.714484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:34.511111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623914+0000","last_change":"2024-09-16T00:59:45.097454+0000","last_active":"2024-09-16T01:00:45.623914+0000","last_peered":"2024-09-16T01:00:45.623914+0000","last_clean":"2024-09-16T01:00:45.623914+0000","last_became_active":"2024-09-16T00:59:45.096985+0000","last_became_peered":"2024-09-16T00:59:45.096985+0000","last_unstale":"2024-09-16T01:00:45.623914+0000","last_undegraded":"2024-09-16T01:00:45.623914+0000","last_fullsized":"2024-09-16T01:00:45.623914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:03.247850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.719801+0000","last_change":"2024-09-16T00:58:43.612479+0000","last_active":"2024-09-16T01:00:45.719801+0000","last_peered":"2024-09-16T01:00:45.719801+0000","last_clean":"2024-09-16T01:00:45.719801+0000","last_became_active":"2024-09-16T00:58:43.612001+0000","last_became_peered":"2024-09-16T00:58:43.612001+0000","last_unstale":"2024-09-16T01:00:45.719801+0000","last_undegraded":"2024-09-16T01:00:45.719801+0000","last_fullsized":"2024-09-16T01:00:45.719801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:33.056052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919590+0000","last_change":"2024-09-16T00:58:36.519407+0000","last_active":"2024-09-16T01:00:45.919590+0000","last_peered":"2024-09-16T01:00:45.919590+0000","last_clean":"2024-09-16T01:00:45.919590+0000","last_became_active":"2024-09-16T00:58:36.519108+0000","last_became_peered":"2024-09-16T00:58:36.519108+0000","last_unstale":"2024-09-16T01:00:45.919590+0000","last_undegraded":"2024-09-16T01:00:45.919590+0000","last_fullsized":"2024-09-16T01:00:45.919590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:28.611094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714187+0000","last_change":"2024-09-16T00:58:34.472295+0000","last_active":"2024-09-16T01:00:45.714187+0000","last_peered":"2024-09-16T01:00:45.714187+0000","last_clean":"2024-09-16T01:00:45.714187+0000","last_became_active":"2024-09-16T00:58:34.471968+0000","last_became_peered":"2024-09-16T00:58:34.471968+0000","last_unstale":"2024-09-16T01:00:45.714187+0000","last_undegraded":"2024-09-16T01:00:45.714187+0000","last_fullsized":"2024-09-16T01:00:45.714187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:44.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720006+0000","last_change":"2024-09-16T00:58:43.615870+0000","last_active":"2024-09-16T01:00:45.720006+0000","last_peered":"2024-09-16T01:00:45.720006+0000","last_clean":"2024-09-16T01:00:45.720006+0000","last_became_active":"2024-09-16T00:58:43.615116+0000","last_became_peered":"2024-09-16T00:58:43.615116+0000","last_unstale":"2024-09-16T01:00:45.720006+0000","last_undegraded":"2024-09-16T01:00:45.720006+0000","last_fullsized":"2024-09-16T01:00:45.720006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:44.742792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967891+0000","last_change":"2024-09-16T00:58:36.512485+0000","last_active":"2024-09-16T01:00:46.967891+0000","last_peered":"2024-09-16T01:00:46.967891+0000","last_clean":"2024-09-16T01:00:46.967891+0000","last_became_active":"2024-09-16T00:58:36.512175+0000","last_became_peered":"2024-09-16T00:58:36.512175+0000","last_unstale":"2024-09-16T01:00:46.967891+0000","last_undegraded":"2024-09-16T01:00:46.967891+0000","last_fullsized":"2024-09-16T01:00:46.967891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.328409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'4","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.896964+0000","last_change":"2024-09-16T00:59:44.841052+0000","last_active":"2024-09-16T01:00:45.896964+0000","last_peered":"2024-09-16T01:00:45.896964+0000","last_clean":"2024-09-16T01:00:45.896964+0000","last_became_active":"2024-09-16T00:59:44.834033+0000","last_became_peered":"2024-09-16T00:59:44.834033+0000","last_unstale":"2024-09-16T01:00:45.896964+0000","last_undegraded":"2024-09-16T01:00:45.896964+0000","last_fullsized":"2024-09-16T01:00:45.896964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:09.696435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720242+0000","last_change":"2024-09-16T00:58:43.610265+0000","last_active":"2024-09-16T01:00:45.720242+0000","last_peered":"2024-09-16T01:00:45.720242+0000","last_clean":"2024-09-16T01:00:45.720242+0000","last_became_active":"2024-09-16T00:58:43.609868+0000","last_became_peered":"2024-09-16T00:58:43.609868+0000","last_unstale":"2024-09-16T01:00:45.720242+0000","last_undegraded":"2024-09-16T01:00:45.720242+0000","last_fullsized":"2024-09-16T01:00:45.720242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:54.689332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897423+0000","last_change":"2024-09-16T00:58:36.512801+0000","last_active":"2024-09-16T01:00:45.897423+0000","last_peered":"2024-09-16T01:00:45.897423+0000","last_clean":"2024-09-16T01:00:45.897423+0000","last_became_active":"2024-09-16T00:58:36.512469+0000","last_became_peered":"2024-09-16T00:58:36.512469+0000","last_unstale":"2024-09-16T01:00:45.897423+0000","last_undegraded":"2024-09-16T01:00:45.897423+0000","last_fullsized":"2024-09-16T01:00:45.897423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:57.951743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967904+0000","last_change":"2024-09-16T00:58:34.471498+0000","last_active":"2024-09-16T01:00:46.967904+0000","last_peered":"2024-09-16T01:00:46.967904+0000","last_clean":"2024-09-16T01:00:46.967904+0000","last_became_active":"2024-09-16T00:58:34.471093+0000","last_became_peered":"2024-09-16T00:58:34.471093+0000","last_unstale":"2024-09-16T01:00:46.967904+0000","last_undegraded":"2024-09-16T01:00:46.967904+0000","last_fullsized":"2024-09-16T01:00:46.967904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:35.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624262+0000","last_change":"2024-09-16T00:58:43.616376+0000","last_active":"2024-09-16T01:00:45.624262+0000","last_peered":"2024-09-16T01:00:45.624262+0000","last_clean":"2024-09-16T01:00:45.624262+0000","last_became_active":"2024-09-16T00:58:43.616029+0000","last_became_peered":"2024-09-16T00:58:43.616029+0000","last_unstale":"2024-09-16T01:00:45.624262+0000","last_undegraded":"2024-09-16T01:00:45.624262+0000","last_fullsized":"2024-09-16T01:00:45.624262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:54.776250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714062+0000","last_change":"2024-09-16T00:58:36.506625+0000","last_active":"2024-09-16T01:00:45.714062+0000","last_peered":"2024-09-16T01:00:45.714062+0000","last_clean":"2024-09-16T01:00:45.714062+0000","last_became_active":"2024-09-16T00:58:36.506337+0000","last_became_peered":"2024-09-16T00:58:36.506337+0000","last_unstale":"2024-09-16T01:00:45.714062+0000","last_undegraded":"2024-09-16T01:00:45.714062+0000","last_fullsized":"2024-09-16T01:00:45.714062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:22.080165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.901530+0000","last_change":"2024-09-16T01:00:45.901112+0000","last_active":"2024-09-16T01:00:45.901530+0000","last_peered":"2024-09-16T01:00:45.901530+0000","last_clean":"2024-09-16T01:00:45.901530+0000","last_became_active":"2024-09-16T01:00:45.898274+0000","last_became_peered":"2024-09-16T01:00:45.898274+0000","last_unstale":"2024-09-16T01:00:45.901530+0000","last_undegraded":"2024-09-16T01:00:45.901530+0000","last_fullsized":"2024-09-16T01:00:45.901530+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:55.626391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720033+0000","last_change":"2024-09-16T00:58:43.609399+0000","last_active":"2024-09-16T01:00:45.720033+0000","last_peered":"2024-09-16T01:00:45.720033+0000","last_clean":"2024-09-16T01:00:45.720033+0000","last_became_active":"2024-09-16T00:58:43.608988+0000","last_became_peered":"2024-09-16T00:58:43.608988+0000","last_unstale":"2024-09-16T01:00:45.720033+0000","last_undegraded":"2024-09-16T01:00:45.720033+0000","last_fullsized":"2024-09-16T01:00:45.720033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.500071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627256+0000","last_change":"2024-09-16T00:58:36.515930+0000","last_active":"2024-09-16T01:00:45.627256+0000","last_peered":"2024-09-16T01:00:45.627256+0000","last_clean":"2024-09-16T01:00:45.627256+0000","last_became_active":"2024-09-16T00:58:36.515625+0000","last_became_peered":"2024-09-16T00:58:36.515625+0000","last_unstale":"2024-09-16T01:00:45.627256+0000","last_undegraded":"2024-09-16T01:00:45.627256+0000","last_fullsized":"2024-09-16T01:00:45.627256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:55.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720365+0000","last_change":"2024-09-16T00:58:34.508686+0000","last_active":"2024-09-16T01:00:45.720365+0000","last_peered":"2024-09-16T01:00:45.720365+0000","last_clean":"2024-09-16T01:00:45.720365+0000","last_became_active":"2024-09-16T00:58:34.508284+0000","last_became_peered":"2024-09-16T00:58:34.508284+0000","last_unstale":"2024-09-16T01:00:45.720365+0000","last_undegraded":"2024-09-16T01:00:45.720365+0000","last_fullsized":"2024-09-16T01:00:45.720365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:47.545949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627558+0000","last_change":"2024-09-16T00:58:43.615852+0000","last_active":"2024-09-16T01:00:45.627558+0000","last_peered":"2024-09-16T01:00:45.627558+0000","last_clean":"2024-09-16T01:00:45.627558+0000","last_became_active":"2024-09-16T00:58:43.615474+0000","last_became_peered":"2024-09-16T00:58:43.615474+0000","last_unstale":"2024-09-16T01:00:45.627558+0000","last_undegraded":"2024-09-16T01:00:45.627558+0000","last_fullsized":"2024-09-16T01:00:45.627558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:39.596924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968316+0000","last_change":"2024-09-16T00:58:36.513820+0000","last_active":"2024-09-16T01:00:46.968316+0000","last_peered":"2024-09-16T01:00:46.968316+0000","last_clean":"2024-09-16T01:00:46.968316+0000","last_became_active":"2024-09-16T00:58:36.513513+0000","last_became_peered":"2024-09-16T00:58:36.513513+0000","last_unstale":"2024-09-16T01:00:46.968316+0000","last_undegraded":"2024-09-16T01:00:46.968316+0000","last_fullsized":"2024-09-16T01:00:46.968316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:34.584214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'16","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624208+0000","last_change":"2024-09-16T00:58:34.462794+0000","last_active":"2024-09-16T01:00:45.624208+0000","last_peered":"2024-09-16T01:00:45.624208+0000","last_clean":"2024-09-16T01:00:45.624208+0000","last_became_active":"2024-09-16T00:58:34.462471+0000","last_became_peered":"2024-09-16T00:58:34.462471+0000","last_unstale":"2024-09-16T01:00:45.624208+0000","last_undegraded":"2024-09-16T01:00:45.624208+0000","last_fullsized":"2024-09-16T01:00:45.624208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:13.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967564+0000","last_change":"2024-09-16T00:58:43.607718+0000","last_active":"2024-09-16T01:00:46.967564+0000","last_peered":"2024-09-16T01:00:46.967564+0000","last_clean":"2024-09-16T01:00:46.967564+0000","last_became_active":"2024-09-16T00:58:43.607347+0000","last_became_peered":"2024-09-16T00:58:43.607347+0000","last_unstale":"2024-09-16T01:00:46.967564+0000","last_undegraded":"2024-09-16T01:00:46.967564+0000","last_fullsized":"2024-09-16T01:00:46.967564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:12.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.507161+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.504062+0000","last_became_peered":"2024-09-16T00:58:36.504062+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:26.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:58:34.829848+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:58:34.829439+0000","last_became_peered":"2024-09-16T00:58:34.829439+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:06.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897267+0000","last_change":"2024-09-16T00:58:43.618334+0000","last_active":"2024-09-16T01:00:45.897267+0000","last_peered":"2024-09-16T01:00:45.897267+0000","last_clean":"2024-09-16T01:00:45.897267+0000","last_became_active":"2024-09-16T00:58:43.617810+0000","last_became_peered":"2024-09-16T00:58:43.617810+0000","last_unstale":"2024-09-16T01:00:45.897267+0000","last_undegraded":"2024-09-16T01:00:45.897267+0000","last_fullsized":"2024-09-16T01:00:45.897267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:58.202973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711427+0000","last_change":"2024-09-16T00:58:36.509025+0000","last_active":"2024-09-16T01:00:45.711427+0000","last_peered":"2024-09-16T01:00:45.711427+0000","last_clean":"2024-09-16T01:00:45.711427+0000","last_became_active":"2024-09-16T00:58:36.508660+0000","last_became_peered":"2024-09-16T00:58:36.508660+0000","last_unstale":"2024-09-16T01:00:45.711427+0000","last_undegraded":"2024-09-16T01:00:45.711427+0000","last_fullsized":"2024-09-16T01:00:45.711427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:01.433486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624046+0000","last_change":"2024-09-16T00:58:34.829899+0000","last_active":"2024-09-16T01:00:45.624046+0000","last_peered":"2024-09-16T01:00:45.624046+0000","last_clean":"2024-09-16T01:00:45.624046+0000","last_became_active":"2024-09-16T00:58:34.829546+0000","last_became_peered":"2024-09-16T00:58:34.829546+0000","last_unstale":"2024-09-16T01:00:45.624046+0000","last_undegraded":"2024-09-16T01:00:45.624046+0000","last_fullsized":"2024-09-16T01:00:45.624046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:21.253829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714080+0000","last_change":"2024-09-16T00:58:43.610143+0000","last_active":"2024-09-16T01:00:45.714080+0000","last_peered":"2024-09-16T01:00:45.714080+0000","last_clean":"2024-09-16T01:00:45.714080+0000","last_became_active":"2024-09-16T00:58:43.609739+0000","last_became_peered":"2024-09-16T00:58:43.609739+0000","last_unstale":"2024-09-16T01:00:45.714080+0000","last_undegraded":"2024-09-16T01:00:45.714080+0000","last_fullsized":"2024-09-16T01:00:45.714080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:28.212908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711421+0000","last_change":"2024-09-16T00:58:36.520423+0000","last_active":"2024-09-16T01:00:45.711421+0000","last_peered":"2024-09-16T01:00:45.711421+0000","last_clean":"2024-09-16T01:00:45.711421+0000","last_became_active":"2024-09-16T00:58:36.520117+0000","last_became_peered":"2024-09-16T00:58:36.520117+0000","last_unstale":"2024-09-16T01:00:45.711421+0000","last_undegraded":"2024-09-16T01:00:45.711421+0000","last_fullsized":"2024-09-16T01:00:45.711421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.652142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:14.959504+0000","last_change":"2024-09-16T00:58:34.475161+0000","last_active":"2024-09-16T01:01:14.959504+0000","last_peered":"2024-09-16T01:01:14.959504+0000","last_clean":"2024-09-16T01:01:14.959504+0000","last_became_active":"2024-09-16T00:58:34.474755+0000","last_became_peered":"2024-09-16T00:58:34.474755+0000","last_unstale":"2024-09-16T01:01:14.959504+0000","last_undegraded":"2024-09-16T01:01:14.959504+0000","last_fullsized":"2024-09-16T01:01:14.959504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:12.884466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717746+0000","last_change":"2024-09-16T00:58:43.609042+0000","last_active":"2024-09-16T01:00:45.717746+0000","last_peered":"2024-09-16T01:00:45.717746+0000","last_clean":"2024-09-16T01:00:45.717746+0000","last_became_active":"2024-09-16T00:58:43.608596+0000","last_became_peered":"2024-09-16T00:58:43.608596+0000","last_unstale":"2024-09-16T01:00:45.717746+0000","last_undegraded":"2024-09-16T01:00:45.717746+0000","last_fullsized":"2024-09-16T01:00:45.717746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:47.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625659+0000","last_change":"2024-09-16T00:59:44.838583+0000","last_active":"2024-09-16T01:00:45.625659+0000","last_peered":"2024-09-16T01:00:45.625659+0000","last_clean":"2024-09-16T01:00:45.625659+0000","last_became_active":"2024-09-16T00:59:44.838221+0000","last_became_peered":"2024-09-16T00:59:44.838221+0000","last_unstale":"2024-09-16T01:00:45.625659+0000","last_undegraded":"2024-09-16T01:00:45.625659+0000","last_fullsized":"2024-09-16T01:00:45.625659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:27.562118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:12.756950+0000","last_change":"2024-09-16T00:58:34.829452+0000","last_active":"2024-09-16T01:01:12.756950+0000","last_peered":"2024-09-16T01:01:12.756950+0000","last_clean":"2024-09-16T01:01:12.756950+0000","last_became_active":"2024-09-16T00:58:34.829129+0000","last_became_peered":"2024-09-16T00:58:34.829129+0000","last_unstale":"2024-09-16T01:01:12.756950+0000","last_undegraded":"2024-09-16T01:01:12.756950+0000","last_fullsized":"2024-09-16T01:01:12.756950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718001+0000","last_change":"2024-09-16T00:58:43.609230+0000","last_active":"2024-09-16T01:00:45.718001+0000","last_peered":"2024-09-16T01:00:45.718001+0000","last_clean":"2024-09-16T01:00:45.718001+0000","last_became_active":"2024-09-16T00:58:43.608879+0000","last_became_peered":"2024-09-16T00:58:43.608879+0000","last_unstale":"2024-09-16T01:00:45.718001+0000","last_undegraded":"2024-09-16T01:00:45.718001+0000","last_fullsized":"2024-09-16T01:00:45.718001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:45.112878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717141+0000","last_change":"2024-09-16T00:58:36.503412+0000","last_active":"2024-09-16T01:00:45.717141+0000","last_peered":"2024-09-16T01:00:45.717141+0000","last_clean":"2024-09-16T01:00:45.717141+0000","last_became_active":"2024-09-16T00:58:36.503043+0000","last_became_peered":"2024-09-16T00:58:36.503043+0000","last_unstale":"2024-09-16T01:00:45.717141+0000","last_undegraded":"2024-09-16T01:00:45.717141+0000","last_fullsized":"2024-09-16T01:00:45.717141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:18.495669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919328+0000","last_change":"2024-09-16T00:58:34.468460+0000","last_active":"2024-09-16T01:00:45.919328+0000","last_peered":"2024-09-16T01:00:45.919328+0000","last_clean":"2024-09-16T01:00:45.919328+0000","last_became_active":"2024-09-16T00:58:34.468104+0000","last_became_peered":"2024-09-16T00:58:34.468104+0000","last_unstale":"2024-09-16T01:00:45.919328+0000","last_undegraded":"2024-09-16T01:00:45.919328+0000","last_fullsized":"2024-09-16T01:00:45.919328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:13.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714467+0000","last_change":"2024-09-16T00:59:44.863609+0000","last_active":"2024-09-16T01:00:45.714467+0000","last_peered":"2024-09-16T01:00:45.714467+0000","last_clean":"2024-09-16T01:00:45.714467+0000","last_became_active":"2024-09-16T00:59:44.863152+0000","last_became_peered":"2024-09-16T00:59:44.863152+0000","last_unstale":"2024-09-16T01:00:45.714467+0000","last_undegraded":"2024-09-16T01:00:45.714467+0000","last_fullsized":"2024-09-16T01:00:45.714467+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:51.312612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967875+0000","last_change":"2024-09-16T00:58:36.509749+0000","last_active":"2024-09-16T01:00:46.967875+0000","last_peered":"2024-09-16T01:00:46.967875+0000","last_clean":"2024-09-16T01:00:46.967875+0000","last_became_active":"2024-09-16T00:58:36.509411+0000","last_became_peered":"2024-09-16T00:58:36.509411+0000","last_unstale":"2024-09-16T01:00:46.967875+0000","last_undegraded":"2024-09-16T01:00:46.967875+0000","last_fullsized":"2024-09-16T01:00:46.967875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:14.291956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720026+0000","last_change":"2024-09-16T00:58:34.470190+0000","last_active":"2024-09-16T01:00:45.720026+0000","last_peered":"2024-09-16T01:00:45.720026+0000","last_clean":"2024-09-16T01:00:45.720026+0000","last_became_active":"2024-09-16T00:58:34.469832+0000","last_became_peered":"2024-09-16T00:58:34.469832+0000","last_unstale":"2024-09-16T01:00:45.720026+0000","last_undegraded":"2024-09-16T01:00:45.720026+0000","last_fullsized":"2024-09-16T01:00:45.720026+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:03.888585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919482+0000","last_change":"2024-09-16T00:57:23.502001+0000","last_active":"2024-09-16T01:00:45.919482+0000","last_peered":"2024-09-16T01:00:45.919482+0000","last_clean":"2024-09-16T01:00:45.919482+0000","last_became_active":"2024-09-16T00:57:23.501465+0000","last_became_peered":"2024-09-16T00:57:23.501465+0000","last_unstale":"2024-09-16T01:00:45.919482+0000","last_undegraded":"2024-09-16T01:00:45.919482+0000","last_fullsized":"2024-09-16T01:00:45.919482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:53:57.344038+0000","last_clean_scrub_stamp":"2024-09-16T00:53:57.344038+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:22.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919823+0000","last_change":"2024-09-16T00:58:43.609572+0000","last_active":"2024-09-16T01:00:45.919823+0000","last_peered":"2024-09-16T01:00:45.919823+0000","last_clean":"2024-09-16T01:00:45.919823+0000","last_became_active":"2024-09-16T00:58:43.609185+0000","last_became_peered":"2024-09-16T00:58:43.609185+0000","last_unstale":"2024-09-16T01:00:45.919823+0000","last_undegraded":"2024-09-16T01:00:45.919823+0000","last_fullsized":"2024-09-16T01:00:45.919823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.199976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919987+0000","last_change":"2024-09-16T00:58:36.510761+0000","last_active":"2024-09-16T01:00:45.919987+0000","last_peered":"2024-09-16T01:00:45.919987+0000","last_clean":"2024-09-16T01:00:45.919987+0000","last_became_active":"2024-09-16T00:58:36.510456+0000","last_became_peered":"2024-09-16T00:58:36.510456+0000","last_unstale":"2024-09-16T01:00:45.919987+0000","last_undegraded":"2024-09-16T01:00:45.919987+0000","last_fullsized":"2024-09-16T01:00:45.919987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:02.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'8","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:14.761188+0000","last_change":"2024-09-16T00:58:34.830238+0000","last_active":"2024-09-16T01:01:14.761188+0000","last_peered":"2024-09-16T01:01:14.761188+0000","last_clean":"2024-09-16T01:01:14.761188+0000","last_became_active":"2024-09-16T00:58:34.829558+0000","last_became_peered":"2024-09-16T00:58:34.829558+0000","last_unstale":"2024-09-16T01:01:14.761188+0000","last_undegraded":"2024-09-16T01:01:14.761188+0000","last_fullsized":"2024-09-16T01:01:14.761188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.347122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624541+0000","last_change":"2024-09-16T00:58:43.613179+0000","last_active":"2024-09-16T01:00:45.624541+0000","last_peered":"2024-09-16T01:00:45.624541+0000","last_clean":"2024-09-16T01:00:45.624541+0000","last_became_active":"2024-09-16T00:58:43.612794+0000","last_became_peered":"2024-09-16T00:58:43.612794+0000","last_unstale":"2024-09-16T01:00:45.624541+0000","last_undegraded":"2024-09-16T01:00:45.624541+0000","last_fullsized":"2024-09-16T01:00:45.624541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:04:24.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919741+0000","last_change":"2024-09-16T00:58:36.512600+0000","last_active":"2024-09-16T01:00:45.919741+0000","last_peered":"2024-09-16T01:00:45.919741+0000","last_clean":"2024-09-16T01:00:45.919741+0000","last_became_active":"2024-09-16T00:58:36.512309+0000","last_became_peered":"2024-09-16T00:58:36.512309+0000","last_unstale":"2024-09-16T01:00:45.919741+0000","last_undegraded":"2024-09-16T01:00:45.919741+0000","last_fullsized":"2024-09-16T01:00:45.919741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:35.790755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626294+0000","last_change":"2024-09-16T00:58:34.471787+0000","last_active":"2024-09-16T01:00:45.626294+0000","last_peered":"2024-09-16T01:00:45.626294+0000","last_clean":"2024-09-16T01:00:45.626294+0000","last_became_active":"2024-09-16T00:58:34.471119+0000","last_became_peered":"2024-09-16T00:58:34.471119+0000","last_unstale":"2024-09-16T01:00:45.626294+0000","last_undegraded":"2024-09-16T01:00:45.626294+0000","last_fullsized":"2024-09-16T01:00:45.626294+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:26.121669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626989+0000","last_change":"2024-09-16T00:58:43.609676+0000","last_active":"2024-09-16T01:00:45.626989+0000","last_peered":"2024-09-16T01:00:45.626989+0000","last_clean":"2024-09-16T01:00:45.626989+0000","last_became_active":"2024-09-16T00:58:43.609313+0000","last_became_peered":"2024-09-16T00:58:43.609313+0000","last_unstale":"2024-09-16T01:00:45.626989+0000","last_undegraded":"2024-09-16T01:00:45.626989+0000","last_fullsized":"2024-09-16T01:00:45.626989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:53.339070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919903+0000","last_change":"2024-09-16T00:58:36.514621+0000","last_active":"2024-09-16T01:00:45.919903+0000","last_peered":"2024-09-16T01:00:45.919903+0000","last_clean":"2024-09-16T01:00:45.919903+0000","last_became_active":"2024-09-16T00:58:36.514259+0000","last_became_peered":"2024-09-16T00:58:36.514259+0000","last_unstale":"2024-09-16T01:00:45.919903+0000","last_undegraded":"2024-09-16T01:00:45.919903+0000","last_fullsized":"2024-09-16T01:00:45.919903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:11.411742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718006+0000","last_change":"2024-09-16T00:58:34.470512+0000","last_active":"2024-09-16T01:00:45.718006+0000","last_peered":"2024-09-16T01:00:45.718006+0000","last_clean":"2024-09-16T01:00:45.718006+0000","last_became_active":"2024-09-16T00:58:34.470140+0000","last_became_peered":"2024-09-16T00:58:34.470140+0000","last_unstale":"2024-09-16T01:00:45.718006+0000","last_undegraded":"2024-09-16T01:00:45.718006+0000","last_fullsized":"2024-09-16T01:00:45.718006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:04.068901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625516+0000","last_change":"2024-09-16T00:58:43.615221+0000","last_active":"2024-09-16T01:00:45.625516+0000","last_peered":"2024-09-16T01:00:45.625516+0000","last_clean":"2024-09-16T01:00:45.625516+0000","last_became_active":"2024-09-16T00:58:43.614820+0000","last_became_peered":"2024-09-16T00:58:43.614820+0000","last_unstale":"2024-09-16T01:00:45.625516+0000","last_undegraded":"2024-09-16T01:00:45.625516+0000","last_fullsized":"2024-09-16T01:00:45.625516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:31.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897390+0000","last_change":"2024-09-16T00:58:36.515470+0000","last_active":"2024-09-16T01:00:45.897390+0000","last_peered":"2024-09-16T01:00:45.897390+0000","last_clean":"2024-09-16T01:00:45.897390+0000","last_became_active":"2024-09-16T00:58:36.515145+0000","last_became_peered":"2024-09-16T00:58:36.515145+0000","last_unstale":"2024-09-16T01:00:45.897390+0000","last_undegraded":"2024-09-16T01:00:45.897390+0000","last_fullsized":"2024-09-16T01:00:45.897390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:10.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714720+0000","last_change":"2024-09-16T00:58:34.464865+0000","last_active":"2024-09-16T01:00:45.714720+0000","last_peered":"2024-09-16T01:00:45.714720+0000","last_clean":"2024-09-16T01:00:45.714720+0000","last_became_active":"2024-09-16T00:58:34.464448+0000","last_became_peered":"2024-09-16T00:58:34.464448+0000","last_unstale":"2024-09-16T01:00:45.714720+0000","last_undegraded":"2024-09-16T01:00:45.714720+0000","last_fullsized":"2024-09-16T01:00:45.714720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:47.454251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625710+0000","last_change":"2024-09-16T00:58:43.610348+0000","last_active":"2024-09-16T01:00:45.625710+0000","last_peered":"2024-09-16T01:00:45.625710+0000","last_clean":"2024-09-16T01:00:45.625710+0000","last_became_active":"2024-09-16T00:58:43.609497+0000","last_became_peered":"2024-09-16T00:58:43.609497+0000","last_unstale":"2024-09-16T01:00:45.625710+0000","last_undegraded":"2024-09-16T01:00:45.625710+0000","last_fullsized":"2024-09-16T01:00:45.625710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:52.931325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626081+0000","last_change":"2024-09-16T00:58:36.517412+0000","last_active":"2024-09-16T01:00:45.626081+0000","last_peered":"2024-09-16T01:00:45.626081+0000","last_clean":"2024-09-16T01:00:45.626081+0000","last_became_active":"2024-09-16T00:58:36.516600+0000","last_became_peered":"2024-09-16T00:58:36.516600+0000","last_unstale":"2024-09-16T01:00:45.626081+0000","last_undegraded":"2024-09-16T01:00:45.626081+0000","last_fullsized":"2024-09-16T01:00:45.626081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:39.445454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714191+0000","last_change":"2024-09-16T00:58:34.831420+0000","last_active":"2024-09-16T01:00:45.714191+0000","last_peered":"2024-09-16T01:00:45.714191+0000","last_clean":"2024-09-16T01:00:45.714191+0000","last_became_active":"2024-09-16T00:58:34.830991+0000","last_became_peered":"2024-09-16T00:58:34.830991+0000","last_unstale":"2024-09-16T01:00:45.714191+0000","last_undegraded":"2024-09-16T01:00:45.714191+0000","last_fullsized":"2024-09-16T01:00:45.714191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:13.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.718011+0000","last_change":"2024-09-16T00:58:43.611781+0000","last_active":"2024-09-16T01:00:45.718011+0000","last_peered":"2024-09-16T01:00:45.718011+0000","last_clean":"2024-09-16T01:00:45.718011+0000","last_became_active":"2024-09-16T00:58:43.610332+0000","last_became_peered":"2024-09-16T00:58:43.610332+0000","last_unstale":"2024-09-16T01:00:45.718011+0000","last_undegraded":"2024-09-16T01:00:45.718011+0000","last_fullsized":"2024-09-16T01:00:45.718011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:18.252140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919291+0000","last_change":"2024-09-16T00:58:36.514395+0000","last_active":"2024-09-16T01:00:45.919291+0000","last_peered":"2024-09-16T01:00:45.919291+0000","last_clean":"2024-09-16T01:00:45.919291+0000","last_became_active":"2024-09-16T00:58:36.513570+0000","last_became_peered":"2024-09-16T00:58:36.513570+0000","last_unstale":"2024-09-16T01:00:45.919291+0000","last_undegraded":"2024-09-16T01:00:45.919291+0000","last_fullsized":"2024-09-16T01:00:45.919291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:56.148815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:11.756066+0000","last_change":"2024-09-16T00:58:34.473583+0000","last_active":"2024-09-16T01:01:11.756066+0000","last_peered":"2024-09-16T01:01:11.756066+0000","last_clean":"2024-09-16T01:01:11.756066+0000","last_became_active":"2024-09-16T00:58:34.473259+0000","last_became_peered":"2024-09-16T00:58:34.473259+0000","last_unstale":"2024-09-16T01:01:11.756066+0000","last_undegraded":"2024-09-16T01:01:11.756066+0000","last_fullsized":"2024-09-16T01:01:11.756066+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:55.622609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714566+0000","last_change":"2024-09-16T00:59:44.835446+0000","last_active":"2024-09-16T01:00:45.714566+0000","last_peered":"2024-09-16T01:00:45.714566+0000","last_clean":"2024-09-16T01:00:45.714566+0000","last_became_active":"2024-09-16T00:59:44.834981+0000","last_became_peered":"2024-09-16T00:59:44.834981+0000","last_unstale":"2024-09-16T01:00:45.714566+0000","last_undegraded":"2024-09-16T01:00:45.714566+0000","last_fullsized":"2024-09-16T01:00:45.714566+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:41.254621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919524+0000","last_change":"2024-09-16T00:59:44.863645+0000","last_active":"2024-09-16T01:00:45.919524+0000","last_peered":"2024-09-16T01:00:45.919524+0000","last_clean":"2024-09-16T01:00:45.919524+0000","last_became_active":"2024-09-16T00:59:44.863207+0000","last_became_peered":"2024-09-16T00:59:44.863207+0000","last_unstale":"2024-09-16T01:00:45.919524+0000","last_undegraded":"2024-09-16T01:00:45.919524+0000","last_fullsized":"2024-09-16T01:00:45.919524+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:27.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626418+0000","last_change":"2024-09-16T00:58:34.470326+0000","last_active":"2024-09-16T01:00:45.626418+0000","last_peered":"2024-09-16T01:00:45.626418+0000","last_clean":"2024-09-16T01:00:45.626418+0000","last_became_active":"2024-09-16T00:58:34.469920+0000","last_became_peered":"2024-09-16T00:58:34.469920+0000","last_unstale":"2024-09-16T01:00:45.626418+0000","last_undegraded":"2024-09-16T01:00:45.626418+0000","last_fullsized":"2024-09-16T01:00:45.626418+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:58.718004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897319+0000","last_change":"2024-09-16T00:58:43.616324+0000","last_active":"2024-09-16T01:00:45.897319+0000","last_peered":"2024-09-16T01:00:45.897319+0000","last_clean":"2024-09-16T01:00:45.897319+0000","last_became_active":"2024-09-16T00:58:43.615903+0000","last_became_peered":"2024-09-16T00:58:43.615903+0000","last_unstale":"2024-09-16T01:00:45.897319+0000","last_undegraded":"2024-09-16T01:00:45.897319+0000","last_fullsized":"2024-09-16T01:00:45.897319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.683788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717440+0000","last_change":"2024-09-16T00:58:36.512490+0000","last_active":"2024-09-16T01:00:45.717440+0000","last_peered":"2024-09-16T01:00:45.717440+0000","last_clean":"2024-09-16T01:00:45.717440+0000","last_became_active":"2024-09-16T00:58:36.512167+0000","last_became_peered":"2024-09-16T00:58:36.512167+0000","last_unstale":"2024-09-16T01:00:45.717440+0000","last_undegraded":"2024-09-16T01:00:45.717440+0000","last_fullsized":"2024-09-16T01:00:45.717440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627945+0000","last_change":"2024-09-16T00:58:34.471603+0000","last_active":"2024-09-16T01:00:45.627945+0000","last_peered":"2024-09-16T01:00:45.627945+0000","last_clean":"2024-09-16T01:00:45.627945+0000","last_became_active":"2024-09-16T00:58:34.471241+0000","last_became_peered":"2024-09-16T00:58:34.471241+0000","last_unstale":"2024-09-16T01:00:45.627945+0000","last_undegraded":"2024-09-16T01:00:45.627945+0000","last_fullsized":"2024-09-16T01:00:45.627945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:33.756759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626074+0000","last_change":"2024-09-16T00:58:43.607428+0000","last_active":"2024-09-16T01:00:45.626074+0000","last_peered":"2024-09-16T01:00:45.626074+0000","last_clean":"2024-09-16T01:00:45.626074+0000","last_became_active":"2024-09-16T00:58:43.606990+0000","last_became_peered":"2024-09-16T00:58:43.606990+0000","last_unstale":"2024-09-16T01:00:45.626074+0000","last_undegraded":"2024-09-16T01:00:45.626074+0000","last_fullsized":"2024-09-16T01:00:45.626074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:52.367384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714506+0000","last_change":"2024-09-16T00:58:36.513967+0000","last_active":"2024-09-16T01:00:45.714506+0000","last_peered":"2024-09-16T01:00:45.714506+0000","last_clean":"2024-09-16T01:00:45.714506+0000","last_became_active":"2024-09-16T00:58:36.513610+0000","last_became_peered":"2024-09-16T00:58:36.513610+0000","last_unstale":"2024-09-16T01:00:45.714506+0000","last_undegraded":"2024-09-16T01:00:45.714506+0000","last_fullsized":"2024-09-16T01:00:45.714506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:22.763430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'42","reported_seq":320,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:13.759322+0000","last_change":"2024-09-16T00:58:34.471511+0000","last_active":"2024-09-16T01:01:13.759322+0000","last_peered":"2024-09-16T01:01:13.759322+0000","last_clean":"2024-09-16T01:01:13.759322+0000","last_became_active":"2024-09-16T00:58:34.470597+0000","last_became_peered":"2024-09-16T00:58:34.470597+0000","last_unstale":"2024-09-16T01:01:13.759322+0000","last_undegraded":"2024-09-16T01:01:13.759322+0000","last_fullsized":"2024-09-16T01:01:13.759322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.782592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69493,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":239,"num_read_kb":189,"num_write":44,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623834+0000","last_change":"2024-09-16T00:58:43.612177+0000","last_active":"2024-09-16T01:00:45.623834+0000","last_peered":"2024-09-16T01:00:45.623834+0000","last_clean":"2024-09-16T01:00:45.623834+0000","last_became_active":"2024-09-16T00:58:43.611801+0000","last_became_peered":"2024-09-16T00:58:43.611801+0000","last_unstale":"2024-09-16T01:00:45.623834+0000","last_undegraded":"2024-09-16T01:00:45.623834+0000","last_fullsized":"2024-09-16T01:00:45.623834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:39.781429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624875+0000","last_change":"2024-09-16T00:58:36.502231+0000","last_active":"2024-09-16T01:00:45.624875+0000","last_peered":"2024-09-16T01:00:45.624875+0000","last_clean":"2024-09-16T01:00:45.624875+0000","last_became_active":"2024-09-16T00:58:36.501934+0000","last_became_peered":"2024-09-16T00:58:36.501934+0000","last_unstale":"2024-09-16T01:00:45.624875+0000","last_undegraded":"2024-09-16T01:00:45.624875+0000","last_fullsized":"2024-09-16T01:00:45.624875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:29.769186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626236+0000","last_change":"2024-09-16T00:58:34.829872+0000","last_active":"2024-09-16T01:00:45.626236+0000","last_peered":"2024-09-16T01:00:45.626236+0000","last_clean":"2024-09-16T01:00:45.626236+0000","last_became_active":"2024-09-16T00:58:34.829496+0000","last_became_peered":"2024-09-16T00:58:34.829496+0000","last_unstale":"2024-09-16T01:00:45.626236+0000","last_undegraded":"2024-09-16T01:00:45.626236+0000","last_fullsized":"2024-09-16T01:00:45.626236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:47.035177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720036+0000","last_change":"2024-09-16T00:58:43.615560+0000","last_active":"2024-09-16T01:00:45.720036+0000","last_peered":"2024-09-16T01:00:45.720036+0000","last_clean":"2024-09-16T01:00:45.720036+0000","last_became_active":"2024-09-16T00:58:43.615124+0000","last_became_peered":"2024-09-16T00:58:43.615124+0000","last_unstale":"2024-09-16T01:00:45.720036+0000","last_undegraded":"2024-09-16T01:00:45.720036+0000","last_fullsized":"2024-09-16T01:00:45.720036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.455528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627428+0000","last_change":"2024-09-16T00:58:36.514456+0000","last_active":"2024-09-16T01:00:45.627428+0000","last_peered":"2024-09-16T01:00:45.627428+0000","last_clean":"2024-09-16T01:00:45.627428+0000","last_became_active":"2024-09-16T00:58:36.514146+0000","last_became_peered":"2024-09-16T00:58:36.514146+0000","last_unstale":"2024-09-16T01:00:45.627428+0000","last_undegraded":"2024-09-16T01:00:45.627428+0000","last_fullsized":"2024-09-16T01:00:45.627428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:06.760121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919878+0000","last_change":"2024-09-16T00:58:34.471316+0000","last_active":"2024-09-16T01:00:45.919878+0000","last_peered":"2024-09-16T01:00:45.919878+0000","last_clean":"2024-09-16T01:00:45.919878+0000","last_became_active":"2024-09-16T00:58:34.470991+0000","last_became_peered":"2024-09-16T00:58:34.470991+0000","last_unstale":"2024-09-16T01:00:45.919878+0000","last_undegraded":"2024-09-16T01:00:45.919878+0000","last_fullsized":"2024-09-16T01:00:45.919878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:44.492439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623687+0000","last_change":"2024-09-16T00:58:43.617202+0000","last_active":"2024-09-16T01:00:45.623687+0000","last_peered":"2024-09-16T01:00:45.623687+0000","last_clean":"2024-09-16T01:00:45.623687+0000","last_became_active":"2024-09-16T00:58:43.616824+0000","last_became_peered":"2024-09-16T00:58:43.616824+0000","last_unstale":"2024-09-16T01:00:45.623687+0000","last_undegraded":"2024-09-16T01:00:45.623687+0000","last_fullsized":"2024-09-16T01:00:45.623687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:43.035003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625210+0000","last_change":"2024-09-16T00:58:36.512079+0000","last_active":"2024-09-16T01:00:45.625210+0000","last_peered":"2024-09-16T01:00:45.625210+0000","last_clean":"2024-09-16T01:00:45.625210+0000","last_became_active":"2024-09-16T00:58:36.511220+0000","last_became_peered":"2024-09-16T00:58:36.511220+0000","last_unstale":"2024-09-16T01:00:45.625210+0000","last_undegraded":"2024-09-16T01:00:45.625210+0000","last_fullsized":"2024-09-16T01:00:45.625210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:49.798132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'6","reported_seq":271,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:13.758829+0000","last_change":"2024-09-16T00:58:34.470682+0000","last_active":"2024-09-16T01:01:13.758829+0000","last_peered":"2024-09-16T01:01:13.758829+0000","last_clean":"2024-09-16T01:01:13.758829+0000","last_became_active":"2024-09-16T00:58:34.470323+0000","last_became_peered":"2024-09-16T00:58:34.470323+0000","last_unstale":"2024-09-16T01:01:13.758829+0000","last_undegraded":"2024-09-16T01:01:13.758829+0000","last_fullsized":"2024-09-16T01:01:13.758829+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.361374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967738+0000","last_change":"2024-09-16T00:58:43.608941+0000","last_active":"2024-09-16T01:00:46.967738+0000","last_peered":"2024-09-16T01:00:46.967738+0000","last_clean":"2024-09-16T01:00:46.967738+0000","last_became_active":"2024-09-16T00:58:43.607406+0000","last_became_peered":"2024-09-16T00:58:43.607406+0000","last_unstale":"2024-09-16T01:00:46.967738+0000","last_undegraded":"2024-09-16T01:00:46.967738+0000","last_fullsized":"2024-09-16T01:00:46.967738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:10.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627074+0000","last_change":"2024-09-16T00:58:43.613902+0000","last_active":"2024-09-16T01:00:45.627074+0000","last_peered":"2024-09-16T01:00:45.627074+0000","last_clean":"2024-09-16T01:00:45.627074+0000","last_became_active":"2024-09-16T00:58:43.613530+0000","last_became_peered":"2024-09-16T00:58:43.613530+0000","last_unstale":"2024-09-16T01:00:45.627074+0000","last_undegraded":"2024-09-16T01:00:45.627074+0000","last_fullsized":"2024-09-16T01:00:45.627074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:34.774810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623790+0000","last_change":"2024-09-16T00:58:36.504745+0000","last_active":"2024-09-16T01:00:45.623790+0000","last_peered":"2024-09-16T01:00:45.623790+0000","last_clean":"2024-09-16T01:00:45.623790+0000","last_became_active":"2024-09-16T00:58:36.504400+0000","last_became_peered":"2024-09-16T00:58:36.504400+0000","last_unstale":"2024-09-16T01:00:45.623790+0000","last_undegraded":"2024-09-16T01:00:45.623790+0000","last_fullsized":"2024-09-16T01:00:45.623790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:34.444019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626135+0000","last_change":"2024-09-16T00:58:34.470285+0000","last_active":"2024-09-16T01:00:45.626135+0000","last_peered":"2024-09-16T01:00:45.626135+0000","last_clean":"2024-09-16T01:00:45.626135+0000","last_became_active":"2024-09-16T00:58:34.469948+0000","last_became_peered":"2024-09-16T00:58:34.469948+0000","last_unstale":"2024-09-16T01:00:45.626135+0000","last_undegraded":"2024-09-16T01:00:45.626135+0000","last_fullsized":"2024-09-16T01:00:45.626135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:28.553863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897172+0000","last_change":"2024-09-16T00:58:43.614818+0000","last_active":"2024-09-16T01:00:45.897172+0000","last_peered":"2024-09-16T01:00:45.897172+0000","last_clean":"2024-09-16T01:00:45.897172+0000","last_became_active":"2024-09-16T00:58:43.614376+0000","last_became_peered":"2024-09-16T00:58:43.614376+0000","last_unstale":"2024-09-16T01:00:45.897172+0000","last_undegraded":"2024-09-16T01:00:45.897172+0000","last_fullsized":"2024-09-16T01:00:45.897172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:41.699930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967770+0000","last_change":"2024-09-16T00:58:36.505127+0000","last_active":"2024-09-16T01:00:46.967770+0000","last_peered":"2024-09-16T01:00:46.967770+0000","last_clean":"2024-09-16T01:00:46.967770+0000","last_became_active":"2024-09-16T00:58:36.504552+0000","last_became_peered":"2024-09-16T00:58:36.504552+0000","last_unstale":"2024-09-16T01:00:46.967770+0000","last_undegraded":"2024-09-16T01:00:46.967770+0000","last_fullsized":"2024-09-16T01:00:46.967770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:48.104109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717213+0000","last_change":"2024-09-16T00:58:34.462231+0000","last_active":"2024-09-16T01:00:45.717213+0000","last_peered":"2024-09-16T01:00:45.717213+0000","last_clean":"2024-09-16T01:00:45.717213+0000","last_became_active":"2024-09-16T00:58:34.461891+0000","last_became_peered":"2024-09-16T00:58:34.461891+0000","last_unstale":"2024-09-16T01:00:45.717213+0000","last_undegraded":"2024-09-16T01:00:45.717213+0000","last_fullsized":"2024-09-16T01:00:45.717213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.483996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711498+0000","last_change":"2024-09-16T00:58:34.472457+0000","last_active":"2024-09-16T01:00:45.711498+0000","last_peered":"2024-09-16T01:00:45.711498+0000","last_clean":"2024-09-16T01:00:45.711498+0000","last_became_active":"2024-09-16T00:58:34.472084+0000","last_became_peered":"2024-09-16T00:58:34.472084+0000","last_unstale":"2024-09-16T01:00:45.711498+0000","last_undegraded":"2024-09-16T01:00:45.711498+0000","last_fullsized":"2024-09-16T01:00:45.711498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:08.005195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626072+0000","last_change":"2024-09-16T00:58:36.508791+0000","last_active":"2024-09-16T01:00:45.626072+0000","last_peered":"2024-09-16T01:00:45.626072+0000","last_clean":"2024-09-16T01:00:45.626072+0000","last_became_active":"2024-09-16T00:58:36.508461+0000","last_became_peered":"2024-09-16T00:58:36.508461+0000","last_unstale":"2024-09-16T01:00:45.626072+0000","last_undegraded":"2024-09-16T01:00:45.626072+0000","last_fullsized":"2024-09-16T01:00:45.626072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:46.938067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627898+0000","last_change":"2024-09-16T00:58:43.620439+0000","last_active":"2024-09-16T01:00:45.627898+0000","last_peered":"2024-09-16T01:00:45.627898+0000","last_clean":"2024-09-16T01:00:45.627898+0000","last_became_active":"2024-09-16T00:58:43.619952+0000","last_became_peered":"2024-09-16T00:58:43.619952+0000","last_unstale":"2024-09-16T01:00:45.627898+0000","last_undegraded":"2024-09-16T01:00:45.627898+0000","last_fullsized":"2024-09-16T01:00:45.627898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:01:10.755023+0000","last_change":"2024-09-16T00:58:34.473169+0000","last_active":"2024-09-16T01:01:10.755023+0000","last_peered":"2024-09-16T01:01:10.755023+0000","last_clean":"2024-09-16T01:01:10.755023+0000","last_became_active":"2024-09-16T00:58:34.472839+0000","last_became_peered":"2024-09-16T00:58:34.472839+0000","last_unstale":"2024-09-16T01:01:10.755023+0000","last_undegraded":"2024-09-16T01:01:10.755023+0000","last_fullsized":"2024-09-16T01:01:10.755023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:33.449772+0000","last_clean_scrub_stamp":"2024-09-16T00:58:33.449772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:03.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714165+0000","last_change":"2024-09-16T00:58:36.508719+0000","last_active":"2024-09-16T01:00:45.714165+0000","last_peered":"2024-09-16T01:00:45.714165+0000","last_clean":"2024-09-16T01:00:45.714165+0000","last_became_active":"2024-09-16T00:58:36.508427+0000","last_became_peered":"2024-09-16T00:58:36.508427+0000","last_unstale":"2024-09-16T01:00:45.714165+0000","last_undegraded":"2024-09-16T01:00:45.714165+0000","last_fullsized":"2024-09-16T01:00:45.714165+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:44.134558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627846+0000","last_change":"2024-09-16T00:58:43.616532+0000","last_active":"2024-09-16T01:00:45.627846+0000","last_peered":"2024-09-16T01:00:45.627846+0000","last_clean":"2024-09-16T01:00:45.627846+0000","last_became_active":"2024-09-16T00:58:43.616146+0000","last_became_peered":"2024-09-16T00:58:43.616146+0000","last_unstale":"2024-09-16T01:00:45.627846+0000","last_undegraded":"2024-09-16T01:00:45.627846+0000","last_fullsized":"2024-09-16T01:00:45.627846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:42.577780+0000","last_clean_scrub_stamp":"2024-09-16T00:58:42.577780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:50.904766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897283+0000","last_change":"2024-09-16T00:58:36.513232+0000","last_active":"2024-09-16T01:00:45.897283+0000","last_peered":"2024-09-16T01:00:45.897283+0000","last_clean":"2024-09-16T01:00:45.897283+0000","last_became_active":"2024-09-16T00:58:36.512239+0000","last_became_peered":"2024-09-16T00:58:36.512239+0000","last_unstale":"2024-09-16T01:00:45.897283+0000","last_undegraded":"2024-09-16T01:00:45.897283+0000","last_fullsized":"2024-09-16T01:00:45.897283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.903069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627619+0000","last_change":"2024-09-16T00:58:36.513160+0000","last_active":"2024-09-16T01:00:45.627619+0000","last_peered":"2024-09-16T01:00:45.627619+0000","last_clean":"2024-09-16T01:00:45.627619+0000","last_became_active":"2024-09-16T00:58:36.512523+0000","last_became_peered":"2024-09-16T00:58:36.512523+0000","last_unstale":"2024-09-16T01:00:45.627619+0000","last_undegraded":"2024-09-16T01:00:45.627619+0000","last_fullsized":"2024-09-16T01:00:45.627619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:20.934937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627648+0000","last_change":"2024-09-16T00:58:36.516416+0000","last_active":"2024-09-16T01:00:45.627648+0000","last_peered":"2024-09-16T01:00:45.627648+0000","last_clean":"2024-09-16T01:00:45.627648+0000","last_became_active":"2024-09-16T00:58:36.516121+0000","last_became_peered":"2024-09-16T00:58:36.516121+0000","last_unstale":"2024-09-16T01:00:45.627648+0000","last_undegraded":"2024-09-16T01:00:45.627648+0000","last_fullsized":"2024-09-16T01:00:45.627648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:28.848616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627011+0000","last_change":"2024-09-16T00:58:36.510854+0000","last_active":"2024-09-16T01:00:45.627011+0000","last_peered":"2024-09-16T01:00:45.627011+0000","last_clean":"2024-09-16T01:00:45.627011+0000","last_became_active":"2024-09-16T00:58:36.510505+0000","last_became_peered":"2024-09-16T00:58:36.510505+0000","last_unstale":"2024-09-16T01:00:45.627011+0000","last_undegraded":"2024-09-16T01:00:45.627011+0000","last_fullsized":"2024-09-16T01:00:45.627011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.699942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717809+0000","last_change":"2024-09-16T00:58:36.509016+0000","last_active":"2024-09-16T01:00:45.717809+0000","last_peered":"2024-09-16T01:00:45.717809+0000","last_clean":"2024-09-16T01:00:45.717809+0000","last_became_active":"2024-09-16T00:58:36.508690+0000","last_became_peered":"2024-09-16T00:58:36.508690+0000","last_unstale":"2024-09-16T01:00:45.717809+0000","last_undegraded":"2024-09-16T01:00:45.717809+0000","last_fullsized":"2024-09-16T01:00:45.717809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:41.425016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897266+0000","last_change":"2024-09-16T00:58:36.511659+0000","last_active":"2024-09-16T01:00:45.897266+0000","last_peered":"2024-09-16T01:00:45.897266+0000","last_clean":"2024-09-16T01:00:45.897266+0000","last_became_active":"2024-09-16T00:58:36.511225+0000","last_became_peered":"2024-09-16T00:58:36.511225+0000","last_unstale":"2024-09-16T01:00:45.897266+0000","last_undegraded":"2024-09-16T01:00:45.897266+0000","last_fullsized":"2024-09-16T01:00:45.897266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:43.452043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628196+0000","last_change":"2024-09-16T00:58:36.511614+0000","last_active":"2024-09-16T01:00:45.628196+0000","last_peered":"2024-09-16T01:00:45.628196+0000","last_clean":"2024-09-16T01:00:45.628196+0000","last_became_active":"2024-09-16T00:58:36.511304+0000","last_became_peered":"2024-09-16T00:58:36.511304+0000","last_unstale":"2024-09-16T01:00:45.628196+0000","last_undegraded":"2024-09-16T01:00:45.628196+0000","last_fullsized":"2024-09-16T01:00:45.628196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:20.755419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.968311+0000","last_change":"2024-09-16T00:58:36.509399+0000","last_active":"2024-09-16T01:00:46.968311+0000","last_peered":"2024-09-16T01:00:46.968311+0000","last_clean":"2024-09-16T01:00:46.968311+0000","last_became_active":"2024-09-16T00:58:36.509072+0000","last_became_peered":"2024-09-16T00:58:36.509072+0000","last_unstale":"2024-09-16T01:00:46.968311+0000","last_undegraded":"2024-09-16T01:00:46.968311+0000","last_fullsized":"2024-09-16T01:00:46.968311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:29.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625679+0000","last_change":"2024-09-16T00:58:36.506252+0000","last_active":"2024-09-16T01:00:45.625679+0000","last_peered":"2024-09-16T01:00:45.625679+0000","last_clean":"2024-09-16T01:00:45.625679+0000","last_became_active":"2024-09-16T00:58:36.505923+0000","last_became_peered":"2024-09-16T00:58:36.505923+0000","last_unstale":"2024-09-16T01:00:45.625679+0000","last_undegraded":"2024-09-16T01:00:45.625679+0000","last_fullsized":"2024-09-16T01:00:45.625679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:05.332472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:46.967824+0000","last_change":"2024-09-16T00:58:36.506598+0000","last_active":"2024-09-16T01:00:46.967824+0000","last_peered":"2024-09-16T01:00:46.967824+0000","last_clean":"2024-09-16T01:00:46.967824+0000","last_became_active":"2024-09-16T00:58:36.506299+0000","last_became_peered":"2024-09-16T00:58:36.506299+0000","last_unstale":"2024-09-16T01:00:46.967824+0000","last_undegraded":"2024-09-16T01:00:46.967824+0000","last_fullsized":"2024-09-16T01:00:46.967824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.327225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624647+0000","last_change":"2024-09-16T00:58:36.517050+0000","last_active":"2024-09-16T01:00:45.624647+0000","last_peered":"2024-09-16T01:00:45.624647+0000","last_clean":"2024-09-16T01:00:45.624647+0000","last_became_active":"2024-09-16T00:58:36.516745+0000","last_became_peered":"2024-09-16T00:58:36.516745+0000","last_unstale":"2024-09-16T01:00:45.624647+0000","last_undegraded":"2024-09-16T01:00:45.624647+0000","last_fullsized":"2024-09-16T01:00:45.624647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:59.981792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717660+0000","last_change":"2024-09-16T00:58:36.512442+0000","last_active":"2024-09-16T01:00:45.717660+0000","last_peered":"2024-09-16T01:00:45.717660+0000","last_clean":"2024-09-16T01:00:45.717660+0000","last_became_active":"2024-09-16T00:58:36.512132+0000","last_became_peered":"2024-09-16T00:58:36.512132+0000","last_unstale":"2024-09-16T01:00:45.717660+0000","last_undegraded":"2024-09-16T01:00:45.717660+0000","last_fullsized":"2024-09-16T01:00:45.717660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:06.511257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897210+0000","last_change":"2024-09-16T00:58:36.519754+0000","last_active":"2024-09-16T01:00:45.897210+0000","last_peered":"2024-09-16T01:00:45.897210+0000","last_clean":"2024-09-16T01:00:45.897210+0000","last_became_active":"2024-09-16T00:58:36.519378+0000","last_became_peered":"2024-09-16T00:58:36.519378+0000","last_unstale":"2024-09-16T01:00:45.897210+0000","last_undegraded":"2024-09-16T01:00:45.897210+0000","last_fullsized":"2024-09-16T01:00:45.897210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:51.076588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.628046+0000","last_change":"2024-09-16T00:58:36.504627+0000","last_active":"2024-09-16T01:00:45.628046+0000","last_peered":"2024-09-16T01:00:45.628046+0000","last_clean":"2024-09-16T01:00:45.628046+0000","last_became_active":"2024-09-16T00:58:36.504282+0000","last_became_peered":"2024-09-16T00:58:36.504282+0000","last_unstale":"2024-09-16T01:00:45.628046+0000","last_undegraded":"2024-09-16T01:00:45.628046+0000","last_fullsized":"2024-09-16T01:00:45.628046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.857181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624140+0000","last_change":"2024-09-16T00:58:36.508971+0000","last_active":"2024-09-16T01:00:45.624140+0000","last_peered":"2024-09-16T01:00:45.624140+0000","last_clean":"2024-09-16T01:00:45.624140+0000","last_became_active":"2024-09-16T00:58:36.508631+0000","last_became_peered":"2024-09-16T00:58:36.508631+0000","last_unstale":"2024-09-16T01:00:45.624140+0000","last_undegraded":"2024-09-16T01:00:45.624140+0000","last_fullsized":"2024-09-16T01:00:45.624140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:17.092613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897604+0000","last_change":"2024-09-16T00:58:36.517255+0000","last_active":"2024-09-16T01:00:45.897604+0000","last_peered":"2024-09-16T01:00:45.897604+0000","last_clean":"2024-09-16T01:00:45.897604+0000","last_became_active":"2024-09-16T00:58:36.516957+0000","last_became_peered":"2024-09-16T00:58:36.516957+0000","last_unstale":"2024-09-16T01:00:45.897604+0000","last_undegraded":"2024-09-16T01:00:45.897604+0000","last_fullsized":"2024-09-16T01:00:45.897604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:34.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.624283+0000","last_change":"2024-09-16T00:58:36.516429+0000","last_active":"2024-09-16T01:00:45.624283+0000","last_peered":"2024-09-16T01:00:45.624283+0000","last_clean":"2024-09-16T01:00:45.624283+0000","last_became_active":"2024-09-16T00:58:36.516111+0000","last_became_peered":"2024-09-16T00:58:36.516111+0000","last_unstale":"2024-09-16T01:00:45.624283+0000","last_undegraded":"2024-09-16T01:00:45.624283+0000","last_fullsized":"2024-09-16T01:00:45.624283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:06.120653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626784+0000","last_change":"2024-09-16T00:58:36.512873+0000","last_active":"2024-09-16T01:00:45.626784+0000","last_peered":"2024-09-16T01:00:45.626784+0000","last_clean":"2024-09-16T01:00:45.626784+0000","last_became_active":"2024-09-16T00:58:36.511761+0000","last_became_peered":"2024-09-16T00:58:36.511761+0000","last_unstale":"2024-09-16T01:00:45.626784+0000","last_undegraded":"2024-09-16T01:00:45.626784+0000","last_fullsized":"2024-09-16T01:00:45.626784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:51.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.626810+0000","last_change":"2024-09-16T00:58:36.511585+0000","last_active":"2024-09-16T01:00:45.626810+0000","last_peered":"2024-09-16T01:00:45.626810+0000","last_clean":"2024-09-16T01:00:45.626810+0000","last_became_active":"2024-09-16T00:58:36.510479+0000","last_became_peered":"2024-09-16T00:58:36.510479+0000","last_unstale":"2024-09-16T01:00:45.626810+0000","last_undegraded":"2024-09-16T01:00:45.626810+0000","last_fullsized":"2024-09-16T01:00:45.626810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:58.017132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.717650+0000","last_change":"2024-09-16T00:58:36.508263+0000","last_active":"2024-09-16T01:00:45.717650+0000","last_peered":"2024-09-16T01:00:45.717650+0000","last_clean":"2024-09-16T01:00:45.717650+0000","last_became_active":"2024-09-16T00:58:36.507979+0000","last_became_peered":"2024-09-16T00:58:36.507979+0000","last_unstale":"2024-09-16T01:00:45.717650+0000","last_undegraded":"2024-09-16T01:00:45.717650+0000","last_fullsized":"2024-09-16T01:00:45.717650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:07.544985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720241+0000","last_change":"2024-09-16T00:58:36.514981+0000","last_active":"2024-09-16T01:00:45.720241+0000","last_peered":"2024-09-16T01:00:45.720241+0000","last_clean":"2024-09-16T01:00:45.720241+0000","last_became_active":"2024-09-16T00:58:36.510433+0000","last_became_peered":"2024-09-16T00:58:36.510433+0000","last_unstale":"2024-09-16T01:00:45.720241+0000","last_undegraded":"2024-09-16T01:00:45.720241+0000","last_fullsized":"2024-09-16T01:00:45.720241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:10.492072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919996+0000","last_change":"2024-09-16T00:58:36.521336+0000","last_active":"2024-09-16T01:00:45.919996+0000","last_peered":"2024-09-16T01:00:45.919996+0000","last_clean":"2024-09-16T01:00:45.919996+0000","last_became_active":"2024-09-16T00:58:36.521026+0000","last_became_peered":"2024-09-16T00:58:36.521026+0000","last_unstale":"2024-09-16T01:00:45.919996+0000","last_undegraded":"2024-09-16T01:00:45.919996+0000","last_fullsized":"2024-09-16T01:00:45.919996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:29.409024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711912+0000","last_change":"2024-09-16T00:58:36.518724+0000","last_active":"2024-09-16T01:00:45.711912+0000","last_peered":"2024-09-16T01:00:45.711912+0000","last_clean":"2024-09-16T01:00:45.711912+0000","last_became_active":"2024-09-16T00:58:36.518428+0000","last_became_peered":"2024-09-16T00:58:36.518428+0000","last_unstale":"2024-09-16T01:00:45.711912+0000","last_undegraded":"2024-09-16T01:00:45.711912+0000","last_fullsized":"2024-09-16T01:00:45.711912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:06.486299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.625258+0000","last_change":"2024-09-16T00:58:36.514347+0000","last_active":"2024-09-16T01:00:45.625258+0000","last_peered":"2024-09-16T01:00:45.625258+0000","last_clean":"2024-09-16T01:00:45.625258+0000","last_became_active":"2024-09-16T00:58:36.512243+0000","last_became_peered":"2024-09-16T00:58:36.512243+0000","last_unstale":"2024-09-16T01:00:45.625258+0000","last_undegraded":"2024-09-16T01:00:45.625258+0000","last_fullsized":"2024-09-16T01:00:45.625258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:03.289541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.623615+0000","last_change":"2024-09-16T00:59:44.837828+0000","last_active":"2024-09-16T01:00:45.623615+0000","last_peered":"2024-09-16T01:00:45.623615+0000","last_clean":"2024-09-16T01:00:45.623615+0000","last_became_active":"2024-09-16T00:59:44.837486+0000","last_became_peered":"2024-09-16T00:59:44.837486+0000","last_unstale":"2024-09-16T01:00:45.623615+0000","last_undegraded":"2024-09-16T01:00:45.623615+0000","last_fullsized":"2024-09-16T01:00:45.623615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:46.914056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.919570+0000","last_change":"2024-09-16T00:58:36.516797+0000","last_active":"2024-09-16T01:00:45.919570+0000","last_peered":"2024-09-16T01:00:45.919570+0000","last_clean":"2024-09-16T01:00:45.919570+0000","last_became_active":"2024-09-16T00:58:36.516480+0000","last_became_peered":"2024-09-16T00:58:36.516480+0000","last_unstale":"2024-09-16T01:00:45.919570+0000","last_undegraded":"2024-09-16T01:00:45.919570+0000","last_fullsized":"2024-09-16T01:00:45.919570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:55.262528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.711421+0000","last_change":"2024-09-16T00:58:36.517973+0000","last_active":"2024-09-16T01:00:45.711421+0000","last_peered":"2024-09-16T01:00:45.711421+0000","last_clean":"2024-09-16T01:00:45.711421+0000","last_became_active":"2024-09-16T00:58:36.517634+0000","last_became_peered":"2024-09-16T00:58:36.517634+0000","last_unstale":"2024-09-16T01:00:45.711421+0000","last_undegraded":"2024-09-16T01:00:45.711421+0000","last_fullsized":"2024-09-16T01:00:45.711421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:19.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.714158+0000","last_change":"2024-09-16T00:58:36.507643+0000","last_active":"2024-09-16T01:00:45.714158+0000","last_peered":"2024-09-16T01:00:45.714158+0000","last_clean":"2024-09-16T01:00:45.714158+0000","last_became_active":"2024-09-16T00:58:36.507263+0000","last_became_peered":"2024-09-16T00:58:36.507263+0000","last_unstale":"2024-09-16T01:00:45.714158+0000","last_undegraded":"2024-09-16T01:00:45.714158+0000","last_fullsized":"2024-09-16T01:00:45.714158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:24.317490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.720025+0000","last_change":"2024-09-16T00:58:36.508798+0000","last_active":"2024-09-16T01:00:45.720025+0000","last_peered":"2024-09-16T01:00:45.720025+0000","last_clean":"2024-09-16T01:00:45.720025+0000","last_became_active":"2024-09-16T00:58:36.508490+0000","last_became_peered":"2024-09-16T00:58:36.508490+0000","last_unstale":"2024-09-16T01:00:45.720025+0000","last_undegraded":"2024-09-16T01:00:45.720025+0000","last_fullsized":"2024-09-16T01:00:45.720025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:44.282270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627327+0000","last_change":"2024-09-16T00:58:36.519065+0000","last_active":"2024-09-16T01:00:45.627327+0000","last_peered":"2024-09-16T01:00:45.627327+0000","last_clean":"2024-09-16T01:00:45.627327+0000","last_became_active":"2024-09-16T00:58:36.518708+0000","last_became_peered":"2024-09-16T00:58:36.518708+0000","last_unstale":"2024-09-16T01:00:45.627327+0000","last_undegraded":"2024-09-16T01:00:45.627327+0000","last_fullsized":"2024-09-16T01:00:45.627327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:10.290341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.627159+0000","last_change":"2024-09-16T00:58:36.513018+0000","last_active":"2024-09-16T01:00:45.627159+0000","last_peered":"2024-09-16T01:00:45.627159+0000","last_clean":"2024-09-16T01:00:45.627159+0000","last_became_active":"2024-09-16T00:58:36.511730+0000","last_became_peered":"2024-09-16T00:58:36.511730+0000","last_unstale":"2024-09-16T01:00:45.627159+0000","last_undegraded":"2024-09-16T01:00:45.627159+0000","last_fullsized":"2024-09-16T01:00:45.627159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:20.852121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-16T01:00:45.897471+0000","last_change":"2024-09-16T00:58:36.518265+0000","last_active":"2024-09-16T01:00:45.897471+0000","last_peered":"2024-09-16T01:00:45.897471+0000","last_clean":"2024-09-16T01:00:45.897471+0000","last_became_active":"2024-09-16T00:58:36.517906+0000","last_became_peered":"2024-09-16T00:58:36.517906+0000","last_unstale":"2024-09-16T01:00:45.897471+0000","last_undegraded":"2024-09-16T01:00:45.897471+0000","last_fullsized":"2024-09-16T01:00:45.897471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:58:35.488847+0000","last_clean_scrub_stamp":"2024-09-16T00:58:35.488847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.255849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76757,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1170,"num_read_kb":668,"num_write":263,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":229133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282150,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612654,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":513588,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841585,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1146880,"data_stored":1169055,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005112,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":516772,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234045,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":512382,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462978,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":1109160,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626503,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":991232,"data_stored":508180,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855435,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":1104742,"data_compressed":65504,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018961,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":512926,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247895,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":507888,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444124,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":579765,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607648,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":577565,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738469,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":510478,"data_compressed":29621,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34245,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35883,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":71229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:01:19.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:19.706 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:20.005 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:19 smithi012 ceph-mon[31197]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:20.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:19 smithi119 ceph-mon[35049]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:19 smithi098 ceph-mon[35346]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.246+0000 7f2a51262640 1 -- 172.21.15.12:0/3392642977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4c074590 msgr2=0x7f2a4c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.246+0000 7f2a51262640 1 --2- 172.21.15.12:0/3392642977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4c074590 0x7f2a4c074970 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009900 tx=0x7f2a3c02a480 comp rx=0 tx=0).stop 2024-09-16T01:01:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.246+0000 7f2a51262640 1 -- 172.21.15.12:0/3392642977 shutdown_connections 2024-09-16T01:01:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.246+0000 7f2a51262640 1 --2- 172.21.15.12:0/3392642977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c112b90 0x7f2a4c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.246+0000 7f2a51262640 1 --2- 172.21.15.12:0/3392642977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c074eb0 0x7f2a4c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.246+0000 7f2a51262640 1 --2- 172.21.15.12:0/3392642977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4c074590 0x7f2a4c074970 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.246+0000 7f2a51262640 1 -- 172.21.15.12:0/3392642977 >> 172.21.15.12:0/3392642977 conn(0x7f2a4c0fd8c0 msgr2=0x7f2a4c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.246+0000 7f2a51262640 1 -- 172.21.15.12:0/3392642977 shutdown_connections 2024-09-16T01:01:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.246+0000 7f2a51262640 1 -- 172.21.15.12:0/3392642977 wait complete. 2024-09-16T01:01:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a51262640 1 Processor -- start 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a51262640 1 -- start start 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a51262640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c074590 0x7f2a4c1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a51262640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4c074eb0 0x7f2a4c1a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a51262640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c112b90 0x7f2a4c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a51262640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c118550 con 0x7f2a4c074eb0 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a51262640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1183d0 con 0x7f2a4c074590 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a51262640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1186d0 con 0x7f2a4c112b90 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a43fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4c074eb0 0x7f2a4c1a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a43fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4c074eb0 0x7f2a4c1a4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57232/0 (socket says 172.21.15.12:57232) 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a43fff640 1 -- 172.21.15.12:0/992106814 learned_addr learned my addr 172.21.15.12:0/992106814 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.247+0000 7f2a4b7fe640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c112b90 0x7f2a4c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a4affd640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c074590 0x7f2a4c1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a43fff640 1 -- 172.21.15.12:0/992106814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c112b90 msgr2=0x7f2a4c19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a43fff640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c112b90 0x7f2a4c19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a43fff640 1 -- 172.21.15.12:0/992106814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c074590 msgr2=0x7f2a4c1a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a43fff640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c074590 0x7f2a4c1a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a43fff640 1 -- 172.21.15.12:0/992106814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c19ef90 con 0x7f2a4c074eb0 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a4affd640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c074590 0x7f2a4c1a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a43fff640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4c074eb0 0x7f2a4c1a4be0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c920 tx=0x7f2a3400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a48ff9640 1 -- 172.21.15.12:0/992106814 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34007c70 con 0x7f2a4c074eb0 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a48ff9640 1 -- 172.21.15.12:0/992106814 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a34007e10 con 0x7f2a4c074eb0 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a51262640 1 -- 172.21.15.12:0/992106814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4c19f280 con 0x7f2a4c074eb0 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a48ff9640 1 -- 172.21.15.12:0/992106814 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34018890 con 0x7f2a4c074eb0 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.248+0000 7f2a51262640 1 -- 172.21.15.12:0/992106814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4c1ab570 con 0x7f2a4c074eb0 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.249+0000 7f2a51262640 1 -- 172.21.15.12:0/992106814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4c074970 con 0x7f2a4c074eb0 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.251+0000 7f2a48ff9640 1 -- 172.21.15.12:0/992106814 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2a34018a50 con 0x7f2a4c074eb0 2024-09-16T01:01:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.251+0000 7f2a48ff9640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a380a32c0 0x7f2a380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:20.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.251+0000 7f2a48ff9640 1 -- 172.21.15.12:0/992106814 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f2a340cfd50 con 0x7f2a4c074eb0 2024-09-16T01:01:20.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.251+0000 7f2a4affd640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a380a32c0 0x7f2a380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:20.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.252+0000 7f2a4affd640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a380a32c0 0x7f2a380a5780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c000c00 tx=0x7f2a3c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:20.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.256+0000 7f2a48ff9640 1 -- 172.21.15.12:0/992106814 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a340d3030 con 0x7f2a4c074eb0 2024-09-16T01:01:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.470+0000 7f2a51262640 1 -- 172.21.15.12:0/992106814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a4c1ab950 con 0x7f2a4c074eb0 2024-09-16T01:01:20.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.470+0000 7f2a48ff9640 1 -- 172.21.15.12:0/992106814 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f2a34014030 con 0x7f2a4c074eb0 2024-09-16T01:01:20.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:20.471 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:01:20.472 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:01:20.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 -- 172.21.15.12:0/992106814 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a380a32c0 msgr2=0x7f2a380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:20.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a380a32c0 0x7f2a380a5780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c000c00 tx=0x7f2a3c005a20 comp rx=0 tx=0).stop 2024-09-16T01:01:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 -- 172.21.15.12:0/992106814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4c074eb0 msgr2=0x7f2a4c1a4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4c074eb0 0x7f2a4c1a4be0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c920 tx=0x7f2a3400cde0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 -- 172.21.15.12:0/992106814 shutdown_connections 2024-09-16T01:01:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2a380a32c0 0x7f2a380a5780 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c112b90 0x7f2a4c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4c074eb0 0x7f2a4c1a4be0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 --2- 172.21.15.12:0/992106814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c074590 0x7f2a4c1a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 -- 172.21.15.12:0/992106814 >> 172.21.15.12:0/992106814 conn(0x7f2a4c0fd8c0 msgr2=0x7f2a4c0fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 -- 172.21.15.12:0/992106814 shutdown_connections 2024-09-16T01:01:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:20.473+0000 7f2a51262640 1 -- 172.21.15.12:0/992106814 wait complete. 2024-09-16T01:01:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:20 smithi119 ceph-mon[35049]: pgmap v367: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:01:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:20 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/992106814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:20 smithi012 ceph-mon[31197]: pgmap v367: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:01:21.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:20 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/992106814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:21.162 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:21.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:20 smithi098 ceph-mon[35346]: pgmap v367: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:01:21.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:20 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/992106814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:21.422 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.906+0000 7ff0e7753640 1 -- 172.21.15.12:0/2730609107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0e0106ba0 msgr2=0x7ff0e0106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.906+0000 7ff0e7753640 1 --2- 172.21.15.12:0/2730609107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0e0106ba0 0x7ff0e0106f80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009900 tx=0x7ff0dc02a410 comp rx=0 tx=0).stop 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.906+0000 7ff0e7753640 1 -- 172.21.15.12:0/2730609107 shutdown_connections 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.906+0000 7ff0e7753640 1 --2- 172.21.15.12:0/2730609107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e0100a70 0x7ff0e010ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.906+0000 7ff0e7753640 1 --2- 172.21.15.12:0/2730609107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e01000d0 0x7ff0e0100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.906+0000 7ff0e7753640 1 --2- 172.21.15.12:0/2730609107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0e0106ba0 0x7ff0e0106f80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.906+0000 7ff0e7753640 1 -- 172.21.15.12:0/2730609107 >> 172.21.15.12:0/2730609107 conn(0x7ff0e0077210 msgr2=0x7ff0e00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.906+0000 7ff0e7753640 1 -- 172.21.15.12:0/2730609107 shutdown_connections 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.906+0000 7ff0e7753640 1 -- 172.21.15.12:0/2730609107 wait complete. 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e7753640 1 Processor -- start 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e7753640 1 -- start start 2024-09-16T01:01:21.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e7753640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0e01000d0 0x7ff0e01012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e7753640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e0100a70 0x7ff0e01017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e7753640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e0106ba0 0x7ff0e0101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e7753640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e01120b0 con 0x7ff0e01000d0 2024-09-16T01:01:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e7753640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0111f30 con 0x7ff0e0106ba0 2024-09-16T01:01:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e7753640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0112230 con 0x7ff0e0100a70 2024-09-16T01:01:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e54ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0e01000d0 0x7ff0e01012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e54ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0e01000d0 0x7ff0e01012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57256/0 (socket says 172.21.15.12:57256) 2024-09-16T01:01:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e54ef640 1 -- 172.21.15.12:0/4281527939 learned_addr learned my addr 172.21.15.12:0/4281527939 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e4cee640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e0100a70 0x7ff0e01017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.907+0000 7ff0e5cf0640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e0106ba0 0x7ff0e0101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0e54ef640 1 -- 172.21.15.12:0/4281527939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e0100a70 msgr2=0x7ff0e01017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0e54ef640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e0100a70 0x7ff0e01017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0e54ef640 1 -- 172.21.15.12:0/4281527939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e0106ba0 msgr2=0x7ff0e0101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0e54ef640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e0106ba0 0x7ff0e0101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0e54ef640 1 -- 172.21.15.12:0/4281527939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e01a6960 con 0x7ff0e01000d0 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0e5cf0640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e0106ba0 0x7ff0e0101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0e54ef640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0e01000d0 0x7ff0e01012b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc006010 tx=0x7ff0dc003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0d67fc640 1 -- 172.21.15.12:0/4281527939 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc03f070 con 0x7ff0e01000d0 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0d67fc640 1 -- 172.21.15.12:0/4281527939 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0dc031e30 con 0x7ff0e01000d0 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0d67fc640 1 -- 172.21.15.12:0/4281527939 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc035030 con 0x7ff0e01000d0 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0e7753640 1 -- 172.21.15.12:0/4281527939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e01a6bf0 con 0x7ff0e01000d0 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.908+0000 7ff0e7753640 1 -- 172.21.15.12:0/4281527939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e01a7120 con 0x7ff0e01000d0 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.909+0000 7ff0e7753640 1 -- 172.21.15.12:0/4281527939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e0100530 con 0x7ff0e01000d0 2024-09-16T01:01:21.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.911+0000 7ff0d67fc640 1 -- 172.21.15.12:0/4281527939 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff0dc042070 con 0x7ff0e01000d0 2024-09-16T01:01:21.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.911+0000 7ff0d67fc640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff0cc0a32c0 0x7ff0cc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.912+0000 7ff0e4cee640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff0cc0a32c0 0x7ff0cc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.912+0000 7ff0d67fc640 1 -- 172.21.15.12:0/4281527939 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7ff0dc0f0500 con 0x7ff0e01000d0 2024-09-16T01:01:21.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.912+0000 7ff0e4cee640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff0cc0a32c0 0x7ff0cc0a5780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0102d40 tx=0x7ff0d000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:21.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:21.916+0000 7ff0d67fc640 1 -- 172.21.15.12:0/4281527939 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0dc0bcec0 con 0x7ff0e01000d0 2024-09-16T01:01:22.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.131+0000 7ff0e7753640 1 -- 172.21.15.12:0/4281527939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0e01a7320 con 0x7ff0e01000d0 2024-09-16T01:01:22.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.132+0000 7ff0d67fc640 1 -- 172.21.15.12:0/4281527939 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7ff0dc0bc7c0 con 0x7ff0e01000d0 2024-09-16T01:01:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:22.133 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:01:22.133 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:01:22.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 -- 172.21.15.12:0/4281527939 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff0cc0a32c0 msgr2=0x7ff0cc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:22.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff0cc0a32c0 0x7ff0cc0a5780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0102d40 tx=0x7ff0d000a2d0 comp rx=0 tx=0).stop 2024-09-16T01:01:22.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 -- 172.21.15.12:0/4281527939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0e01000d0 msgr2=0x7ff0e01012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:22.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0e01000d0 0x7ff0e01012b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc006010 tx=0x7ff0dc003c80 comp rx=0 tx=0).stop 2024-09-16T01:01:22.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 -- 172.21.15.12:0/4281527939 shutdown_connections 2024-09-16T01:01:22.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff0cc0a32c0 0x7ff0cc0a5780 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:22.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0e0106ba0 0x7ff0e0101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:22.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0e0100a70 0x7ff0e01017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:22.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 --2- 172.21.15.12:0/4281527939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0e01000d0 0x7ff0e01012b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:22.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 -- 172.21.15.12:0/4281527939 >> 172.21.15.12:0/4281527939 conn(0x7ff0e0077210 msgr2=0x7ff0e0104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:22.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 -- 172.21.15.12:0/4281527939 shutdown_connections 2024-09-16T01:01:22.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:22.134+0000 7ff0e7753640 1 -- 172.21.15.12:0/4281527939 wait complete. 2024-09-16T01:01:22.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:01:22.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:22 smithi012 ceph-mon[31197]: pgmap v368: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:01:22.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:22 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/4281527939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:23.041 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:22 smithi119 ceph-mon[35049]: pgmap v368: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:01:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:22 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/4281527939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:22 smithi098 ceph-mon[35346]: pgmap v368: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:01:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:22 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/4281527939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 -- 172.21.15.12:0/3071696884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fbc106f40 msgr2=0x7f8fbc10eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 --2- 172.21.15.12:0/3071696884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fbc106f40 0x7f8fbc10eac0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa402a410 comp rx=0 tx=0).stop 2024-09-16T01:01:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 -- 172.21.15.12:0/3071696884 shutdown_connections 2024-09-16T01:01:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 --2- 172.21.15.12:0/3071696884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fbc106f40 0x7f8fbc10eac0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 --2- 172.21.15.12:0/3071696884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fbc1027c0 0x7f8fbc106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 --2- 172.21.15.12:0/3071696884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fbc101e10 0x7f8fbc1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 -- 172.21.15.12:0/3071696884 >> 172.21.15.12:0/3071696884 conn(0x7f8fbc0fd8d0 msgr2=0x7f8fbc0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 -- 172.21.15.12:0/3071696884 shutdown_connections 2024-09-16T01:01:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 -- 172.21.15.12:0/3071696884 wait complete. 2024-09-16T01:01:23.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 Processor -- start 2024-09-16T01:01:23.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.558+0000 7f8fc30f7640 1 -- start start 2024-09-16T01:01:23.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fc30f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fbc101e10 0x7f8fbc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:23.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fc30f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fbc1027c0 0x7f8fbc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:23.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fc30f7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fbc106f40 0x7f8fbc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:23.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fc30f7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc111fa0 con 0x7f8fbc1027c0 2024-09-16T01:01:23.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fc30f7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc111e20 con 0x7f8fbc106f40 2024-09-16T01:01:23.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fc30f7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc112120 con 0x7f8fbc101e10 2024-09-16T01:01:23.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fbbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fbc1027c0 0x7f8fbc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:23.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fbbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fbc1027c0 0x7f8fbc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57284/0 (socket says 172.21.15.12:57284) 2024-09-16T01:01:23.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fbbfff640 1 -- 172.21.15.12:0/1818563123 learned_addr learned my addr 172.21.15.12:0/1818563123 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:23.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fc0e93640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fbc101e10 0x7f8fbc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:23.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fc1694640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fbc106f40 0x7f8fbc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:23.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fbbfff640 1 -- 172.21.15.12:0/1818563123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fbc101e10 msgr2=0x7f8fbc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fbbfff640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fbc101e10 0x7f8fbc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fbbfff640 1 -- 172.21.15.12:0/1818563123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fbc106f40 msgr2=0x7f8fbc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fbbfff640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fbc106f40 0x7f8fbc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fbbfff640 1 -- 172.21.15.12:0/1818563123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc1a68a0 con 0x7f8fbc1027c0 2024-09-16T01:01:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fbbfff640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fbc1027c0 0x7f8fbc074a30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00ea80 tx=0x7f8fac00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.559+0000 7f8fb9ffb640 1 -- 172.21.15.12:0/1818563123 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00ce40 con 0x7f8fbc1027c0 2024-09-16T01:01:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.560+0000 7f8fc30f7640 1 -- 172.21.15.12:0/1818563123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc1a6b90 con 0x7f8fbc1027c0 2024-09-16T01:01:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.560+0000 7f8fb9ffb640 1 -- 172.21.15.12:0/1818563123 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fac005020 con 0x7f8fbc1027c0 2024-09-16T01:01:23.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.560+0000 7f8fb9ffb640 1 -- 172.21.15.12:0/1818563123 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac011760 con 0x7f8fbc1027c0 2024-09-16T01:01:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.560+0000 7f8fc30f7640 1 -- 172.21.15.12:0/1818563123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc1a7080 con 0x7f8fbc1027c0 2024-09-16T01:01:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.561+0000 7f8fc30f7640 1 -- 172.21.15.12:0/1818563123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc1021f0 con 0x7f8fbc1027c0 2024-09-16T01:01:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.562+0000 7f8fb9ffb640 1 -- 172.21.15.12:0/1818563123 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8fac0051d0 con 0x7f8fbc1027c0 2024-09-16T01:01:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.562+0000 7f8fb9ffb640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8fa80a3240 0x7f8fa80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.563+0000 7f8fc0e93640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8fa80a3240 0x7f8fa80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.563+0000 7f8fb9ffb640 1 -- 172.21.15.12:0/1818563123 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f8fac0d02d0 con 0x7f8fbc1027c0 2024-09-16T01:01:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.563+0000 7f8fc0e93640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8fa80a3240 0x7f8fa80a5700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4005fd0 tx=0x7f8fb400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.567+0000 7f8fb9ffb640 1 -- 172.21.15.12:0/1818563123 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fac016030 con 0x7f8fbc1027c0 2024-09-16T01:01:23.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.745+0000 7f8fc30f7640 1 -- 172.21.15.12:0/1818563123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8fbc109b90 con 0x7f8fbc1027c0 2024-09-16T01:01:23.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.746+0000 7f8fb9ffb640 1 -- 172.21.15.12:0/1818563123 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24678 (secure 0 0 0) 0x7f8fac09cc90 con 0x7f8fbc1027c0 2024-09-16T01:01:23.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:23.748 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T01:00:45.617096+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:01:23.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 -- 172.21.15.12:0/1818563123 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8fa80a3240 msgr2=0x7f8fa80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:23.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8fa80a3240 0x7f8fa80a5700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4005fd0 tx=0x7f8fb400b590 comp rx=0 tx=0).stop 2024-09-16T01:01:23.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 -- 172.21.15.12:0/1818563123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fbc1027c0 msgr2=0x7f8fbc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:23.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fbc1027c0 0x7f8fbc074a30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00ea80 tx=0x7f8fac00ef40 comp rx=0 tx=0).stop 2024-09-16T01:01:23.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 -- 172.21.15.12:0/1818563123 shutdown_connections 2024-09-16T01:01:23.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8fa80a3240 0x7f8fa80a5700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fbc106f40 0x7f8fbc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fbc1027c0 0x7f8fbc074a30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 --2- 172.21.15.12:0/1818563123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fbc101e10 0x7f8fbc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 -- 172.21.15.12:0/1818563123 >> 172.21.15.12:0/1818563123 conn(0x7f8fbc0fd8d0 msgr2=0x7f8fbc0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:23.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 -- 172.21.15.12:0/1818563123 shutdown_connections 2024-09-16T01:01:23.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:23.749+0000 7f8fc30f7640 1 -- 172.21.15.12:0/1818563123 wait complete. 2024-09-16T01:01:24.422 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-16T01:01:24.686 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:24.999 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:24 smithi012 ceph-mon[31197]: pgmap v369: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-16T01:01:24.999 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:24 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1818563123' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:24 smithi119 ceph-mon[35049]: pgmap v369: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-16T01:01:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:24 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1818563123' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:24 smithi098 ceph-mon[35346]: pgmap v369: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-16T01:01:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:24 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1818563123' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:25.996 INFO:teuthology.orchestra.run.smithi012.stdout:{"run_dir":"/var/run/ceph"} 2024-09-16T01:01:25.997 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-16T01:01:25.997 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 3393 2024-09-16T01:01:25.997 DEBUG:tasks.quiescer:Yielding 2024-09-16T01:01:25.997 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T01:01:26.023 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T01:01:26.023 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T01:01:26.023 INFO:tasks.workunit:timeout=3h 2024-09-16T01:01:26.023 INFO:tasks.workunit:cleanup=True 2024-09-16T01:01:26.023 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T01:01:26.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:26.041 INFO:teuthology.orchestra.run.smithi012.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-16T01:01:26.041 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-16T01:01:26.041 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-16T01:01:26.041 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:01:26.041 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-16T01:01:26.042 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-16 00:59:29.431330272 +0000 2024-09-16T01:01:26.042 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-16 00:59:29.431330272 +0000 2024-09-16T01:01:26.042 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-16 01:01:03.164326025 +0000 2024-09-16T01:01:26.042 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-16 00:59:29.431330272 +0000 2024-09-16T01:01:26.042 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-16T01:01:26.042 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-16T01:01:26.116 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T01:01:26.172 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T01:01:26.288 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:26.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.799+0000 7f79b9b75640 1 -- 172.21.15.12:0/2458006548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79b4102ef0 msgr2=0x7f79b410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.799+0000 7f79b9b75640 1 --2- 172.21.15.12:0/2458006548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79b4102ef0 0x7f79b410da40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009ca0 tx=0x7f79ac02a950 comp rx=0 tx=0).stop 2024-09-16T01:01:26.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.799+0000 7f79b9b75640 1 -- 172.21.15.12:0/2458006548 shutdown_connections 2024-09-16T01:01:26.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.799+0000 7f79b9b75640 1 --2- 172.21.15.12:0/2458006548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79b4102ef0 0x7f79b410da40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.799+0000 7f79b9b75640 1 --2- 172.21.15.12:0/2458006548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79b4102570 0x7f79b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.799+0000 7f79b9b75640 1 --2- 172.21.15.12:0/2458006548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79b4100e20 0x7f79b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.799+0000 7f79b9b75640 1 -- 172.21.15.12:0/2458006548 >> 172.21.15.12:0/2458006548 conn(0x7f79b40fc7d0 msgr2=0x7f79b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.799+0000 7f79b9b75640 1 -- 172.21.15.12:0/2458006548 shutdown_connections 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.799+0000 7f79b9b75640 1 -- 172.21.15.12:0/2458006548 wait complete. 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.800+0000 7f79b9b75640 1 Processor -- start 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.800+0000 7f79b9b75640 1 -- start start 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.800+0000 7f79b9b75640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79b4100e20 0x7f79b4199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.800+0000 7f79b9b75640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79b4102570 0x7f79b41998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.800+0000 7f79b9b75640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79b4102ef0 0x7f79b41a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.800+0000 7f79b9b75640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79b4110f80 con 0x7f79b4100e20 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.800+0000 7f79b9b75640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79b4110e00 con 0x7f79b4102570 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.800+0000 7f79b9b75640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f79b4111100 con 0x7f79b4102ef0 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79b4100e20 0x7f79b4199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79b4100e20 0x7f79b4199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58240/0 (socket says 172.21.15.12:58240) 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b37fe640 1 -- 172.21.15.12:0/173016094 learned_addr learned my addr 172.21.15.12:0/173016094 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79aaffd640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79b4102570 0x7f79b41998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b3fff640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79b4102ef0 0x7f79b41a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b37fe640 1 -- 172.21.15.12:0/173016094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79b4102ef0 msgr2=0x7f79b41a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b37fe640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79b4102ef0 0x7f79b41a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b37fe640 1 -- 172.21.15.12:0/173016094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79b4102570 msgr2=0x7f79b41998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b37fe640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79b4102570 0x7f79b41998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b37fe640 1 -- 172.21.15.12:0/173016094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b41a4930 con 0x7f79b4100e20 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b3fff640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79b4102ef0 0x7f79b41a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b37fe640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79b4100e20 0x7f79b4199370 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f79a400d950 tx=0x7f79a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b17fa640 1 -- 172.21.15.12:0/173016094 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4017030 con 0x7f79b4100e20 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b9b75640 1 -- 172.21.15.12:0/173016094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b41a4b00 con 0x7f79b4100e20 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b17fa640 1 -- 172.21.15.12:0/173016094 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79a4004020 con 0x7f79b4100e20 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b17fa640 1 -- 172.21.15.12:0/173016094 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a40047a0 con 0x7f79b4100e20 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.801+0000 7f79b9b75640 1 -- 172.21.15.12:0/173016094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b41a5040 con 0x7f79b4100e20 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.803+0000 7f79b9b75640 1 -- 172.21.15.12:0/173016094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b4101200 con 0x7f79b4100e20 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.804+0000 7f79b17fa640 1 -- 172.21.15.12:0/173016094 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f79a40041d0 con 0x7f79b4100e20 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.805+0000 7f79b17fa640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79a00a32c0 0x7f79a00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.805+0000 7f79aaffd640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79a00a32c0 0x7f79a00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.805+0000 7f79b17fa640 1 -- 172.21.15.12:0/173016094 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f79a40cf690 con 0x7f79b4100e20 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.805+0000 7f79aaffd640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79a00a32c0 0x7f79a00a5780 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f799c005fd0 tx=0x7f799c00b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:26.813+0000 7f79b17fa640 1 -- 172.21.15.12:0/173016094 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79a409c050 con 0x7f79b4100e20 2024-09-16T01:01:27.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:26 smithi098 ceph-mon[35346]: pgmap v370: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-16T01:01:27.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:26 smithi098 ceph-mon[35346]: scrub summary: idle 2024-09-16T01:01:27.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.027+0000 7f79b9b75640 1 -- 172.21.15.12:0/173016094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79b41a52a0 con 0x7f79b4100e20 2024-09-16T01:01:27.028 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:26 smithi012 ceph-mon[31197]: pgmap v370: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-16T01:01:27.028 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:26 smithi012 ceph-mon[31197]: scrub summary: idle 2024-09-16T01:01:27.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.028+0000 7f79b17fa640 1 -- 172.21.15.12:0/173016094 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f79a409b950 con 0x7f79b4100e20 2024-09-16T01:01:27.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:27.029 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:01:27.030 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:01:27.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.030+0000 7f79b9b75640 1 -- 172.21.15.12:0/173016094 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79a00a32c0 msgr2=0x7f79a00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.030+0000 7f79b9b75640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79a00a32c0 0x7f79a00a5780 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f799c005fd0 tx=0x7f799c00b510 comp rx=0 tx=0).stop 2024-09-16T01:01:27.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.030+0000 7f79b9b75640 1 -- 172.21.15.12:0/173016094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79b4100e20 msgr2=0x7f79b4199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.030+0000 7f79b9b75640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79b4100e20 0x7f79b4199370 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f79a400d950 tx=0x7f79a400de10 comp rx=0 tx=0).stop 2024-09-16T01:01:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.031+0000 7f79b9b75640 1 -- 172.21.15.12:0/173016094 shutdown_connections 2024-09-16T01:01:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.031+0000 7f79b9b75640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f79a00a32c0 0x7f79a00a5780 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.031+0000 7f79b9b75640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79b4102ef0 0x7f79b41a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.031+0000 7f79b9b75640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79b4102570 0x7f79b41998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.031+0000 7f79b9b75640 1 --2- 172.21.15.12:0/173016094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79b4100e20 0x7f79b4199370 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.031+0000 7f79b9b75640 1 -- 172.21.15.12:0/173016094 >> 172.21.15.12:0/173016094 conn(0x7f79b40fc7d0 msgr2=0x7f79b4106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.031+0000 7f79b9b75640 1 -- 172.21.15.12:0/173016094 shutdown_connections 2024-09-16T01:01:27.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:27.031+0000 7f79b9b75640 1 -- 172.21.15.12:0/173016094 wait complete. 2024-09-16T01:01:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:26 smithi119 ceph-mon[35049]: pgmap v370: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-16T01:01:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:26 smithi119 ceph-mon[35049]: scrub summary: idle 2024-09-16T01:01:27.844 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-16T00:58:37.161987+0000', 'modified': '2024-09-16T01:01:03.851345+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24518, 'mds_1': 24482, 'mds_2': 24475, 'mds_3': 24458, 'mds_4': 14601}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14595': {'gid': 14595, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6839/3964724197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6838', 'nonce': 3964724197}, {'type': 'v1', 'addr': '172.21.15.12:6839', 'nonce': 3964724197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14601': {'gid': 14601, 'name': 'a', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.12:6841/1625323518', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6840', 'nonce': 1625323518}, {'type': 'v1', 'addr': '172.21.15.12:6841', 'nonce': 1625323518}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6833/489944636', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6832', 'nonce': 489944636}, {'type': 'v1', 'addr': '172.21.15.119:6833', 'nonce': 489944636}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24434': {'gid': 24434, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6833/676872767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6832', 'nonce': 676872767}, {'type': 'v1', 'addr': '172.21.15.98:6833', 'nonce': 676872767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/3086232870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 3086232870}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 3086232870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6837/3417248856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 3417248856}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 3417248856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'e', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.98:6835/1575072845', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 1575072845}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 1575072845}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.119:6839/3964855150', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 3964855150}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 3964855150}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.98:6837/390846726', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 390846726}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 390846726}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24518': {'gid': 24518, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.98:6839/2784619271', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 2784619271}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 2784619271}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24518, 'qdb_cluster': [14601, 24458, 24475, 24482, 24518]} 2024-09-16T01:01:27.844 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-16T01:01:27.845 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-16T01:01:28.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:27 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/173016094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:28.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:27 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/173016094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:28.144 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:27 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/173016094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.573+0000 7fb62aed7640 1 -- 172.21.15.12:0/4178207015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb624106f10 msgr2=0x7fb62410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.573+0000 7fb62aed7640 1 --2- 172.21.15.12:0/4178207015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb624106f10 0x7fb62410ea90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009ca0 tx=0x7fb61c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.573+0000 7fb62aed7640 1 -- 172.21.15.12:0/4178207015 shutdown_connections 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.573+0000 7fb62aed7640 1 --2- 172.21.15.12:0/4178207015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb624106f10 0x7fb62410ea90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.573+0000 7fb62aed7640 1 --2- 172.21.15.12:0/4178207015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb624102790 0x7fb6241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.573+0000 7fb62aed7640 1 --2- 172.21.15.12:0/4178207015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb624101de0 0x7fb6241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.573+0000 7fb62aed7640 1 -- 172.21.15.12:0/4178207015 >> 172.21.15.12:0/4178207015 conn(0x7fb6240fd8c0 msgr2=0x7fb6240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.573+0000 7fb62aed7640 1 -- 172.21.15.12:0/4178207015 shutdown_connections 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.573+0000 7fb62aed7640 1 -- 172.21.15.12:0/4178207015 wait complete. 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.574+0000 7fb62aed7640 1 Processor -- start 2024-09-16T01:01:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.574+0000 7fb62aed7640 1 -- start start 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb62aed7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb624101de0 0x7fb6241a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb62aed7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb624102790 0x7fb6241a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb62aed7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb624106f10 0x7fb62410db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb62aed7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb624111f70 con 0x7fb624102790 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb62aed7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb624111df0 con 0x7fb624101de0 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb62aed7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb6241120f0 con 0x7fb624106f10 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb623fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb624102790 0x7fb6241a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb623fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb624102790 0x7fb6241a4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58256/0 (socket says 172.21.15.12:58256) 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb623fff640 1 -- 172.21.15.12:0/3220811145 learned_addr learned my addr 172.21.15.12:0/3220811145 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb628c73640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb624101de0 0x7fb6241a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb629474640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb624106f10 0x7fb62410db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb623fff640 1 -- 172.21.15.12:0/3220811145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb624106f10 msgr2=0x7fb62410db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb623fff640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb624106f10 0x7fb62410db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb623fff640 1 -- 172.21.15.12:0/3220811145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb624101de0 msgr2=0x7fb6241a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb623fff640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb624101de0 0x7fb6241a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.575+0000 7fb623fff640 1 -- 172.21.15.12:0/3220811145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62410e330 con 0x7fb624102790 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.576+0000 7fb623fff640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb624102790 0x7fb6241a4b40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c920 tx=0x7fb61400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.576+0000 7fb621ffb640 1 -- 172.21.15.12:0/3220811145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614007c70 con 0x7fb624102790 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.576+0000 7fb621ffb640 1 -- 172.21.15.12:0/3220811145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb614007e10 con 0x7fb624102790 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.576+0000 7fb62aed7640 1 -- 172.21.15.12:0/3220811145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62410e620 con 0x7fb624102790 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.576+0000 7fb621ffb640 1 -- 172.21.15.12:0/3220811145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614018890 con 0x7fb624102790 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.576+0000 7fb62aed7640 1 -- 172.21.15.12:0/3220811145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6241ab460 con 0x7fb624102790 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.578+0000 7fb621ffb640 1 -- 172.21.15.12:0/3220811145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb614018a70 con 0x7fb624102790 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb621ffb640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb6100a3240 0x7fb6100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb62d2b0740 1 Processor -- start 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb62d2b0740 1 -- start start 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb621ffb640 1 -- 172.21.15.12:0/3220811145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fb6140cfd40 con 0x7fb624102790 2024-09-16T01:01:28.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb628c73640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb6100a3240 0x7fb6100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 0x5574adad7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad82f0 0x5574adae2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adae2bb0 0x5574adae4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5574ada3e090 con 0x5574adad82f0 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5574ad9e5a70 con 0x5574adad79d0 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5574ada3a050 con 0x5574adae2bb0 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb623fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad82f0 0x5574adae2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb623fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad82f0 0x5574adae2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58262/0 (socket says 172.21.15.12:58262) 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.579+0000 7fb623fff640 1 -- 172.21.15.12:0/1298470635 learned_addr learned my addr 172.21.15.12:0/1298470635 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb628c73640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb6100a3240 0x7fb6100a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009c20 tx=0x7fb60c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb628c73640 1 --2- 172.21.15.12:0/1298470635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 0x5574adad7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb629474640 1 --2- 172.21.15.12:0/1298470635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adae2bb0 0x5574adae4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb623fff640 1 -- 172.21.15.12:0/1298470635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adae2bb0 msgr2=0x5574adae4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:28.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb623fff640 1 --2- 172.21.15.12:0/1298470635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adae2bb0 0x5574adae4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb623fff640 1 -- 172.21.15.12:0/1298470635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 msgr2=0x5574adad7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb623fff640 1 --2- 172.21.15.12:0/1298470635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 0x5574adad7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb623fff640 1 -- 172.21.15.12:0/1298470635 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574ad9f2130 con 0x5574adad82f0 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb623fff640 1 --2- 172.21.15.12:0/1298470635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad82f0 0x5574adae2670 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb61409bf90 tx=0x7fb61409c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b074d563cafa9d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb61affd640 1 -- 172.21.15.12:0/1298470635 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61409a0a0 con 0x5574adad82f0 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb61affd640 1 -- 172.21.15.12:0/1298470635 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb61409a300 con 0x5574adad82f0 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.580+0000 7fb61affd640 1 -- 172.21.15.12:0/1298470635 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6140a47e0 con 0x5574adad82f0 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 -- 172.21.15.12:0/1298470635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad82f0 msgr2=0x5574adae2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/1298470635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad82f0 0x5574adae2670 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb61409bf90 tx=0x7fb61409c000 comp rx=0 tx=0).stop 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 -- 172.21.15.12:0/1298470635 shutdown_connections 2024-09-16T01:01:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/1298470635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adae2bb0 0x5574adae4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/1298470635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad82f0 0x5574adae2670 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/1298470635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 0x5574adad7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 -- 172.21.15.12:0/1298470635 >> 172.21.15.12:0/1298470635 conn(0x5574adad3f60 msgr2=0x5574adad4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 -- 172.21.15.12:0/1298470635 shutdown_connections 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 -- 172.21.15.12:0/1298470635 wait complete. 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 -- start start 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.581+0000 7fb62d2b0740 1 Processor -- start 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adae2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 0x5574adadf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adae2bb0 0x5574adadfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5574adae5780 con 0x5574adad79d0 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5574ad9f8f20 con 0x5574adae2bb0 2024-09-16T01:01:28.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5574adae5900 con 0x5574adad82f0 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb62d2b0740 10 client.0 _ll_register_callbacks cb 0x5574ad9c2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb628c73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adae2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb628c73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adae2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58278/0 (socket says 172.21.15.12:58278) 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb628c73640 1 -- 172.21.15.12:0/2166282171 learned_addr learned my addr 172.21.15.12:0/2166282171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb623fff640 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 0x5574adadf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb629474640 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adae2bb0 0x5574adadfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb623fff640 1 -- 172.21.15.12:0/2166282171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adae2bb0 msgr2=0x5574adadfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb623fff640 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adae2bb0 0x5574adadfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb623fff640 1 -- 172.21.15.12:0/2166282171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 msgr2=0x5574adae2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb623fff640 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adae2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb623fff640 1 -- 172.21.15.12:0/2166282171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574ad7af2b0 con 0x5574adad82f0 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb628c73640 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adae2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb623fff640 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 0x5574adadf7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c8f0 tx=0x7fb61400a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d3ea35b41b4d3aa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:28.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.582+0000 7fb603fff640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb603fff640 1 -- 172.21.15.12:0/2166282171 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61407f060 con 0x5574adad82f0 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2166282171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb61409a300 con 0x5574adad82f0 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb603fff640 1 -- 172.21.15.12:0/2166282171 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fb6140a47e0 con 0x5574adad82f0 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb603fff640 1 -- 172.21.15.12:0/2166282171 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb61400fb30 con 0x5574adad82f0 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb62d2b0740 10 client.25078 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2166282171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5574adae5780 con 0x5574adad82f0 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb603fff640 1 -- 172.21.15.12:0/2166282171 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb61409a300 con 0x5574adad82f0 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb603fff640 1 -- 172.21.15.12:0/2166282171 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb6140b8070 con 0x5574adad82f0 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb62d2b0740 10 client.25078 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb62d2b0740 10 client.25078 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb62d2b0740 20 client.25078 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5574adaf3120 0x5574adaf4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb62d2b0740 4 client.25078 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:28.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2166282171 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574ada4b600 con 0x5574adaf3120 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.583+0000 7fb628c73640 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5574adaf3120 0x5574adaf4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.584+0000 7fb603fff640 10 client.25078 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.584+0000 7fb628c73640 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5574adaf3120 0x5574adaf4590 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7d840760d7f28e08 server_cookie=8c8316b7b286d337 in_seq=0 out_seq=0 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.584+0000 7fb603fff640 1 -- 172.21.15.12:0/2166282171 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5574ada4b600 con 0x5574adaf3120 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.584+0000 7fb603fff640 10 client.25078 handle_command_reply: tid=0 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.584+0000 7fb62d2b0740 1 client.25078 shutdown 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2166282171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 msgr2=0x5574adadf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 0x5574adadf7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c8f0 tx=0x7fb61400a5b0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2166282171 shutdown_connections 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5574adaf3120 0x5574adaf4590 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adae2bb0 0x5574adadfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb603fff640 0 client.25078 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 0x5574adadf7d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2166282171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adae2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2166282171 >> 172.21.15.12:0/2166282171 conn(0x5574adad3f60 msgr2=0x5574adad9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:28.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2166282171 shutdown_connections 2024-09-16T01:01:28.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2166282171 wait complete. 2024-09-16T01:01:28.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.585+0000 7fb62d2b0740 20 client.25078 trim_cache size 0 max 16384 2024-09-16T01:01:28.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb62d2b0740 1 Processor -- start 2024-09-16T01:01:28.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb62d2b0740 1 -- start start 2024-09-16T01:01:28.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 0x5574adaf3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 0x5574adacee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adae2bb0 0x5574adafc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5574adaf28d0 con 0x5574adae2bb0 2024-09-16T01:01:28.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5574adaf2fa0 con 0x5574adad79d0 2024-09-16T01:01:28.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5574adaf3670 con 0x5574adad82f0 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb629474640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adae2bb0 0x5574adafc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb629474640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adae2bb0 0x5574adafc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58282/0 (socket says 172.21.15.12:58282) 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb629474640 1 -- 172.21.15.12:0/2732888604 learned_addr learned my addr 172.21.15.12:0/2732888604 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb623fff640 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 0x5574adacee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb628c73640 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 0x5574adaf3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb629474640 1 -- 172.21.15.12:0/2732888604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 msgr2=0x5574adacee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb629474640 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 0x5574adacee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb629474640 1 -- 172.21.15.12:0/2732888604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 msgr2=0x5574adaf3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb629474640 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 0x5574adaf3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb629474640 1 -- 172.21.15.12:0/2732888604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574adae20a0 con 0x5574adae2bb0 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb623fff640 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 0x5574adacee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.608+0000 7fb628c73640 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 0x5574adaf3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.609+0000 7fb629474640 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adae2bb0 0x5574adafc840 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009ca0 tx=0x7fb61c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e36c30a81a6143 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:28.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.609+0000 7fb61a7fc640 1 -- 172.21.15.12:0/2732888604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c003970 con 0x5574adae2bb0 2024-09-16T01:01:28.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.609+0000 7fb61a7fc640 1 -- 172.21.15.12:0/2732888604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb61c04a070 con 0x5574adae2bb0 2024-09-16T01:01:28.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.609+0000 7fb61a7fc640 1 -- 172.21.15.12:0/2732888604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0042a0 con 0x5574adae2bb0 2024-09-16T01:01:28.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.609+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2732888604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adae2bb0 msgr2=0x5574adafc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:28.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.609+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adae2bb0 0x5574adafc840 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009ca0 tx=0x7fb61c0098b0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2732888604 shutdown_connections 2024-09-16T01:01:28.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adae2bb0 0x5574adafc840 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adad82f0 0x5574adacee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2732888604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad79d0 0x5574adaf3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2732888604 >> 172.21.15.12:0/2732888604 conn(0x5574adad3f60 msgr2=0x5574adad3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2732888604 shutdown_connections 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2732888604 wait complete. 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 -- start start 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 Processor -- start 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adaf79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad82f0 0x5574adaf7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adae2bb0 0x5574adb5b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5574adaf4410 con 0x5574adad79d0 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5574adaf3d40 con 0x5574adad82f0 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.610+0000 7fb62d2b0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5574adaf4ae0 con 0x5574adae2bb0 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb62d2b0740 10 client.0 _ll_register_callbacks cb 0x7fb61409b9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:28.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb628c73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adaf79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb628c73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adaf79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58284/0 (socket says 172.21.15.12:58284) 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb628c73640 1 -- 172.21.15.12:0/2322054123 learned_addr learned my addr 172.21.15.12:0/2322054123 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb629474640 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adae2bb0 0x5574adb5b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb623fff640 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad82f0 0x5574adaf7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb628c73640 1 -- 172.21.15.12:0/2322054123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adae2bb0 msgr2=0x5574adb5b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb628c73640 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adae2bb0 0x5574adb5b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb628c73640 1 -- 172.21.15.12:0/2322054123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad82f0 msgr2=0x5574adaf7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb628c73640 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad82f0 0x5574adaf7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb628c73640 1 -- 172.21.15.12:0/2322054123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574adb5bd60 con 0x5574adad79d0 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb628c73640 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adaf79e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0045a0 tx=0x7fb60c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b78a12d8b5b3a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb603fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb603fff640 1 -- 172.21.15.12:0/2322054123 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c005020 con 0x5574adad79d0 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb603fff640 1 -- 172.21.15.12:0/2322054123 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fb60c0051c0 con 0x5574adad79d0 2024-09-16T01:01:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.611+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2322054123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb61c04a070 con 0x5574adad79d0 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb603fff640 1 -- 172.21.15.12:0/2322054123 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb60c035050 con 0x5574adad79d0 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb62d2b0740 10 client.15456 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2322054123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5574adb5cf70 con 0x5574adad79d0 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb603fff640 1 -- 172.21.15.12:0/2322054123 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb61c04a070 con 0x5574adad79d0 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb603fff640 1 -- 172.21.15.12:0/2322054123 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb60c028640 con 0x5574adad79d0 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb62d2b0740 10 client.15456 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb62d2b0740 10 client.15456 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb62d2b0740 20 client.15456 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5574adb61b70 0x5574adb60880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb62d2b0740 4 client.15456 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2322054123 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "status"}) -- 0x5574ada45b10 con 0x5574adb61b70 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb623fff640 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5574adb61b70 0x5574adb60880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.612+0000 7fb603fff640 10 client.15456 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:01:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb623fff640 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5574adb61b70 0x5574adb60880 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a6b055ddeaec2458 server_cookie=a0786fa583f4a822 in_seq=0 out_seq=0 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb603fff640 1 -- 172.21.15.12:0/2322054123 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5574ada45b10 con 0x5574adb61b70 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb603fff640 10 client.15456 handle_command_reply: tid=0 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 client.15456 shutdown 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2322054123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 msgr2=0x5574adaf79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adaf79e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0045a0 tx=0x7fb60c004730 comp rx=0 tx=0).stop 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2322054123 shutdown_connections 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5574adb61b70 0x5574adb60880 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5574adae2bb0 0x5574adb5b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5574adad82f0 0x5574adaf7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 --2- 172.21.15.12:0/2322054123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574adad79d0 0x5574adaf79e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2322054123 >> 172.21.15.12:0/2322054123 conn(0x5574adad3f60 msgr2=0x5574adaddf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb603fff640 0 client.15456 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2322054123 shutdown_connections 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 1 -- 172.21.15.12:0/2322054123 wait complete. 2024-09-16T01:01:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.613+0000 7fb62d2b0740 20 client.15456 trim_cache size 0 max 16384 2024-09-16T01:01:28.619 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:01:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:01:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 4, 2024-09-16T01:01:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 14601, 2024-09-16T01:01:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:01:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:01:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:01:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 127.041559533, 2024-09-16T01:01:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 29, 2024-09-16T01:01:28.619 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-09-16T01:01:28.620 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 89, 2024-09-16T01:01:28.620 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 184.91596523699999 2024-09-16T01:01:28.620 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:01:28.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 -- 172.21.15.12:0/3220811145 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb6100a3240 msgr2=0x7fb6100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:28.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb6100a3240 0x7fb6100a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009c20 tx=0x7fb60c005f90 comp rx=0 tx=0).stop 2024-09-16T01:01:28.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 -- 172.21.15.12:0/3220811145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb624102790 msgr2=0x7fb6241a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:28.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb624102790 0x7fb6241a4b40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c920 tx=0x7fb61400cde0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 -- 172.21.15.12:0/3220811145 shutdown_connections 2024-09-16T01:01:28.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb6100a3240 0x7fb6100a5700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb624106f10 0x7fb62410db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb624102790 0x7fb6241a4b40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 --2- 172.21.15.12:0/3220811145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb624101de0 0x7fb6241a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:28.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 -- 172.21.15.12:0/3220811145 >> 172.21.15.12:0/3220811145 conn(0x7fb6240fd8c0 msgr2=0x7fb6240ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:28.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 -- 172.21.15.12:0/3220811145 shutdown_connections 2024-09-16T01:01:28.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:28.614+0000 7fb62aed7640 1 -- 172.21.15.12:0/3220811145 wait complete. 2024-09-16T01:01:28.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:28 smithi012 ceph-mon[31197]: pgmap v371: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:28 smithi119 ceph-mon[35049]: pgmap v371: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:28 smithi098 ceph-mon[35346]: pgmap v371: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:29.436 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.e status 2024-09-16T01:01:29.697 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:30.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.184+0000 7f5feb7fe640 1 -- 172.21.15.12:0/1806360009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe4102570 msgr2=0x7f5fe41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.184+0000 7f5feb7fe640 1 --2- 172.21.15.12:0/1806360009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe4102570 0x7f5fe41029b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009900 tx=0x7f5fd402a480 comp rx=0 tx=0).stop 2024-09-16T01:01:30.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.184+0000 7f5feb7fe640 1 -- 172.21.15.12:0/1806360009 shutdown_connections 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.184+0000 7f5feb7fe640 1 --2- 172.21.15.12:0/1806360009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe4102ef0 0x7f5fe410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.184+0000 7f5feb7fe640 1 --2- 172.21.15.12:0/1806360009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe4102570 0x7f5fe41029b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.184+0000 7f5feb7fe640 1 --2- 172.21.15.12:0/1806360009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe4100e20 0x7f5fe4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.184+0000 7f5feb7fe640 1 -- 172.21.15.12:0/1806360009 >> 172.21.15.12:0/1806360009 conn(0x7f5fe40fc7d0 msgr2=0x7f5fe40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.184+0000 7f5feb7fe640 1 -- 172.21.15.12:0/1806360009 shutdown_connections 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.184+0000 7f5feb7fe640 1 -- 172.21.15.12:0/1806360009 wait complete. 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5feb7fe640 1 Processor -- start 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5feb7fe640 1 -- start start 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5feb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe4100e20 0x7f5fe4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5feb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe4102570 0x7f5fe4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5feb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe4102ef0 0x7f5fe419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5feb7fe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe4110f50 con 0x7f5fe4100e20 2024-09-16T01:01:30.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5feb7fe640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe4110dd0 con 0x7f5fe4102ef0 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5feb7fe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe41110d0 con 0x7f5fe4102570 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5fe959a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe4100e20 0x7f5fe4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5fe959a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe4100e20 0x7f5fe4198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58294/0 (socket says 172.21.15.12:58294) 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5fe959a640 1 -- 172.21.15.12:0/2243293417 learned_addr learned my addr 172.21.15.12:0/2243293417 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe4102ef0 0x7f5fe419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5fe959a640 1 -- 172.21.15.12:0/2243293417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe4102570 msgr2=0x7f5fe4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5fe8d99640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe4102570 0x7f5fe4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.185+0000 7f5fe959a640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe4102570 0x7f5fe4198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.186+0000 7f5fe959a640 1 -- 172.21.15.12:0/2243293417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe4102ef0 msgr2=0x7f5fe419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.186+0000 7f5fe959a640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe4102ef0 0x7f5fe419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.186+0000 7f5fe959a640 1 -- 172.21.15.12:0/2243293417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe419d4b0 con 0x7f5fe4100e20 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.186+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe4102ef0 0x7f5fe419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.186+0000 7f5fe959a640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe4100e20 0x7f5fe4198500 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c920 tx=0x7f5fe000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.186+0000 7f5fda7fc640 1 -- 172.21.15.12:0/2243293417 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0007c70 con 0x7f5fe4100e20 2024-09-16T01:01:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.186+0000 7f5feb7fe640 1 -- 172.21.15.12:0/2243293417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe419d7a0 con 0x7f5fe4100e20 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.186+0000 7f5fda7fc640 1 -- 172.21.15.12:0/2243293417 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fe0007e10 con 0x7f5fe4100e20 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.186+0000 7f5feb7fe640 1 -- 172.21.15.12:0/2243293417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe41a5080 con 0x7f5fe4100e20 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.186+0000 7f5fda7fc640 1 -- 172.21.15.12:0/2243293417 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0005260 con 0x7f5fe4100e20 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.188+0000 7f5fda7fc640 1 -- 172.21.15.12:0/2243293417 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5fe0005400 con 0x7f5fe4100e20 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fedbd7740 1 Processor -- start 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fedbd7740 1 -- start start 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e88745f9d0 0x55e88745fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e8874602f0 0x55e88746a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e88746cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e8873c6090 con 0x55e8874602f0 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e88736da70 con 0x55e88745f9d0 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e8873c2050 con 0x55e88746abb0 2024-09-16T01:01:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fda7fc640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fd00a3240 0x7f5fd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fe959a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e8874602f0 0x55e88746a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fe959a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e8874602f0 0x55e88746a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58296/0 (socket says 172.21.15.12:58296) 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fe959a640 1 -- 172.21.15.12:0/1575136373 learned_addr learned my addr 172.21.15.12:0/1575136373 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/1575136373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e88745f9d0 0x55e88745fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.189+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fd00a3240 0x7f5fd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fda7fc640 1 -- 172.21.15.12:0/2243293417 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5fe00cfe90 con 0x7f5fe4100e20 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fe8d99640 1 --2- 172.21.15.12:0/1575136373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e88746cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fe959a640 1 -- 172.21.15.12:0/1575136373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 msgr2=0x55e88746cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fe959a640 1 --2- 172.21.15.12:0/1575136373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e88746cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fe959a640 1 -- 172.21.15.12:0/1575136373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e88745f9d0 msgr2=0x55e88745fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fe959a640 1 --2- 172.21.15.12:0/1575136373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e88745f9d0 0x55e88745fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fe959a640 1 -- 172.21.15.12:0/1575136373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e88737a130 con 0x55e8874602f0 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/1575136373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e88745f9d0 0x55e88745fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fe959a640 1 --2- 172.21.15.12:0/1575136373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e8874602f0 0x55e88746a670 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5fe009c0e0 tx=0x7f5fe000a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc959f83b4045a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fd00a3240 0x7f5fd00a5700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc005cc0 tx=0x7f5fdc005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fcf7fe640 1 -- 172.21.15.12:0/1575136373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe009c850 con 0x55e8874602f0 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fcf7fe640 1 -- 172.21.15.12:0/1575136373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fe009c150 con 0x55e8874602f0 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.190+0000 7f5fcf7fe640 1 -- 172.21.15.12:0/1575136373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00987c0 con 0x55e8874602f0 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 -- 172.21.15.12:0/1575136373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e8874602f0 msgr2=0x55e88746a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/1575136373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e8874602f0 0x55e88746a670 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5fe009c0e0 tx=0x7f5fe000a630 comp rx=0 tx=0).stop 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 -- 172.21.15.12:0/1575136373 shutdown_connections 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/1575136373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e88746cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/1575136373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e8874602f0 0x55e88746a670 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/1575136373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e88745f9d0 0x55e88745fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 -- 172.21.15.12:0/1575136373 >> 172.21.15.12:0/1575136373 conn(0x55e88745bf60 msgr2=0x55e88745c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 -- 172.21.15.12:0/1575136373 shutdown_connections 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 -- 172.21.15.12:0/1575136373 wait complete. 2024-09-16T01:01:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 -- start start 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.191+0000 7f5fedbd7740 1 Processor -- start 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88745f9d0 0x55e88746a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e8874677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88746abb0 0x55e887467d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e88746d780 con 0x55e88746abb0 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e887380f20 con 0x55e8874602f0 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e88746d900 con 0x55e88745f9d0 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fedbd7740 10 client.0 _ll_register_callbacks cb 0x55e88734a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88746abb0 0x55e887467d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88746abb0 0x55e887467d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58308/0 (socket says 172.21.15.12:58308) 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe9d9b640 1 -- 172.21.15.12:0/93000065 learned_addr learned my addr 172.21.15.12:0/93000065 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe959a640 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88745f9d0 0x55e88746a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe8d99640 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e8874677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe9d9b640 1 -- 172.21.15.12:0/93000065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88745f9d0 msgr2=0x55e88746a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88745f9d0 0x55e88746a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe9d9b640 1 -- 172.21.15.12:0/93000065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 msgr2=0x55e8874677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e8874677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe9d9b640 1 -- 172.21.15.12:0/93000065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8871372b0 con 0x55e88746abb0 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88746abb0 0x55e887467d00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0124c0 tx=0x7f5fdc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f996f7146960e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.192+0000 7f5fccff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fccff9640 1 -- 172.21.15.12:0/93000065 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc025070 con 0x55e88746abb0 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fccff9640 1 -- 172.21.15.12:0/93000065 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5fdc011dd0 con 0x55e88746abb0 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fedbd7740 1 -- 172.21.15.12:0/93000065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fe009c150 con 0x55e88746abb0 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fccff9640 1 -- 172.21.15.12:0/93000065 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5fdc031050 con 0x55e88746abb0 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fedbd7740 10 client.15468 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fedbd7740 1 -- 172.21.15.12:0/93000065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e887479130 con 0x55e88746abb0 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fccff9640 1 -- 172.21.15.12:0/93000065 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fe009c150 con 0x55e88746abb0 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fccff9640 1 -- 172.21.15.12:0/93000065 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5fdc01c050 con 0x55e88746abb0 2024-09-16T01:01:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fedbd7740 10 client.15468 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fedbd7740 10 client.15468 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fedbd7740 20 client.15468 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e88747b750 0x55e88747cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fedbd7740 4 client.15468 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.193+0000 7f5fedbd7740 1 -- 172.21.15.12:0/93000065 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8873d3600 con 0x55e88747b750 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.194+0000 7f5fe959a640 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e88747b750 0x55e88747cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.194+0000 7f5fe959a640 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e88747b750 0x55e88747cbc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=de7dd2b03332ad3b server_cookie=ce8efe9de1a3d80a in_seq=0 out_seq=0 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.194+0000 7f5fccff9640 10 client.15468 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fccff9640 1 -- 172.21.15.12:0/93000065 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8873d3600 con 0x55e88747b750 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fccff9640 10 client.15468 handle_command_reply: tid=0 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 client.15468 shutdown 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 -- 172.21.15.12:0/93000065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88746abb0 msgr2=0x55e887467d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88746abb0 0x55e887467d00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0124c0 tx=0x7f5fdc004ab0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 -- 172.21.15.12:0/93000065 shutdown_connections 2024-09-16T01:01:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e88747b750 0x55e88747cbc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88746abb0 0x55e887467d00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e8874677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/93000065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88745f9d0 0x55e88746a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 -- 172.21.15.12:0/93000065 >> 172.21.15.12:0/93000065 conn(0x55e88745bf60 msgr2=0x55e887461c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fccff9640 0 client.15468 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:01:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 -- 172.21.15.12:0/93000065 shutdown_connections 2024-09-16T01:01:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 1 -- 172.21.15.12:0/93000065 wait complete. 2024-09-16T01:01:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.195+0000 7f5fedbd7740 20 client.15468 trim_cache size 0 max 16384 2024-09-16T01:01:30.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fedbd7740 1 Processor -- start 2024-09-16T01:01:30.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fedbd7740 1 -- start start 2024-09-16T01:01:30.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e88747a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e887485290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e887466090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e88747af00 con 0x55e88745f9d0 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e88747b5d0 con 0x55e8874602f0 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e88747bca0 con 0x55e88746abb0 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fe959a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e88747a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fe959a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e88747a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58318/0 (socket says 172.21.15.12:58318) 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.213+0000 7f5fe959a640 1 -- 172.21.15.12:0/819329003 learned_addr learned my addr 172.21.15.12:0/819329003 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.214+0000 7f5fe959a640 1 -- 172.21.15.12:0/819329003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 msgr2=0x55e887466090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.214+0000 7f5fe959a640 1 --2- 172.21.15.12:0/819329003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e887466090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.214+0000 7f5fe959a640 1 -- 172.21.15.12:0/819329003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 msgr2=0x55e887485290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.214+0000 7f5fe959a640 1 --2- 172.21.15.12:0/819329003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e887485290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.214+0000 7f5fe959a640 1 -- 172.21.15.12:0/819329003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e88746a090 con 0x55e88745f9d0 2024-09-16T01:01:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.214+0000 7f5fe959a640 1 --2- 172.21.15.12:0/819329003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e88747a5a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00b0010 tx=0x7f5fe00983f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b39d0c914c9633 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:30.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.214+0000 7f5fceffd640 1 -- 172.21.15.12:0/819329003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00b4070 con 0x55e88745f9d0 2024-09-16T01:01:30.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.214+0000 7f5fceffd640 1 -- 172.21.15.12:0/819329003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fe009c150 con 0x55e88745f9d0 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.214+0000 7f5fceffd640 1 -- 172.21.15.12:0/819329003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00a0170 con 0x55e88745f9d0 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 -- 172.21.15.12:0/819329003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 msgr2=0x55e88747a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/819329003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e88747a5a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00b0010 tx=0x7f5fe00983f0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 -- 172.21.15.12:0/819329003 shutdown_connections 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/819329003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e887466090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/819329003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e887485290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/819329003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e88747a5a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 -- 172.21.15.12:0/819329003 >> 172.21.15.12:0/819329003 conn(0x55e88745bf60 msgr2=0x55e887467780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 -- 172.21.15.12:0/819329003 shutdown_connections 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 -- 172.21.15.12:0/819329003 wait complete. 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 -- start start 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 Processor -- start 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.215+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e887464680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e887464bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fedbd7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e8874e1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e88747ca40 con 0x55e88745f9d0 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e88747c370 con 0x55e8874602f0 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fedbd7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e88747d110 con 0x55e88746abb0 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fedbd7740 10 client.0 _ll_register_callbacks cb 0x7f5fdc012050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe959a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e887464680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe959a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e887464680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58324/0 (socket says 172.21.15.12:58324) 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe959a640 1 -- 172.21.15.12:0/3716448620 learned_addr learned my addr 172.21.15.12:0/3716448620 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe8d99640 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e887464bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e8874e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe959a640 1 -- 172.21.15.12:0/3716448620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 msgr2=0x55e8874e1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe959a640 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e8874e1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe959a640 1 -- 172.21.15.12:0/3716448620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 msgr2=0x55e887464bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe959a640 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e887464bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe959a640 1 -- 172.21.15.12:0/3716448620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8874e1720 con 0x55e88745f9d0 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe9d9b640 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e8874e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fe959a640 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e887464680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00d01b0 tx=0x7f5fe0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0986fa7cd36a505 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fccff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fccff9640 1 -- 172.21.15.12:0/3716448620 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0066060 con 0x55e88745f9d0 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fccff9640 1 -- 172.21.15.12:0/3716448620 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5fe00ae9d0 con 0x55e88745f9d0 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.216+0000 7f5fedbd7740 1 -- 172.21.15.12:0/3716448620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fe009c150 con 0x55e88745f9d0 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fccff9640 1 -- 172.21.15.12:0/3716448620 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5fe00b4070 con 0x55e88745f9d0 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fedbd7740 10 client.15474 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fedbd7740 1 -- 172.21.15.12:0/3716448620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e8874e9cb0 con 0x55e88745f9d0 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fccff9640 1 -- 172.21.15.12:0/3716448620 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fe009c150 con 0x55e88745f9d0 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fccff9640 1 -- 172.21.15.12:0/3716448620 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5fe00a4930 con 0x55e88745f9d0 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fedbd7740 10 client.15474 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fedbd7740 10 client.15474 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-16T01:01:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fedbd7740 20 client.15474 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e8874ee000 0x55e8874ecd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fedbd7740 4 client.15474 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fedbd7740 1 -- 172.21.15.12:0/3716448620 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "status"}) -- 0x55e8873cdb10 con 0x55e8874ee000 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.217+0000 7f5fe8d99640 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e8874ee000 0x55e8874ecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fccff9640 10 client.15474 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fe8d99640 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e8874ee000 0x55e8874ecd10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a3074ea4dd5d9d77 server_cookie=2ce40283a732b5db in_seq=0 out_seq=0 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fccff9640 1 -- 172.21.15.12:0/3716448620 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e8873cdb10 con 0x55e8874ee000 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fccff9640 10 client.15474 handle_command_reply: tid=0 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 client.15474 shutdown 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 -- 172.21.15.12:0/3716448620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 msgr2=0x55e887464680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e887464680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00d01b0 tx=0x7f5fe0000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 -- 172.21.15.12:0/3716448620 shutdown_connections 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e8874ee000 0x55e8874ecd10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e88746abb0 0x55e8874e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e8874602f0 0x55e887464bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 --2- 172.21.15.12:0/3716448620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e88745f9d0 0x55e887464680 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fccff9640 0 client.15474 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 -- 172.21.15.12:0/3716448620 >> 172.21.15.12:0/3716448620 conn(0x55e88745bf60 msgr2=0x55e887465fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 -- 172.21.15.12:0/3716448620 shutdown_connections 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.218+0000 7f5fedbd7740 1 -- 172.21.15.12:0/3716448620 wait complete. 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5fedbd7740 20 client.15474 trim_cache size 0 max 16384 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 3, 2024-09-16T01:01:30.224 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24458, 2024-09-16T01:01:30.225 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:01:30.225 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:01:30.225 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:01:30.225 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 129.457806874, 2024-09-16T01:01:30.225 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 29, 2024-09-16T01:01:30.225 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-09-16T01:01:30.225 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 89, 2024-09-16T01:01:30.225 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 203.04271898799999 2024-09-16T01:01:30.225 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:01:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 -- 172.21.15.12:0/2243293417 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fd00a3240 msgr2=0x7f5fd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fd00a3240 0x7f5fd00a5700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc005cc0 tx=0x7f5fdc005c30 comp rx=0 tx=0).stop 2024-09-16T01:01:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 -- 172.21.15.12:0/2243293417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe4100e20 msgr2=0x7f5fe4198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe4100e20 0x7f5fe4198500 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c920 tx=0x7f5fe000cde0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 -- 172.21.15.12:0/2243293417 shutdown_connections 2024-09-16T01:01:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5fd00a3240 0x7f5fd00a5700 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fe4102ef0 0x7f5fe419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fe4102570 0x7f5fe4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 --2- 172.21.15.12:0/2243293417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe4100e20 0x7f5fe4198500 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 -- 172.21.15.12:0/2243293417 >> 172.21.15.12:0/2243293417 conn(0x7f5fe40fc7d0 msgr2=0x7f5fe406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:30.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 -- 172.21.15.12:0/2243293417 shutdown_connections 2024-09-16T01:01:30.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:30.219+0000 7f5feb7fe640 1 -- 172.21.15.12:0/2243293417 wait complete. 2024-09-16T01:01:30.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:30 smithi012 ceph-mon[31197]: pgmap v372: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-16T01:01:31.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-16T01:01:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:30 smithi119 ceph-mon[35049]: pgmap v372: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-16T01:01:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:30 smithi098 ceph-mon[35346]: pgmap v372: 129 pgs: 129 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-16T01:01:31.296 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:31.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.777+0000 7f6807b0e640 1 -- 172.21.15.12:0/3705947576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6800102570 msgr2=0x7f68001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.777+0000 7f6807b0e640 1 --2- 172.21.15.12:0/3705947576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6800102570 0x7f68001029b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009900 tx=0x7f67f002a480 comp rx=0 tx=0).stop 2024-09-16T01:01:31.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.777+0000 7f6807b0e640 1 -- 172.21.15.12:0/3705947576 shutdown_connections 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.777+0000 7f6807b0e640 1 --2- 172.21.15.12:0/3705947576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6800102ef0 0x7f680010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.777+0000 7f6807b0e640 1 --2- 172.21.15.12:0/3705947576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6800102570 0x7f68001029b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.777+0000 7f6807b0e640 1 --2- 172.21.15.12:0/3705947576 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6800100e20 0x7f6800101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.777+0000 7f6807b0e640 1 -- 172.21.15.12:0/3705947576 >> 172.21.15.12:0/3705947576 conn(0x7f68000fc7d0 msgr2=0x7f68000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.777+0000 7f6807b0e640 1 -- 172.21.15.12:0/3705947576 shutdown_connections 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.777+0000 7f6807b0e640 1 -- 172.21.15.12:0/3705947576 wait complete. 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f6807b0e640 1 Processor -- start 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f6807b0e640 1 -- start start 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f6807b0e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6800100e20 0x7f68001973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f6807b0e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6800102570 0x7f6800197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f6807b0e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6800102ef0 0x7f680019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f6807b0e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6800110f80 con 0x7f6800102570 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f6807b0e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6800110e00 con 0x7f6800102ef0 2024-09-16T01:01:31.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f6807b0e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6800111100 con 0x7f6800100e20 2024-09-16T01:01:31.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f68050a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6800102570 0x7f6800197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f68050a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6800102570 0x7f6800197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58344/0 (socket says 172.21.15.12:58344) 2024-09-16T01:01:31.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f68050a9640 1 -- 172.21.15.12:0/4010001708 learned_addr learned my addr 172.21.15.12:0/4010001708 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:31.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f68060ab640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6800102ef0 0x7f680019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f68050a9640 1 -- 172.21.15.12:0/4010001708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6800100e20 msgr2=0x7f68001973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f68050a9640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6800100e20 0x7f68001973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f68050a9640 1 -- 172.21.15.12:0/4010001708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6800102ef0 msgr2=0x7f680019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.778+0000 7f68050a9640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6800102ef0 0x7f680019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.779+0000 7f68050a9640 1 -- 172.21.15.12:0/4010001708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680019c390 con 0x7f6800102570 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.779+0000 7f68050a9640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6800102570 0x7f6800197920 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f67f0006010 tx=0x7f67f0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.779+0000 7f67f6ffd640 1 -- 172.21.15.12:0/4010001708 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f003f070 con 0x7f6800102570 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.779+0000 7f6807b0e640 1 -- 172.21.15.12:0/4010001708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680019c620 con 0x7f6800102570 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.779+0000 7f67f6ffd640 1 -- 172.21.15.12:0/4010001708 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67f0031c30 con 0x7f6800102570 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.779+0000 7f67f6ffd640 1 -- 172.21.15.12:0/4010001708 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0035030 con 0x7f6800102570 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.779+0000 7f6807b0e640 1 -- 172.21.15.12:0/4010001708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68001a3f60 con 0x7f6800102570 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.782+0000 7f67f6ffd640 1 -- 172.21.15.12:0/4010001708 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f67f0042070 con 0x7f6800102570 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.782+0000 7f6809ee7740 1 Processor -- start 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.782+0000 7f6809ee7740 1 -- start start 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.782+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf6dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.782+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf7a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.782+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf7d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.782+0000 7f6809ee7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5561cbed4090 con 0x5561cbf7adc0 2024-09-16T01:01:31.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.782+0000 7f6809ee7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561cbe7ba70 con 0x5561cbf6d870 2024-09-16T01:01:31.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.782+0000 7f6809ee7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5561cbed0050 con 0x5561cbf6e190 2024-09-16T01:01:31.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68050a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf7d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68060ab640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf6dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68050a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf7d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58348/0 (socket says 172.21.15.12:58348) 2024-09-16T01:01:31.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68050a9640 1 -- 172.21.15.12:0/2179274692 learned_addr learned my addr 172.21.15.12:0/2179274692 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:31.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68058aa640 1 --2- 172.21.15.12:0/2179274692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf7a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f67f6ffd640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67ec0a3240 0x7f67ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68060ab640 1 -- 172.21.15.12:0/2179274692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 msgr2=0x5561cbf7a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68060ab640 1 --2- 172.21.15.12:0/2179274692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf7a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68060ab640 1 -- 172.21.15.12:0/2179274692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 msgr2=0x5561cbf7d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68060ab640 1 --2- 172.21.15.12:0/2179274692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf7d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68060ab640 1 -- 172.21.15.12:0/2179274692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561cbe88130 con 0x5561cbf6d870 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68050a9640 1 --2- 172.21.15.12:0/2179274692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf7d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f67f6ffd640 1 -- 172.21.15.12:0/4010001708 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f67f00f0460 con 0x7f6800102570 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68060ab640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67ec0a3240 0x7f67ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.783+0000 7f68060ab640 1 --2- 172.21.15.12:0/2179274692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf6dc50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009ed0 tx=0x7f67f80107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab2eeb787e3b43d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f67ebfff640 1 -- 172.21.15.12:0/2179274692 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f801d9a0 con 0x5561cbf6d870 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f67ebfff640 1 -- 172.21.15.12:0/2179274692 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67f8015070 con 0x5561cbf6d870 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f67ebfff640 1 -- 172.21.15.12:0/2179274692 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f801c620 con 0x5561cbf6d870 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f6809ee7740 1 -- 172.21.15.12:0/2179274692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 msgr2=0x5561cbf6dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f68060ab640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67ec0a3240 0x7f67ec0a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f67f8011010 tx=0x7f67f801cd50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2179274692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf6dc50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009ed0 tx=0x7f67f80107a0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f6809ee7740 1 -- 172.21.15.12:0/2179274692 shutdown_connections 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2179274692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf7d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2179274692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf7a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2179274692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf6dc50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.784+0000 7f6809ee7740 1 -- 172.21.15.12:0/2179274692 >> 172.21.15.12:0/2179274692 conn(0x5561cbf69f60 msgr2=0x5561cbf6a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 1 -- 172.21.15.12:0/2179274692 shutdown_connections 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 1 -- 172.21.15.12:0/2179274692 wait complete. 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 1 -- start start 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 1 Processor -- start 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf7a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf779b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf77ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5561cbf7d990 con 0x5561cbf7adc0 2024-09-16T01:01:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561cbe8ef20 con 0x5561cbf6d870 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5561cbf7db10 con 0x5561cbf6e190 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.785+0000 7f6809ee7740 10 client.0 _ll_register_callbacks cb 0x5561cbe58030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68060ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf77ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68060ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf77ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58354/0 (socket says 172.21.15.12:58354) 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68058aa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf7a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68060ab640 1 -- 172.21.15.12:0/2671659883 learned_addr learned my addr 172.21.15.12:0/2671659883 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68050a9640 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68060ab640 1 -- 172.21.15.12:0/2671659883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 msgr2=0x5561cbf779b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68060ab640 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf779b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68060ab640 1 -- 172.21.15.12:0/2671659883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 msgr2=0x5561cbf7a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68060ab640 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf7a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68060ab640 1 -- 172.21.15.12:0/2671659883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561cbc452b0 con 0x5561cbf7adc0 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f68060ab640 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf77ef0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f67f801f090 tx=0x7f67f8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5c512f443d96af server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f67e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f67e97fa640 1 -- 172.21.15.12:0/2671659883 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f801c5d0 con 0x5561cbf7adc0 2024-09-16T01:01:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f6809ee7740 1 -- 172.21.15.12:0/2671659883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67f8015070 con 0x5561cbf7adc0 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.786+0000 7f67e97fa640 1 -- 172.21.15.12:0/2671659883 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f67f801c770 con 0x5561cbf7adc0 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f67e97fa640 1 -- 172.21.15.12:0/2671659883 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f67f8011440 con 0x5561cbf7adc0 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f6809ee7740 10 client.15486 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f6809ee7740 1 -- 172.21.15.12:0/2671659883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561cbf89340 con 0x5561cbf7adc0 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f67e97fa640 1 -- 172.21.15.12:0/2671659883 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67f8015070 con 0x5561cbf7adc0 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f67e97fa640 1 -- 172.21.15.12:0/2671659883 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f67f8011700 con 0x5561cbf7adc0 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f6809ee7740 10 client.15486 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f6809ee7740 10 client.15486 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f6809ee7740 20 client.15486 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5561cbf8b7b0 0x5561cbf8cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f6809ee7740 4 client.15486 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f6809ee7740 1 -- 172.21.15.12:0/2671659883 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561cbee1600 con 0x5561cbf8b7b0 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.787+0000 7f68058aa640 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5561cbf8b7b0 0x5561cbf8cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.788+0000 7f68058aa640 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5561cbf8b7b0 0x5561cbf8cc20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f6c7b9d389dc653 server_cookie=2aabdaedc6b58038 in_seq=0 out_seq=0 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.788+0000 7f67e97fa640 10 client.15486 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.788+0000 7f67e97fa640 1 -- 172.21.15.12:0/2671659883 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5561cbee1600 con 0x5561cbf8b7b0 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.788+0000 7f67e97fa640 10 client.15486 handle_command_reply: tid=0 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.788+0000 7f6809ee7740 1 client.15486 shutdown 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 1 -- 172.21.15.12:0/2671659883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 msgr2=0x5561cbf77ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf77ef0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f67f801f090 tx=0x7f67f8023000 comp rx=0 tx=0).stop 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 1 -- 172.21.15.12:0/2671659883 shutdown_connections 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5561cbf8b7b0 0x5561cbf8cc20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf77ef0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf779b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2671659883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf7a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f67e97fa640 0 client.15486 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:01:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 1 -- 172.21.15.12:0/2671659883 >> 172.21.15.12:0/2671659883 conn(0x5561cbf69f60 msgr2=0x5561cbf6fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:31.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 1 -- 172.21.15.12:0/2671659883 shutdown_connections 2024-09-16T01:01:31.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 1 -- 172.21.15.12:0/2671659883 wait complete. 2024-09-16T01:01:31.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.789+0000 7f6809ee7740 20 client.15486 trim_cache size 0 max 16384 2024-09-16T01:01:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f6809ee7740 1 Processor -- start 2024-09-16T01:01:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f6809ee7740 1 -- start start 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf6fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf952f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f6809ee7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5561cbf8af60 con 0x5561cbf7adc0 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f6809ee7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561cbf8b630 con 0x5561cbf6d870 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f6809ee7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5561cbf8bd00 con 0x5561cbf6e190 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f68060ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f68050a9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf6fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.807+0000 7f68060ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58368/0 (socket says 172.21.15.12:58368) 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f68060ab640 1 -- 172.21.15.12:0/2482765636 learned_addr learned my addr 172.21.15.12:0/2482765636 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f68058aa640 1 --2- 172.21.15.12:0/2482765636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f68060ab640 1 -- 172.21.15.12:0/2482765636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 msgr2=0x5561cbf6fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f68060ab640 1 --2- 172.21.15.12:0/2482765636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf6fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f68060ab640 1 -- 172.21.15.12:0/2482765636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 msgr2=0x5561cbf697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f68060ab640 1 --2- 172.21.15.12:0/2482765636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f68060ab640 1 -- 172.21.15.12:0/2482765636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561cbf72620 con 0x5561cbf7adc0 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f68058aa640 1 --2- 172.21.15.12:0/2482765636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f68050a9640 1 --2- 172.21.15.12:0/2482765636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf6fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f68060ab640 1 --2- 172.21.15.12:0/2482765636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf952f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f67f801d040 tx=0x7f67f8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828aeb1ad279dd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f67eb7fe640 1 -- 172.21.15.12:0/2482765636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f801ddc0 con 0x5561cbf7adc0 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f67eb7fe640 1 -- 172.21.15.12:0/2482765636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67f8015070 con 0x5561cbf7adc0 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.808+0000 7f67eb7fe640 1 -- 172.21.15.12:0/2482765636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f80115e0 con 0x5561cbf7adc0 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 -- 172.21.15.12:0/2482765636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 msgr2=0x5561cbf952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2482765636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf952f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f67f801d040 tx=0x7f67f8005bd0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 -- 172.21.15.12:0/2482765636 shutdown_connections 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2482765636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf7adc0 0x5561cbf952f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2482765636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6e190 0x5561cbf6fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 --2- 172.21.15.12:0/2482765636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf6d870 0x5561cbf697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 -- 172.21.15.12:0/2482765636 >> 172.21.15.12:0/2482765636 conn(0x5561cbf69f60 msgr2=0x5561cbf6f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 -- 172.21.15.12:0/2482765636 shutdown_connections 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 -- 172.21.15.12:0/2482765636 wait complete. 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 -- start start 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.809+0000 7f6809ee7740 1 Processor -- start 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6d870 0x5561cbf8f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf6e190 0x5561cbf8ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f6809ee7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf7adc0 0x5561cbf8e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f6809ee7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5561cbf8caa0 con 0x5561cbf6e190 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f6809ee7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561cbf8c3d0 con 0x5561cbf7adc0 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f6809ee7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5561cbf8d170 con 0x5561cbf6d870 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f6809ee7740 10 client.0 _ll_register_callbacks cb 0x7f67f00f3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f68050a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf6e190 0x5561cbf8ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f68050a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf6e190 0x5561cbf8ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58380/0 (socket says 172.21.15.12:58380) 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f68050a9640 1 -- 172.21.15.12:0/4226361294 learned_addr learned my addr 172.21.15.12:0/4226361294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f68058aa640 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6d870 0x5561cbf8f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f68060ab640 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf7adc0 0x5561cbf8e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f68050a9640 1 -- 172.21.15.12:0/4226361294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6d870 msgr2=0x5561cbf8f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f68050a9640 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6d870 0x5561cbf8f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f68050a9640 1 -- 172.21.15.12:0/4226361294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf7adc0 msgr2=0x5561cbf8e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f68050a9640 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf7adc0 0x5561cbf8e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.810+0000 7f68050a9640 1 -- 172.21.15.12:0/4226361294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561cbf8e870 con 0x5561cbf6e190 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f68050a9640 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf6e190 0x5561cbf8ddf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f67f00bc6b0 tx=0x7f67f0009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf6c704fd2ecd6f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f67e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f67e97fa640 1 -- 172.21.15.12:0/4226361294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0049040 con 0x5561cbf6e190 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f67e97fa640 1 -- 172.21.15.12:0/4226361294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f67f00f01e0 con 0x5561cbf6e190 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f6809ee7740 1 -- 172.21.15.12:0/4226361294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67f8015070 con 0x5561cbf6e190 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f67e97fa640 1 -- 172.21.15.12:0/4226361294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f67f00bc080 con 0x5561cbf6e190 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f6809ee7740 10 client.15492 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f6809ee7740 1 -- 172.21.15.12:0/4226361294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561cbff8bf0 con 0x5561cbf6e190 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f67e97fa640 1 -- 172.21.15.12:0/4226361294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67f8015070 con 0x5561cbf6e190 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f67e97fa640 1 -- 172.21.15.12:0/4226361294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f67f00b8d90 con 0x5561cbf6e190 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f6809ee7740 10 client.15492 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f6809ee7740 10 client.15492 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f6809ee7740 20 client.15492 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f6809ee7740 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5561cbffd800 0x5561cbffc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f6809ee7740 4 client.15492 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.811+0000 7f6809ee7740 1 -- 172.21.15.12:0/4226361294 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "status"}) -- 0x5561cbedbb10 con 0x5561cbffd800 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f68058aa640 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5561cbffd800 0x5561cbffc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f67e97fa640 10 client.15492 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f68058aa640 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5561cbffd800 0x5561cbffc510 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6682f3982482e355 server_cookie=338071ae9d4de011 in_seq=0 out_seq=0 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f67e97fa640 1 -- 172.21.15.12:0/4226361294 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5561cbedbb10 con 0x5561cbffd800 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f67e97fa640 10 client.15492 handle_command_reply: tid=0 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f6809ee7740 1 client.15492 shutdown 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f6809ee7740 1 -- 172.21.15.12:0/4226361294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf6e190 msgr2=0x5561cbf8ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f6809ee7740 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf6e190 0x5561cbf8ddf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f67f00bc6b0 tx=0x7f67f0009620 comp rx=0 tx=0).stop 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f6809ee7740 1 -- 172.21.15.12:0/4226361294 shutdown_connections 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f6809ee7740 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5561cbffd800 0x5561cbffc510 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f6809ee7740 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561cbf7adc0 0x5561cbf8e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f6809ee7740 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561cbf6e190 0x5561cbf8ddf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f67e97fa640 0 client.15492 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.812+0000 7f6809ee7740 1 --2- 172.21.15.12:0/4226361294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561cbf6d870 0x5561cbf8f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.813+0000 7f6809ee7740 1 -- 172.21.15.12:0/4226361294 >> 172.21.15.12:0/4226361294 conn(0x5561cbf69f60 msgr2=0x5561cbf6fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.813+0000 7f6809ee7740 1 -- 172.21.15.12:0/4226361294 shutdown_connections 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.813+0000 7f6809ee7740 1 -- 172.21.15.12:0/4226361294 wait complete. 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.813+0000 7f6809ee7740 20 client.15492 trim_cache size 0 max 16384 2024-09-16T01:01:31.826 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 2, 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24475, 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 132.05671737700001, 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 29, 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 89, 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 193.98206847500001 2024-09-16T01:01:31.827 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.813+0000 7f6807b0e640 1 -- 172.21.15.12:0/4010001708 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67ec0a3240 msgr2=0x7f67ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.813+0000 7f6807b0e640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67ec0a3240 0x7f67ec0a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f67f8011010 tx=0x7f67f801cd50 comp rx=0 tx=0).stop 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.813+0000 7f6807b0e640 1 -- 172.21.15.12:0/4010001708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6800102570 msgr2=0x7f6800197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.813+0000 7f6807b0e640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6800102570 0x7f6800197920 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f67f0006010 tx=0x7f67f0003c10 comp rx=0 tx=0).stop 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.813+0000 7f6807b0e640 1 -- 172.21.15.12:0/4010001708 shutdown_connections 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.814+0000 7f6807b0e640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f67ec0a3240 0x7f67ec0a5700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.814+0000 7f6807b0e640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6800102ef0 0x7f680019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.814+0000 7f6807b0e640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6800102570 0x7f6800197920 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.814+0000 7f6807b0e640 1 --2- 172.21.15.12:0/4010001708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6800100e20 0x7f68001973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.814+0000 7f6807b0e640 1 -- 172.21.15.12:0/4010001708 >> 172.21.15.12:0/4010001708 conn(0x7f68000fc7d0 msgr2=0x7f68001068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.814+0000 7f6807b0e640 1 -- 172.21.15.12:0/4010001708 shutdown_connections 2024-09-16T01:01:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:31.814+0000 7f6807b0e640 1 -- 172.21.15.12:0/4010001708 wait complete. 2024-09-16T01:01:32.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-16T01:01:32.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:32 smithi012 ceph-mon[31197]: pgmap v373: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:01:32.857 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:32 smithi119 ceph-mon[35049]: pgmap v373: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:01:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:32 smithi098 ceph-mon[35346]: pgmap v373: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:01:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 -- 172.21.15.12:0/1913010693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f408c106a80 msgr2=0x7f408c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 --2- 172.21.15.12:0/1913010693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f408c106a80 0x7f408c106e60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f407c009930 tx=0x7f407c02a420 comp rx=0 tx=0).stop 2024-09-16T01:01:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 -- 172.21.15.12:0/1913010693 shutdown_connections 2024-09-16T01:01:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 --2- 172.21.15.12:0/1913010693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c101420 0x7f408c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 --2- 172.21.15.12:0/1913010693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f408c100a80 0x7f408c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 --2- 172.21.15.12:0/1913010693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f408c106a80 0x7f408c106e60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 -- 172.21.15.12:0/1913010693 >> 172.21.15.12:0/1913010693 conn(0x7f408c0fc7a0 msgr2=0x7f408c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 -- 172.21.15.12:0/1913010693 shutdown_connections 2024-09-16T01:01:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 -- 172.21.15.12:0/1913010693 wait complete. 2024-09-16T01:01:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 Processor -- start 2024-09-16T01:01:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.337+0000 7f4092f15640 1 -- start start 2024-09-16T01:01:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4092f15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f408c100a80 0x7f408c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4092f15640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f408c101420 0x7f408c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4092f15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c106a80 0x7f408c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4092f15640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f408c110e80 con 0x7f408c100a80 2024-09-16T01:01:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4092f15640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f408c110d00 con 0x7f408c101420 2024-09-16T01:01:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4092f15640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f408c111000 con 0x7f408c106a80 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4090cb1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f408c100a80 0x7f408c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4090cb1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f408c100a80 0x7f408c1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58400/0 (socket says 172.21.15.12:58400) 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4090cb1640 1 -- 172.21.15.12:0/3726206801 learned_addr learned my addr 172.21.15.12:0/3726206801 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f40914b2640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c106a80 0x7f408c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f408bfff640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f408c101420 0x7f408c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4090cb1640 1 -- 172.21.15.12:0/3726206801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c106a80 msgr2=0x7f408c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4090cb1640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c106a80 0x7f408c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4090cb1640 1 -- 172.21.15.12:0/3726206801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f408c101420 msgr2=0x7f408c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4090cb1640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f408c101420 0x7f408c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4090cb1640 1 -- 172.21.15.12:0/3726206801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408c19d390 con 0x7f408c100a80 2024-09-16T01:01:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.338+0000 7f4090cb1640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f408c100a80 0x7f408c1983e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f407c009230 tx=0x7f407c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.339+0000 7f4089ffb640 1 -- 172.21.15.12:0/3726206801 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c03f030 con 0x7f408c100a80 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.339+0000 7f4089ffb640 1 -- 172.21.15.12:0/3726206801 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f407c003ad0 con 0x7f408c100a80 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.339+0000 7f4092f15640 1 -- 172.21.15.12:0/3726206801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408c19d620 con 0x7f408c100a80 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.339+0000 7f4089ffb640 1 -- 172.21.15.12:0/3726206801 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c035070 con 0x7f408c100a80 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.339+0000 7f4092f15640 1 -- 172.21.15.12:0/3726206801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f408c1a4f60 con 0x7f408c100a80 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.341+0000 7f4089ffb640 1 -- 172.21.15.12:0/3726206801 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f407c042030 con 0x7f408c100a80 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.341+0000 7f40952ee740 1 Processor -- start 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.341+0000 7f40952ee740 1 -- start start 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40952ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f050cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40952ee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 0x562c6f05fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40952ee740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f0623b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40952ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562c6efb7090 con 0x562c6f0508d0 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40952ee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c6ef5ea70 con 0x562c6f0511f0 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40952ee740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562c6efb3050 con 0x562c6f05ffc0 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40914b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f050cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40914b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f050cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58404/0 (socket says 172.21.15.12:58404) 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40914b2640 1 -- 172.21.15.12:0/3484854101 learned_addr learned my addr 172.21.15.12:0/3484854101 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f4090cb1640 1 --2- 172.21.15.12:0/3484854101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 0x562c6f05fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f4089ffb640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f40740a32c0 0x7f40740a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f408bfff640 1 --2- 172.21.15.12:0/3484854101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f0623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40914b2640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f40740a32c0 0x7f40740a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40914b2640 1 -- 172.21.15.12:0/3484854101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 msgr2=0x562c6f0623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40914b2640 1 --2- 172.21.15.12:0/3484854101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f0623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40914b2640 1 -- 172.21.15.12:0/3484854101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 msgr2=0x562c6f05fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40914b2640 1 --2- 172.21.15.12:0/3484854101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 0x562c6f05fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f40914b2640 1 -- 172.21.15.12:0/3484854101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6ef6b130 con 0x562c6f0508d0 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.342+0000 7f4089ffb640 1 -- 172.21.15.12:0/3726206801 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f407c0f0100 con 0x7f408c100a80 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.343+0000 7f40914b2640 1 --2- 172.21.15.12:0/3484854101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f050cb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4084014a60 tx=0x7f4084014f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecf355b5036a393 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.343+0000 7f4072ffd640 1 -- 172.21.15.12:0/3484854101 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408401ec50 con 0x562c6f0508d0 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.343+0000 7f4072ffd640 1 -- 172.21.15.12:0/3484854101 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4084023070 con 0x562c6f0508d0 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.343+0000 7f4072ffd640 1 -- 172.21.15.12:0/3484854101 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408401de00 con 0x562c6f0508d0 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.343+0000 7f40952ee740 1 -- 172.21.15.12:0/3484854101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 msgr2=0x562c6f050cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.343+0000 7f40914b2640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f40740a32c0 0x7f40740a5780 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4084022000 tx=0x7f408401e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.343+0000 7f40952ee740 1 --2- 172.21.15.12:0/3484854101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f050cb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4084014a60 tx=0x7f4084014f20 comp rx=0 tx=0).stop 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.343+0000 7f40952ee740 1 -- 172.21.15.12:0/3484854101 shutdown_connections 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.343+0000 7f40952ee740 1 --2- 172.21.15.12:0/3484854101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f0623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 --2- 172.21.15.12:0/3484854101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 0x562c6f05fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 --2- 172.21.15.12:0/3484854101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f050cb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 -- 172.21.15.12:0/3484854101 >> 172.21.15.12:0/3484854101 conn(0x562c6f04cf60 msgr2=0x562c6f04d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 -- 172.21.15.12:0/3484854101 shutdown_connections 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 -- 172.21.15.12:0/3484854101 wait complete. 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 -- start start 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 Processor -- start 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f0508d0 0x562c6f05f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f05cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f05ffc0 0x562c6f05d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562c6f062bf0 con 0x562c6f0511f0 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c6ef71f20 con 0x562c6f05ffc0 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562c6f062d70 con 0x562c6f0508d0 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.344+0000 7f40952ee740 10 client.0 _ll_register_callbacks cb 0x562c6ef3b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f408bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f05cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f408bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f05cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58406/0 (socket says 172.21.15.12:58406) 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f408bfff640 1 -- 172.21.15.12:0/2647277499 learned_addr learned my addr 172.21.15.12:0/2647277499 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f40914b2640 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f05ffc0 0x562c6f05d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f4090cb1640 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f0508d0 0x562c6f05f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f408bfff640 1 -- 172.21.15.12:0/2647277499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f0508d0 msgr2=0x562c6f05f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f408bfff640 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f0508d0 0x562c6f05f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f408bfff640 1 -- 172.21.15.12:0/2647277499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f05ffc0 msgr2=0x562c6f05d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f408bfff640 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f05ffc0 0x562c6f05d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f408bfff640 1 -- 172.21.15.12:0/2647277499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c6ed282b0 con 0x562c6f0511f0 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f408bfff640 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f05cba0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f40800116c0 tx=0x7f4080011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c189db467d11cce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f406bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f406bfff640 1 -- 172.21.15.12:0/2647277499 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408001e060 con 0x562c6f0511f0 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f40952ee740 1 -- 172.21.15.12:0/2647277499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4084023070 con 0x562c6f0511f0 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f406bfff640 1 -- 172.21.15.12:0/2647277499 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f40800193f0 con 0x562c6f0511f0 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f406bfff640 1 -- 172.21.15.12:0/2647277499 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4080025050 con 0x562c6f0511f0 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f40952ee740 10 client.15504 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.345+0000 7f40952ee740 1 -- 172.21.15.12:0/2647277499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c6f06e5f0 con 0x562c6f0511f0 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.346+0000 7f406bfff640 1 -- 172.21.15.12:0/2647277499 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4084023070 con 0x562c6f0511f0 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.346+0000 7f406bfff640 1 -- 172.21.15.12:0/2647277499 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4080018030 con 0x562c6f0511f0 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.346+0000 7f40952ee740 10 client.15504 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.346+0000 7f40952ee740 10 client.15504 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.346+0000 7f40952ee740 20 client.15504 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.346+0000 7f40952ee740 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x562c6f070c40 0x562c6f0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.346+0000 7f40952ee740 4 client.15504 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.346+0000 7f40952ee740 1 -- 172.21.15.12:0/2647277499 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c6efc4600 con 0x562c6f070c40 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.346+0000 7f4090cb1640 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x562c6f070c40 0x562c6f0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f4090cb1640 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x562c6f070c40 0x562c6f0720b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=485ea225d855602b server_cookie=6b1f77681137446 in_seq=0 out_seq=0 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f406bfff640 10 client.15504 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f406bfff640 1 -- 172.21.15.12:0/2647277499 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c6efc4600 con 0x562c6f070c40 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f406bfff640 10 client.15504 handle_command_reply: tid=0 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f40952ee740 1 client.15504 shutdown 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f40952ee740 1 -- 172.21.15.12:0/2647277499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 msgr2=0x562c6f05cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f40952ee740 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f05cba0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f40800116c0 tx=0x7f4080011b80 comp rx=0 tx=0).stop 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f40952ee740 1 -- 172.21.15.12:0/2647277499 shutdown_connections 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f40952ee740 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x562c6f070c40 0x562c6f0720b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f40952ee740 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f05ffc0 0x562c6f05d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f40952ee740 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f05cba0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f40952ee740 1 --2- 172.21.15.12:0/2647277499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f0508d0 0x562c6f05f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.347+0000 7f40952ee740 1 -- 172.21.15.12:0/2647277499 >> 172.21.15.12:0/2647277499 conn(0x562c6f04cf60 msgr2=0x562c6f052cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.348+0000 7f406bfff640 0 client.15504 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.348+0000 7f40952ee740 1 -- 172.21.15.12:0/2647277499 shutdown_connections 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.348+0000 7f40952ee740 1 -- 172.21.15.12:0/2647277499 wait complete. 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.348+0000 7f40952ee740 20 client.15504 trim_cache size 0 max 16384 2024-09-16T01:01:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.365+0000 7f40952ee740 1 Processor -- start 2024-09-16T01:01:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.365+0000 7f40952ee740 1 -- start start 2024-09-16T01:01:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f40952ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f058130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f40952ee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 0x562c6f059e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f40952ee740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f05a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f40952ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562c6f0703f0 con 0x562c6f0508d0 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f40952ee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c6f070ac0 con 0x562c6f0511f0 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f40952ee740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562c6f071190 con 0x562c6f05ffc0 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f4090cb1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f058130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f4090cb1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f058130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58418/0 (socket says 172.21.15.12:58418) 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f4090cb1640 1 -- 172.21.15.12:0/509977811 learned_addr learned my addr 172.21.15.12:0/509977811 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f40914b2640 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f05a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f408bfff640 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 0x562c6f059e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f4090cb1640 1 -- 172.21.15.12:0/509977811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 msgr2=0x562c6f05a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f4090cb1640 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f05a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f4090cb1640 1 -- 172.21.15.12:0/509977811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 msgr2=0x562c6f059e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f4090cb1640 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 0x562c6f059e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f4090cb1640 1 -- 172.21.15.12:0/509977811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6f05d960 con 0x562c6f0508d0 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f408bfff640 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 0x562c6f059e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f40914b2640 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f05a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f4090cb1640 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f058130 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f407c009a50 tx=0x7f407c0ed770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec9e57416c806f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.366+0000 7f40727fc640 1 -- 172.21.15.12:0/509977811 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c049040 con 0x562c6f0508d0 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40727fc640 1 -- 172.21.15.12:0/509977811 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f407c0c0770 con 0x562c6f0508d0 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40727fc640 1 -- 172.21.15.12:0/509977811 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c003c80 con 0x562c6f0508d0 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40952ee740 1 -- 172.21.15.12:0/509977811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 msgr2=0x562c6f058130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40952ee740 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f058130 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f407c009a50 tx=0x7f407c0ed770 comp rx=0 tx=0).stop 2024-09-16T01:01:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40952ee740 1 -- 172.21.15.12:0/509977811 shutdown_connections 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40952ee740 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f05a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40952ee740 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0511f0 0x562c6f059e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40952ee740 1 --2- 172.21.15.12:0/509977811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0508d0 0x562c6f058130 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40952ee740 1 -- 172.21.15.12:0/509977811 >> 172.21.15.12:0/509977811 conn(0x562c6f04cf60 msgr2=0x562c6f057a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40952ee740 1 -- 172.21.15.12:0/509977811 shutdown_connections 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40952ee740 1 -- 172.21.15.12:0/509977811 wait complete. 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.367+0000 7f40952ee740 1 -- start start 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f40952ee740 1 Processor -- start 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f40952ee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0508d0 0x562c6f0732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f40952ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f0737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f40952ee740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f073d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f40952ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562c6f071f30 con 0x562c6f0511f0 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f40952ee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c6f071860 con 0x562c6f0508d0 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f40952ee740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562c6f072600 con 0x562c6f05ffc0 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f40952ee740 10 client.0 _ll_register_callbacks cb 0x7f408000c690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f408bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f0737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f408bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f0737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58424/0 (socket says 172.21.15.12:58424) 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f408bfff640 1 -- 172.21.15.12:0/4040091529 learned_addr learned my addr 172.21.15.12:0/4040091529 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f4090cb1640 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0508d0 0x562c6f0732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f40914b2640 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f073d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f408bfff640 1 -- 172.21.15.12:0/4040091529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 msgr2=0x562c6f073d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f408bfff640 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f073d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f408bfff640 1 -- 172.21.15.12:0/4040091529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0508d0 msgr2=0x562c6f0732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f408bfff640 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0508d0 0x562c6f0732b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.368+0000 7f408bfff640 1 -- 172.21.15.12:0/4040091529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c6f0d9340 con 0x562c6f0511f0 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f408bfff640 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f0737f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f408000c530 tx=0x7f408000a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2897233712b5ffd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f406bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f406bfff640 1 -- 172.21.15.12:0/4040091529 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408001e030 con 0x562c6f0511f0 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f406bfff640 1 -- 172.21.15.12:0/4040091529 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f408000ac30 con 0x562c6f0511f0 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f40952ee740 1 -- 172.21.15.12:0/4040091529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f407c0c0770 con 0x562c6f0511f0 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f406bfff640 1 -- 172.21.15.12:0/4040091529 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4080034050 con 0x562c6f0511f0 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f40952ee740 10 client.15510 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f40952ee740 1 -- 172.21.15.12:0/4040091529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c6f0da550 con 0x562c6f0511f0 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f406bfff640 1 -- 172.21.15.12:0/4040091529 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f407c0c0770 con 0x562c6f0511f0 2024-09-16T01:01:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f406bfff640 1 -- 172.21.15.12:0/4040091529 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4080018050 con 0x562c6f0511f0 2024-09-16T01:01:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f40952ee740 10 client.15510 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f40952ee740 10 client.15510 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-16T01:01:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f40952ee740 20 client.15510 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.369+0000 7f40952ee740 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x562c6f0df070 0x562c6f0ddd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.370+0000 7f40952ee740 4 client.15510 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:01:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.370+0000 7f40952ee740 1 -- 172.21.15.12:0/4040091529 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "status"}) -- 0x562c6efbeb10 con 0x562c6f0df070 2024-09-16T01:01:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.370+0000 7f4090cb1640 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x562c6f0df070 0x562c6f0ddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.370+0000 7f4090cb1640 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x562c6f0df070 0x562c6f0ddd80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b2314424381f2406 server_cookie=ca3eccec19076029 in_seq=0 out_seq=0 2024-09-16T01:01:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.370+0000 7f406bfff640 10 client.15510 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:01:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.370+0000 7f406bfff640 1 -- 172.21.15.12:0/4040091529 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562c6efbeb10 con 0x562c6f0df070 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.370+0000 7f406bfff640 10 client.15510 handle_command_reply: tid=0 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.370+0000 7f40952ee740 1 client.15510 shutdown 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 1 -- 172.21.15.12:0/4040091529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 msgr2=0x562c6f0737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f0737f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f408000c530 tx=0x7f408000a910 comp rx=0 tx=0).stop 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 1 -- 172.21.15.12:0/4040091529 shutdown_connections 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x562c6f0df070 0x562c6f0ddd80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562c6f05ffc0 0x562c6f073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c6f0511f0 0x562c6f0737f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f406bfff640 0 client.15510 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 1 --2- 172.21.15.12:0/4040091529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c6f0508d0 0x562c6f0732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 1 -- 172.21.15.12:0/4040091529 >> 172.21.15.12:0/4040091529 conn(0x562c6f04cf60 msgr2=0x562c6f058240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 1 -- 172.21.15.12:0/4040091529 shutdown_connections 2024-09-16T01:01:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 1 -- 172.21.15.12:0/4040091529 wait complete. 2024-09-16T01:01:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f40952ee740 20 client.15510 trim_cache size 0 max 16384 2024-09-16T01:01:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:01:33.379 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:01:33.379 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 1, 2024-09-16T01:01:33.379 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24482, 2024-09-16T01:01:33.379 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:01:33.379 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:01:33.379 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:01:33.380 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 134.629426505, 2024-09-16T01:01:33.380 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 29, 2024-09-16T01:01:33.380 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-09-16T01:01:33.380 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 89, 2024-09-16T01:01:33.380 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 198.16422864800001 2024-09-16T01:01:33.380 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:01:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f4092f15640 1 -- 172.21.15.12:0/3726206801 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f40740a32c0 msgr2=0x7f40740a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f4092f15640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f40740a32c0 0x7f40740a5780 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4084022000 tx=0x7f408401e000 comp rx=0 tx=0).stop 2024-09-16T01:01:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f4092f15640 1 -- 172.21.15.12:0/3726206801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f408c100a80 msgr2=0x7f408c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.371+0000 7f4092f15640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f408c100a80 0x7f408c1983e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f407c009230 tx=0x7f407c004270 comp rx=0 tx=0).stop 2024-09-16T01:01:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.372+0000 7f4092f15640 1 -- 172.21.15.12:0/3726206801 shutdown_connections 2024-09-16T01:01:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.372+0000 7f4092f15640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f40740a32c0 0x7f40740a5780 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.372+0000 7f4092f15640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c106a80 0x7f408c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.372+0000 7f4092f15640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f408c101420 0x7f408c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.372+0000 7f4092f15640 1 --2- 172.21.15.12:0/3726206801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f408c100a80 0x7f408c1983e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.372+0000 7f4092f15640 1 -- 172.21.15.12:0/3726206801 >> 172.21.15.12:0/3726206801 conn(0x7f408c0fc7a0 msgr2=0x7f408c06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:33.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.372+0000 7f4092f15640 1 -- 172.21.15.12:0/3726206801 shutdown_connections 2024-09-16T01:01:33.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:33.372+0000 7f4092f15640 1 -- 172.21.15.12:0/3726206801 wait complete. 2024-09-16T01:01:34.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-16T01:01:34.313 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.808+0000 7fd534994640 1 -- 172.21.15.12:0/157640219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd530106f10 msgr2=0x7fd53010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.808+0000 7fd534994640 1 --2- 172.21.15.12:0/157640219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd530106f10 0x7fd53010ea90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd528009ca0 tx=0x7fd52802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.808+0000 7fd534994640 1 -- 172.21.15.12:0/157640219 shutdown_connections 2024-09-16T01:01:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.808+0000 7fd534994640 1 --2- 172.21.15.12:0/157640219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd530106f10 0x7fd53010ea90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.808+0000 7fd534994640 1 --2- 172.21.15.12:0/157640219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd530102790 0x7fd5301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.808+0000 7fd534994640 1 --2- 172.21.15.12:0/157640219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530101de0 0x7fd5301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.808+0000 7fd534994640 1 -- 172.21.15.12:0/157640219 >> 172.21.15.12:0/157640219 conn(0x7fd5300fd8c0 msgr2=0x7fd5300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:34.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.808+0000 7fd534994640 1 -- 172.21.15.12:0/157640219 shutdown_connections 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.808+0000 7fd534994640 1 -- 172.21.15.12:0/157640219 wait complete. 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd534994640 1 Processor -- start 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd534994640 1 -- start start 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd534994640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd530101de0 0x7fd530198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd534994640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd530102790 0x7fd530198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd534994640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530106f10 0x7fd53019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd534994640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd530111f90 con 0x7fd530102790 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd534994640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd530111e10 con 0x7fd530106f10 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd534994640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd530112110 con 0x7fd530101de0 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd527fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd530102790 0x7fd530198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd527fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd530102790 0x7fd530198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58454/0 (socket says 172.21.15.12:58454) 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd527fff640 1 -- 172.21.15.12:0/1530694728 learned_addr learned my addr 172.21.15.12:0/1530694728 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd52e59c640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd530101de0 0x7fd530198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.809+0000 7fd52ed9d640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530106f10 0x7fd53019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd527fff640 1 -- 172.21.15.12:0/1530694728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd530101de0 msgr2=0x7fd530198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd527fff640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd530101de0 0x7fd530198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd527fff640 1 -- 172.21.15.12:0/1530694728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530106f10 msgr2=0x7fd53019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd527fff640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530106f10 0x7fd53019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd527fff640 1 -- 172.21.15.12:0/1530694728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53019d400 con 0x7fd530102790 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd527fff640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd530102790 0x7fd530198990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd51800b4a0 tx=0x7fd51800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd5277fe640 1 -- 172.21.15.12:0/1530694728 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518014070 con 0x7fd530102790 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd5277fe640 1 -- 172.21.15.12:0/1530694728 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd518010af0 con 0x7fd530102790 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd534994640 1 -- 172.21.15.12:0/1530694728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53019d6f0 con 0x7fd530102790 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd5277fe640 1 -- 172.21.15.12:0/1530694728 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518017d10 con 0x7fd530102790 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.810+0000 7fd534994640 1 -- 172.21.15.12:0/1530694728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5301a4fd0 con 0x7fd530102790 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.813+0000 7fd5277fe640 1 -- 172.21.15.12:0/1530694728 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd518017070 con 0x7fd530102790 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.813+0000 7fd536d6d740 1 Processor -- start 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.813+0000 7fd536d6d740 1 -- start start 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.813+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b82084c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.813+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b82093a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.813+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b820963b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.813+0000 7fd536d6d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560b81feb090 con 0x560b820848b0 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.813+0000 7fd536d6d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560b81f92a70 con 0x560b82093fc0 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.813+0000 7fd536d6d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560b81fe7050 con 0x560b820851d0 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b82084c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd5277fe640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd51c0a3240 0x7fd51c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b82084c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58470/0 (socket says 172.21.15.12:58470) 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52ed9d640 1 -- 172.21.15.12:0/3513672375 learned_addr learned my addr 172.21.15.12:0/3513672375 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52e59c640 1 --2- 172.21.15.12:0/3513672375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b82093a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd527fff640 1 --2- 172.21.15.12:0/3513672375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b820963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52ed9d640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd51c0a3240 0x7fd51c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd5277fe640 1 -- 172.21.15.12:0/1530694728 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fd5180cef90 con 0x7fd530102790 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52e59c640 1 -- 172.21.15.12:0/3513672375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 msgr2=0x560b820963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52e59c640 1 --2- 172.21.15.12:0/3513672375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b820963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52e59c640 1 -- 172.21.15.12:0/3513672375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 msgr2=0x560b82084c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52e59c640 1 --2- 172.21.15.12:0/3513672375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b82084c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52e59c640 1 -- 172.21.15.12:0/3513672375 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b81f9f130 con 0x560b820851d0 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52ed9d640 1 --2- 172.21.15.12:0/3513672375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b82084c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52e59c640 1 --2- 172.21.15.12:0/3513672375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b82093a80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd52000ab40 tx=0x7fd52000f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=330601aa5297726c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.814+0000 7fd52ed9d640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd51c0a3240 0x7fd51c0a5700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd528031f80 tx=0x7fd52802a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd524ff9640 1 -- 172.21.15.12:0/3513672375 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520004020 con 0x560b820851d0 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd524ff9640 1 -- 172.21.15.12:0/3513672375 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5200041c0 con 0x560b820851d0 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd524ff9640 1 -- 172.21.15.12:0/3513672375 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5200187c0 con 0x560b820851d0 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd536d6d740 1 -- 172.21.15.12:0/3513672375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 msgr2=0x560b82093a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd536d6d740 1 --2- 172.21.15.12:0/3513672375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b82093a80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd52000ab40 tx=0x7fd52000f3c0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd536d6d740 1 -- 172.21.15.12:0/3513672375 shutdown_connections 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd536d6d740 1 --2- 172.21.15.12:0/3513672375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b820963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd536d6d740 1 --2- 172.21.15.12:0/3513672375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b82093a80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd536d6d740 1 --2- 172.21.15.12:0/3513672375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b82084c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd536d6d740 1 -- 172.21.15.12:0/3513672375 >> 172.21.15.12:0/3513672375 conn(0x560b82080f60 msgr2=0x560b82081340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd536d6d740 1 -- 172.21.15.12:0/3513672375 shutdown_connections 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.815+0000 7fd536d6d740 1 -- 172.21.15.12:0/3513672375 wait complete. 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd536d6d740 1 -- start start 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd536d6d740 1 Processor -- start 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820848b0 0x560b82093810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820851d0 0x560b82090b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b820910a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd536d6d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560b82096b90 con 0x560b820851d0 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd536d6d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560b81fa5f20 con 0x560b82093fc0 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd536d6d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560b82096d10 con 0x560b820848b0 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd536d6d740 10 client.0 _ll_register_callbacks cb 0x560b81f6f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd527fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820851d0 0x560b82090b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd52e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820848b0 0x560b82093810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd52e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820848b0 0x560b82093810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:43376/0 (socket says 172.21.15.12:43376) 2024-09-16T01:01:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd52e59c640 1 -- 172.21.15.12:0/3025153598 learned_addr learned my addr 172.21.15.12:0/3025153598 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd527fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820851d0 0x560b82090b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58472/0 (socket says 172.21.15.12:58472) 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.816+0000 7fd52ed9d640 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b820910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd527fff640 1 -- 172.21.15.12:0/3025153598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820848b0 msgr2=0x560b82093810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd527fff640 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820848b0 0x560b82093810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd527fff640 1 -- 172.21.15.12:0/3025153598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 msgr2=0x560b820910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd527fff640 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b820910a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd527fff640 1 -- 172.21.15.12:0/3025153598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b81d5c2b0 con 0x560b820851d0 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd52e59c640 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820848b0 0x560b82093810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd52ed9d640 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b820910a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd527fff640 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820851d0 0x560b82090b60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x560b82082050 tx=0x7fd51806a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46cca4272f5d8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd515ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd515ffb640 1 -- 172.21.15.12:0/3025153598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51801e070 con 0x560b820851d0 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd515ffb640 1 -- 172.21.15.12:0/3025153598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fd518097970 con 0x560b820851d0 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd536d6d740 1 -- 172.21.15.12:0/3025153598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5200041c0 con 0x560b820851d0 2024-09-16T01:01:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd515ffb640 1 -- 172.21.15.12:0/3025153598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd51809b300 con 0x560b820851d0 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd536d6d740 10 client.15522 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd536d6d740 1 -- 172.21.15.12:0/3025153598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560b820a2500 con 0x560b820851d0 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd515ffb640 1 -- 172.21.15.12:0/3025153598 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5200041c0 con 0x560b820851d0 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd515ffb640 1 -- 172.21.15.12:0/3025153598 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd5180d10d0 con 0x560b820851d0 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.817+0000 7fd536d6d740 10 client.15522 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.818+0000 7fd536d6d740 10 client.15522 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.818+0000 7fd536d6d740 20 client.15522 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.818+0000 7fd536d6d740 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x560b820a4ab0 0x560b820a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.818+0000 7fd536d6d740 4 client.15522 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.818+0000 7fd536d6d740 1 -- 172.21.15.12:0/3025153598 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b81ff8600 con 0x560b820a4ab0 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.818+0000 7fd52e59c640 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x560b820a4ab0 0x560b820a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.818+0000 7fd515ffb640 10 client.15522 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.818+0000 7fd52e59c640 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x560b820a4ab0 0x560b820a5f20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d14e64d11e437e99 server_cookie=a9c2579685021053 in_seq=0 out_seq=0 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd515ffb640 1 -- 172.21.15.12:0/3025153598 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560b81ff8600 con 0x560b820a4ab0 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd515ffb640 10 client.15522 handle_command_reply: tid=0 2024-09-16T01:01:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 client.15522 shutdown 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 -- 172.21.15.12:0/3025153598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820851d0 msgr2=0x560b82090b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820851d0 0x560b82090b60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x560b82082050 tx=0x7fd51806a040 comp rx=0 tx=0).stop 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 -- 172.21.15.12:0/3025153598 shutdown_connections 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x560b820a4ab0 0x560b820a5f20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b820910a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820851d0 0x560b82090b60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 --2- 172.21.15.12:0/3025153598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820848b0 0x560b82093810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 -- 172.21.15.12:0/3025153598 >> 172.21.15.12:0/3025153598 conn(0x560b82080f60 msgr2=0x560b82086cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd515ffb640 0 client.15522 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 -- 172.21.15.12:0/3025153598 shutdown_connections 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 1 -- 172.21.15.12:0/3025153598 wait complete. 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.819+0000 7fd536d6d740 20 client.15522 trim_cache size 0 max 16384 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.837+0000 7fd536d6d740 1 Processor -- start 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.837+0000 7fd536d6d740 1 -- start start 2024-09-16T01:01:34.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b820848b0 0x560b8209ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b8208f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b82093fc0 0x560b8208f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd536d6d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560b820a4260 con 0x560b82093fc0 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd536d6d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560b820a4930 con 0x560b820848b0 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd536d6d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560b820a5000 con 0x560b820851d0 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd52ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b82093fc0 0x560b8208f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd52ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b82093fc0 0x560b8208f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58478/0 (socket says 172.21.15.12:58478) 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd52ed9d640 1 -- 172.21.15.12:0/1802679513 learned_addr learned my addr 172.21.15.12:0/1802679513 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd52e59c640 1 --2- 172.21.15.12:0/1802679513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b820848b0 0x560b8209ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd527fff640 1 --2- 172.21.15.12:0/1802679513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b8208f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd52ed9d640 1 -- 172.21.15.12:0/1802679513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 msgr2=0x560b8208f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd52ed9d640 1 --2- 172.21.15.12:0/1802679513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b8208f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd52ed9d640 1 -- 172.21.15.12:0/1802679513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b820848b0 msgr2=0x560b8209ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:34.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd52ed9d640 1 --2- 172.21.15.12:0/1802679513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b820848b0 0x560b8209ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd52ed9d640 1 -- 172.21.15.12:0/1802679513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b82093b40 con 0x560b82093fc0 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd527fff640 1 --2- 172.21.15.12:0/1802679513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b8208f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd52ed9d640 1 --2- 172.21.15.12:0/1802679513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b82093fc0 0x560b8208f970 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd528035000 tx=0x7fd5280093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea83587a80420599 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd517fff640 1 -- 172.21.15.12:0/1802679513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd528050070 con 0x560b82093fc0 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd517fff640 1 -- 172.21.15.12:0/1802679513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd528036040 con 0x560b82093fc0 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.838+0000 7fd517fff640 1 -- 172.21.15.12:0/1802679513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd528030820 con 0x560b82093fc0 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.839+0000 7fd536d6d740 1 -- 172.21.15.12:0/1802679513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b82093fc0 msgr2=0x560b8208f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.839+0000 7fd536d6d740 1 --2- 172.21.15.12:0/1802679513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b82093fc0 0x560b8208f970 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd528035000 tx=0x7fd5280093f0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.839+0000 7fd536d6d740 1 -- 172.21.15.12:0/1802679513 shutdown_connections 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.839+0000 7fd536d6d740 1 --2- 172.21.15.12:0/1802679513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b82093fc0 0x560b8208f970 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.839+0000 7fd536d6d740 1 --2- 172.21.15.12:0/1802679513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b8208f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.839+0000 7fd536d6d740 1 --2- 172.21.15.12:0/1802679513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b820848b0 0x560b8209ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.839+0000 7fd536d6d740 1 -- 172.21.15.12:0/1802679513 >> 172.21.15.12:0/1802679513 conn(0x560b82080f60 msgr2=0x560b8207bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.839+0000 7fd536d6d740 1 -- 172.21.15.12:0/1802679513 shutdown_connections 2024-09-16T01:01:34.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.839+0000 7fd536d6d740 1 -- 172.21.15.12:0/1802679513 wait complete. 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.839+0000 7fd536d6d740 1 -- start start 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd536d6d740 1 Processor -- start 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b820a7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b820a7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd536d6d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b8210d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd536d6d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560b820a5da0 con 0x560b820848b0 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd536d6d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560b820a56d0 con 0x560b82093fc0 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd536d6d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560b820a6470 con 0x560b820851d0 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd536d6d740 10 client.0 _ll_register_callbacks cb 0x7fd518009330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd52e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b820a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd52e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b820a7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58484/0 (socket says 172.21.15.12:58484) 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd52e59c640 1 -- 172.21.15.12:0/1457491507 learned_addr learned my addr 172.21.15.12:0/1457491507 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd527fff640 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b820a7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd52e59c640 1 -- 172.21.15.12:0/1457491507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 msgr2=0x560b820a7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:34.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd52e59c640 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b820a7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd52ed9d640 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b8210d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd52e59c640 1 -- 172.21.15.12:0/1457491507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 msgr2=0x560b8210d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd52e59c640 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b8210d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd52e59c640 1 -- 172.21.15.12:0/1457491507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b8210d6f0 con 0x560b820848b0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd52e59c640 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b820a7500 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd52000ab40 tx=0x7fd52000a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555801dbb4657bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.840+0000 7fd515ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd515ffb640 1 -- 172.21.15.12:0/1457491507 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520004300 con 0x560b820848b0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd515ffb640 1 -- 172.21.15.12:0/1457491507 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fd520003900 con 0x560b820848b0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd536d6d740 1 -- 172.21.15.12:0/1457491507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd528036040 con 0x560b820848b0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd515ffb640 1 -- 172.21.15.12:0/1457491507 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd520039050 con 0x560b820848b0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd536d6d740 10 client.15528 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd536d6d740 1 -- 172.21.15.12:0/1457491507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560b8210e8b0 con 0x560b820848b0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd515ffb640 1 -- 172.21.15.12:0/1457491507 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd528036040 con 0x560b820848b0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd515ffb640 1 -- 172.21.15.12:0/1457491507 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd520004680 con 0x560b820848b0 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd536d6d740 10 client.15528 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:34.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd536d6d740 10 client.15528 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd536d6d740 20 client.15528 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd536d6d740 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x560b82113130 0x560b82111e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd536d6d740 4 client.15528 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.841+0000 7fd536d6d740 1 -- 172.21.15.12:0/1457491507 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "status"}) -- 0x560b81ff2b10 con 0x560b82113130 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd527fff640 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x560b82113130 0x560b82111e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd527fff640 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x560b82113130 0x560b82111e40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a22d6b811f26c9d5 server_cookie=484eeabf48f0e8fa in_seq=0 out_seq=0 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd515ffb640 10 client.15528 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd515ffb640 1 -- 172.21.15.12:0/1457491507 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560b81ff2b10 con 0x560b82113130 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd515ffb640 10 client.15528 handle_command_reply: tid=0 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 client.15528 shutdown 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 -- 172.21.15.12:0/1457491507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 msgr2=0x560b820a7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b820a7500 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd52000ab40 tx=0x7fd52000a470 comp rx=0 tx=0).stop 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 -- 172.21.15.12:0/1457491507 shutdown_connections 2024-09-16T01:01:34.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x560b82113130 0x560b82111e40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9a476aac-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24518, 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 177.27250632900001, 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 29, 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 89, 2024-09-16T01:01:34.865 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 188.44305966799999 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b82093fc0 0x560b8210d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd515ffb640 0 client.15528 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560b820851d0 0x560b820a7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 --2- 172.21.15.12:0/1457491507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b820848b0 0x560b820a7500 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 -- 172.21.15.12:0/1457491507 >> 172.21.15.12:0/1457491507 conn(0x560b82080f60 msgr2=0x560b8208f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 -- 172.21.15.12:0/1457491507 shutdown_connections 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.842+0000 7fd536d6d740 1 -- 172.21.15.12:0/1457491507 wait complete. 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd536d6d740 20 client.15528 trim_cache size 0 max 16384 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 -- 172.21.15.12:0/1530694728 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd51c0a3240 msgr2=0x7fd51c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd51c0a3240 0x7fd51c0a5700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd528031f80 tx=0x7fd52802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 -- 172.21.15.12:0/1530694728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd530102790 msgr2=0x7fd530198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:34.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd530102790 0x7fd530198990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd51800b4a0 tx=0x7fd51800b960 comp rx=0 tx=0).stop 2024-09-16T01:01:34.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 -- 172.21.15.12:0/1530694728 shutdown_connections 2024-09-16T01:01:34.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd51c0a3240 0x7fd51c0a5700 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530106f10 0x7fd53019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd530102790 0x7fd530198990 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 --2- 172.21.15.12:0/1530694728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd530101de0 0x7fd530198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:34.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 -- 172.21.15.12:0/1530694728 >> 172.21.15.12:0/1530694728 conn(0x7fd5300fd8c0 msgr2=0x7fd5300fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:34.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 -- 172.21.15.12:0/1530694728 shutdown_connections 2024-09-16T01:01:34.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:34.843+0000 7fd534994640 1 -- 172.21.15.12:0/1530694728 wait complete. 2024-09-16T01:01:35.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:34 smithi119 ceph-mon[35049]: pgmap v374: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:01:35.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:34 smithi012 ceph-mon[31197]: pgmap v374: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:01:35.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:34 smithi098 ceph-mon[35346]: pgmap v374: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:01:35.665 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-16T01:01:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:36 smithi119 ceph-mon[35049]: pgmap v375: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:01:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:36 smithi012 ceph-mon[31197]: pgmap v375: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:01:37.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:36 smithi098 ceph-mon[35346]: pgmap v375: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:01:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:38 smithi119 ceph-mon[35049]: pgmap v376: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-16T01:01:39.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:38 smithi012 ceph-mon[31197]: pgmap v376: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-16T01:01:39.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:38 smithi098 ceph-mon[35346]: pgmap v376: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-16T01:01:40.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:39 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:01:40.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:39 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:01:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:39 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:01:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:40 smithi012 ceph-mon[31197]: pgmap v377: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:01:41.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:01:41.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:01:41.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:01:41.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:01:41.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:40 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:01:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:40 smithi098 ceph-mon[35346]: pgmap v377: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:01:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:01:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:01:41.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:01:41.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:01:41.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:40 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:01:41.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:40 smithi119 ceph-mon[35049]: pgmap v377: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:01:41.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:01:41.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:01:41.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:01:41.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:01:41.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:40 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:01:43.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:42 smithi012 ceph-mon[31197]: pgmap v378: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-16T01:01:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:42 smithi098 ceph-mon[35346]: pgmap v378: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-16T01:01:43.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:42 smithi119 ceph-mon[35049]: pgmap v378: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-16T01:01:45.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:44 smithi012 ceph-mon[31197]: pgmap v379: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-16T01:01:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:44 smithi098 ceph-mon[35346]: pgmap v379: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-16T01:01:45.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:44 smithi119 ceph-mon[35049]: pgmap v379: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-16T01:01:46.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:01:46.664 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:47.054 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:46 smithi012 ceph-mon[31197]: pgmap v380: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:01:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:46 smithi098 ceph-mon[35346]: pgmap v380: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:01:47.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.295+0000 7efd608ce640 1 -- 172.21.15.12:0/2665835056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c102780 msgr2=0x7efd5c1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.295+0000 7efd608ce640 1 --2- 172.21.15.12:0/2665835056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c102780 0x7efd5c1067d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efd44009900 tx=0x7efd4402a410 comp rx=0 tx=0).stop 2024-09-16T01:01:47.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.295+0000 7efd608ce640 1 -- 172.21.15.12:0/2665835056 shutdown_connections 2024-09-16T01:01:47.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.295+0000 7efd608ce640 1 --2- 172.21.15.12:0/2665835056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd5c106f00 0x7efd5c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.295+0000 7efd608ce640 1 --2- 172.21.15.12:0/2665835056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c102780 0x7efd5c1067d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.295+0000 7efd608ce640 1 --2- 172.21.15.12:0/2665835056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c101dd0 0x7efd5c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.295+0000 7efd608ce640 1 -- 172.21.15.12:0/2665835056 >> 172.21.15.12:0/2665835056 conn(0x7efd5c0fd890 msgr2=0x7efd5c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.295+0000 7efd608ce640 1 -- 172.21.15.12:0/2665835056 shutdown_connections 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.295+0000 7efd608ce640 1 -- 172.21.15.12:0/2665835056 wait complete. 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd608ce640 1 Processor -- start 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd608ce640 1 -- start start 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd608ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c101dd0 0x7efd5c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd608ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd5c102780 0x7efd5c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd608ce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c106f00 0x7efd5c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd608ce640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c111f60 con 0x7efd5c101dd0 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd608ce640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c111de0 con 0x7efd5c106f00 2024-09-16T01:01:47.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd608ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1120e0 con 0x7efd5c102780 2024-09-16T01:01:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd5a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c101dd0 0x7efd5c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd5a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c101dd0 0x7efd5c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52092/0 (socket says 172.21.15.12:52092) 2024-09-16T01:01:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.296+0000 7efd5a59c640 1 -- 172.21.15.12:0/302534238 learned_addr learned my addr 172.21.15.12:0/302534238 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd5ad9d640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c106f00 0x7efd5c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd53fff640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd5c102780 0x7efd5c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd5a59c640 1 -- 172.21.15.12:0/302534238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd5c102780 msgr2=0x7efd5c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd5a59c640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd5c102780 0x7efd5c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd5a59c640 1 -- 172.21.15.12:0/302534238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c106f00 msgr2=0x7efd5c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd5a59c640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c106f00 0x7efd5c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd5a59c640 1 -- 172.21.15.12:0/302534238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c19d410 con 0x7efd5c101dd0 2024-09-16T01:01:47.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd53fff640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd5c102780 0x7efd5c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:47.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd5a59c640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c101dd0 0x7efd5c198460 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00d950 tx=0x7efd4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:47.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd537fe640 1 -- 172.21.15.12:0/302534238 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c017070 con 0x7efd5c101dd0 2024-09-16T01:01:47.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd537fe640 1 -- 172.21.15.12:0/302534238 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd4c009c30 con 0x7efd5c101dd0 2024-09-16T01:01:47.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd608ce640 1 -- 172.21.15.12:0/302534238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c19d700 con 0x7efd5c101dd0 2024-09-16T01:01:47.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd537fe640 1 -- 172.21.15.12:0/302534238 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c00f6b0 con 0x7efd5c101dd0 2024-09-16T01:01:47.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.297+0000 7efd608ce640 1 -- 172.21.15.12:0/302534238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c1a4fe0 con 0x7efd5c101dd0 2024-09-16T01:01:47.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.300+0000 7efd537fe640 1 -- 172.21.15.12:0/302534238 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efd4c0109d0 con 0x7efd5c101dd0 2024-09-16T01:01:47.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.300+0000 7efd62ca7740 1 Processor -- start 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.300+0000 7efd62ca7740 1 -- start start 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73380 0x55d192e73760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73ca0 0x55d192e82550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e82a90 0x55d192e84e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd62ca7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d192dd92e0 con 0x55d192e73380 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd62ca7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d192d80ce0 con 0x55d192e82a90 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd62ca7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d192dd52a0 con 0x55d192e73ca0 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73380 0x55d192e73760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73380 0x55d192e73760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52108/0 (socket says 172.21.15.12:52108) 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5ad9d640 1 -- 172.21.15.12:0/1272161970 learned_addr learned my addr 172.21.15.12:0/1272161970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd53fff640 1 --2- 172.21.15.12:0/1272161970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e82a90 0x55d192e84e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd537fe640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd480a3240 0x7efd480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5a59c640 1 --2- 172.21.15.12:0/1272161970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73ca0 0x55d192e82550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5ad9d640 1 -- 172.21.15.12:0/1272161970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73ca0 msgr2=0x55d192e82550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5ad9d640 1 --2- 172.21.15.12:0/1272161970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73ca0 0x55d192e82550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd537fe640 1 -- 172.21.15.12:0/302534238 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7efd4c0cfd20 con 0x7efd5c101dd0 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5ad9d640 1 -- 172.21.15.12:0/1272161970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e82a90 msgr2=0x55d192e84e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5ad9d640 1 --2- 172.21.15.12:0/1272161970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e82a90 0x55d192e84e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5ad9d640 1 -- 172.21.15.12:0/1272161970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d192d65440 con 0x55d192e73380 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5a59c640 1 --2- 172.21.15.12:0/1272161970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73ca0 0x55d192e82550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.301+0000 7efd5ad9d640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd480a3240 0x7efd480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.302+0000 7efd5ad9d640 1 --2- 172.21.15.12:0/1272161970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73380 0x55d192e73760 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efd54008ec0 tx=0x7efd5400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8121b3bd964aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.302+0000 7efd50ff9640 1 -- 172.21.15.12:0/1272161970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54022070 con 0x55d192e73380 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.302+0000 7efd50ff9640 1 -- 172.21.15.12:0/1272161970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd5401c470 con 0x55d192e73380 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd62ca7740 1 -- 172.21.15.12:0/1272161970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73380 msgr2=0x55d192e73760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd5ad9d640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd480a3240 0x7efd480a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd5401f000 tx=0x7efd54020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd62ca7740 1 --2- 172.21.15.12:0/1272161970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73380 0x55d192e73760 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efd54008ec0 tx=0x7efd5400e720 comp rx=0 tx=0).stop 2024-09-16T01:01:47.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd62ca7740 1 -- 172.21.15.12:0/1272161970 shutdown_connections 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd62ca7740 1 --2- 172.21.15.12:0/1272161970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e82a90 0x55d192e84e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd62ca7740 1 --2- 172.21.15.12:0/1272161970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73ca0 0x55d192e82550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd62ca7740 1 --2- 172.21.15.12:0/1272161970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73380 0x55d192e73760 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd62ca7740 1 -- 172.21.15.12:0/1272161970 >> 172.21.15.12:0/1272161970 conn(0x55d192e6fa30 msgr2=0x55d192e6fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd62ca7740 1 -- 172.21.15.12:0/1272161970 shutdown_connections 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd62ca7740 1 -- 172.21.15.12:0/1272161970 wait complete. 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.303+0000 7efd62ca7740 1 -- start start 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd62ca7740 1 Processor -- start 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73380 0x55d192e81f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e82440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e82a90 0x55d192e7b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd62ca7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d192e856b0 con 0x55d192e73ca0 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd62ca7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d192d94050 con 0x55d192e82a90 2024-09-16T01:01:47.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd62ca7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d192e85830 con 0x55d192e73380 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd62ca7740 10 client.0 _ll_register_callbacks cb 0x55d192dd4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd53fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e82440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd53fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e82440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52118/0 (socket says 172.21.15.12:52118) 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd53fff640 1 -- 172.21.15.12:0/3109753010 learned_addr learned my addr 172.21.15.12:0/3109753010 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.304+0000 7efd5a59c640 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73380 0x55d192e81f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd5ad9d640 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e82a90 0x55d192e7b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd53fff640 1 -- 172.21.15.12:0/3109753010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73380 msgr2=0x55d192e81f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd53fff640 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73380 0x55d192e81f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd53fff640 1 -- 172.21.15.12:0/3109753010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e82a90 msgr2=0x55d192e7b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd53fff640 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e82a90 0x55d192e7b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd53fff640 1 -- 172.21.15.12:0/3109753010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d192b4a3c0 con 0x55d192e73ca0 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd53fff640 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e82440 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efd44009230 tx=0x7efd440317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e116f6bfd0eb0ae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd41ffb640 1 -- 172.21.15.12:0/3109753010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44040070 con 0x55d192e73ca0 2024-09-16T01:01:47.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd41ffb640 1 -- 172.21.15.12:0/3109753010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7efd44004250 con 0x55d192e73ca0 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd62ca7740 1 -- 172.21.15.12:0/3109753010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd5401c470 con 0x55d192e73ca0 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd41ffb640 1 -- 172.21.15.12:0/3109753010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd44035040 con 0x55d192e73ca0 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd62ca7740 10 client.15540 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.305+0000 7efd62ca7740 1 -- 172.21.15.12:0/3109753010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d192e95510 con 0x55d192e73ca0 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.306+0000 7efd41ffb640 1 -- 172.21.15.12:0/3109753010 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd44004450 con 0x55d192e73ca0 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.306+0000 7efd41ffb640 1 -- 172.21.15.12:0/3109753010 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7efd44004c50 con 0x55d192e73ca0 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.306+0000 7efd62ca7740 10 client.15540 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.306+0000 7efd62ca7740 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.306+0000 7efd62ca7740 20 client.15540 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.306+0000 7efd62ca7740 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d192e96900 0x55d192e98cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.306+0000 7efd62ca7740 4 client.15540 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.306+0000 7efd62ca7740 1 -- 172.21.15.12:0/3109753010 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efd5401c470 con 0x55d192e96900 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.306+0000 7efd5a59c640 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d192e96900 0x55d192e98cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.307+0000 7efd41ffb640 10 client.15540 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.307+0000 7efd5a59c640 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d192e96900 0x55d192e98cf0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=875a3f9ccea5cf1e server_cookie=37389c20ee42c07b in_seq=0 out_seq=0 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.307+0000 7efd41ffb640 1 -- 172.21.15.12:0/3109753010 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7efd5401c470 con 0x55d192e96900 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.307+0000 7efd41ffb640 10 client.15540 handle_command_reply: tid=0 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.307+0000 7efd62ca7740 1 client.15540 shutdown 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.307+0000 7efd62ca7740 1 -- 172.21.15.12:0/3109753010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 msgr2=0x55d192e82440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.307+0000 7efd62ca7740 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e82440 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efd44009230 tx=0x7efd440317e0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.308+0000 7efd62ca7740 1 -- 172.21.15.12:0/3109753010 shutdown_connections 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.308+0000 7efd62ca7740 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d192e96900 0x55d192e98cf0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.308+0000 7efd41ffb640 0 client.15540 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.308+0000 7efd62ca7740 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e82a90 0x55d192e7b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.308+0000 7efd62ca7740 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e82440 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.308+0000 7efd62ca7740 1 --2- 172.21.15.12:0/3109753010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e73380 0x55d192e81f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.308+0000 7efd62ca7740 1 -- 172.21.15.12:0/3109753010 >> 172.21.15.12:0/3109753010 conn(0x55d192e6fa30 msgr2=0x55d192e75790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.308+0000 7efd62ca7740 1 -- 172.21.15.12:0/3109753010 shutdown_connections 2024-09-16T01:01:47.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.308+0000 7efd62ca7740 1 -- 172.21.15.12:0/3109753010 wait complete. 2024-09-16T01:01:47.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.308+0000 7efd62ca7740 20 client.15540 trim_cache size 0 max 16384 2024-09-16T01:01:47.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.333+0000 7efd62ca7740 1 Processor -- start 2024-09-16T01:01:47.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.333+0000 7efd62ca7740 1 -- start start 2024-09-16T01:01:47.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.333+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 0x55d192e767d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.333+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e9e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.333+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e82a90 0x55d192e9ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd62ca7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1acb90 con 0x55d192e73ca0 2024-09-16T01:01:47.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd62ca7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1ae6d0 con 0x55d192e73380 2024-09-16T01:01:47.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd62ca7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1ad260 con 0x55d192e82a90 2024-09-16T01:01:47.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd53fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e9e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd53fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e9e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52126/0 (socket says 172.21.15.12:52126) 2024-09-16T01:01:47.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd53fff640 1 -- 172.21.15.12:0/3723617583 learned_addr learned my addr 172.21.15.12:0/3723617583 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:47.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd5a59c640 1 --2- 172.21.15.12:0/3723617583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 0x55d192e767d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd5ad9d640 1 --2- 172.21.15.12:0/3723617583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e82a90 0x55d192e9ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd53fff640 1 -- 172.21.15.12:0/3723617583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e82a90 msgr2=0x55d192e9ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd53fff640 1 --2- 172.21.15.12:0/3723617583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e82a90 0x55d192e9ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd53fff640 1 -- 172.21.15.12:0/3723617583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 msgr2=0x55d192e767d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd53fff640 1 --2- 172.21.15.12:0/3723617583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 0x55d192e767d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd53fff640 1 -- 172.21.15.12:0/3723617583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d192e827b0 con 0x55d192e73ca0 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd5a59c640 1 --2- 172.21.15.12:0/3723617583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 0x55d192e767d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.334+0000 7efd53fff640 1 --2- 172.21.15.12:0/3723617583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e9e590 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7efd44031550 tx=0x7efd44001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87cf6e62679ca80 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.335+0000 7efd43fff640 1 -- 172.21.15.12:0/3723617583 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44040070 con 0x55d192e73ca0 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.335+0000 7efd43fff640 1 -- 172.21.15.12:0/3723617583 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd44056070 con 0x55d192e73ca0 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.335+0000 7efd43fff640 1 -- 172.21.15.12:0/3723617583 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd440044b0 con 0x55d192e73ca0 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.335+0000 7efd62ca7740 1 -- 172.21.15.12:0/3723617583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 msgr2=0x55d192e9e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.335+0000 7efd62ca7740 1 --2- 172.21.15.12:0/3723617583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e9e590 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7efd44031550 tx=0x7efd44001e70 comp rx=0 tx=0).stop 2024-09-16T01:01:47.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.335+0000 7efd62ca7740 1 -- 172.21.15.12:0/3723617583 shutdown_connections 2024-09-16T01:01:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.335+0000 7efd62ca7740 1 --2- 172.21.15.12:0/3723617583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e82a90 0x55d192e9ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.335+0000 7efd62ca7740 1 --2- 172.21.15.12:0/3723617583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192e9e590 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.335+0000 7efd62ca7740 1 --2- 172.21.15.12:0/3723617583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 0x55d192e767d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.336+0000 7efd62ca7740 1 -- 172.21.15.12:0/3723617583 >> 172.21.15.12:0/3723617583 conn(0x55d192e6fa30 msgr2=0x55d192e760c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.336+0000 7efd62ca7740 1 -- 172.21.15.12:0/3723617583 shutdown_connections 2024-09-16T01:01:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.336+0000 7efd62ca7740 1 -- 172.21.15.12:0/3723617583 wait complete. 2024-09-16T01:01:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.336+0000 7efd62ca7740 1 -- start start 2024-09-16T01:01:47.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.336+0000 7efd62ca7740 1 Processor -- start 2024-09-16T01:01:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.336+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 0x55d192efa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.336+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192efadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.336+0000 7efd62ca7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e82a90 0x55d192e8fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd62ca7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1ae000 con 0x55d192e73ca0 2024-09-16T01:01:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd62ca7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1ad930 con 0x55d192e73380 2024-09-16T01:01:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd62ca7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1aab70 con 0x55d192e82a90 2024-09-16T01:01:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd62ca7740 10 client.0 _ll_register_callbacks cb 0x7efd44005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd53fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192efadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd53fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192efadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52130/0 (socket says 172.21.15.12:52130) 2024-09-16T01:01:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd53fff640 1 -- 172.21.15.12:0/1001891354 learned_addr learned my addr 172.21.15.12:0/1001891354 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd5ad9d640 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e82a90 0x55d192e8fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd5a59c640 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 0x55d192efa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd53fff640 1 -- 172.21.15.12:0/1001891354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e82a90 msgr2=0x55d192e8fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd53fff640 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e82a90 0x55d192e8fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd53fff640 1 -- 172.21.15.12:0/1001891354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 msgr2=0x55d192efa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd53fff640 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 0x55d192efa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd53fff640 1 -- 172.21.15.12:0/1001891354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d192e7c450 con 0x55d192e73ca0 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd5a59c640 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 0x55d192efa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd53fff640 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192efadc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7efd44009900 tx=0x7efd44003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24486a458b88139 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.337+0000 7efd41ffb640 1 -- 172.21.15.12:0/1001891354 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44040040 con 0x55d192e73ca0 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd41ffb640 1 -- 172.21.15.12:0/1001891354 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7efd4404a020 con 0x55d192e73ca0 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd62ca7740 1 -- 172.21.15.12:0/1001891354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd44056070 con 0x55d192e73ca0 2024-09-16T01:01:47.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd41ffb640 1 -- 172.21.15.12:0/1001891354 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd44067050 con 0x55d192e73ca0 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd62ca7740 10 client.15546 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd62ca7740 1 -- 172.21.15.12:0/1001891354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d192f01e50 con 0x55d192e73ca0 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd41ffb640 1 -- 172.21.15.12:0/1001891354 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd44056070 con 0x55d192e73ca0 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd41ffb640 1 -- 172.21.15.12:0/1001891354 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7efd440049b0 con 0x55d192e73ca0 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd62ca7740 10 client.15546 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd62ca7740 10 client.15546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd62ca7740 20 client.15546 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd62ca7740 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d192e96900 0x55d192f044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd62ca7740 4 client.15546 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.338+0000 7efd62ca7740 1 -- 172.21.15.12:0/1001891354 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d192de6850 con 0x55d192e96900 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd5a59c640 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d192e96900 0x55d192f044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd5a59c640 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d192e96900 0x55d192f044f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dca958587134bc5 server_cookie=ca491d066300175d in_seq=0 out_seq=0 2024-09-16T01:01:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd41ffb640 10 client.15546 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd41ffb640 1 -- 172.21.15.12:0/1001891354 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d192de6850 con 0x55d192e96900 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd41ffb640 10 client.15546 handle_command_reply: tid=0 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd62ca7740 1 client.15546 shutdown 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd62ca7740 1 -- 172.21.15.12:0/1001891354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 msgr2=0x55d192efadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd62ca7740 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192efadc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7efd44009900 tx=0x7efd44003c50 comp rx=0 tx=0).stop 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd62ca7740 1 -- 172.21.15.12:0/1001891354 shutdown_connections 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd62ca7740 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d192e96900 0x55d192f044f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd62ca7740 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d192e82a90 0x55d192e8fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd41ffb640 0 client.15546 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd62ca7740 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d192e73ca0 0x55d192efadc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.339+0000 7efd62ca7740 1 --2- 172.21.15.12:0/1001891354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d192e73380 0x55d192efa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.340+0000 7efd62ca7740 1 -- 172.21.15.12:0/1001891354 >> 172.21.15.12:0/1001891354 conn(0x55d192e6fa30 msgr2=0x55d192e7ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.340+0000 7efd62ca7740 1 -- 172.21.15.12:0/1001891354 shutdown_connections 2024-09-16T01:01:47.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.340+0000 7efd62ca7740 1 -- 172.21.15.12:0/1001891354 wait complete. 2024-09-16T01:01:47.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.340+0000 7efd62ca7740 20 client.15546 trim_cache size 0 max 16384 2024-09-16T01:01:47.346 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:01:47.346 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-16T01:01:47.346 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-16T01:01:47.346 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.340+0000 7efd608ce640 1 -- 172.21.15.12:0/302534238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd480a3240 msgr2=0x7efd480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.340+0000 7efd608ce640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd480a3240 0x7efd480a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd5401f000 tx=0x7efd54020000 comp rx=0 tx=0).stop 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.340+0000 7efd608ce640 1 -- 172.21.15.12:0/302534238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c101dd0 msgr2=0x7efd5c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.340+0000 7efd608ce640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c101dd0 0x7efd5c198460 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00d950 tx=0x7efd4c00de10 comp rx=0 tx=0).stop 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.341+0000 7efd608ce640 1 -- 172.21.15.12:0/302534238 shutdown_connections 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.341+0000 7efd608ce640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd480a3240 0x7efd480a5700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.341+0000 7efd608ce640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c106f00 0x7efd5c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.341+0000 7efd608ce640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd5c102780 0x7efd5c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.341+0000 7efd608ce640 1 --2- 172.21.15.12:0/302534238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c101dd0 0x7efd5c198460 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.341+0000 7efd608ce640 1 -- 172.21.15.12:0/302534238 >> 172.21.15.12:0/302534238 conn(0x7efd5c0fd890 msgr2=0x7efd5c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.341+0000 7efd608ce640 1 -- 172.21.15.12:0/302534238 shutdown_connections 2024-09-16T01:01:47.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:47.341+0000 7efd608ce640 1 -- 172.21.15.12:0/302534238 wait complete. 2024-09-16T01:01:47.348 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:46 smithi119 ceph-mon[35049]: pgmap v380: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:01:48.278 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-16T01:01:48.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:48.557 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:48.957 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:48 smithi012 ceph-mon[31197]: pgmap v381: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.042+0000 7fef1fa46640 1 -- 172.21.15.12:0/1011382972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef18102ef0 msgr2=0x7fef1810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.042+0000 7fef1fa46640 1 --2- 172.21.15.12:0/1011382972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef18102ef0 0x7fef1810da40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fef10009ca0 tx=0x7fef1002a950 comp rx=0 tx=0).stop 2024-09-16T01:01:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.042+0000 7fef1fa46640 1 -- 172.21.15.12:0/1011382972 shutdown_connections 2024-09-16T01:01:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.042+0000 7fef1fa46640 1 --2- 172.21.15.12:0/1011382972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef18102ef0 0x7fef1810da40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.042+0000 7fef1fa46640 1 --2- 172.21.15.12:0/1011382972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef18102570 0x7fef181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.042+0000 7fef1fa46640 1 --2- 172.21.15.12:0/1011382972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef18100e20 0x7fef18101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.042+0000 7fef1fa46640 1 -- 172.21.15.12:0/1011382972 >> 172.21.15.12:0/1011382972 conn(0x7fef180fc7d0 msgr2=0x7fef180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.042+0000 7fef1fa46640 1 -- 172.21.15.12:0/1011382972 shutdown_connections 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.042+0000 7fef1fa46640 1 -- 172.21.15.12:0/1011382972 wait complete. 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1fa46640 1 Processor -- start 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1fa46640 1 -- start start 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1fa46640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef18100e20 0x7fef180fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1fa46640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef18102570 0x7fef180fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1fa46640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef18102ef0 0x7fef180fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1fa46640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fef18110f80 con 0x7fef18100e20 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1fa46640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fef18110e00 con 0x7fef18102570 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1fa46640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fef18111100 con 0x7fef18102ef0 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1d7e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef18100e20 0x7fef180fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1d7e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef18100e20 0x7fef180fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52148/0 (socket says 172.21.15.12:52148) 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1d7e2640 1 -- 172.21.15.12:0/1856665072 learned_addr learned my addr 172.21.15.12:0/1856665072 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1cfe1640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef18102570 0x7fef180fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.043+0000 7fef1dfe3640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef18102ef0 0x7fef180fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef1d7e2640 1 -- 172.21.15.12:0/1856665072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef18102ef0 msgr2=0x7fef180fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef1d7e2640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef18102ef0 0x7fef180fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef1d7e2640 1 -- 172.21.15.12:0/1856665072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef18102570 msgr2=0x7fef180fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef1d7e2640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef18102570 0x7fef180fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef1d7e2640 1 -- 172.21.15.12:0/1856665072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef181a6890 con 0x7fef18100e20 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef1d7e2640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef18100e20 0x7fef180fcc80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fef1400c920 tx=0x7fef1400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef0e7fc640 1 -- 172.21.15.12:0/1856665072 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14007c70 con 0x7fef18100e20 2024-09-16T01:01:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef1fa46640 1 -- 172.21.15.12:0/1856665072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef181a6b80 con 0x7fef18100e20 2024-09-16T01:01:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef0e7fc640 1 -- 172.21.15.12:0/1856665072 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef14007e10 con 0x7fef18100e20 2024-09-16T01:01:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef0e7fc640 1 -- 172.21.15.12:0/1856665072 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14018890 con 0x7fef18100e20 2024-09-16T01:01:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.044+0000 7fef1fa46640 1 -- 172.21.15.12:0/1856665072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef181a7110 con 0x7fef18100e20 2024-09-16T01:01:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.045+0000 7fef1fa46640 1 -- 172.21.15.12:0/1856665072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef18101200 con 0x7fef18100e20 2024-09-16T01:01:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.048+0000 7fef0e7fc640 1 -- 172.21.15.12:0/1856665072 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fef14018a50 con 0x7fef18100e20 2024-09-16T01:01:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.048+0000 7fef0e7fc640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fef040a3240 0x7fef040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.049+0000 7fef1cfe1640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fef040a3240 0x7fef040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.049+0000 7fef0e7fc640 1 -- 172.21.15.12:0/1856665072 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fef140d0040 con 0x7fef18100e20 2024-09-16T01:01:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.049+0000 7fef1cfe1640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fef040a3240 0x7fef040a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fef180fe710 tx=0x7fef08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.052+0000 7fef0e7fc640 1 -- 172.21.15.12:0/1856665072 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef14014030 con 0x7fef18100e20 2024-09-16T01:01:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:48 smithi098 ceph-mon[35346]: pgmap v381: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.291+0000 7fef1fa46640 1 -- 172.21.15.12:0/1856665072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef1810a0a0 con 0x7fef18100e20 2024-09-16T01:01:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.292+0000 7fef0e7fc640 1 -- 172.21.15.12:0/1856665072 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7fef1409ca90 con 0x7fef18100e20 2024-09-16T01:01:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:49.295 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:01:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:01:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 -- 172.21.15.12:0/1856665072 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fef040a3240 msgr2=0x7fef040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fef040a3240 0x7fef040a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fef180fe710 tx=0x7fef08005f90 comp rx=0 tx=0).stop 2024-09-16T01:01:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 -- 172.21.15.12:0/1856665072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef18100e20 msgr2=0x7fef180fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef18100e20 0x7fef180fcc80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fef1400c920 tx=0x7fef1400cde0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 -- 172.21.15.12:0/1856665072 shutdown_connections 2024-09-16T01:01:49.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fef040a3240 0x7fef040a5700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef18102ef0 0x7fef180fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef18102570 0x7fef180fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 --2- 172.21.15.12:0/1856665072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef18100e20 0x7fef180fcc80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 -- 172.21.15.12:0/1856665072 >> 172.21.15.12:0/1856665072 conn(0x7fef180fc7d0 msgr2=0x7fef1806a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 -- 172.21.15.12:0/1856665072 shutdown_connections 2024-09-16T01:01:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:49.294+0000 7fef1fa46640 1 -- 172.21.15.12:0/1856665072 wait complete. 2024-09-16T01:01:49.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:48 smithi119 ceph-mon[35049]: pgmap v381: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:50.087 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:49 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1856665072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:50.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-16T01:01:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:49 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1856665072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:50.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:49 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1856665072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:50.666 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.2 2024-09-16T01:01:50.666 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.924+0000 7f65761f5640 1 -- 172.21.15.12:0/3198789112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6570101de0 msgr2=0x7f65701021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.924+0000 7f65761f5640 1 --2- 172.21.15.12:0/3198789112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6570101de0 0x7f65701021c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6560009900 tx=0x7f656002a3f0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.924+0000 7f65761f5640 1 -- 172.21.15.12:0/3198789112 shutdown_connections 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.924+0000 7f65761f5640 1 --2- 172.21.15.12:0/3198789112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6570106f10 0x7f657010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.924+0000 7f65761f5640 1 --2- 172.21.15.12:0/3198789112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570102790 0x7f65701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.924+0000 7f65761f5640 1 --2- 172.21.15.12:0/3198789112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6570101de0 0x7f65701021c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.924+0000 7f65761f5640 1 -- 172.21.15.12:0/3198789112 >> 172.21.15.12:0/3198789112 conn(0x7f65700fd8e0 msgr2=0x7f65700ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.924+0000 7f65761f5640 1 -- 172.21.15.12:0/3198789112 shutdown_connections 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.924+0000 7f65761f5640 1 -- 172.21.15.12:0/3198789112 wait complete. 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.924+0000 7f65761f5640 1 Processor -- start 2024-09-16T01:01:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f65761f5640 1 -- start start 2024-09-16T01:01:50.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f65761f5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570101de0 0x7f65701983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f65761f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6570102790 0x7f65701988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f65761f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6570106f10 0x7f657019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f65761f5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6570111f70 con 0x7f6570102790 2024-09-16T01:01:50.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f65761f5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6570111df0 con 0x7f6570101de0 2024-09-16T01:01:50.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f65761f5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f65701120f0 con 0x7f6570106f10 2024-09-16T01:01:50.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6570102790 0x7f65701988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6570102790 0x7f65701988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52160/0 (socket says 172.21.15.12:52160) 2024-09-16T01:01:50.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656effd640 1 -- 172.21.15.12:0/681798096 learned_addr learned my addr 172.21.15.12:0/681798096 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:50.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656f7fe640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570101de0 0x7f65701983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656ffff640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6570106f10 0x7f657019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656effd640 1 -- 172.21.15.12:0/681798096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6570106f10 msgr2=0x7f657019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656effd640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6570106f10 0x7f657019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656effd640 1 -- 172.21.15.12:0/681798096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570101de0 msgr2=0x7f65701983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656effd640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570101de0 0x7f65701983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656effd640 1 -- 172.21.15.12:0/681798096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657019d360 con 0x7f6570102790 2024-09-16T01:01:50.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.925+0000 7f656ffff640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6570106f10 0x7f657019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:50.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.926+0000 7f656effd640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6570102790 0x7f65701988f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f656400d950 tx=0x7f656400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.926+0000 7f656cff9640 1 -- 172.21.15.12:0/681798096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564017070 con 0x7f6570102790 2024-09-16T01:01:50.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.926+0000 7f656cff9640 1 -- 172.21.15.12:0/681798096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6564009c30 con 0x7f6570102790 2024-09-16T01:01:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.926+0000 7f65761f5640 1 -- 172.21.15.12:0/681798096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657019d650 con 0x7f6570102790 2024-09-16T01:01:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.926+0000 7f656cff9640 1 -- 172.21.15.12:0/681798096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656400f6b0 con 0x7f6570102790 2024-09-16T01:01:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.926+0000 7f65761f5640 1 -- 172.21.15.12:0/681798096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65701a4f30 con 0x7f6570102790 2024-09-16T01:01:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.928+0000 7f656cff9640 1 -- 172.21.15.12:0/681798096 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f65640109d0 con 0x7f6570102790 2024-09-16T01:01:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.929+0000 7f65785ce740 1 Processor -- start 2024-09-16T01:01:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.929+0000 7f65785ce740 1 -- start start 2024-09-16T01:01:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.929+0000 7f656cff9640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65580a3240 0x7f65580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f65785ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a01464090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f65785ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a014645d0 0x558a01464a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f65785ce740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a0146f370 0x558a01471760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f65785ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a013ca2f0 con 0x558a01465b40 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f65785ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558a01371cf0 con 0x558a014645d0 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f65785ce740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558a013c62b0 con 0x558a0146f370 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656cff9640 1 -- 172.21.15.12:0/681798096 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f65640cf900 con 0x7f6570102790 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a01464090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a01464090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52174/0 (socket says 172.21.15.12:52174) 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656f7fe640 1 -- 172.21.15.12:0/2263990671 learned_addr learned my addr 172.21.15.12:0/2263990671 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656ffff640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65580a3240 0x7f65580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656effd640 1 --2- 172.21.15.12:0/2263990671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a014645d0 0x558a01464a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656f7fe640 1 -- 172.21.15.12:0/2263990671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a0146f370 msgr2=0x558a01471760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:01:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656f7fe640 1 --2- 172.21.15.12:0/2263990671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a0146f370 0x558a01471760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656f7fe640 1 -- 172.21.15.12:0/2263990671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a014645d0 msgr2=0x558a01464a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656f7fe640 1 --2- 172.21.15.12:0/2263990671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a014645d0 0x558a01464a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656f7fe640 1 -- 172.21.15.12:0/2263990671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a013563a0 con 0x558a01465b40 2024-09-16T01:01:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656f7fe640 1 --2- 172.21.15.12:0/2263990671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a01464090 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6560009900 tx=0x7f6560031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68aea1889f253e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.930+0000 7f656ffff640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65580a3240 0x7f65580a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x558a01465070 tx=0x7f6568005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f6555ffb640 1 -- 172.21.15.12:0/2263990671 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560040070 con 0x558a01465b40 2024-09-16T01:01:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f6555ffb640 1 -- 172.21.15.12:0/2263990671 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6560005020 con 0x558a01465b40 2024-09-16T01:01:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f6555ffb640 1 -- 172.21.15.12:0/2263990671 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560035040 con 0x558a01465b40 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f65785ce740 1 -- 172.21.15.12:0/2263990671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 msgr2=0x558a01464090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f65785ce740 1 --2- 172.21.15.12:0/2263990671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a01464090 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6560009900 tx=0x7f6560031630 comp rx=0 tx=0).stop 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f65785ce740 1 -- 172.21.15.12:0/2263990671 shutdown_connections 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f65785ce740 1 --2- 172.21.15.12:0/2263990671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a0146f370 0x558a01471760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f65785ce740 1 --2- 172.21.15.12:0/2263990671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a014645d0 0x558a01464a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f65785ce740 1 --2- 172.21.15.12:0/2263990671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a01464090 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f65785ce740 1 -- 172.21.15.12:0/2263990671 >> 172.21.15.12:0/2263990671 conn(0x558a0142d310 msgr2=0x558a01460c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.931+0000 7f65785ce740 1 -- 172.21.15.12:0/2263990671 shutdown_connections 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.932+0000 7f65785ce740 1 -- 172.21.15.12:0/2263990671 wait complete. 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.932+0000 7f65785ce740 1 -- start start 2024-09-16T01:01:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.932+0000 7f65785ce740 1 Processor -- start 2024-09-16T01:01:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.932+0000 7f65785ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a014645d0 0x558a0146ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f65785ce740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a01465b40 0x558a0146bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f65785ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a0146f370 0x558a0146c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f65785ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a01476420 con 0x558a014645d0 2024-09-16T01:01:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f65785ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558a01385060 con 0x558a0146f370 2024-09-16T01:01:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f65785ce740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558a014765a0 con 0x558a01465b40 2024-09-16T01:01:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f65785ce740 10 client.0 _ll_register_callbacks cb 0x558a010d88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a014645d0 0x558a0146ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a014645d0 0x558a0146ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52180/0 (socket says 172.21.15.12:52180) 2024-09-16T01:01:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656f7fe640 1 -- 172.21.15.12:0/1828477643 learned_addr learned my addr 172.21.15.12:0/1828477643 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656ffff640 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a0146f370 0x558a0146c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656effd640 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a01465b40 0x558a0146bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656f7fe640 1 -- 172.21.15.12:0/1828477643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a01465b40 msgr2=0x558a0146bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656f7fe640 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a01465b40 0x558a0146bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656f7fe640 1 -- 172.21.15.12:0/1828477643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a0146f370 msgr2=0x558a0146c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656f7fe640 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a0146f370 0x558a0146c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656f7fe640 1 -- 172.21.15.12:0/1828477643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a0113b3c0 con 0x558a014645d0 2024-09-16T01:01:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656effd640 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a01465b40 0x558a0146bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656ffff640 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a0146f370 0x558a0146c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f656f7fe640 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a014645d0 0x558a0146ecf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f656002a430 tx=0x7f6560005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522c6108767cc0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f654effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f654effd640 1 -- 172.21.15.12:0/1828477643 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560040030 con 0x558a014645d0 2024-09-16T01:01:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.933+0000 7f654effd640 1 -- 172.21.15.12:0/1828477643 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f6560004940 con 0x558a014645d0 2024-09-16T01:01:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f65785ce740 1 -- 172.21.15.12:0/1828477643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6560005020 con 0x558a014645d0 2024-09-16T01:01:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f654effd640 1 -- 172.21.15.12:0/1828477643 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6560035070 con 0x558a014645d0 2024-09-16T01:01:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f65785ce740 10 client.15564 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f65785ce740 1 -- 172.21.15.12:0/1828477643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558a01481e50 con 0x558a014645d0 2024-09-16T01:01:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f654effd640 1 -- 172.21.15.12:0/1828477643 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6560005020 con 0x558a014645d0 2024-09-16T01:01:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f654effd640 1 -- 172.21.15.12:0/1828477643 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f656004e420 con 0x558a014645d0 2024-09-16T01:01:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f65785ce740 10 client.15564 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f65785ce740 10 client.15564 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-16T01:01:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f65785ce740 20 client.15564 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f65785ce740 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558a014831a0 0x558a01485590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f65785ce740 4 client.15564 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.934+0000 7f65785ce740 1 -- 172.21.15.12:0/1828477643 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a013d7860 con 0x558a014831a0 2024-09-16T01:01:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.935+0000 7f656effd640 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558a014831a0 0x558a01485590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.935+0000 7f654effd640 10 client.15564 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:01:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.935+0000 7f656effd640 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558a014831a0 0x558a01485590 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e3dc19ad7ec6f084 server_cookie=8c87a14a86c01aba in_seq=0 out_seq=0 2024-09-16T01:01:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.935+0000 7f654effd640 1 -- 172.21.15.12:0/1828477643 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a013d7860 con 0x558a014831a0 2024-09-16T01:01:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f654effd640 10 client.15564 handle_command_reply: tid=0 2024-09-16T01:01:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 client.15564 shutdown 2024-09-16T01:01:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 -- 172.21.15.12:0/1828477643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a014645d0 msgr2=0x558a0146ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a014645d0 0x558a0146ecf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f656002a430 tx=0x7f6560005400 comp rx=0 tx=0).stop 2024-09-16T01:01:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 -- 172.21.15.12:0/1828477643 shutdown_connections 2024-09-16T01:01:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558a014831a0 0x558a01485590 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a0146f370 0x558a0146c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a01465b40 0x558a0146bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 --2- 172.21.15.12:0/1828477643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a014645d0 0x558a0146ecf0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f654effd640 0 client.15564 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:01:50.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 -- 172.21.15.12:0/1828477643 >> 172.21.15.12:0/1828477643 conn(0x558a0142d310 msgr2=0x558a01466930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 -- 172.21.15.12:0/1828477643 shutdown_connections 2024-09-16T01:01:50.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 1 -- 172.21.15.12:0/1828477643 wait complete. 2024-09-16T01:01:50.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.936+0000 7f65785ce740 20 client.15564 trim_cache size 0 max 16384 2024-09-16T01:01:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.950+0000 7f65785ce740 1 Processor -- start 2024-09-16T01:01:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f65785ce740 1 -- start start 2024-09-16T01:01:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f65785ce740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a014645d0 0x558a0147f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f65785ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a01465b40 0x558a0148ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f65785ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a0146f370 0x558a0148b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f65785ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65701ac940 con 0x558a0146f370 2024-09-16T01:01:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f65785ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f65701ae480 con 0x558a01465b40 2024-09-16T01:01:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f65785ce740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f65701ad010 con 0x558a014645d0 2024-09-16T01:01:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a0146f370 0x558a0148b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a0146f370 0x558a0148b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52190/0 (socket says 172.21.15.12:52190) 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656ffff640 1 -- 172.21.15.12:0/2119470650 learned_addr learned my addr 172.21.15.12:0/2119470650 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656effd640 1 --2- 172.21.15.12:0/2119470650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a01465b40 0x558a0148ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656f7fe640 1 --2- 172.21.15.12:0/2119470650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a014645d0 0x558a0147f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656ffff640 1 -- 172.21.15.12:0/2119470650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a014645d0 msgr2=0x558a0147f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656ffff640 1 --2- 172.21.15.12:0/2119470650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a014645d0 0x558a0147f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656ffff640 1 -- 172.21.15.12:0/2119470650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a01465b40 msgr2=0x558a0148ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656ffff640 1 --2- 172.21.15.12:0/2119470650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a01465b40 0x558a0148ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656ffff640 1 -- 172.21.15.12:0/2119470650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a0146a510 con 0x558a0146f370 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.951+0000 7f656effd640 1 --2- 172.21.15.12:0/2119470650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a01465b40 0x558a0148ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.952+0000 7f656ffff640 1 --2- 172.21.15.12:0/2119470650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a0146f370 0x558a0148b070 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6568003aa0 tx=0x7f6568011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59473b2941deb8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.952+0000 7f65557fa640 1 -- 172.21.15.12:0/2119470650 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656801f640 con 0x558a0146f370 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.952+0000 7f65557fa640 1 -- 172.21.15.12:0/2119470650 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6568024070 con 0x558a0146f370 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.952+0000 7f65557fa640 1 -- 172.21.15.12:0/2119470650 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568010c10 con 0x558a0146f370 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.953+0000 7f65785ce740 1 -- 172.21.15.12:0/2119470650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a0146f370 msgr2=0x558a0148b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.953+0000 7f65785ce740 1 --2- 172.21.15.12:0/2119470650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a0146f370 0x558a0148b070 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6568003aa0 tx=0x7f6568011000 comp rx=0 tx=0).stop 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.953+0000 7f65785ce740 1 -- 172.21.15.12:0/2119470650 shutdown_connections 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.953+0000 7f65785ce740 1 --2- 172.21.15.12:0/2119470650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a0146f370 0x558a0148b070 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.953+0000 7f65785ce740 1 --2- 172.21.15.12:0/2119470650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a01465b40 0x558a0148ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.953+0000 7f65785ce740 1 --2- 172.21.15.12:0/2119470650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a014645d0 0x558a0147f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.953+0000 7f65785ce740 1 -- 172.21.15.12:0/2119470650 >> 172.21.15.12:0/2119470650 conn(0x558a0142d310 msgr2=0x558a0146a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.953+0000 7f65785ce740 1 -- 172.21.15.12:0/2119470650 shutdown_connections 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.953+0000 7f65785ce740 1 -- 172.21.15.12:0/2119470650 wait complete. 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.953+0000 7f65785ce740 1 -- start start 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.954+0000 7f65785ce740 1 Processor -- start 2024-09-16T01:01:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.954+0000 7f65785ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a014645d0 0x558a0147b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.954+0000 7f65785ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a0147bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.954+0000 7f65785ce740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a0146f370 0x558a01478800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.954+0000 7f65785ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65701addb0 con 0x558a01465b40 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.954+0000 7f65785ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f65701ad6e0 con 0x558a014645d0 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.954+0000 7f65785ce740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f65701aa920 con 0x558a0146f370 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.954+0000 7f65785ce740 10 client.0 _ll_register_callbacks cb 0x7f6560009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a0147bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a0147bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52192/0 (socket says 172.21.15.12:52192) 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656effd640 1 -- 172.21.15.12:0/457474616 learned_addr learned my addr 172.21.15.12:0/457474616 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656ffff640 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a0146f370 0x558a01478800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656f7fe640 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a014645d0 0x558a0147b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656effd640 1 -- 172.21.15.12:0/457474616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a0146f370 msgr2=0x558a01478800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656effd640 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a0146f370 0x558a01478800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656effd640 1 -- 172.21.15.12:0/457474616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a014645d0 msgr2=0x558a0147b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656effd640 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a014645d0 0x558a0147b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656effd640 1 -- 172.21.15.12:0/457474616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a0147c360 con 0x558a01465b40 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f656effd640 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a0147bd70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6564009610 tx=0x7f6564005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b17656cadab2a7c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f654effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f654effd640 1 -- 172.21.15.12:0/457474616 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564020040 con 0x558a01465b40 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f654effd640 1 -- 172.21.15.12:0/457474616 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f6564098230 con 0x558a01465b40 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.955+0000 7f65785ce740 1 -- 172.21.15.12:0/457474616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6568024070 con 0x558a01465b40 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f654effd640 1 -- 172.21.15.12:0/457474616 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65640860c0 con 0x558a01465b40 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f65785ce740 10 client.15570 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f65785ce740 1 -- 172.21.15.12:0/457474616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558a014ee080 con 0x558a01465b40 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f654effd640 1 -- 172.21.15.12:0/457474616 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6568024070 con 0x558a01465b40 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f654effd640 1 -- 172.21.15.12:0/457474616 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f65640ba440 con 0x558a01465b40 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f65785ce740 10 client.15570 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f65785ce740 10 client.15570 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-16T01:01:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f65785ce740 20 client.15570 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f65785ce740 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558a014ee7b0 0x558a014f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f65785ce740 4 client.15570 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.956+0000 7f65785ce740 1 -- 172.21.15.12:0/457474616 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a013d1d70 con 0x558a014ee7b0 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.957+0000 7f656f7fe640 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558a014ee7b0 0x558a014f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.957+0000 7f654effd640 10 client.15570 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.957+0000 7f656f7fe640 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558a014ee7b0 0x558a014f0bd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fcb1c72784509d41 server_cookie=784983c2e3aea2ff in_seq=0 out_seq=0 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f654effd640 1 -- 172.21.15.12:0/457474616 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a013d1d70 con 0x558a014ee7b0 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f654effd640 10 client.15570 handle_command_reply: tid=0 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 client.15570 shutdown 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 -- 172.21.15.12:0/457474616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 msgr2=0x558a0147bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a0147bd70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6564009610 tx=0x7f6564005f90 comp rx=0 tx=0).stop 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 -- 172.21.15.12:0/457474616 shutdown_connections 2024-09-16T01:01:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558a014ee7b0 0x558a014f0bd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558a0146f370 0x558a01478800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f654effd640 0 client.15570 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:01:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a01465b40 0x558a0147bd70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 --2- 172.21.15.12:0/457474616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558a014645d0 0x558a0147b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 -- 172.21.15.12:0/457474616 >> 172.21.15.12:0/457474616 conn(0x558a0142d310 msgr2=0x558a0145f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 -- 172.21.15.12:0/457474616 shutdown_connections 2024-09-16T01:01:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.958+0000 7f65785ce740 1 -- 172.21.15.12:0/457474616 wait complete. 2024-09-16T01:01:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65785ce740 20 client.15570 trim_cache size 0 max 16384 2024-09-16T01:01:50.969 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:01:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 -- 172.21.15.12:0/681798096 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65580a3240 msgr2=0x7f65580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65580a3240 0x7f65580a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x558a01465070 tx=0x7f6568005c50 comp rx=0 tx=0).stop 2024-09-16T01:01:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 -- 172.21.15.12:0/681798096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6570102790 msgr2=0x7f65701988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6570102790 0x7f65701988f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f656400d950 tx=0x7f656400de10 comp rx=0 tx=0).stop 2024-09-16T01:01:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 -- 172.21.15.12:0/681798096 shutdown_connections 2024-09-16T01:01:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65580a3240 0x7f65580a5700 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6570106f10 0x7f657019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6570102790 0x7f65701988f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 --2- 172.21.15.12:0/681798096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570101de0 0x7f65701983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 -- 172.21.15.12:0/681798096 >> 172.21.15.12:0/681798096 conn(0x7f65700fd8e0 msgr2=0x7f65700fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.959+0000 7f65761f5640 1 -- 172.21.15.12:0/681798096 shutdown_connections 2024-09-16T01:01:50.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:50.960+0000 7f65761f5640 1 -- 172.21.15.12:0/681798096 wait complete. 2024-09-16T01:01:51.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:50 smithi012 ceph-mon[31197]: pgmap v382: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:01:51.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:50 smithi098 ceph-mon[35346]: pgmap v382: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:01:51.237 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:51.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:50 smithi119 ceph-mon[35049]: pgmap v382: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:01:51.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-16T01:01:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.272+0000 7fa019ab3640 1 -- 172.21.15.12:0/1246784858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa014100e20 msgr2=0x7fa014101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.272+0000 7fa019ab3640 1 --2- 172.21.15.12:0/1246784858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa014100e20 0x7fa014101200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa004009900 tx=0x7fa00402a480 comp rx=0 tx=0).stop 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.273+0000 7fa019ab3640 1 -- 172.21.15.12:0/1246784858 shutdown_connections 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.273+0000 7fa019ab3640 1 --2- 172.21.15.12:0/1246784858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa014102ef0 0x7fa01410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.273+0000 7fa019ab3640 1 --2- 172.21.15.12:0/1246784858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa014102570 0x7fa0141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.273+0000 7fa019ab3640 1 --2- 172.21.15.12:0/1246784858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa014100e20 0x7fa014101200 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.273+0000 7fa019ab3640 1 -- 172.21.15.12:0/1246784858 >> 172.21.15.12:0/1246784858 conn(0x7fa0140fc7d0 msgr2=0x7fa0140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.273+0000 7fa019ab3640 1 -- 172.21.15.12:0/1246784858 shutdown_connections 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.273+0000 7fa019ab3640 1 -- 172.21.15.12:0/1246784858 wait complete. 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.273+0000 7fa019ab3640 1 Processor -- start 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.273+0000 7fa019ab3640 1 -- start start 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa019ab3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa014100e20 0x7fa01419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa019ab3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa014102570 0x7fa01419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa019ab3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa014102ef0 0x7fa01419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa019ab3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa014110f50 con 0x7fa014102570 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa019ab3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa014110dd0 con 0x7fa014102ef0 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa019ab3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa0141110d0 con 0x7fa014100e20 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa012ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa014102570 0x7fa01419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa012ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa014102570 0x7fa01419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52208/0 (socket says 172.21.15.12:52208) 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa012ffd640 1 -- 172.21.15.12:0/3395973580 learned_addr learned my addr 172.21.15.12:0/3395973580 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa013fff640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa014102ef0 0x7fa01419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa0137fe640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa014100e20 0x7fa01419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa012ffd640 1 -- 172.21.15.12:0/3395973580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa014100e20 msgr2=0x7fa01419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa012ffd640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa014100e20 0x7fa01419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa012ffd640 1 -- 172.21.15.12:0/3395973580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa014102ef0 msgr2=0x7fa01419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa012ffd640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa014102ef0 0x7fa01419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa012ffd640 1 -- 172.21.15.12:0/3395973580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01419f670 con 0x7fa014102570 2024-09-16T01:01:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa013fff640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa014102ef0 0x7fa01419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.274+0000 7fa012ffd640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa014102570 0x7fa01419ac00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa00800d950 tx=0x7fa00800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.275+0000 7fa010ff9640 1 -- 172.21.15.12:0/3395973580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa008017070 con 0x7fa014102570 2024-09-16T01:01:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.275+0000 7fa019ab3640 1 -- 172.21.15.12:0/3395973580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01419f960 con 0x7fa014102570 2024-09-16T01:01:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.275+0000 7fa019ab3640 1 -- 172.21.15.12:0/3395973580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0141a7240 con 0x7fa014102570 2024-09-16T01:01:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.275+0000 7fa010ff9640 1 -- 172.21.15.12:0/3395973580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa008009c30 con 0x7fa014102570 2024-09-16T01:01:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.275+0000 7fa010ff9640 1 -- 172.21.15.12:0/3395973580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00800f6b0 con 0x7fa014102570 2024-09-16T01:01:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.276+0000 7fa019ab3640 1 -- 172.21.15.12:0/3395973580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa000005290 con 0x7fa014102570 2024-09-16T01:01:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.277+0000 7fa010ff9640 1 -- 172.21.15.12:0/3395973580 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa00800f850 con 0x7fa014102570 2024-09-16T01:01:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.278+0000 7fa010ff9640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ffc0a32c0 0x7f9ffc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.278+0000 7fa0137fe640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ffc0a32c0 0x7f9ffc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.279+0000 7fa010ff9640 1 -- 172.21.15.12:0/3395973580 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa0080cfa50 con 0x7fa014102570 2024-09-16T01:01:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.279+0000 7fa0137fe640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ffc0a32c0 0x7f9ffc0a5780 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa004009230 tx=0x7fa0040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:52.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.282+0000 7fa010ff9640 1 -- 172.21.15.12:0/3395973580 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa00809c490 con 0x7fa014102570 2024-09-16T01:01:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.538+0000 7fa019ab3640 1 -- 172.21.15.12:0/3395973580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa000005580 con 0x7fa014102570 2024-09-16T01:01:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.539+0000 7fa010ff9640 1 -- 172.21.15.12:0/3395973580 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7fa008009de0 con 0x7fa014102570 2024-09-16T01:01:52.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:01:52.542 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:01:52.544 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:01:52.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 -- 172.21.15.12:0/3395973580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ffc0a32c0 msgr2=0x7f9ffc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:52.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ffc0a32c0 0x7f9ffc0a5780 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa004009230 tx=0x7fa0040058d0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 -- 172.21.15.12:0/3395973580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa014102570 msgr2=0x7fa01419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:52.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa014102570 0x7fa01419ac00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa00800d950 tx=0x7fa00800de10 comp rx=0 tx=0).stop 2024-09-16T01:01:52.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 -- 172.21.15.12:0/3395973580 shutdown_connections 2024-09-16T01:01:52.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9ffc0a32c0 0x7f9ffc0a5780 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa014102ef0 0x7fa01419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa014102570 0x7fa01419ac00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 --2- 172.21.15.12:0/3395973580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa014100e20 0x7fa01419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 -- 172.21.15.12:0/3395973580 >> 172.21.15.12:0/3395973580 conn(0x7fa0140fc7d0 msgr2=0x7fa01406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:52.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 -- 172.21.15.12:0/3395973580 shutdown_connections 2024-09-16T01:01:52.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:52.541+0000 7fa019ab3640 1 -- 172.21.15.12:0/3395973580 wait complete. 2024-09-16T01:01:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:52 smithi098 ceph-mon[35346]: pgmap v383: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:01:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:52 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3395973580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:53.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:52 smithi119 ceph-mon[35049]: pgmap v383: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:01:53.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:52 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3395973580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:53.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:52 smithi012 ceph-mon[31197]: pgmap v383: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:01:53.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:52 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3395973580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:53 smithi098 ceph-mon[35346]: pgmap v384: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:54.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:53 smithi119 ceph-mon[35049]: pgmap v384: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:54.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:53 smithi012 ceph-mon[31197]: pgmap v384: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:56.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:56 smithi119 ceph-mon[35049]: pgmap v385: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:01:56.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:56 smithi012 ceph-mon[31197]: pgmap v385: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:01:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:56 smithi098 ceph-mon[35346]: pgmap v385: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:01:57.660 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db / --timeout 90 --expiration 150.2 --await-for 45.0' 2024-09-16T01:01:57.661 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24518 quiesce db / --timeout 90 --expiration 150.2 --await-for 45.0 2024-09-16T01:01:57.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.891+0000 7f466a191640 1 -- 172.21.15.12:0/884164529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4664101380 msgr2=0x7f466410dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.891+0000 7f466a191640 1 --2- 172.21.15.12:0/884164529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4664101380 0x7f466410dfb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4658009900 tx=0x7f465802a410 comp rx=0 tx=0).stop 2024-09-16T01:01:57.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.891+0000 7f466a191640 1 -- 172.21.15.12:0/884164529 shutdown_connections 2024-09-16T01:01:57.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.891+0000 7f466a191640 1 --2- 172.21.15.12:0/884164529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466410e4f0 0x7f4664110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.891+0000 7f466a191640 1 --2- 172.21.15.12:0/884164529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4664101380 0x7f466410dfb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.891+0000 7f466a191640 1 --2- 172.21.15.12:0/884164529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46641009d0 0x7f4664100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.891+0000 7f466a191640 1 -- 172.21.15.12:0/884164529 >> 172.21.15.12:0/884164529 conn(0x7f46640fc7d0 msgr2=0x7f46640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:57.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.891+0000 7f466a191640 1 -- 172.21.15.12:0/884164529 shutdown_connections 2024-09-16T01:01:57.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.891+0000 7f466a191640 1 -- 172.21.15.12:0/884164529 wait complete. 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.892+0000 7f466a191640 1 Processor -- start 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.892+0000 7f466a191640 1 -- start start 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f466a191640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46641009d0 0x7f466419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f466a191640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4664101380 0x7f466419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f466a191640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f466410e4f0 0x7f466419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f4663fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f466410e4f0 0x7f466419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f4663fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f466410e4f0 0x7f466419eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42382/0 (socket says 172.21.15.12:42382) 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f4663fff640 1 -- 172.21.15.12:0/2737682740 learned_addr learned my addr 172.21.15.12:0/2737682740 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4664114240 con 0x7f466410e4f0 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46641140c0 con 0x7f4664101380 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f46641143c0 con 0x7f46641009d0 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f4662ffd640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4664101380 0x7f466419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.893+0000 7f46637fe640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46641009d0 0x7f466419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.894+0000 7f4662ffd640 1 -- 172.21.15.12:0/2737682740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46641009d0 msgr2=0x7f466419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.894+0000 7f4662ffd640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46641009d0 0x7f466419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.894+0000 7f4662ffd640 1 -- 172.21.15.12:0/2737682740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f466410e4f0 msgr2=0x7f466419eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.894+0000 7f4662ffd640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f466410e4f0 0x7f466419eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.894+0000 7f4662ffd640 1 -- 172.21.15.12:0/2737682740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466419f6d0 con 0x7f4664101380 2024-09-16T01:01:57.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.894+0000 7f4663fff640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f466410e4f0 0x7f466419eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.894+0000 7f4662ffd640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4664101380 0x7f466419ac60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4658005940 tx=0x7f4658004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.894+0000 7f4660ff9640 1 -- 172.21.15.12:0/2737682740 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465803f030 con 0x7f4664101380 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.895+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466419f960 con 0x7f4664101380 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.895+0000 7f4660ff9640 1 -- 172.21.15.12:0/2737682740 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4658003ad0 con 0x7f4664101380 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.895+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46641a72a0 con 0x7f4664101380 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.895+0000 7f4660ff9640 1 -- 172.21.15.12:0/2737682740 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658035070 con 0x7f4664101380 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.898+0000 7f4660ff9640 1 -- 172.21.15.12:0/2737682740 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4658042030 con 0x7f4664101380 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.898+0000 7f466c56a740 1 Processor -- start 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.898+0000 7f466c56a740 1 -- start start 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.900+0000 7f466c56a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a8c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.900+0000 7f466c56a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a8d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.900+0000 7f466c56a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a97b80 0x55c2f3a99f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.900+0000 7f466c56a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c2f39ea2f0 con 0x55c2f3a8e350 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.900+0000 7f466c56a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c2f3991cf0 con 0x55c2f3a97b80 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.900+0000 7f466c56a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c2f39e62b0 con 0x55c2f3a8cde0 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f46637fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a8d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f46637fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a8d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:36122/0 (socket says 172.21.15.12:36122) 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f46637fe640 1 -- 172.21.15.12:0/3312746040 learned_addr learned my addr 172.21.15.12:0/3312746040 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f4663fff640 1 --2- 172.21.15.12:0/3312746040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a8c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f46637fe640 1 -- 172.21.15.12:0/3312746040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a97b80 msgr2=0x55c2f3a99f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f46637fe640 1 --2- 172.21.15.12:0/3312746040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a97b80 0x55c2f3a99f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f46637fe640 1 -- 172.21.15.12:0/3312746040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 msgr2=0x55c2f3a8c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f46637fe640 1 --2- 172.21.15.12:0/3312746040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a8c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f46637fe640 1 -- 172.21.15.12:0/3312746040 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f39763a0 con 0x55c2f3a8cde0 2024-09-16T01:01:57.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f4663fff640 1 --2- 172.21.15.12:0/3312746040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a8c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:57.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f4660ff9640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f464c0a3340 0x7f464c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f4663fff640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f464c0a3340 0x7f464c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.901+0000 7f4660ff9640 1 -- 172.21.15.12:0/2737682740 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f46580f01e0 con 0x7f4664101380 2024-09-16T01:01:57.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.902+0000 7f46637fe640 1 --2- 172.21.15.12:0/3312746040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a8d220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4654009cf0 tx=0x7f4654011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379d6d5422749446 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:57.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.902+0000 7f4663fff640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f464c0a3340 0x7f464c0a5800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f465c011a00 tx=0x7f465c009640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:57.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.902+0000 7f4649ffb640 1 -- 172.21.15.12:0/3312746040 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654004230 con 0x55c2f3a8cde0 2024-09-16T01:01:57.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.902+0000 7f4649ffb640 1 -- 172.21.15.12:0/3312746040 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46540043d0 con 0x55c2f3a8cde0 2024-09-16T01:01:57.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.903+0000 7f4649ffb640 1 -- 172.21.15.12:0/3312746040 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654019960 con 0x55c2f3a8cde0 2024-09-16T01:01:57.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.903+0000 7f466c56a740 1 -- 172.21.15.12:0/3312746040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8cde0 msgr2=0x55c2f3a8d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.903+0000 7f466c56a740 1 --2- 172.21.15.12:0/3312746040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a8d220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4654009cf0 tx=0x7f4654011810 comp rx=0 tx=0).stop 2024-09-16T01:01:57.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.903+0000 7f466c56a740 1 -- 172.21.15.12:0/3312746040 shutdown_connections 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.903+0000 7f466c56a740 1 --2- 172.21.15.12:0/3312746040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a97b80 0x55c2f3a99f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.903+0000 7f466c56a740 1 --2- 172.21.15.12:0/3312746040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a8d220 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.903+0000 7f466c56a740 1 --2- 172.21.15.12:0/3312746040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a8c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.903+0000 7f466c56a740 1 -- 172.21.15.12:0/3312746040 >> 172.21.15.12:0/3312746040 conn(0x55c2f3a4d310 msgr2=0x55c2f3a89470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.903+0000 7f466c56a740 1 -- 172.21.15.12:0/3312746040 shutdown_connections 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.903+0000 7f466c56a740 1 -- 172.21.15.12:0/3312746040 wait complete. 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.904+0000 7f466c56a740 1 -- start start 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.904+0000 7f466c56a740 1 Processor -- start 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.904+0000 7f466c56a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a97500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.904+0000 7f466c56a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 0x55c2f3a94800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.904+0000 7f466c56a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a97b80 0x55c2f3a94e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.904+0000 7f466c56a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c2f3a9a920 con 0x55c2f3a97b80 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.904+0000 7f466c56a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c2f39a5060 con 0x55c2f3a8cde0 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.904+0000 7f466c56a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c2f3a9aaa0 con 0x55c2f3a8e350 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.904+0000 7f466c56a740 10 client.0 _ll_register_callbacks cb 0x55c2f36f88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f4663fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a97b80 0x55c2f3a94e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f4663fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a97b80 0x55c2f3a94e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42402/0 (socket says 172.21.15.12:42402) 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f4663fff640 1 -- 172.21.15.12:0/1797994791 learned_addr learned my addr 172.21.15.12:0/1797994791 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f46637fe640 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a97500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f4662ffd640 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 0x55c2f3a94800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f4663fff640 1 -- 172.21.15.12:0/1797994791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 msgr2=0x55c2f3a94800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f4663fff640 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 0x55c2f3a94800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f4663fff640 1 -- 172.21.15.12:0/1797994791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a8cde0 msgr2=0x55c2f3a97500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f4663fff640 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a97500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f4663fff640 1 -- 172.21.15.12:0/1797994791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f375b3c0 con 0x55c2f3a97b80 2024-09-16T01:01:57.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.905+0000 7f4663fff640 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a97b80 0x55c2f3a94e10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f465c013f00 tx=0x7f465c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4767166a69a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:57.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.906+0000 7f4642ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.906+0000 7f4642ffd640 1 -- 172.21.15.12:0/1797994791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c020830 con 0x55c2f3a97b80 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.906+0000 7f4642ffd640 1 -- 172.21.15.12:0/1797994791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f465c0209d0 con 0x55c2f3a97b80 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.906+0000 7f466c56a740 1 -- 172.21.15.12:0/1797994791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46540043d0 con 0x55c2f3a97b80 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.906+0000 7f4642ffd640 1 -- 172.21.15.12:0/1797994791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f465c031050 con 0x55c2f3a97b80 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.906+0000 7f466c56a740 10 client.15588 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.906+0000 7f466c56a740 1 -- 172.21.15.12:0/1797994791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2f3aa6420 con 0x55c2f3a97b80 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.907+0000 7f4642ffd640 1 -- 172.21.15.12:0/1797994791 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46540043d0 con 0x55c2f3a97b80 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.907+0000 7f4642ffd640 1 -- 172.21.15.12:0/1797994791 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f465c00f040 con 0x55c2f3a97b80 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.907+0000 7f466c56a740 10 client.15588 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.907+0000 7f466c56a740 10 client.15588 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-16T01:01:57.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.907+0000 7f466c56a740 20 client.15588 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.907+0000 7f466c56a740 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55c2f3aa7c70 0x55c2f3aaa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.907+0000 7f466c56a740 4 client.15588 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.907+0000 7f466c56a740 1 -- 172.21.15.12:0/1797994791 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2f39f7860 con 0x55c2f3aa7c70 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.908+0000 7f46637fe640 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55c2f3aa7c70 0x55c2f3aaa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.908+0000 7f46637fe640 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55c2f3aa7c70 0x55c2f3aaa0e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3846a4256a6b605d server_cookie=5d9a14cb672f8bef in_seq=0 out_seq=0 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.908+0000 7f4642ffd640 10 client.15588 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.909+0000 7f4642ffd640 1 -- 172.21.15.12:0/1797994791 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2f39f7860 con 0x55c2f3aa7c70 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.909+0000 7f4642ffd640 10 client.15588 handle_command_reply: tid=0 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.909+0000 7f466c56a740 1 client.15588 shutdown 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.909+0000 7f466c56a740 1 -- 172.21.15.12:0/1797994791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a97b80 msgr2=0x55c2f3a94e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.909+0000 7f466c56a740 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a97b80 0x55c2f3a94e10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f465c013f00 tx=0x7f465c004a40 comp rx=0 tx=0).stop 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.909+0000 7f466c56a740 1 -- 172.21.15.12:0/1797994791 shutdown_connections 2024-09-16T01:01:57.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.910+0000 7f466c56a740 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55c2f3aa7c70 0x55c2f3aaa0e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.910+0000 7f466c56a740 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a97b80 0x55c2f3a94e10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.910+0000 7f466c56a740 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 0x55c2f3a94800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.910+0000 7f466c56a740 1 --2- 172.21.15.12:0/1797994791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a97500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.910+0000 7f466c56a740 1 -- 172.21.15.12:0/1797994791 >> 172.21.15.12:0/1797994791 conn(0x55c2f3a4d310 msgr2=0x55c2f3a8f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:57.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.910+0000 7f4642ffd640 0 client.15588 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:01:57.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.910+0000 7f466c56a740 1 -- 172.21.15.12:0/1797994791 shutdown_connections 2024-09-16T01:01:57.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.910+0000 7f466c56a740 1 -- 172.21.15.12:0/1797994791 wait complete. 2024-09-16T01:01:57.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.911+0000 7f466c56a740 20 client.15588 trim_cache size 0 max 16384 2024-09-16T01:01:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.937+0000 7f466c56a740 1 Processor -- start 2024-09-16T01:01:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.937+0000 7f466c56a740 1 -- start start 2024-09-16T01:01:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f466c56a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a89620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f466c56a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 0x55c2f3aa3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f46637fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a89620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f46637fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a89620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42418/0 (socket says 172.21.15.12:42418) 2024-09-16T01:01:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f46637fe640 1 -- 172.21.15.12:0/1723341045 learned_addr learned my addr 172.21.15.12:0/1723341045 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f466c56a740 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a97b80 0x55c2f3a8f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f466c56a740 1 -- 172.21.15.12:0/1723341045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f46641acb00 con 0x55c2f3a8cde0 2024-09-16T01:01:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f466c56a740 1 -- 172.21.15.12:0/1723341045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46641ae640 con 0x55c2f3a97b80 2024-09-16T01:01:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f466c56a740 1 -- 172.21.15.12:0/1723341045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f46641ad1d0 con 0x55c2f3a8e350 2024-09-16T01:01:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f4662ffd640 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 0x55c2f3aa3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.938+0000 7f4663fff640 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a97b80 0x55c2f3a8f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.939+0000 7f46637fe640 1 -- 172.21.15.12:0/1723341045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 msgr2=0x55c2f3aa3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.939+0000 7f46637fe640 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 0x55c2f3aa3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.939+0000 7f46637fe640 1 -- 172.21.15.12:0/1723341045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a97b80 msgr2=0x55c2f3a8f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.939+0000 7f46637fe640 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a97b80 0x55c2f3a8f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.939+0000 7f46637fe640 1 -- 172.21.15.12:0/1723341045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f3a8db10 con 0x55c2f3a8cde0 2024-09-16T01:01:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.939+0000 7f4662ffd640 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 0x55c2f3aa3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.939+0000 7f46637fe640 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a89620 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4654009cf0 tx=0x7f4654005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a327e78a9523f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.940+0000 7f46497fa640 1 -- 172.21.15.12:0/1723341045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654031070 con 0x55c2f3a8cde0 2024-09-16T01:01:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.940+0000 7f46497fa640 1 -- 172.21.15.12:0/1723341045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46540035f0 con 0x55c2f3a8cde0 2024-09-16T01:01:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.940+0000 7f46497fa640 1 -- 172.21.15.12:0/1723341045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654019850 con 0x55c2f3a8cde0 2024-09-16T01:01:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.941+0000 7f466c56a740 1 -- 172.21.15.12:0/1723341045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8cde0 msgr2=0x55c2f3a89620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.941+0000 7f466c56a740 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a89620 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4654009cf0 tx=0x7f4654005f90 comp rx=0 tx=0).stop 2024-09-16T01:01:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.942+0000 7f466c56a740 1 -- 172.21.15.12:0/1723341045 shutdown_connections 2024-09-16T01:01:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.942+0000 7f466c56a740 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a97b80 0x55c2f3a8f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.942+0000 7f466c56a740 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a8e350 0x55c2f3aa3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.942+0000 7f466c56a740 1 --2- 172.21.15.12:0/1723341045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a89620 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.942+0000 7f466c56a740 1 -- 172.21.15.12:0/1723341045 >> 172.21.15.12:0/1723341045 conn(0x55c2f3a4d310 msgr2=0x55c2f3a88f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.942+0000 7f466c56a740 1 -- 172.21.15.12:0/1723341045 shutdown_connections 2024-09-16T01:01:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.942+0000 7f466c56a740 1 -- 172.21.15.12:0/1723341045 wait complete. 2024-09-16T01:01:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.943+0000 7f466c56a740 1 -- start start 2024-09-16T01:01:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.943+0000 7f466c56a740 1 Processor -- start 2024-09-16T01:01:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.944+0000 7f466c56a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a9ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.944+0000 7f466c56a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a9b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.944+0000 7f466c56a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a97b80 0x55c2f3a9b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.944+0000 7f466c56a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f46641adf70 con 0x55c2f3a8e350 2024-09-16T01:01:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.944+0000 7f466c56a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46641ad8a0 con 0x55c2f3a8cde0 2024-09-16T01:01:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.944+0000 7f466c56a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f46641aaae0 con 0x55c2f3a97b80 2024-09-16T01:01:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.944+0000 7f4662ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a9b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.944+0000 7f4662ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a9b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42432/0 (socket says 172.21.15.12:42432) 2024-09-16T01:01:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.944+0000 7f4662ffd640 1 -- 172.21.15.12:0/579633756 learned_addr learned my addr 172.21.15.12:0/579633756 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.945+0000 7f4663fff640 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a97b80 0x55c2f3a9b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.945+0000 7f46637fe640 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a9ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.945+0000 7f466c56a740 10 client.0 _ll_register_callbacks cb 0x7f465c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.945+0000 7f4662ffd640 1 -- 172.21.15.12:0/579633756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a97b80 msgr2=0x55c2f3a9b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.945+0000 7f4662ffd640 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a97b80 0x55c2f3a9b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.945+0000 7f4662ffd640 1 -- 172.21.15.12:0/579633756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a8cde0 msgr2=0x55c2f3a9ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.945+0000 7f4662ffd640 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a9ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.945+0000 7f4662ffd640 1 -- 172.21.15.12:0/579633756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f3b10ab0 con 0x55c2f3a8e350 2024-09-16T01:01:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.945+0000 7f4662ffd640 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a9b260 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f46580bc1f0 tx=0x7f4658009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239ac8817f58e1c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.945+0000 7f4642ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.946+0000 7f4642ffd640 1 -- 172.21.15.12:0/579633756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580d4030 con 0x55c2f3a8e350 2024-09-16T01:01:57.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.946+0000 7f4642ffd640 1 -- 172.21.15.12:0/579633756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f46580ba590 con 0x55c2f3a8e350 2024-09-16T01:01:57.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.946+0000 7f4663fff640 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a97b80 0x55c2f3a9b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:57.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.946+0000 7f466c56a740 1 -- 172.21.15.12:0/579633756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46540035f0 con 0x55c2f3a8e350 2024-09-16T01:01:57.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.946+0000 7f4642ffd640 1 -- 172.21.15.12:0/579633756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4658049040 con 0x55c2f3a8e350 2024-09-16T01:01:57.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.946+0000 7f466c56a740 10 client.15594 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:57.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.946+0000 7f466c56a740 1 -- 172.21.15.12:0/579633756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2f3b11d50 con 0x55c2f3a8e350 2024-09-16T01:01:57.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.947+0000 7f4642ffd640 1 -- 172.21.15.12:0/579633756 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46540035f0 con 0x55c2f3a8e350 2024-09-16T01:01:57.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.947+0000 7f4642ffd640 1 -- 172.21.15.12:0/579633756 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f46580a0020 con 0x55c2f3a8e350 2024-09-16T01:01:57.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.948+0000 7f466c56a740 10 client.15594 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:57.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.948+0000 7f466c56a740 10 client.15594 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-16T01:01:57.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.948+0000 7f466c56a740 20 client.15594 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:57.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.948+0000 7f466c56a740 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55c2f3b12500 0x55c2f3b14920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.948+0000 7f466c56a740 4 client.15594 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:01:57.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.948+0000 7f466c56a740 1 -- 172.21.15.12:0/579633756 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2f39f1d70 con 0x55c2f3b12500 2024-09-16T01:01:57.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.948+0000 7f46637fe640 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55c2f3b12500 0x55c2f3b14920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.949+0000 7f46637fe640 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55c2f3b12500 0x55c2f3b14920 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=acff7f85401eaa16 server_cookie=53361478ba1d31ee in_seq=0 out_seq=0 2024-09-16T01:01:57.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.949+0000 7f4642ffd640 10 client.15594 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:01:57.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.949+0000 7f4642ffd640 1 -- 172.21.15.12:0/579633756 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2f39f1d70 con 0x55c2f3b12500 2024-09-16T01:01:57.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.949+0000 7f4642ffd640 10 client.15594 handle_command_reply: tid=0 2024-09-16T01:01:57.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.949+0000 7f466c56a740 1 client.15594 shutdown 2024-09-16T01:01:57.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.949+0000 7f466c56a740 1 -- 172.21.15.12:0/579633756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 msgr2=0x55c2f3a9b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.949+0000 7f466c56a740 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a9b260 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f46580bc1f0 tx=0x7f4658009620 comp rx=0 tx=0).stop 2024-09-16T01:01:57.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.950+0000 7f466c56a740 1 -- 172.21.15.12:0/579633756 shutdown_connections 2024-09-16T01:01:57.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.950+0000 7f466c56a740 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55c2f3b12500 0x55c2f3b14920 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.950+0000 7f4642ffd640 0 client.15594 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:01:57.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.950+0000 7f466c56a740 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c2f3a97b80 0x55c2f3a9b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.950+0000 7f466c56a740 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2f3a8e350 0x55c2f3a9b260 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.950+0000 7f466c56a740 1 --2- 172.21.15.12:0/579633756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2f3a8cde0 0x55c2f3a9ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.950+0000 7f466c56a740 1 -- 172.21.15.12:0/579633756 >> 172.21.15.12:0/579633756 conn(0x55c2f3a4d310 msgr2=0x55c2f3a7f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:57.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.950+0000 7f466c56a740 1 -- 172.21.15.12:0/579633756 shutdown_connections 2024-09-16T01:01:57.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.950+0000 7f466c56a740 1 -- 172.21.15.12:0/579633756 wait complete. 2024-09-16T01:01:57.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.950+0000 7f466c56a740 20 client.15594 trim_cache size 0 max 16384 2024-09-16T01:01:57.954 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:01:57.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.951+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f464c0a3340 msgr2=0x7f464c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.951+0000 7f466a191640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f464c0a3340 0x7f464c0a5800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f465c011a00 tx=0x7f465c009640 comp rx=0 tx=0).stop 2024-09-16T01:01:57.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.951+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4664101380 msgr2=0x7f466419ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.951+0000 7f466a191640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4664101380 0x7f466419ac60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4658005940 tx=0x7f4658004270 comp rx=0 tx=0).stop 2024-09-16T01:01:57.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.952+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 shutdown_connections 2024-09-16T01:01:57.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.952+0000 7f466a191640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f464c0a3340 0x7f464c0a5800 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.952+0000 7f466a191640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f466410e4f0 0x7f466419eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.952+0000 7f466a191640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4664101380 0x7f466419ac60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.952+0000 7f466a191640 1 --2- 172.21.15.12:0/2737682740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46641009d0 0x7f466419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.952+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 >> 172.21.15.12:0/2737682740 conn(0x7f46640fc7d0 msgr2=0x7f46640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:57.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.952+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 shutdown_connections 2024-09-16T01:01:57.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:57.953+0000 7f466a191640 1 -- 172.21.15.12:0/2737682740 wait complete. 2024-09-16T01:01:58.264 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:01:58 smithi098 ceph-mon[35346]: pgmap v386: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:58.297 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:01:58 smithi012 ceph-mon[31197]: pgmap v386: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:58.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:01:58 smithi119 ceph-mon[35049]: pgmap v386: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:01:58.659 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-16T01:01:58.684 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.249+0000 7f5da4018640 1 -- 172.21.15.12:0/4181239320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c102df0 msgr2=0x7f5d9c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.249+0000 7f5da4018640 1 --2- 172.21.15.12:0/4181239320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c102df0 0x7f5d9c1031d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009900 tx=0x7f5d8c02a480 comp rx=0 tx=0).stop 2024-09-16T01:01:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.249+0000 7f5da4018640 1 -- 172.21.15.12:0/4181239320 shutdown_connections 2024-09-16T01:01:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.249+0000 7f5da4018640 1 --2- 172.21.15.12:0/4181239320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d9c10c190 0x7f5d9c10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.249+0000 7f5da4018640 1 --2- 172.21.15.12:0/4181239320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d9c103710 0x7f5d9c10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.249+0000 7f5da4018640 1 --2- 172.21.15.12:0/4181239320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c102df0 0x7f5d9c1031d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.249+0000 7f5da4018640 1 -- 172.21.15.12:0/4181239320 >> 172.21.15.12:0/4181239320 conn(0x7f5d9c0fc7d0 msgr2=0x7f5d9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.249+0000 7f5da4018640 1 -- 172.21.15.12:0/4181239320 shutdown_connections 2024-09-16T01:01:59.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.249+0000 7f5da4018640 1 -- 172.21.15.12:0/4181239320 wait complete. 2024-09-16T01:01:59.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.250+0000 7f5da4018640 1 Processor -- start 2024-09-16T01:01:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.250+0000 7f5da4018640 1 -- start start 2024-09-16T01:01:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.250+0000 7f5da4018640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c103710 0x7f5d9c19f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.250+0000 7f5da4018640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d9c10c190 0x7f5d9c10af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da4018640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d9c10b460 0x7f5d9c10b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da4018640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c111f80 con 0x7f5d9c103710 2024-09-16T01:01:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da1db4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c103710 0x7f5d9c19f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da1db4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c103710 0x7f5d9c19f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42442/0 (socket says 172.21.15.12:42442) 2024-09-16T01:01:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da1db4640 1 -- 172.21.15.12:0/1161188118 learned_addr learned my addr 172.21.15.12:0/1161188118 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:59.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da4018640 1 -- 172.21.15.12:0/1161188118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c111e00 con 0x7f5d9c10b460 2024-09-16T01:01:59.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da4018640 1 -- 172.21.15.12:0/1161188118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c112100 con 0x7f5d9c10c190 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d9c10c190 0x7f5d9c10af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da25b5640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d9c10b460 0x7f5d9c10b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da15b3640 1 -- 172.21.15.12:0/1161188118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d9c10b460 msgr2=0x7f5d9c10b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d9c10b460 0x7f5d9c10b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da15b3640 1 -- 172.21.15.12:0/1161188118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c103710 msgr2=0x7f5d9c19f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c103710 0x7f5d9c19f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da15b3640 1 -- 172.21.15.12:0/1161188118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c19aca0 con 0x7f5d9c10c190 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da1db4640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c103710 0x7f5d9c19f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.251+0000 7f5da25b5640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d9c10b460 0x7f5d9c10b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.252+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d9c10c190 0x7f5d9c10af20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000e9f0 tx=0x7f5d9000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.252+0000 7f5d9affd640 1 -- 172.21.15.12:0/1161188118 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000ccc0 con 0x7f5d9c10c190 2024-09-16T01:01:59.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.252+0000 7f5d9affd640 1 -- 172.21.15.12:0/1161188118 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d90010910 con 0x7f5d9c10c190 2024-09-16T01:01:59.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.252+0000 7f5da4018640 1 -- 172.21.15.12:0/1161188118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c19af90 con 0x7f5d9c10c190 2024-09-16T01:01:59.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.252+0000 7f5d9affd640 1 -- 172.21.15.12:0/1161188118 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90018960 con 0x7f5d9c10c190 2024-09-16T01:01:59.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.252+0000 7f5da4018640 1 -- 172.21.15.12:0/1161188118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c19b4d0 con 0x7f5d9c10c190 2024-09-16T01:01:59.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.256+0000 7f5da63f1740 1 Processor -- start 2024-09-16T01:01:59.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.256+0000 7f5da63f1740 1 -- start start 2024-09-16T01:01:59.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.256+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189ba760 0x55d8189bab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.256+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189bb080 0x55d8189c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d8189c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da63f1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d8189202a0 con 0x55d8189bb080 2024-09-16T01:01:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da63f1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d8188c7b10 con 0x55d8189ba760 2024-09-16T01:01:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da63f1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d81891c260 con 0x55d8189c5940 2024-09-16T01:01:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da1db4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189bb080 0x55d8189c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da25b5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189ba760 0x55d8189bab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da1db4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189bb080 0x55d8189c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42444/0 (socket says 172.21.15.12:42444) 2024-09-16T01:01:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da1db4640 1 -- 172.21.15.12:0/1205510427 learned_addr learned my addr 172.21.15.12:0/1205510427 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:59.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5d9affd640 1 -- 172.21.15.12:0/1161188118 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5d90010ac0 con 0x7f5d9c10c190 2024-09-16T01:01:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da25b5640 1 -- 172.21.15.12:0/1205510427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 msgr2=0x55d8189c7d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:01:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da25b5640 1 --2- 172.21.15.12:0/1205510427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d8189c7d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da25b5640 1 -- 172.21.15.12:0/1205510427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189bb080 msgr2=0x55d8189c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da25b5640 1 --2- 172.21.15.12:0/1205510427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189bb080 0x55d8189c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.257+0000 7f5da25b5640 1 -- 172.21.15.12:0/1205510427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d818691b90 con 0x55d8189ba760 2024-09-16T01:01:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.258+0000 7f5da1db4640 1 --2- 172.21.15.12:0/1205510427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189bb080 0x55d8189c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.258+0000 7f5da25b5640 1 --2- 172.21.15.12:0/1205510427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189ba760 0x55d8189bab40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d94010710 tx=0x7f5d94010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d20c7c449b36613f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.258+0000 7f5d9affd640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5d840a3240 0x7f5d840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.258+0000 7f5d83fff640 1 -- 172.21.15.12:0/1205510427 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94004b20 con 0x55d8189ba760 2024-09-16T01:01:59.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.258+0000 7f5d83fff640 1 -- 172.21.15.12:0/1205510427 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d9400edb0 con 0x55d8189ba760 2024-09-16T01:01:59.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.258+0000 7f5d83fff640 1 -- 172.21.15.12:0/1205510427 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94005670 con 0x55d8189ba760 2024-09-16T01:01:59.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.259+0000 7f5da1db4640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5d840a3240 0x7f5d840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.259+0000 7f5da63f1740 1 -- 172.21.15.12:0/1205510427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189ba760 msgr2=0x55d8189bab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.259+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1205510427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189ba760 0x55d8189bab40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d94010710 tx=0x7f5d94010bd0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.259+0000 7f5da63f1740 1 -- 172.21.15.12:0/1205510427 shutdown_connections 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.259+0000 7f5d9affd640 1 -- 172.21.15.12:0/1161188118 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5d900d0060 con 0x7f5d9c10c190 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.259+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1205510427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d8189c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.259+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1205510427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189bb080 0x55d8189c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.259+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1205510427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189ba760 0x55d8189bab40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.259+0000 7f5da1db4640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5d840a3240 0x7f5d840a5700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55d8189b7b50 tx=0x7f5d8c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.259+0000 7f5da63f1740 1 -- 172.21.15.12:0/1205510427 >> 172.21.15.12:0/1205510427 conn(0x55d8189b6cf0 msgr2=0x55d8189b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.260+0000 7f5da63f1740 1 -- 172.21.15.12:0/1205510427 shutdown_connections 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.260+0000 7f5da63f1740 1 -- 172.21.15.12:0/1205510427 wait complete. 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.260+0000 7f5da63f1740 1 -- start start 2024-09-16T01:01:59.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.260+0000 7f5da63f1740 1 Processor -- start 2024-09-16T01:01:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d8189c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da1db4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da1db4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42450/0 (socket says 172.21.15.12:42450) 2024-09-16T01:01:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da63f1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d8189c8510 con 0x55d8189ba760 2024-09-16T01:01:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da1db4640 1 -- 172.21.15.12:0/673386079 learned_addr learned my addr 172.21.15.12:0/673386079 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da63f1740 1 -- 172.21.15.12:0/673386079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d8188a86e0 con 0x55d8189bb080 2024-09-16T01:01:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da63f1740 1 -- 172.21.15.12:0/673386079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d8189c8690 con 0x55d8189c5940 2024-09-16T01:01:59.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da63f1740 10 client.0 _ll_register_callbacks cb 0x55d8188cca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da25b5640 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d8189c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.261+0000 7f5da15b3640 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.262+0000 7f5da1db4640 1 -- 172.21.15.12:0/673386079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 msgr2=0x55d8189c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.262+0000 7f5da1db4640 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d8189c32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.262+0000 7f5da1db4640 1 -- 172.21.15.12:0/673386079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 msgr2=0x55d8189c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.262+0000 7f5da1db4640 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189c2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.262+0000 7f5da1db4640 1 -- 172.21.15.12:0/673386079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8189d1a60 con 0x55d8189ba760 2024-09-16T01:01:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.262+0000 7f5da1db4640 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c2850 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0316a0 tx=0x7f5d8c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380a7db8115e3bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:59.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.262+0000 7f5d817fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.262+0000 7f5d817fa640 1 -- 172.21.15.12:0/673386079 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c04d070 con 0x55d8189ba760 2024-09-16T01:01:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.262+0000 7f5da63f1740 1 -- 172.21.15.12:0/673386079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d9400edb0 con 0x55d8189ba760 2024-09-16T01:01:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.262+0000 7f5d817fa640 1 -- 172.21.15.12:0/673386079 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5d8c003b80 con 0x55d8189ba760 2024-09-16T01:01:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5d817fa640 1 -- 172.21.15.12:0/673386079 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d8c05b050 con 0x55d8189ba760 2024-09-16T01:01:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5da63f1740 10 client.15606 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5da63f1740 1 -- 172.21.15.12:0/673386079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8189d4440 con 0x55d8189ba760 2024-09-16T01:01:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5d817fa640 1 -- 172.21.15.12:0/673386079 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d9400edb0 con 0x55d8189ba760 2024-09-16T01:01:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5d817fa640 1 -- 172.21.15.12:0/673386079 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5d8c03d450 con 0x55d8189ba760 2024-09-16T01:01:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5da63f1740 10 client.15606 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:59.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5da63f1740 10 client.15606 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5da63f1740 20 client.15606 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5da63f1740 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d8189d5c30 0x55d8189d8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5da63f1740 4 client.15606 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.263+0000 7f5da63f1740 1 -- 172.21.15.12:0/673386079 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d81892d9d0 con 0x55d8189d5c30 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.264+0000 7f5da15b3640 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d8189d5c30 0x55d8189d8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.264+0000 7f5d817fa640 10 client.15606 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.264+0000 7f5da15b3640 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d8189d5c30 0x55d8189d8050 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe69d4583244822f server_cookie=838ef435ae4c4a74 in_seq=0 out_seq=0 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5d817fa640 1 -- 172.21.15.12:0/673386079 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d81892d9d0 con 0x55d8189d5c30 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5d817fa640 10 client.15606 handle_command_reply: tid=0 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 client.15606 shutdown 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 -- 172.21.15.12:0/673386079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 msgr2=0x55d8189c2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c2850 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0316a0 tx=0x7f5d8c009260 comp rx=0 tx=0).stop 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 -- 172.21.15.12:0/673386079 shutdown_connections 2024-09-16T01:01:59.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d8189d5c30 0x55d8189d8050 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d8189c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5d817fa640 0 client.15606 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 --2- 172.21.15.12:0/673386079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c2850 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 -- 172.21.15.12:0/673386079 >> 172.21.15.12:0/673386079 conn(0x55d8189b6cf0 msgr2=0x55d8189bca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 -- 172.21.15.12:0/673386079 shutdown_connections 2024-09-16T01:01:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 1 -- 172.21.15.12:0/673386079 wait complete. 2024-09-16T01:01:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.265+0000 7f5da63f1740 20 client.15606 trim_cache size 0 max 16384 2024-09-16T01:01:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:59.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.299+0000 7f5da63f1740 1 Processor -- start 2024-09-16T01:01:59.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.299+0000 7f5da63f1740 1 -- start start 2024-09-16T01:01:59.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.299+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189ba760 0x55d8189dd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.299+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189ddea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.299+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189c5940 0x55d8189bfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.299+0000 7f5da63f1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1bded0 con 0x55d8189c5940 2024-09-16T01:01:59.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.299+0000 7f5da63f1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1bfa10 con 0x55d8189bb080 2024-09-16T01:01:59.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.299+0000 7f5da63f1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1be5a0 con 0x55d8189ba760 2024-09-16T01:01:59.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da15b3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189ddea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da15b3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189ddea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:42938/0 (socket says 172.21.15.12:42938) 2024-09-16T01:01:59.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da15b3640 1 -- 172.21.15.12:0/1445759995 learned_addr learned my addr 172.21.15.12:0/1445759995 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:59.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da25b5640 1 --2- 172.21.15.12:0/1445759995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189c5940 0x55d8189bfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da1db4640 1 --2- 172.21.15.12:0/1445759995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189ba760 0x55d8189dd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da15b3640 1 -- 172.21.15.12:0/1445759995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189ba760 msgr2=0x55d8189dd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:59.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1445759995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189ba760 0x55d8189dd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da15b3640 1 -- 172.21.15.12:0/1445759995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189c5940 msgr2=0x55d8189bfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:59.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1445759995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189c5940 0x55d8189bfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da15b3640 1 -- 172.21.15.12:0/1445759995 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8189b6b20 con 0x55d8189bb080 2024-09-16T01:01:59.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.300+0000 7f5da25b5640 1 --2- 172.21.15.12:0/1445759995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189c5940 0x55d8189bfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:59.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.301+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1445759995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189ddea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d900cd7a0 tx=0x7f5d900cd670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e445b25ba672baf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:59.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.301+0000 7f5d837fe640 1 -- 172.21.15.12:0/1445759995 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9009a670 con 0x55d8189bb080 2024-09-16T01:01:59.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.301+0000 7f5d837fe640 1 -- 172.21.15.12:0/1445759995 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d900cd8b0 con 0x55d8189bb080 2024-09-16T01:01:59.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.301+0000 7f5d837fe640 1 -- 172.21.15.12:0/1445759995 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900bc0b0 con 0x55d8189bb080 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.302+0000 7f5da63f1740 1 -- 172.21.15.12:0/1445759995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 msgr2=0x55d8189ddea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.302+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1445759995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189ddea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d900cd7a0 tx=0x7f5d900cd670 comp rx=0 tx=0).stop 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.302+0000 7f5da63f1740 1 -- 172.21.15.12:0/1445759995 shutdown_connections 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.302+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1445759995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189c5940 0x55d8189bfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.302+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1445759995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189ddea0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.302+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1445759995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189ba760 0x55d8189dd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.302+0000 7f5da63f1740 1 -- 172.21.15.12:0/1445759995 >> 172.21.15.12:0/1445759995 conn(0x55d8189b6cf0 msgr2=0x55d8189bca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.302+0000 7f5da63f1740 1 -- 172.21.15.12:0/1445759995 shutdown_connections 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.302+0000 7f5da63f1740 1 -- 172.21.15.12:0/1445759995 wait complete. 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.303+0000 7f5da63f1740 1 -- start start 2024-09-16T01:01:59.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.303+0000 7f5da63f1740 1 Processor -- start 2024-09-16T01:01:59.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.303+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.303+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.303+0000 7f5da63f1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d818a3f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.303+0000 7f5da63f1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1bf340 con 0x55d8189ba760 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da63f1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1bec70 con 0x55d8189bb080 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da63f1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1bbeb0 con 0x55d8189c5940 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da63f1740 10 client.0 _ll_register_callbacks cb 0x7f5d8c009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da1db4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da1db4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42464/0 (socket says 172.21.15.12:42464) 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da1db4640 1 -- 172.21.15.12:0/1083587597 learned_addr learned my addr 172.21.15.12:0/1083587597 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da25b5640 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d818a3f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da1db4640 1 -- 172.21.15.12:0/1083587597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 msgr2=0x55d818a3f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da1db4640 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d818a3f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da1db4640 1 -- 172.21.15.12:0/1083587597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 msgr2=0x55d8189c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:59.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da1db4640 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da1db4640 1 -- 172.21.15.12:0/1083587597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8189b2260 con 0x55d8189ba760 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5da1db4640 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c9a00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c03da10 tx=0x7f5d8c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dd0e4e883904a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.304+0000 7f5d817fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.305+0000 7f5d817fa640 1 -- 172.21.15.12:0/1083587597 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c063020 con 0x55d8189ba760 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.305+0000 7f5d817fa640 1 -- 172.21.15.12:0/1083587597 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5d8c03da90 con 0x55d8189ba760 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.305+0000 7f5da63f1740 1 -- 172.21.15.12:0/1083587597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d900cd8b0 con 0x55d8189ba760 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.305+0000 7f5d817fa640 1 -- 172.21.15.12:0/1083587597 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d8c06e050 con 0x55d8189ba760 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.305+0000 7f5da63f1740 10 client.15612 fetch_fsmap learned FSMap version 29 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.305+0000 7f5da63f1740 1 -- 172.21.15.12:0/1083587597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d818a40d50 con 0x55d8189ba760 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.306+0000 7f5d817fa640 1 -- 172.21.15.12:0/1083587597 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d900cd8b0 con 0x55d8189ba760 2024-09-16T01:01:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.306+0000 7f5d817fa640 1 -- 172.21.15.12:0/1083587597 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5d8c005400 con 0x55d8189ba760 2024-09-16T01:01:59.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.306+0000 7f5da63f1740 10 client.15612 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:01:59.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.306+0000 7f5da63f1740 10 client.15612 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:01:59.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.306+0000 7f5da63f1740 20 client.15612 populate_metadata read hostname 'smithi012' 2024-09-16T01:01:59.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.306+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d818a41560 0x55d818a43980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.306+0000 7f5da63f1740 4 client.15612 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.2, "await_for": 45.0}] 2024-09-16T01:01:59.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.306+0000 7f5da63f1740 1 -- 172.21.15.12:0/1083587597 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.2, "await_for": 45.0}) -- 0x55d818927d20 con 0x55d818a41560 2024-09-16T01:01:59.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.306+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d818a41560 0x55d818a43980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.307+0000 7f5da15b3640 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d818a41560 0x55d818a43980 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc0360931368332f server_cookie=286a4f83956bf344 in_seq=0 out_seq=0 2024-09-16T01:01:59.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.307+0000 7f5d817fa640 10 client.15612 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:59.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.313+0000 7f5d817fa640 1 -- 172.21.15.12:0/1083587597 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d818927d20 con 0x55d818a41560 2024-09-16T01:01:59.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5d817fa640 10 client.15612 handle_command_reply: tid=0 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 client.15612 shutdown 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 -- 172.21.15.12:0/1083587597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 msgr2=0x55d8189c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c9a00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c03da10 tx=0x7f5d8c005bd0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 -- 172.21.15.12:0/1083587597 shutdown_connections 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55d818a41560 0x55d818a43980 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d8189c5940 0x55d818a3f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d8189bb080 0x55d8189c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 --2- 172.21.15.12:0/1083587597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8189ba760 0x55d8189c9a00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5d817fa640 0 client.15612 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 -- 172.21.15.12:0/1083587597 >> 172.21.15.12:0/1083587597 conn(0x55d8189b6cf0 msgr2=0x55d8189b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 -- 172.21.15.12:0/1083587597 shutdown_connections 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 1 -- 172.21.15.12:0/1083587597 wait complete. 2024-09-16T01:01:59.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.314+0000 7f5da63f1740 20 client.15612 trim_cache size 0 max 16384 2024-09-16T01:01:59.318 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:01:59.318 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 29, 2024-09-16T01:01:59.318 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24518, 2024-09-16T01:01:59.318 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 2, 2024-09-16T01:01:59.318 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-16T01:01:59.318 INFO:teuthology.orchestra.run.smithi012.stdout: "1ec91d52": { 2024-09-16T01:01:59.318 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 2, 2024-09-16T01:01:59.318 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-16T01:01:59.318 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-16T01:01:59.318 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 150.2, 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:01:59.319 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:01:59.320 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:01:59.320 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:01:59.320 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:01:59.320 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:01:59.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 -- 172.21.15.12:0/1161188118 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5d840a3240 msgr2=0x7f5d840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5d840a3240 0x7f5d840a5700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55d8189b7b50 tx=0x7f5d8c0058d0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 -- 172.21.15.12:0/1161188118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d9c10c190 msgr2=0x7f5d9c10af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d9c10c190 0x7f5d9c10af20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000e9f0 tx=0x7f5d9000eeb0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 -- 172.21.15.12:0/1161188118 shutdown_connections 2024-09-16T01:01:59.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5d840a3240 0x7f5d840a5700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d9c10b460 0x7f5d9c10b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d9c10c190 0x7f5d9c10af20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 --2- 172.21.15.12:0/1161188118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c103710 0x7f5d9c19f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 -- 172.21.15.12:0/1161188118 >> 172.21.15.12:0/1161188118 conn(0x7f5d9c0fc7d0 msgr2=0x7f5d9c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:59.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 -- 172.21.15.12:0/1161188118 shutdown_connections 2024-09-16T01:01:59.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:01:59.315+0000 7f5da4018640 1 -- 172.21.15.12:0/1161188118 wait complete. 2024-09-16T01:02:00.203 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:00 smithi012 ceph-mon[31197]: pgmap v387: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:02:00.238 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1ec91d52', quiesce took 9.6 seconds. Will release after: 20.6 2024-09-16T01:02:00.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:00 smithi119 ceph-mon[35049]: pgmap v387: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:02:00.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.422+0000 7fa4c771a640 1 -- 172.21.15.12:0/1040846834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c0106a60 msgr2=0x7fa4c0106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.422+0000 7fa4c771a640 1 --2- 172.21.15.12:0/1040846834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c0106a60 0x7fa4c0106e40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009930 tx=0x7fa4bc02a420 comp rx=0 tx=0).stop 2024-09-16T01:02:00.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.422+0000 7fa4c771a640 1 -- 172.21.15.12:0/1040846834 shutdown_connections 2024-09-16T01:02:00.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.422+0000 7fa4c771a640 1 --2- 172.21.15.12:0/1040846834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c0101400 0x7fa4c010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.422+0000 7fa4c771a640 1 --2- 172.21.15.12:0/1040846834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c0100a60 0x7fa4c0100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.422+0000 7fa4c771a640 1 --2- 172.21.15.12:0/1040846834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c0106a60 0x7fa4c0106e40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.422+0000 7fa4c771a640 1 -- 172.21.15.12:0/1040846834 >> 172.21.15.12:0/1040846834 conn(0x7fa4c00fc780 msgr2=0x7fa4c00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:00.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.422+0000 7fa4c771a640 1 -- 172.21.15.12:0/1040846834 shutdown_connections 2024-09-16T01:02:00.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.423+0000 7fa4c771a640 1 -- 172.21.15.12:0/1040846834 wait complete. 2024-09-16T01:02:00.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.423+0000 7fa4c771a640 1 Processor -- start 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.423+0000 7fa4c771a640 1 -- start start 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c771a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c0100a60 0x7fa4c01079d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c771a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c0101400 0x7fa4c0107f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c771a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c0106a60 0x7fa4c0108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c771a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c0110e60 con 0x7fa4c0106a60 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c771a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c0110ce0 con 0x7fa4c0101400 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c771a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c0110fe0 con 0x7fa4c0100a60 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c54b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c0100a60 0x7fa4c01079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c54b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c0100a60 0x7fa4c01079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:36190/0 (socket says 172.21.15.12:36190) 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c54b6640 1 -- 172.21.15.12:0/1202166434 learned_addr learned my addr 172.21.15.12:0/1202166434 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c5cb7640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c0106a60 0x7fa4c0108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c0101400 0x7fa4c0107f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c5cb7640 1 -- 172.21.15.12:0/1202166434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c0100a60 msgr2=0x7fa4c01079d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c5cb7640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c0100a60 0x7fa4c01079d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c5cb7640 1 -- 172.21.15.12:0/1202166434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c0101400 msgr2=0x7fa4c0107f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c5cb7640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c0101400 0x7fa4c0107f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c5cb7640 1 -- 172.21.15.12:0/1202166434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c01a68b0 con 0x7fa4c0106a60 2024-09-16T01:02:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.424+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c0100a60 0x7fa4c01079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.425+0000 7fa4c5cb7640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c0106a60 0x7fa4c0108450 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800cab0 tx=0x7fa4b800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.425+0000 7fa4b67fc640 1 -- 172.21.15.12:0/1202166434 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800ae20 con 0x7fa4c0106a60 2024-09-16T01:02:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.425+0000 7fa4b67fc640 1 -- 172.21.15.12:0/1202166434 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4b800f930 con 0x7fa4c0106a60 2024-09-16T01:02:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.425+0000 7fa4b67fc640 1 -- 172.21.15.12:0/1202166434 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8018b30 con 0x7fa4c0106a60 2024-09-16T01:02:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.425+0000 7fa4c771a640 1 -- 172.21.15.12:0/1202166434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c01a6ba0 con 0x7fa4c0106a60 2024-09-16T01:02:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.425+0000 7fa4c771a640 1 -- 172.21.15.12:0/1202166434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c01a70e0 con 0x7fa4c0106a60 2024-09-16T01:02:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.427+0000 7fa4b67fc640 1 -- 172.21.15.12:0/1202166434 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa4b800fae0 con 0x7fa4c0106a60 2024-09-16T01:02:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.428+0000 7fa4b67fc640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4ac0a32c0 0x7fa4ac0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.428+0000 7fa4b67fc640 1 -- 172.21.15.12:0/1202166434 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa4b80d0270 con 0x7fa4c0106a60 2024-09-16T01:02:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.428+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4ac0a32c0 0x7fa4ac0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c9af3740 1 Processor -- start 2024-09-16T01:02:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c9af3740 1 -- start start 2024-09-16T01:02:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4ac0a32c0 0x7fa4ac0a5780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc000c00 tx=0x7fa4bc009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e00b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 0x55f70e018760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f70df712f0 con 0x55f70e00b5d0 2024-09-16T01:02:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f70df18cf0 con 0x55f70e00cb40 2024-09-16T01:02:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f70df6d2b0 con 0x55f70e016370 2024-09-16T01:02:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c4cb5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c4cb5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e00ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42488/0 (socket says 172.21.15.12:42488) 2024-09-16T01:02:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c4cb5640 1 -- 172.21.15.12:0/3524311652 learned_addr learned my addr 172.21.15.12:0/3524311652 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.429+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/3524311652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e00b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4c5cb7640 1 --2- 172.21.15.12:0/3524311652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 0x55f70e018760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4c4cb5640 1 -- 172.21.15.12:0/3524311652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 msgr2=0x55f70e018760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/3524311652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 0x55f70e018760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4c4cb5640 1 -- 172.21.15.12:0/3524311652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 msgr2=0x55f70e00b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/3524311652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e00b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4c4cb5640 1 -- 172.21.15.12:0/3524311652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70defd3a0 con 0x55f70e00b5d0 2024-09-16T01:02:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4c5cb7640 1 --2- 172.21.15.12:0/3524311652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 0x55f70e018760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/3524311652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e00ba10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000bcb0 tx=0x7fa4b00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5627da2ccc2b76fb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4ab7fe640 1 -- 172.21.15.12:0/3524311652 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0004030 con 0x55f70e00b5d0 2024-09-16T01:02:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4ab7fe640 1 -- 172.21.15.12:0/3524311652 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4b00041d0 con 0x55f70e00b5d0 2024-09-16T01:02:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.430+0000 7fa4ab7fe640 1 -- 172.21.15.12:0/3524311652 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0011800 con 0x55f70e00b5d0 2024-09-16T01:02:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.431+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3524311652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 msgr2=0x55f70e00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.431+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/3524311652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e00ba10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000bcb0 tx=0x7fa4b00107a0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.431+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3524311652 shutdown_connections 2024-09-16T01:02:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.431+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/3524311652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 0x55f70e018760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.431+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/3524311652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e00ba10 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.431+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/3524311652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e00b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.431+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3524311652 >> 172.21.15.12:0/3524311652 conn(0x55f70dfd4310 msgr2=0x55f70e007c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.431+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3524311652 shutdown_connections 2024-09-16T01:02:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.431+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3524311652 wait complete. 2024-09-16T01:02:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.432+0000 7fa4c9af3740 1 -- start start 2024-09-16T01:02:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.432+0000 7fa4c9af3740 1 Processor -- start 2024-09-16T01:02:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.432+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e015db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.432+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e013060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 0x55f70e0137f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f70e019070 con 0x55f70e00b5d0 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f70df2c060 con 0x55f70e00cb40 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f70e0191f0 con 0x55f70e016370 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c54b6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e015db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c54b6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e015db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42490/0 (socket says 172.21.15.12:42490) 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c54b6640 1 -- 172.21.15.12:0/77164603 learned_addr learned my addr 172.21.15.12:0/77164603 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e013060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c5cb7640 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 0x55f70e0137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c9af3740 10 client.0 _ll_register_callbacks cb 0x55f70dc7f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c54b6640 1 -- 172.21.15.12:0/77164603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 msgr2=0x55f70e0137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 0x55f70e0137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c54b6640 1 -- 172.21.15.12:0/77164603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 msgr2=0x55f70e013060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e013060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c54b6640 1 -- 172.21.15.12:0/77164603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70dce23c0 con 0x55f70e00b5d0 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e013060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c5cb7640 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 0x55f70e0137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e015db0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0042c0 tx=0x7fa4bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed9a5814a9c83d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.433+0000 7fa4a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.434+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/77164603 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc035040 con 0x55f70e00b5d0 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.434+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/77164603 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa4bc003b70 con 0x55f70e00b5d0 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.434+0000 7fa4c9af3740 1 -- 172.21.15.12:0/77164603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4b00041d0 con 0x55f70e00b5d0 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.434+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/77164603 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa4bc003d70 con 0x55f70e00b5d0 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.434+0000 7fa4c9af3740 10 client.15624 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:00.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.434+0000 7fa4c9af3740 1 -- 172.21.15.12:0/77164603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f70e024b20 con 0x55f70e00b5d0 2024-09-16T01:02:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.434+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/77164603 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4b00041d0 con 0x55f70e00b5d0 2024-09-16T01:02:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.434+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/77164603 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa4bc052550 con 0x55f70e00b5d0 2024-09-16T01:02:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.434+0000 7fa4c9af3740 10 client.15624 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.434+0000 7fa4c9af3740 10 client.15624 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-16T01:02:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.435+0000 7fa4c9af3740 20 client.15624 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.435+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f70e025fe0 0x55f70e0284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.435+0000 7fa4c9af3740 4 client.15624 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.435+0000 7fa4c9af3740 1 -- 172.21.15.12:0/77164603 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f70df7e860 con 0x55f70e025fe0 2024-09-16T01:02:00.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.435+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f70e025fe0 0x55f70e0284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.436+0000 7fa4a8ff9640 10 client.15624 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.436+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f70e025fe0 0x55f70e0284a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d2e5cf8c8fa64cee server_cookie=afa10430a9b2c8dc in_seq=0 out_seq=0 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.436+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/77164603 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f70df7e860 con 0x55f70e025fe0 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.436+0000 7fa4a8ff9640 10 client.15624 handle_command_reply: tid=0 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.436+0000 7fa4c9af3740 1 client.15624 shutdown 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 1 -- 172.21.15.12:0/77164603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 msgr2=0x55f70e015db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e015db0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0042c0 tx=0x7fa4bc009260 comp rx=0 tx=0).stop 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 1 -- 172.21.15.12:0/77164603 shutdown_connections 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f70e025fe0 0x55f70e0284a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e016370 0x55f70e0137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e013060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/77164603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e00b5d0 0x55f70e015db0 secure :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0042c0 tx=0x7fa4bc009260 comp rx=0 tx=0).stop 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 1 -- 172.21.15.12:0/77164603 >> 172.21.15.12:0/77164603 conn(0x55f70dfd4310 msgr2=0x55f70e00d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:00.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4a8ff9640 0 client.15624 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 1 -- 172.21.15.12:0/77164603 shutdown_connections 2024-09-16T01:02:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 1 -- 172.21.15.12:0/77164603 wait complete. 2024-09-16T01:02:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.437+0000 7fa4c9af3740 20 client.15624 trim_cache size 0 max 16384 2024-09-16T01:02:00.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.450+0000 7fa4c9af3740 1 Processor -- start 2024-09-16T01:02:00.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.450+0000 7fa4c9af3740 1 -- start start 2024-09-16T01:02:00.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.450+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e00cb40 0x55f70e00c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 0x55f70e011950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e011e90 0x55f70e007700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01b0d90 con 0x55f70e016370 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01b28d0 con 0x55f70e011e90 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01b1460 con 0x55f70e00cb40 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c4cb5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 0x55f70e011950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c54b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e00cb40 0x55f70e00c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c54b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e00cb40 0x55f70e00c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:36208/0 (socket says 172.21.15.12:36208) 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c54b6640 1 -- 172.21.15.12:0/2482090831 learned_addr learned my addr 172.21.15.12:0/2482090831 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c5cb7640 1 --2- 172.21.15.12:0/2482090831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e011e90 0x55f70e007700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c54b6640 1 -- 172.21.15.12:0/2482090831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e011e90 msgr2=0x55f70e007700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/2482090831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e011e90 0x55f70e007700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c54b6640 1 -- 172.21.15.12:0/2482090831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 msgr2=0x55f70e011950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:00.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/2482090831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 0x55f70e011950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.451+0000 7fa4c54b6640 1 -- 172.21.15.12:0/2482090831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70e013b20 con 0x55f70e00cb40 2024-09-16T01:02:00.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.452+0000 7fa4c5cb7640 1 --2- 172.21.15.12:0/2482090831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e011e90 0x55f70e007700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:00.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.452+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/2482090831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 0x55f70e011950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:00.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.452+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/2482090831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e00cb40 0x55f70e00c300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0057a0 tx=0x7fa4bc005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f72b876eb8ff1f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:00.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.452+0000 7fa4aaffd640 1 -- 172.21.15.12:0/2482090831 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc035070 con 0x55f70e00cb40 2024-09-16T01:02:00.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.452+0000 7fa4aaffd640 1 -- 172.21.15.12:0/2482090831 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4bc003bc0 con 0x55f70e00cb40 2024-09-16T01:02:00.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.452+0000 7fa4aaffd640 1 -- 172.21.15.12:0/2482090831 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc004940 con 0x55f70e00cb40 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.453+0000 7fa4c9af3740 1 -- 172.21.15.12:0/2482090831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e00cb40 msgr2=0x55f70e00c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.453+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/2482090831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e00cb40 0x55f70e00c300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0057a0 tx=0x7fa4bc005c90 comp rx=0 tx=0).stop 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.453+0000 7fa4c9af3740 1 -- 172.21.15.12:0/2482090831 shutdown_connections 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.453+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/2482090831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e011e90 0x55f70e007700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.453+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/2482090831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 0x55f70e011950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.453+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/2482090831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e00cb40 0x55f70e00c300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.453+0000 7fa4c9af3740 1 -- 172.21.15.12:0/2482090831 >> 172.21.15.12:0/2482090831 conn(0x55f70dfd4310 msgr2=0x55f70e002a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.453+0000 7fa4c9af3740 1 -- 172.21.15.12:0/2482090831 shutdown_connections 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.453+0000 7fa4c9af3740 1 -- 172.21.15.12:0/2482090831 wait complete. 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.454+0000 7fa4c9af3740 1 -- start start 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.454+0000 7fa4c9af3740 1 Processor -- start 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.454+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e01e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.454+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e011e90 0x55f70e01ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.454+0000 7fa4c9af3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 0x55f70e00f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.454+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01b2200 con 0x55f70e016370 2024-09-16T01:02:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.454+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01b1b30 con 0x55f70e00cb40 2024-09-16T01:02:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.454+0000 7fa4c9af3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01aed70 con 0x55f70e011e90 2024-09-16T01:02:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.454+0000 7fa4c9af3740 10 client.0 _ll_register_callbacks cb 0x7fa4bc031920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c5cb7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 0x55f70e00f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c5cb7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 0x55f70e00f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42508/0 (socket says 172.21.15.12:42508) 2024-09-16T01:02:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c5cb7640 1 -- 172.21.15.12:0/3213963241 learned_addr learned my addr 172.21.15.12:0/3213963241 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e011e90 0x55f70e01ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e01e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c4cb5640 1 -- 172.21.15.12:0/3213963241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 msgr2=0x55f70e01e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e01e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c4cb5640 1 -- 172.21.15.12:0/3213963241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 msgr2=0x55f70e00f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 0x55f70e00f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c4cb5640 1 -- 172.21.15.12:0/3213963241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70e0100f0 con 0x55f70e011e90 2024-09-16T01:02:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4c4cb5640 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e011e90 0x55f70e01ec10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0011010 tx=0x7fa4b0003f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebe2a14ba810066b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.455+0000 7fa4a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-16T01:02:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.456+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/3213963241 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b002c020 con 0x55f70e011e90 2024-09-16T01:02:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.456+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/3213963241 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa4b0005240 con 0x55f70e011e90 2024-09-16T01:02:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.456+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3213963241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4bc003bc0 con 0x55f70e011e90 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.456+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/3213963241 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa4b0005440 con 0x55f70e011e90 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.456+0000 7fa4c9af3740 10 client.25210 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.456+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3213963241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f70e090860 con 0x55f70e011e90 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.457+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/3213963241 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4b00055e0 con 0x55f70e011e90 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.457+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/3213963241 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa4b00296f0 con 0x55f70e011e90 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.457+0000 7fa4c9af3740 10 client.25210 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.457+0000 7fa4c9af3740 10 client.25210 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.457+0000 7fa4c9af3740 20 client.25210 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.457+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f70e090ea0 0x55f70e0932c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.457+0000 7fa4c9af3740 4 client.25210 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.457+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3213963241 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa4bc003bc0 con 0x55f70e090ea0 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.457+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f70e090ea0 0x55f70e0932c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4a8ff9640 10 client.25210 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4c54b6640 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f70e090ea0 0x55f70e0932c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7f7a61d679aed84 server_cookie=2763ebd2848f8e0d in_seq=0 out_seq=0 2024-09-16T01:02:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4a8ff9640 1 -- 172.21.15.12:0/3213963241 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa4bc003bc0 con 0x55f70e090ea0 2024-09-16T01:02:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4a8ff9640 10 client.25210 handle_command_reply: tid=0 2024-09-16T01:02:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4c9af3740 1 client.25210 shutdown 2024-09-16T01:02:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3213963241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e011e90 msgr2=0x55f70e01ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e011e90 0x55f70e01ec10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0011010 tx=0x7fa4b0003f20 comp rx=0 tx=0).stop 2024-09-16T01:02:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:00 smithi098 ceph-mon[35346]: pgmap v387: 129 pgs: 129 active+clean; 657 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:02:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3213963241 shutdown_connections 2024-09-16T01:02:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f70e090ea0 0x55f70e0932c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70e016370 0x55f70e00f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f70e011e90 0x55f70e01ec10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4c9af3740 1 --2- 172.21.15.12:0/3213963241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f70e00cb40 0x55f70e01e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.458+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3213963241 >> 172.21.15.12:0/3213963241 conn(0x55f70dfd4310 msgr2=0x55f70e007700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.459+0000 7fa4a8ff9640 0 client.25210 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.459+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3213963241 shutdown_connections 2024-09-16T01:02:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.459+0000 7fa4c9af3740 1 -- 172.21.15.12:0/3213963241 wait complete. 2024-09-16T01:02:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.459+0000 7fa4c9af3740 20 client.25210 trim_cache size 0 max 16384 2024-09-16T01:02:00.464 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.460+0000 7fa4c771a640 1 -- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4ac0a32c0 msgr2=0x7fa4ac0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.460+0000 7fa4c771a640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4ac0a32c0 0x7fa4ac0a5780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc000c00 tx=0x7fa4bc009560 comp rx=0 tx=0).stop 2024-09-16T01:02:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.460+0000 7fa4c771a640 1 -- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c0106a60 msgr2=0x7fa4c0108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.460+0000 7fa4c771a640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c0106a60 0x7fa4c0108450 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800cab0 tx=0x7fa4b800cf70 comp rx=0 tx=0).stop 2024-09-16T01:02:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.460+0000 7fa4c771a640 1 -- 172.21.15.12:0/1202166434 shutdown_connections 2024-09-16T01:02:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.460+0000 7fa4c771a640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa4ac0a32c0 0x7fa4ac0a5780 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.460+0000 7fa4c771a640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c0106a60 0x7fa4c0108450 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.460+0000 7fa4c771a640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c0101400 0x7fa4c0107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.460+0000 7fa4c771a640 1 --2- 172.21.15.12:0/1202166434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c0100a60 0x7fa4c01079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.460+0000 7fa4c771a640 1 -- 172.21.15.12:0/1202166434 >> 172.21.15.12:0/1202166434 conn(0x7fa4c00fc780 msgr2=0x7fa4c00fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.461+0000 7fa4c771a640 1 -- 172.21.15.12:0/1202166434 shutdown_connections 2024-09-16T01:02:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:00.461+0000 7fa4c771a640 1 -- 172.21.15.12:0/1202166434 wait complete. 2024-09-16T01:02:01.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-16T01:02:01.509 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.015+0000 7fa155dc9640 1 -- 172.21.15.12:0/1650972669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa150103780 msgr2=0x7fa150107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.015+0000 7fa155dc9640 1 --2- 172.21.15.12:0/1650972669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa150103780 0x7fa150107bc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa144009930 tx=0x7fa14402a420 comp rx=0 tx=0).stop 2024-09-16T01:02:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.015+0000 7fa155dc9640 1 -- 172.21.15.12:0/1650972669 shutdown_connections 2024-09-16T01:02:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.015+0000 7fa155dc9640 1 --2- 172.21.15.12:0/1650972669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa150108300 0x7fa15010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.015+0000 7fa155dc9640 1 --2- 172.21.15.12:0/1650972669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa150103780 0x7fa150107bc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.015+0000 7fa155dc9640 1 --2- 172.21.15.12:0/1650972669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa150102dd0 0x7fa1501031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.015+0000 7fa155dc9640 1 -- 172.21.15.12:0/1650972669 >> 172.21.15.12:0/1650972669 conn(0x7fa1500fc7d0 msgr2=0x7fa1500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.016+0000 7fa155dc9640 1 -- 172.21.15.12:0/1650972669 shutdown_connections 2024-09-16T01:02:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.016+0000 7fa155dc9640 1 -- 172.21.15.12:0/1650972669 wait complete. 2024-09-16T01:02:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.017+0000 7fa155dc9640 1 Processor -- start 2024-09-16T01:02:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.017+0000 7fa155dc9640 1 -- start start 2024-09-16T01:02:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.018+0000 7fa155dc9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa150102dd0 0x7fa1501985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.018+0000 7fa155dc9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa150103780 0x7fa150198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.018+0000 7fa14f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa150102dd0 0x7fa1501985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.018+0000 7fa14effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa150103780 0x7fa150198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.018+0000 7fa14f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa150102dd0 0x7fa1501985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:43016/0 (socket says 172.21.15.12:43016) 2024-09-16T01:02:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.018+0000 7fa14f7fe640 1 -- 172.21.15.12:0/4115576045 learned_addr learned my addr 172.21.15.12:0/4115576045 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.018+0000 7fa155dc9640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa150108300 0x7fa15019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.018+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1501120c0 con 0x7fa150103780 2024-09-16T01:02:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.018+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa150111f40 con 0x7fa150102dd0 2024-09-16T01:02:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.018+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa150112240 con 0x7fa150108300 2024-09-16T01:02:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14f7fe640 1 -- 172.21.15.12:0/4115576045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa150108300 msgr2=0x7fa15019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14ffff640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa150108300 0x7fa15019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa150108300 0x7fa15019ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14f7fe640 1 -- 172.21.15.12:0/4115576045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa150103780 msgr2=0x7fa150198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa150103780 0x7fa150198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14f7fe640 1 -- 172.21.15.12:0/4115576045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15019d590 con 0x7fa150102dd0 2024-09-16T01:02:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14effd640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa150103780 0x7fa150198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14ffff640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa150108300 0x7fa15019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa150102dd0 0x7fa1501985e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa140011f50 tx=0x7fa140009610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14cff9640 1 -- 172.21.15.12:0/4115576045 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140015070 con 0x7fa150102dd0 2024-09-16T01:02:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15019d880 con 0x7fa150102dd0 2024-09-16T01:02:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa14cff9640 1 -- 172.21.15.12:0/4115576045 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa14000f440 con 0x7fa150102dd0 2024-09-16T01:02:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.019+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa150100960 con 0x7fa150102dd0 2024-09-16T01:02:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.020+0000 7fa14cff9640 1 -- 172.21.15.12:0/4115576045 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14000e620 con 0x7fa150102dd0 2024-09-16T01:02:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.023+0000 7fa1581a2740 1 Processor -- start 2024-09-16T01:02:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.023+0000 7fa1581a2740 1 -- start start 2024-09-16T01:02:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.023+0000 7fa14cff9640 1 -- 172.21.15.12:0/4115576045 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa14000f5f0 con 0x7fa150102dd0 2024-09-16T01:02:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.023+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x556121543090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.023+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561215435d0 0x556121543a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.023+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 0x556121550760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.023+0000 7fa1581a2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5561214a92f0 con 0x556121544b40 2024-09-16T01:02:02.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.023+0000 7fa1581a2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556121450cf0 con 0x5561215435d0 2024-09-16T01:02:02.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.023+0000 7fa1581a2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5561214a52b0 con 0x55612154e370 2024-09-16T01:02:02.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.023+0000 7fa14ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x556121543090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x556121543090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42538/0 (socket says 172.21.15.12:42538) 2024-09-16T01:02:02.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14ffff640 1 -- 172.21.15.12:0/2097819943 learned_addr learned my addr 172.21.15.12:0/2097819943 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:02.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14effd640 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 0x556121550760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561215435d0 0x556121543a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14ffff640 1 -- 172.21.15.12:0/2097819943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 msgr2=0x556121550760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:02.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14ffff640 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 0x556121550760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14ffff640 1 -- 172.21.15.12:0/2097819943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561215435d0 msgr2=0x556121543a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:02.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14cff9640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1380a3240 0x7fa1380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14ffff640 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561215435d0 0x556121543a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14ffff640 1 -- 172.21.15.12:0/2097819943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561214353a0 con 0x556121544b40 2024-09-16T01:02:02.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14effd640 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 0x556121550760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:02.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.024+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561215435d0 0x556121543a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.025+0000 7fa14effd640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1380a3240 0x7fa1380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.025+0000 7fa14ffff640 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x556121543090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa148009820 tx=0x7fa148009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326acf653b019adb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.025+0000 7fa14cff9640 1 -- 172.21.15.12:0/4115576045 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa1400cf890 con 0x7fa150102dd0 2024-09-16T01:02:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.025+0000 7fa14effd640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1380a3240 0x7fa1380a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa14402a940 tx=0x7fa144005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.027+0000 7fa135ffb640 1 -- 172.21.15.12:0/2097819943 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa148004d20 con 0x556121544b40 2024-09-16T01:02:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.028+0000 7fa135ffb640 1 -- 172.21.15.12:0/2097819943 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa148007c80 con 0x556121544b40 2024-09-16T01:02:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.028+0000 7fa135ffb640 1 -- 172.21.15.12:0/2097819943 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1480058d0 con 0x556121544b40 2024-09-16T01:02:02.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.029+0000 7fa1581a2740 1 -- 172.21.15.12:0/2097819943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 msgr2=0x556121543090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.029+0000 7fa1581a2740 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x556121543090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa148009820 tx=0x7fa148009ce0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.029+0000 7fa1581a2740 1 -- 172.21.15.12:0/2097819943 shutdown_connections 2024-09-16T01:02:02.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.029+0000 7fa1581a2740 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 0x556121550760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.029+0000 7fa1581a2740 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561215435d0 0x556121543a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.029+0000 7fa1581a2740 1 --2- 172.21.15.12:0/2097819943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x556121543090 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.029+0000 7fa1581a2740 1 -- 172.21.15.12:0/2097819943 >> 172.21.15.12:0/2097819943 conn(0x55612150c310 msgr2=0x55612153fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:02.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.029+0000 7fa1581a2740 1 -- 172.21.15.12:0/2097819943 shutdown_connections 2024-09-16T01:02:02.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.029+0000 7fa1581a2740 1 -- 172.21.15.12:0/2097819943 wait complete. 2024-09-16T01:02:02.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.029+0000 7fa1581a2740 1 -- start start 2024-09-16T01:02:02.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.030+0000 7fa1581a2740 1 Processor -- start 2024-09-16T01:02:02.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.030+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561215435d0 0x55612154dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.030+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x55612154afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.030+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612154e370 0x55612154b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa1581a2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556121551070 con 0x556121544b40 2024-09-16T01:02:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa14effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x55612154afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa14effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x55612154afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42544/0 (socket says 172.21.15.12:42544) 2024-09-16T01:02:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa14effd640 1 -- 172.21.15.12:0/2775820041 learned_addr learned my addr 172.21.15.12:0/2775820041 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa14ffff640 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612154e370 0x55612154b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561215435d0 0x55612154dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa1581a2740 1 -- 172.21.15.12:0/2775820041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556121464060 con 0x55612154e370 2024-09-16T01:02:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa1581a2740 1 -- 172.21.15.12:0/2775820041 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5561215511f0 con 0x5561215435d0 2024-09-16T01:02:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa14effd640 1 -- 172.21.15.12:0/2775820041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561215435d0 msgr2=0x55612154dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa14effd640 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561215435d0 0x55612154dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa14effd640 1 -- 172.21.15.12:0/2775820041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612154e370 msgr2=0x55612154b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa14effd640 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612154e370 0x55612154b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa14effd640 1 -- 172.21.15.12:0/2775820041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55612121a3c0 con 0x556121544b40 2024-09-16T01:02:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.031+0000 7fa1581a2740 10 client.0 _ll_register_callbacks cb 0x5561211b78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.032+0000 7fa1581a2740 1 -- 172.21.15.12:0/2775820041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa148007c80 con 0x556121544b40 2024-09-16T01:02:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.032+0000 7fa14effd640 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x55612154afc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa144009930 tx=0x7fa144009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222c6e831d65a138 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.032+0000 7fa12effd640 10 client.15639 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.032+0000 7fa12effd640 1 -- 172.21.15.12:0/2775820041 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144035040 con 0x556121544b40 2024-09-16T01:02:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.032+0000 7fa12effd640 1 -- 172.21.15.12:0/2775820041 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa144031b40 con 0x556121544b40 2024-09-16T01:02:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.033+0000 7fa12effd640 1 -- 172.21.15.12:0/2775820041 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa144031d80 con 0x556121544b40 2024-09-16T01:02:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.033+0000 7fa1581a2740 10 client.15639 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.033+0000 7fa1581a2740 1 -- 172.21.15.12:0/2775820041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55612155c920 con 0x556121544b40 2024-09-16T01:02:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.033+0000 7fa12effd640 1 -- 172.21.15.12:0/2775820041 <== mon.0 v2:172.21.15.12:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa144044030 con 0x556121544b40 2024-09-16T01:02:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.033+0000 7fa1581a2740 10 client.15639 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:02.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.033+0000 7fa1581a2740 10 client.15639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-16T01:02:02.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.033+0000 7fa1581a2740 20 client.15639 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:02.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.033+0000 7fa1581a2740 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55612155e220 0x5561215606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.033+0000 7fa1581a2740 4 client.15639 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:02.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.034+0000 7fa1581a2740 1 -- 172.21.15.12:0/2775820041 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561214b6860 con 0x55612155e220 2024-09-16T01:02:02.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.034+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55612155e220 0x5561215606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.034+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55612155e220 0x5561215606e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c1659571e2d99e2c server_cookie=9a05f4de92090d59 in_seq=0 out_seq=0 2024-09-16T01:02:02.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.034+0000 7fa12effd640 10 client.15639 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:02.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.035+0000 7fa12effd640 1 -- 172.21.15.12:0/2775820041 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5561214b6860 con 0x55612155e220 2024-09-16T01:02:02.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.035+0000 7fa12effd640 10 client.15639 handle_command_reply: tid=0 2024-09-16T01:02:02.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.035+0000 7fa1581a2740 1 client.15639 shutdown 2024-09-16T01:02:02.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.035+0000 7fa1581a2740 1 -- 172.21.15.12:0/2775820041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 msgr2=0x55612154afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.035+0000 7fa1581a2740 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x55612154afc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa144009930 tx=0x7fa144009260 comp rx=0 tx=0).stop 2024-09-16T01:02:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.035+0000 7fa1581a2740 1 -- 172.21.15.12:0/2775820041 shutdown_connections 2024-09-16T01:02:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.036+0000 7fa1581a2740 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55612155e220 0x5561215606e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.036+0000 7fa1581a2740 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612154e370 0x55612154b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.036+0000 7fa1581a2740 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556121544b40 0x55612154afc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.036+0000 7fa1581a2740 1 --2- 172.21.15.12:0/2775820041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561215435d0 0x55612154dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.036+0000 7fa1581a2740 1 -- 172.21.15.12:0/2775820041 >> 172.21.15.12:0/2775820041 conn(0x55612150c310 msgr2=0x556121545960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.036+0000 7fa12effd640 0 client.15639 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.036+0000 7fa1581a2740 1 -- 172.21.15.12:0/2775820041 shutdown_connections 2024-09-16T01:02:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.036+0000 7fa1581a2740 1 -- 172.21.15.12:0/2775820041 wait complete. 2024-09-16T01:02:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.036+0000 7fa1581a2740 20 client.15639 trim_cache size 0 max 16384 2024-09-16T01:02:02.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa1581a2740 1 Processor -- start 2024-09-16T01:02:02.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa1581a2740 1 -- start start 2024-09-16T01:02:02.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x55612155a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556121544b40 0x55612154af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612154e370 0x55612154b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa1581a2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1501acae0 con 0x5561215435d0 2024-09-16T01:02:02.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa1581a2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1501ae620 con 0x55612154e370 2024-09-16T01:02:02.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa1581a2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1501ad1b0 con 0x556121544b40 2024-09-16T01:02:02.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa14f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x55612155a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa14f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x55612155a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42558/0 (socket says 172.21.15.12:42558) 2024-09-16T01:02:02.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.058+0000 7fa14f7fe640 1 -- 172.21.15.12:0/1839879886 learned_addr learned my addr 172.21.15.12:0/1839879886 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:02.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa14effd640 1 --2- 172.21.15.12:0/1839879886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556121544b40 0x55612154af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa14ffff640 1 --2- 172.21.15.12:0/1839879886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612154e370 0x55612154b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa14f7fe640 1 -- 172.21.15.12:0/1839879886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556121544b40 msgr2=0x55612154af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:02.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/1839879886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556121544b40 0x55612154af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa14f7fe640 1 -- 172.21.15.12:0/1839879886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612154e370 msgr2=0x55612154b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:02.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/1839879886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612154e370 0x55612154b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa14f7fe640 1 -- 172.21.15.12:0/1839879886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556121560a50 con 0x5561215435d0 2024-09-16T01:02:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/1839879886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x55612155a310 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa140098520 tx=0x7fa140005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c341949d01f937 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa1357fa640 1 -- 172.21.15.12:0/1839879886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14001e040 con 0x5561215435d0 2024-09-16T01:02:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa1357fa640 1 -- 172.21.15.12:0/1839879886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1400a47c0 con 0x5561215435d0 2024-09-16T01:02:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.059+0000 7fa1357fa640 1 -- 172.21.15.12:0/1839879886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14009bdb0 con 0x5561215435d0 2024-09-16T01:02:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.060+0000 7fa1581a2740 1 -- 172.21.15.12:0/1839879886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 msgr2=0x55612155a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.060+0000 7fa1581a2740 1 --2- 172.21.15.12:0/1839879886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x55612155a310 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa140098520 tx=0x7fa140005880 comp rx=0 tx=0).stop 2024-09-16T01:02:02.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.060+0000 7fa1581a2740 1 -- 172.21.15.12:0/1839879886 shutdown_connections 2024-09-16T01:02:02.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.060+0000 7fa1581a2740 1 --2- 172.21.15.12:0/1839879886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612154e370 0x55612154b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.060+0000 7fa1581a2740 1 --2- 172.21.15.12:0/1839879886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556121544b40 0x55612154af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.060+0000 7fa1581a2740 1 --2- 172.21.15.12:0/1839879886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x55612155a310 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.061+0000 7fa1581a2740 1 -- 172.21.15.12:0/1839879886 >> 172.21.15.12:0/1839879886 conn(0x55612150c310 msgr2=0x5561215462c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.061+0000 7fa1581a2740 1 -- 172.21.15.12:0/1839879886 shutdown_connections 2024-09-16T01:02:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.061+0000 7fa1581a2740 1 -- 172.21.15.12:0/1839879886 wait complete. 2024-09-16T01:02:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.061+0000 7fa1581a2740 1 -- start start 2024-09-16T01:02:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.061+0000 7fa1581a2740 1 Processor -- start 2024-09-16T01:02:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.061+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x556121556480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.061+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556121544b40 0x5561215569c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa1581a2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 0x5561215473f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa1581a2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1501adf50 con 0x5561215435d0 2024-09-16T01:02:02.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa1581a2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1501ad880 con 0x556121544b40 2024-09-16T01:02:02.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa1581a2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1501aab10 con 0x55612154e370 2024-09-16T01:02:02.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x556121556480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa1581a2740 10 client.0 _ll_register_callbacks cb 0x7fa144005d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:02.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x556121556480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42560/0 (socket says 172.21.15.12:42560) 2024-09-16T01:02:02.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14f7fe640 1 -- 172.21.15.12:0/1084775136 learned_addr learned my addr 172.21.15.12:0/1084775136 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:02.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14effd640 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556121544b40 0x5561215569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14ffff640 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 0x5561215473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14effd640 1 -- 172.21.15.12:0/1084775136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 msgr2=0x5561215473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:02.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14effd640 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 0x5561215473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14effd640 1 -- 172.21.15.12:0/1084775136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 msgr2=0x556121556480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14effd640 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x556121556480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14effd640 1 -- 172.21.15.12:0/1084775136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556121547930 con 0x556121544b40 2024-09-16T01:02:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.062+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x556121556480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.063+0000 7fa14effd640 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556121544b40 0x5561215569c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa14402aa10 tx=0x7fa144043000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7664bc49c5ae1bc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.063+0000 7fa12effd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T01:02:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.063+0000 7fa12effd640 1 -- 172.21.15.12:0/1084775136 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144061070 con 0x556121544b40 2024-09-16T01:02:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.063+0000 7fa1581a2740 1 -- 172.21.15.12:0/1084775136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1400a47c0 con 0x556121544b40 2024-09-16T01:02:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.063+0000 7fa12effd640 1 -- 172.21.15.12:0/1084775136 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa144051470 con 0x556121544b40 2024-09-16T01:02:02.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.063+0000 7fa12effd640 1 -- 172.21.15.12:0/1084775136 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa144005850 con 0x556121544b40 2024-09-16T01:02:02.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.063+0000 7fa1581a2740 10 client.25277 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:02.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.063+0000 7fa1581a2740 1 -- 172.21.15.12:0/1084775136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561215c86b0 con 0x556121544b40 2024-09-16T01:02:02.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.063+0000 7fa12effd640 1 -- 172.21.15.12:0/1084775136 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1400a47c0 con 0x556121544b40 2024-09-16T01:02:02.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.064+0000 7fa12effd640 1 -- 172.21.15.12:0/1084775136 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa144044040 con 0x556121544b40 2024-09-16T01:02:02.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.064+0000 7fa1581a2740 10 client.25277 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:02.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.064+0000 7fa1581a2740 10 client.25277 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-16T01:02:02.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.064+0000 7fa1581a2740 20 client.25277 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:02.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.064+0000 7fa1581a2740 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5561215c8e80 0x5561215cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.064+0000 7fa1581a2740 4 client.25277 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:02.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.064+0000 7fa1581a2740 1 -- 172.21.15.12:0/1084775136 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561214b0d70 con 0x5561215c8e80 2024-09-16T01:02:02.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.064+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5561215c8e80 0x5561215cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.064+0000 7fa14f7fe640 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5561215c8e80 0x5561215cb2a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9137f8b39e741ee3 server_cookie=1183e7bd0fb70740 in_seq=0 out_seq=0 2024-09-16T01:02:02.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.064+0000 7fa12effd640 10 client.25277 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:02.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa12effd640 1 -- 172.21.15.12:0/1084775136 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561214b0d70 con 0x5561215c8e80 2024-09-16T01:02:02.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa12effd640 10 client.25277 handle_command_reply: tid=0 2024-09-16T01:02:02.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 client.25277 shutdown 2024-09-16T01:02:02.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 -- 172.21.15.12:0/1084775136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556121544b40 msgr2=0x5561215569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556121544b40 0x5561215569c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa14402aa10 tx=0x7fa144043000 comp rx=0 tx=0).stop 2024-09-16T01:02:02.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 -- 172.21.15.12:0/1084775136 shutdown_connections 2024-09-16T01:02:02.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5561215c8e80 0x5561215cb2a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa12effd640 0 client.25277 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:02.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55612154e370 0x5561215473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556121544b40 0x5561215569c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 --2- 172.21.15.12:0/1084775136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5561215435d0 0x556121556480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 -- 172.21.15.12:0/1084775136 >> 172.21.15.12:0/1084775136 conn(0x55612150c310 msgr2=0x5561215462c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:02.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 -- 172.21.15.12:0/1084775136 shutdown_connections 2024-09-16T01:02:02.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.065+0000 7fa1581a2740 1 -- 172.21.15.12:0/1084775136 wait complete. 2024-09-16T01:02:02.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.066+0000 7fa1581a2740 20 client.25277 trim_cache size 0 max 16384 2024-09-16T01:02:02.093 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:02.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.066+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1380a3240 msgr2=0x7fa1380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.066+0000 7fa155dc9640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1380a3240 0x7fa1380a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa14402a940 tx=0x7fa144005a40 comp rx=0 tx=0).stop 2024-09-16T01:02:02.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.066+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa150102dd0 msgr2=0x7fa1501985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.066+0000 7fa155dc9640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa150102dd0 0x7fa1501985e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa140011f50 tx=0x7fa140009610 comp rx=0 tx=0).stop 2024-09-16T01:02:02.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.067+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 shutdown_connections 2024-09-16T01:02:02.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.067+0000 7fa155dc9640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa1380a3240 0x7fa1380a5700 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.067+0000 7fa155dc9640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa150108300 0x7fa15019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.067+0000 7fa155dc9640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa150103780 0x7fa150198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.067+0000 7fa155dc9640 1 --2- 172.21.15.12:0/4115576045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa150102dd0 0x7fa1501985e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.067+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 >> 172.21.15.12:0/4115576045 conn(0x7fa1500fc7d0 msgr2=0x7fa150105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:02.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.067+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 shutdown_connections 2024-09-16T01:02:02.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:02.067+0000 7fa155dc9640 1 -- 172.21.15.12:0/4115576045 wait complete. 2024-09-16T01:02:02.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:02 smithi119 ceph-mon[35049]: pgmap v388: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:02:02.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:02 smithi012 ceph-mon[31197]: pgmap v388: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:02:02.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:02 smithi098 ceph-mon[35346]: pgmap v388: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:02:02.875 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-16T01:02:03.138 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:03.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.603+0000 7f5a44f4a640 1 -- 172.21.15.12:0/254082569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a401027a0 msgr2=0x7f5a401067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.603+0000 7f5a44f4a640 1 --2- 172.21.15.12:0/254082569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a401027a0 0x7f5a401067f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009900 tx=0x7f5a3402a410 comp rx=0 tx=0).stop 2024-09-16T01:02:03.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.603+0000 7f5a44f4a640 1 -- 172.21.15.12:0/254082569 shutdown_connections 2024-09-16T01:02:03.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.603+0000 7f5a44f4a640 1 --2- 172.21.15.12:0/254082569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a40106f20 0x7f5a4010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.603+0000 7f5a44f4a640 1 --2- 172.21.15.12:0/254082569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a401027a0 0x7f5a401067f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.603+0000 7f5a44f4a640 1 --2- 172.21.15.12:0/254082569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a40101df0 0x7f5a401021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.603+0000 7f5a44f4a640 1 -- 172.21.15.12:0/254082569 >> 172.21.15.12:0/254082569 conn(0x7f5a400fd8b0 msgr2=0x7f5a400ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:03.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.604+0000 7f5a44f4a640 1 -- 172.21.15.12:0/254082569 shutdown_connections 2024-09-16T01:02:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.604+0000 7f5a44f4a640 1 -- 172.21.15.12:0/254082569 wait complete. 2024-09-16T01:02:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.604+0000 7f5a44f4a640 1 Processor -- start 2024-09-16T01:02:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.604+0000 7f5a44f4a640 1 -- start start 2024-09-16T01:02:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a44f4a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a40101df0 0x7f5a40198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a44f4a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a401027a0 0x7f5a40198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a44f4a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a40106f20 0x7f5a4019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a3e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a40101df0 0x7f5a40198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a3e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a40101df0 0x7f5a40198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:36314/0 (socket says 172.21.15.12:36314) 2024-09-16T01:02:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a3ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a40106f20 0x7f5a4019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a3ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a40106f20 0x7f5a4019ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42570/0 (socket says 172.21.15.12:42570) 2024-09-16T01:02:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a3dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a401027a0 0x7f5a40198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a3dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a401027a0 0x7f5a40198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:43076/0 (socket says 172.21.15.12:43076) 2024-09-16T01:02:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a3e59c640 1 -- 172.21.15.12:0/1364425538 learned_addr learned my addr 172.21.15.12:0/1364425538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5a40111f80 con 0x7f5a40106f20 2024-09-16T01:02:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5a40111e00 con 0x7f5a401027a0 2024-09-16T01:02:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.605+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5a40112100 con 0x7f5a40101df0 2024-09-16T01:02:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.606+0000 7f5a3e59c640 1 -- 172.21.15.12:0/1364425538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a401027a0 msgr2=0x7f5a40198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.606+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a401027a0 0x7f5a40198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.606+0000 7f5a3e59c640 1 -- 172.21.15.12:0/1364425538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a40106f20 msgr2=0x7f5a4019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.606+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a40106f20 0x7f5a4019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.606+0000 7f5a3e59c640 1 -- 172.21.15.12:0/1364425538 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4019d3d0 con 0x7f5a40101df0 2024-09-16T01:02:03.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.606+0000 7f5a3ed9d640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a40106f20 0x7f5a4019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.606+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a40101df0 0x7f5a40198420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000d770 tx=0x7f5a3000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.606+0000 7f5a2f7fe640 1 -- 172.21.15.12:0/1364425538 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30017070 con 0x7f5a40101df0 2024-09-16T01:02:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.606+0000 7f5a2f7fe640 1 -- 172.21.15.12:0/1364425538 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a30005500 con 0x7f5a40101df0 2024-09-16T01:02:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.606+0000 7f5a2f7fe640 1 -- 172.21.15.12:0/1364425538 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30004e00 con 0x7f5a40101df0 2024-09-16T01:02:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.607+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4019d6c0 con 0x7f5a40101df0 2024-09-16T01:02:03.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.607+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a401a4fa0 con 0x7f5a40101df0 2024-09-16T01:02:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.609+0000 7f5a2f7fe640 1 -- 172.21.15.12:0/1364425538 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5a30004fa0 con 0x7f5a40101df0 2024-09-16T01:02:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.610+0000 7f5a2f7fe640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5a280a32c0 0x7f5a280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.610+0000 7f5a2f7fe640 1 -- 172.21.15.12:0/1364425538 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5a300cf6a0 con 0x7f5a40101df0 2024-09-16T01:02:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.610+0000 7f5a47323740 1 Processor -- start 2024-09-16T01:02:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.610+0000 7f5a3dd9b640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5a280a32c0 0x7f5a280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.610+0000 7f5a47323740 1 -- start start 2024-09-16T01:02:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a47323740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 0x55ca870d7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a47323740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca870d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a47323740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca870e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a47323740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ca8703d2f0 con 0x55ca870d75d0 2024-09-16T01:02:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a47323740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ca86fe4cf0 con 0x55ca870d8b40 2024-09-16T01:02:03.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a47323740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ca870392b0 con 0x55ca870e2370 2024-09-16T01:02:03.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca870e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca870e4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:36322/0 (socket says 172.21.15.12:36322) 2024-09-16T01:02:03.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3ed9d640 1 -- 172.21.15.12:0/279947449 learned_addr learned my addr 172.21.15.12:0/279947449 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:03.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3dd9b640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5a280a32c0 0x7f5a280a5780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009230 tx=0x7f5a340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:03.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/279947449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 0x55ca870d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3dd9b640 1 --2- 172.21.15.12:0/279947449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca870d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3e59c640 1 -- 172.21.15.12:0/279947449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 msgr2=0x55ca870e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:03.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/279947449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca870e4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3e59c640 1 -- 172.21.15.12:0/279947449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 msgr2=0x55ca870d7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:03.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/279947449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca870d7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.611+0000 7f5a3e59c640 1 -- 172.21.15.12:0/279947449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca86fc93a0 con 0x55ca870d8b40 2024-09-16T01:02:03.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.612+0000 7f5a3ed9d640 1 --2- 172.21.15.12:0/279947449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca870e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:03.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.612+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/279947449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 0x55ca870d7090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000d740 tx=0x7f5a30004780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e3cb2598cfa2be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:03.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.612+0000 7f5a2cff9640 1 -- 172.21.15.12:0/279947449 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30020070 con 0x55ca870d8b40 2024-09-16T01:02:03.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.612+0000 7f5a2cff9640 1 -- 172.21.15.12:0/279947449 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a300a4570 con 0x55ca870d8b40 2024-09-16T01:02:03.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.613+0000 7f5a47323740 1 -- 172.21.15.12:0/279947449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 msgr2=0x55ca870d7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.613+0000 7f5a47323740 1 --2- 172.21.15.12:0/279947449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 0x55ca870d7090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000d740 tx=0x7f5a30004780 comp rx=0 tx=0).stop 2024-09-16T01:02:03.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.614+0000 7f5a47323740 1 -- 172.21.15.12:0/279947449 shutdown_connections 2024-09-16T01:02:03.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.614+0000 7f5a47323740 1 --2- 172.21.15.12:0/279947449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca870e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.614+0000 7f5a47323740 1 --2- 172.21.15.12:0/279947449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca870d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.614+0000 7f5a47323740 1 --2- 172.21.15.12:0/279947449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 0x55ca870d7090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.614+0000 7f5a47323740 1 -- 172.21.15.12:0/279947449 >> 172.21.15.12:0/279947449 conn(0x55ca870a0310 msgr2=0x55ca870d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:03.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.615+0000 7f5a47323740 1 -- 172.21.15.12:0/279947449 shutdown_connections 2024-09-16T01:02:03.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.615+0000 7f5a47323740 1 -- 172.21.15.12:0/279947449 wait complete. 2024-09-16T01:02:03.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.615+0000 7f5a47323740 1 -- start start 2024-09-16T01:02:03.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.615+0000 7f5a47323740 1 Processor -- start 2024-09-16T01:02:03.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a47323740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d75d0 0x55ca870e1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a47323740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 0x55ca870def70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a47323740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870e2370 0x55ca870df4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d75d0 0x55ca870e1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a47323740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ca870e94c0 con 0x55ca870e2370 2024-09-16T01:02:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a47323740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ca86ff8060 con 0x55ca870d75d0 2024-09-16T01:02:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a47323740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ca870e9640 con 0x55ca870d8b40 2024-09-16T01:02:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870e2370 0x55ca870df4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870e2370 0x55ca870df4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42596/0 (socket says 172.21.15.12:42596) 2024-09-16T01:02:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3ed9d640 1 -- 172.21.15.12:0/2640135721 learned_addr learned my addr 172.21.15.12:0/2640135721 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3dd9b640 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 0x55ca870def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a47323740 10 client.0 _ll_register_callbacks cb 0x55ca86d4b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:03.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3ed9d640 1 -- 172.21.15.12:0/2640135721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 msgr2=0x55ca870def70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:03.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3ed9d640 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 0x55ca870def70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3ed9d640 1 -- 172.21.15.12:0/2640135721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d75d0 msgr2=0x55ca870e1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:03.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3ed9d640 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d75d0 0x55ca870e1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3ed9d640 1 -- 172.21.15.12:0/2640135721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca86dae3c0 con 0x55ca870e2370 2024-09-16T01:02:03.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.616+0000 7f5a3dd9b640 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 0x55ca870def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:03.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.617+0000 7f5a3ed9d640 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870e2370 0x55ca870df4d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5a38011d30 tx=0x7f5a38013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337f58ff8d5b307a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:03.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.617+0000 7f5a25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:03.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.617+0000 7f5a25ffb640 1 -- 172.21.15.12:0/2640135721 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380107e0 con 0x55ca870e2370 2024-09-16T01:02:03.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.617+0000 7f5a25ffb640 1 -- 172.21.15.12:0/2640135721 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5a38010980 con 0x55ca870e2370 2024-09-16T01:02:03.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.617+0000 7f5a47323740 1 -- 172.21.15.12:0/2640135721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a300a4570 con 0x55ca870e2370 2024-09-16T01:02:03.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.617+0000 7f5a25ffb640 1 -- 172.21.15.12:0/2640135721 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5a38010bc0 con 0x55ca870e2370 2024-09-16T01:02:03.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.617+0000 7f5a47323740 10 client.15657 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:03.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.617+0000 7f5a47323740 1 -- 172.21.15.12:0/2640135721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ca870e7290 con 0x55ca870e2370 2024-09-16T01:02:03.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.618+0000 7f5a25ffb640 1 -- 172.21.15.12:0/2640135721 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a38010d60 con 0x55ca870e2370 2024-09-16T01:02:03.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.618+0000 7f5a25ffb640 1 -- 172.21.15.12:0/2640135721 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5a3801a070 con 0x55ca870e2370 2024-09-16T01:02:03.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.618+0000 7f5a47323740 10 client.15657 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.618+0000 7f5a47323740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.618+0000 7f5a47323740 20 client.15657 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.618+0000 7f5a47323740 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ca870e8750 0x55ca871059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.618+0000 7f5a47323740 4 client.15657 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.618+0000 7f5a47323740 1 -- 172.21.15.12:0/2640135721 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5a300a4570 con 0x55ca870e8750 2024-09-16T01:02:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.619+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ca870e8750 0x55ca871059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.619+0000 7f5a25ffb640 10 client.15657 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.619+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ca870e8750 0x55ca871059e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e61d5ae98a05822c server_cookie=d5cba77e839791db in_seq=0 out_seq=0 2024-09-16T01:02:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a25ffb640 1 -- 172.21.15.12:0/2640135721 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5a300a4570 con 0x55ca870e8750 2024-09-16T01:02:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a25ffb640 10 client.15657 handle_command_reply: tid=0 2024-09-16T01:02:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a47323740 1 client.15657 shutdown 2024-09-16T01:02:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a47323740 1 -- 172.21.15.12:0/2640135721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870e2370 msgr2=0x55ca870df4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a47323740 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870e2370 0x55ca870df4d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5a38011d30 tx=0x7f5a38013830 comp rx=0 tx=0).stop 2024-09-16T01:02:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a47323740 1 -- 172.21.15.12:0/2640135721 shutdown_connections 2024-09-16T01:02:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a47323740 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ca870e8750 0x55ca871059e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a25ffb640 0 client.15657 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a47323740 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870e2370 0x55ca870df4d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a47323740 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 0x55ca870def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a47323740 1 --2- 172.21.15.12:0/2640135721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d75d0 0x55ca870e1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.620+0000 7f5a47323740 1 -- 172.21.15.12:0/2640135721 >> 172.21.15.12:0/2640135721 conn(0x55ca870a0310 msgr2=0x55ca870d99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.621+0000 7f5a47323740 1 -- 172.21.15.12:0/2640135721 shutdown_connections 2024-09-16T01:02:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.621+0000 7f5a47323740 1 -- 172.21.15.12:0/2640135721 wait complete. 2024-09-16T01:02:03.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.621+0000 7f5a47323740 20 client.15657 trim_cache size 0 max 16384 2024-09-16T01:02:03.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.647+0000 7f5a47323740 1 Processor -- start 2024-09-16T01:02:03.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.647+0000 7f5a47323740 1 -- start start 2024-09-16T01:02:03.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.647+0000 7f5a47323740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca870da120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.647+0000 7f5a47323740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 0x55ca870da660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.647+0000 7f5a47323740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870e2370 0x55ca87108a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.647+0000 7f5a47323740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5a401ac9d0 con 0x55ca870d75d0 2024-09-16T01:02:03.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.647+0000 7f5a47323740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5a401ae510 con 0x55ca870e2370 2024-09-16T01:02:03.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.647+0000 7f5a47323740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5a401ad0a0 con 0x55ca870d8b40 2024-09-16T01:02:03.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca870da120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca870da120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42612/0 (socket says 172.21.15.12:42612) 2024-09-16T01:02:03.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3e59c640 1 -- 172.21.15.12:0/3422252946 learned_addr learned my addr 172.21.15.12:0/3422252946 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:03.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 0x55ca870da660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3ed9d640 1 --2- 172.21.15.12:0/3422252946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870e2370 0x55ca87108a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3dd9b640 1 -- 172.21.15.12:0/3422252946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870e2370 msgr2=0x55ca87108a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:03.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3dd9b640 1 --2- 172.21.15.12:0/3422252946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870e2370 0x55ca87108a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3dd9b640 1 -- 172.21.15.12:0/3422252946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 msgr2=0x55ca870da120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:03.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3dd9b640 1 --2- 172.21.15.12:0/3422252946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca870da120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3dd9b640 1 -- 172.21.15.12:0/3422252946 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca870e2030 con 0x55ca870d8b40 2024-09-16T01:02:03.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.648+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/3422252946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca870da120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:03.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.649+0000 7f5a3dd9b640 1 --2- 172.21.15.12:0/3422252946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 0x55ca870da660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a34005940 tx=0x7f5a3403d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76c946835546754 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:03.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.649+0000 7f5a27fff640 1 -- 172.21.15.12:0/3422252946 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34035040 con 0x55ca870d8b40 2024-09-16T01:02:03.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.649+0000 7f5a27fff640 1 -- 172.21.15.12:0/3422252946 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a3404f070 con 0x55ca870d8b40 2024-09-16T01:02:03.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.649+0000 7f5a27fff640 1 -- 172.21.15.12:0/3422252946 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a340547e0 con 0x55ca870d8b40 2024-09-16T01:02:03.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.650+0000 7f5a47323740 1 -- 172.21.15.12:0/3422252946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 msgr2=0x55ca870da660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.650+0000 7f5a47323740 1 --2- 172.21.15.12:0/3422252946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 0x55ca870da660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a34005940 tx=0x7f5a3403d000 comp rx=0 tx=0).stop 2024-09-16T01:02:03.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.650+0000 7f5a47323740 1 -- 172.21.15.12:0/3422252946 shutdown_connections 2024-09-16T01:02:03.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.650+0000 7f5a47323740 1 --2- 172.21.15.12:0/3422252946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870e2370 0x55ca87108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.650+0000 7f5a47323740 1 --2- 172.21.15.12:0/3422252946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870d8b40 0x55ca870da660 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.650+0000 7f5a47323740 1 --2- 172.21.15.12:0/3422252946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca870da120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.650+0000 7f5a47323740 1 -- 172.21.15.12:0/3422252946 >> 172.21.15.12:0/3422252946 conn(0x55ca870a0310 msgr2=0x55ca870e0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:03.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.650+0000 7f5a47323740 1 -- 172.21.15.12:0/3422252946 shutdown_connections 2024-09-16T01:02:03.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.650+0000 7f5a47323740 1 -- 172.21.15.12:0/3422252946 wait complete. 2024-09-16T01:02:03.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.651+0000 7f5a47323740 1 -- start start 2024-09-16T01:02:03.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.651+0000 7f5a47323740 1 Processor -- start 2024-09-16T01:02:03.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.651+0000 7f5a47323740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca871069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.652+0000 7f5a3e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca871069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.652+0000 7f5a3e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca871069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42616/0 (socket says 172.21.15.12:42616) 2024-09-16T01:02:03.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.652+0000 7f5a3e59c640 1 -- 172.21.15.12:0/1778047275 learned_addr learned my addr 172.21.15.12:0/1778047275 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:03.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.652+0000 7f5a47323740 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 0x55ca87106f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.652+0000 7f5a47323740 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca87107450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.652+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5a401ade40 con 0x55ca870d75d0 2024-09-16T01:02:03.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.652+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5a401ad770 con 0x55ca870d8b40 2024-09-16T01:02:03.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.652+0000 7f5a3dd9b640 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 0x55ca87106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.652+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5a401aa9b0 con 0x55ca870e2370 2024-09-16T01:02:03.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.652+0000 7f5a3ed9d640 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca87107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a3ed9d640 1 -- 172.21.15.12:0/1778047275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 msgr2=0x55ca87106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:03.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a3ed9d640 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 0x55ca87106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a3ed9d640 1 -- 172.21.15.12:0/1778047275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 msgr2=0x55ca871069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:03.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a3ed9d640 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca871069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a3ed9d640 1 -- 172.21.15.12:0/1778047275 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca870ddf20 con 0x55ca870e2370 2024-09-16T01:02:03.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a3dd9b640 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 0x55ca87106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:03.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca871069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:03.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a3ed9d640 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca87107450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a3801b610 tx=0x7f5a38013d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2bffb9f8944b2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:03.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-16T01:02:03.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a47323740 10 client.0 _ll_register_callbacks cb 0x7f5a380113e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:03.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a3404f070 con 0x55ca870e2370 2024-09-16T01:02:03.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a25ffb640 1 -- 172.21.15.12:0/1778047275 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3802e070 con 0x55ca870e2370 2024-09-16T01:02:03.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.653+0000 7f5a25ffb640 1 -- 172.21.15.12:0/1778047275 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5a380107e0 con 0x55ca870e2370 2024-09-16T01:02:03.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a25ffb640 1 -- 172.21.15.12:0/1778047275 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5a38010a00 con 0x55ca870e2370 2024-09-16T01:02:03.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a47323740 10 client.25243 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:03.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55ca8716dfb0 con 0x55ca870e2370 2024-09-16T01:02:03.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a25ffb640 1 -- 172.21.15.12:0/1778047275 <== mon.1 v2:172.21.15.119:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5a3801a050 con 0x55ca870e2370 2024-09-16T01:02:03.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a47323740 10 client.25243 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:03.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a47323740 10 client.25243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:03.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a47323740 20 client.25243 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:03.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a47323740 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ca8716e5a0 0x55ca87170a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a47323740 4 client.25243 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:03.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca8704a860 con 0x55ca8716e5a0 2024-09-16T01:02:03.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.654+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ca8716e5a0 0x55ca87170a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.655+0000 7f5a25ffb640 10 client.25243 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:03.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.655+0000 7f5a3e59c640 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ca8716e5a0 0x55ca87170a60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b735c21277dc59f7 server_cookie=3eb95ff77db227ae in_seq=0 out_seq=0 2024-09-16T01:02:03.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.655+0000 7f5a25ffb640 1 -- 172.21.15.12:0/1778047275 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca8704a860 con 0x55ca8716e5a0 2024-09-16T01:02:03.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.655+0000 7f5a25ffb640 10 client.25243 handle_command_reply: tid=0 2024-09-16T01:02:03.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.655+0000 7f5a47323740 1 client.25243 shutdown 2024-09-16T01:02:03.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 msgr2=0x55ca87107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca87107450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a3801b610 tx=0x7f5a38013d30 comp rx=0 tx=0).stop 2024-09-16T01:02:03.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 shutdown_connections 2024-09-16T01:02:03.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ca8716e5a0 0x55ca87170a60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a25ffb640 0 client.25243 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:03.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ca870e2370 0x55ca87107450 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca870d8b40 0x55ca87106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 1 --2- 172.21.15.12:0/1778047275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca870d75d0 0x55ca871069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 >> 172.21.15.12:0/1778047275 conn(0x55ca870a0310 msgr2=0x55ca870f1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:03.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 shutdown_connections 2024-09-16T01:02:03.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 1 -- 172.21.15.12:0/1778047275 wait complete. 2024-09-16T01:02:03.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.656+0000 7f5a47323740 20 client.25243 trim_cache size 0 max 16384 2024-09-16T01:02:03.680 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:03.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.657+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5a280a32c0 msgr2=0x7f5a280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.657+0000 7f5a44f4a640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5a280a32c0 0x7f5a280a5780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009230 tx=0x7f5a340058d0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.657+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a40101df0 msgr2=0x7f5a40198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.657+0000 7f5a44f4a640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a40101df0 0x7f5a40198420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000d770 tx=0x7f5a3000dc30 comp rx=0 tx=0).stop 2024-09-16T01:02:03.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.657+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 shutdown_connections 2024-09-16T01:02:03.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.657+0000 7f5a44f4a640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5a280a32c0 0x7f5a280a5780 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.657+0000 7f5a44f4a640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a40106f20 0x7f5a4019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.657+0000 7f5a44f4a640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a401027a0 0x7f5a40198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.657+0000 7f5a44f4a640 1 --2- 172.21.15.12:0/1364425538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a40101df0 0x7f5a40198420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.657+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 >> 172.21.15.12:0/1364425538 conn(0x7f5a400fd8b0 msgr2=0x7f5a400feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:03.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.658+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 shutdown_connections 2024-09-16T01:02:03.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:03.658+0000 7f5a44f4a640 1 -- 172.21.15.12:0/1364425538 wait complete. 2024-09-16T01:02:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:04 smithi012 ceph-mon[31197]: pgmap v389: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:02:04.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:04 smithi119 ceph-mon[35049]: pgmap v389: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:02:04.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:04 smithi098 ceph-mon[35346]: pgmap v389: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:02:05.380 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-16T01:02:05.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-16T01:02:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:06.192 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:06 smithi012 ceph-mon[31197]: pgmap v390: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-16T01:02:06.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.285+0000 7f12b15af640 1 -- 172.21.15.12:0/3554393497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12ac101280 msgr2=0x7f12ac10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:06.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.285+0000 7f12b15af640 1 --2- 172.21.15.12:0/3554393497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12ac101280 0x7f12ac10df40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009900 tx=0x7f12a002a410 comp rx=0 tx=0).stop 2024-09-16T01:02:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.285+0000 7f12b15af640 1 -- 172.21.15.12:0/3554393497 shutdown_connections 2024-09-16T01:02:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.285+0000 7f12b15af640 1 --2- 172.21.15.12:0/3554393497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac10e480 0x7f12ac110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.285+0000 7f12b15af640 1 --2- 172.21.15.12:0/3554393497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12ac101280 0x7f12ac10df40 secure :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009900 tx=0x7f12a002a410 comp rx=0 tx=0).stop 2024-09-16T01:02:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.285+0000 7f12b15af640 1 --2- 172.21.15.12:0/3554393497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12ac1008d0 0x7f12ac100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.285+0000 7f12b15af640 1 -- 172.21.15.12:0/3554393497 >> 172.21.15.12:0/3554393497 conn(0x7f12ac0fc7a0 msgr2=0x7f12ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.285+0000 7f12b15af640 1 -- 172.21.15.12:0/3554393497 shutdown_connections 2024-09-16T01:02:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.285+0000 7f12b15af640 1 -- 172.21.15.12:0/3554393497 wait complete. 2024-09-16T01:02:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.286+0000 7f12b15af640 1 Processor -- start 2024-09-16T01:02:06.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.286+0000 7f12b15af640 1 -- start start 2024-09-16T01:02:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.286+0000 7f12b15af640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac1008d0 0x7f12ac1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.286+0000 7f12b15af640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12ac10e480 0x7f12ac1a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.286+0000 7f12b15af640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12ac19a6b0 0x7f12ac19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.286+0000 7f12b15af640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac1141e0 con 0x7f12ac19a6b0 2024-09-16T01:02:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.286+0000 7f12b15af640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac114060 con 0x7f12ac10e480 2024-09-16T01:02:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.286+0000 7f12b15af640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac114360 con 0x7f12ac1008d0 2024-09-16T01:02:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.287+0000 7f12ab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12ac19a6b0 0x7f12ac19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.287+0000 7f12ab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12ac19a6b0 0x7f12ac19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39370/0 (socket says 172.21.15.12:39370) 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.287+0000 7f12ab7fe640 1 -- 172.21.15.12:0/422962640 learned_addr learned my addr 172.21.15.12:0/422962640 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.287+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12ac10e480 0x7f12ac1a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.287+0000 7f12aaffd640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac1008d0 0x7f12ac1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.287+0000 7f12aaffd640 1 -- 172.21.15.12:0/422962640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12ac10e480 msgr2=0x7f12ac1a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.287+0000 7f12aaffd640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12ac10e480 0x7f12ac1a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.287+0000 7f12aaffd640 1 -- 172.21.15.12:0/422962640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12ac19a6b0 msgr2=0x7f12ac19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.287+0000 7f12aaffd640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12ac19a6b0 0x7f12ac19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.287+0000 7f12aaffd640 1 -- 172.21.15.12:0/422962640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac19b260 con 0x7f12ac1008d0 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.288+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12ac10e480 0x7f12ac1a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.288+0000 7f12ab7fe640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12ac19a6b0 0x7f12ac19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.288+0000 7f12aaffd640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac1008d0 0x7f12ac1a05e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f129c00d6d0 tx=0x7f129c00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.288+0000 7f1293fff640 1 -- 172.21.15.12:0/422962640 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c017070 con 0x7f12ac1008d0 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.288+0000 7f1293fff640 1 -- 172.21.15.12:0/422962640 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f129c009820 con 0x7f12ac1008d0 2024-09-16T01:02:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.288+0000 7f1293fff640 1 -- 172.21.15.12:0/422962640 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c004ca0 con 0x7f12ac1008d0 2024-09-16T01:02:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.288+0000 7f12b15af640 1 -- 172.21.15.12:0/422962640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac1a7390 con 0x7f12ac1008d0 2024-09-16T01:02:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.288+0000 7f12b15af640 1 -- 172.21.15.12:0/422962640 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac1a7730 con 0x7f12ac1008d0 2024-09-16T01:02:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.291+0000 7f12b3988740 1 Processor -- start 2024-09-16T01:02:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.291+0000 7f12b3988740 1 -- start start 2024-09-16T01:02:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.291+0000 7f1293fff640 1 -- 172.21.15.12:0/422962640 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f129c0099d0 con 0x7f12ac1008d0 2024-09-16T01:02:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.291+0000 7f12b3988740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7e9fb60 0x5653d7e9ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.291+0000 7f12b3988740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7ea0480 0x5653d7eaa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.292+0000 7f12b3988740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7eaad40 0x5653d7ead130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.292+0000 7f12b3988740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5653d7e05280 con 0x5653d7eaad40 2024-09-16T01:02:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.292+0000 7f12b3988740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5653d7dacb10 con 0x5653d7ea0480 2024-09-16T01:02:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.292+0000 7f12b3988740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5653d7e01240 con 0x5653d7e9fb60 2024-09-16T01:02:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.292+0000 7f12aaffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7ea0480 0x5653d7eaa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.292+0000 7f12aaffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7ea0480 0x5653d7eaa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:58240/0 (socket says 172.21.15.12:58240) 2024-09-16T01:02:06.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.292+0000 7f12aaffd640 1 -- 172.21.15.12:0/26381354 learned_addr learned my addr 172.21.15.12:0/26381354 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:06.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.292+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/26381354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7eaad40 0x5653d7ead130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.292+0000 7f12ab7fe640 1 --2- 172.21.15.12:0/26381354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7e9fb60 0x5653d7e9ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.293+0000 7f12aaffd640 1 -- 172.21.15.12:0/26381354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7e9fb60 msgr2=0x5653d7e9ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:06.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.293+0000 7f12aaffd640 1 --2- 172.21.15.12:0/26381354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7e9fb60 0x5653d7e9ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.293+0000 7f12aaffd640 1 -- 172.21.15.12:0/26381354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7eaad40 msgr2=0x5653d7ead130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:06.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.293+0000 7f12aaffd640 1 --2- 172.21.15.12:0/26381354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7eaad40 0x5653d7ead130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.293+0000 7f12aaffd640 1 -- 172.21.15.12:0/26381354 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d7db91f0 con 0x5653d7ea0480 2024-09-16T01:02:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.293+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/26381354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7eaad40 0x5653d7ead130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.293+0000 7f1293fff640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f12940a3390 0x7f12940a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.293+0000 7f1293fff640 1 -- 172.21.15.12:0/422962640 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f129c0cf5c0 con 0x7f12ac1008d0 2024-09-16T01:02:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.293+0000 7f12aaffd640 1 --2- 172.21.15.12:0/26381354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7ea0480 0x5653d7eaa800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f129c0d5c10 tx=0x7f129c0d7690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec8558919ae1d34e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.294+0000 7f12ab7fe640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f12940a3390 0x7f12940a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.294+0000 7f12917fa640 1 -- 172.21.15.12:0/26381354 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c020070 con 0x5653d7ea0480 2024-09-16T01:02:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.294+0000 7f12917fa640 1 -- 172.21.15.12:0/26381354 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f129c004e40 con 0x5653d7ea0480 2024-09-16T01:02:06.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12917fa640 1 -- 172.21.15.12:0/26381354 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c09b3c0 con 0x5653d7ea0480 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12ab7fe640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f12940a3390 0x7f12940a5850 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f12a40049d0 tx=0x7f12a40097e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12b3988740 1 -- 172.21.15.12:0/26381354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7ea0480 msgr2=0x5653d7eaa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12b3988740 1 --2- 172.21.15.12:0/26381354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7ea0480 0x5653d7eaa800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f129c0d5c10 tx=0x7f129c0d7690 comp rx=0 tx=0).stop 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12b3988740 1 -- 172.21.15.12:0/26381354 shutdown_connections 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12b3988740 1 --2- 172.21.15.12:0/26381354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7eaad40 0x5653d7ead130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12b3988740 1 --2- 172.21.15.12:0/26381354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7ea0480 0x5653d7eaa800 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12b3988740 1 --2- 172.21.15.12:0/26381354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7e9fb60 0x5653d7e9ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12b3988740 1 -- 172.21.15.12:0/26381354 >> 172.21.15.12:0/26381354 conn(0x5653d7e9c0f0 msgr2=0x5653d7e9c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12b3988740 1 -- 172.21.15.12:0/26381354 shutdown_connections 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.295+0000 7f12b3988740 1 -- 172.21.15.12:0/26381354 wait complete. 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12b3988740 1 -- start start 2024-09-16T01:02:06.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12b3988740 1 Processor -- start 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12b3988740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eaa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12b3988740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 0x5653d7ea7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12b3988740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7eaad40 0x5653d7ea82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12b3988740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5653d7ead9b0 con 0x5653d7e9fb60 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12b3988740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5653d7dbff10 con 0x5653d7eaad40 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12b3988740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5653d7eadb30 con 0x5653d7ea0480 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12b3988740 10 client.0 _ll_register_callbacks cb 0x5653d7d88a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12aaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eaa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12aaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eaa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39384/0 (socket says 172.21.15.12:39384) 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.296+0000 7f12aaffd640 1 -- 172.21.15.12:0/3722675598 learned_addr learned my addr 172.21.15.12:0/3722675598 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:06.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 0x5653d7ea7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f12ab7fe640 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7eaad40 0x5653d7ea82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f12aaffd640 1 -- 172.21.15.12:0/3722675598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 msgr2=0x5653d7ea7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f12aaffd640 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 0x5653d7ea7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f12aaffd640 1 -- 172.21.15.12:0/3722675598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7eaad40 msgr2=0x5653d7ea82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f12aaffd640 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7eaad40 0x5653d7ea82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f12aaffd640 1 -- 172.21.15.12:0/3722675598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d7b766a0 con 0x5653d7e9fb60 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 0x5653d7ea7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f12aaffd640 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eaa800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f129c00d6a0 tx=0x7f129c0d7f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760f055c5017a395 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f128eff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f128eff5640 1 -- 172.21.15.12:0/3722675598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c020070 con 0x5653d7e9fb60 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.297+0000 7f128eff5640 1 -- 172.21.15.12:0/3722675598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f129c099b80 con 0x5653d7e9fb60 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f12b3988740 1 -- 172.21.15.12:0/3722675598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f129c004e40 con 0x5653d7e9fb60 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f128eff5640 1 -- 172.21.15.12:0/3722675598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f129c09b1e0 con 0x5653d7e9fb60 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f12b3988740 10 client.15675 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f12b3988740 1 -- 172.21.15.12:0/3722675598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5653d7eb9530 con 0x5653d7e9fb60 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f128eff5640 1 -- 172.21.15.12:0/3722675598 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f129c004e40 con 0x5653d7e9fb60 2024-09-16T01:02:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f128eff5640 1 -- 172.21.15.12:0/3722675598 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f129c097ef0 con 0x5653d7e9fb60 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f12b3988740 10 client.15675 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f12b3988740 10 client.15675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f12b3988740 20 client.15675 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f12b3988740 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5653d7eba880 0x5653d7ebcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f12b3988740 4 client.15675 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.298+0000 7f12b3988740 1 -- 172.21.15.12:0/3722675598 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653d7e127f0 con 0x5653d7eba880 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.299+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5653d7eba880 0x5653d7ebcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.299+0000 7f128eff5640 10 client.15675 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.299+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5653d7eba880 0x5653d7ebcc70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd483031a78a53cd server_cookie=71a5d956b829d352 in_seq=0 out_seq=0 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f128eff5640 1 -- 172.21.15.12:0/3722675598 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653d7e127f0 con 0x5653d7eba880 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f128eff5640 10 client.15675 handle_command_reply: tid=0 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f12b3988740 1 client.15675 shutdown 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f12b3988740 1 -- 172.21.15.12:0/3722675598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 msgr2=0x5653d7eaa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f12b3988740 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eaa800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f129c00d6a0 tx=0x7f129c0d7f50 comp rx=0 tx=0).stop 2024-09-16T01:02:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f12b3988740 1 -- 172.21.15.12:0/3722675598 shutdown_connections 2024-09-16T01:02:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f12b3988740 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5653d7eba880 0x5653d7ebcc70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f12b3988740 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7eaad40 0x5653d7ea82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f12b3988740 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 0x5653d7ea7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f12b3988740 1 --2- 172.21.15.12:0/3722675598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eaa800 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f128eff5640 0 client.15675 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.300+0000 7f12b3988740 1 -- 172.21.15.12:0/3722675598 >> 172.21.15.12:0/3722675598 conn(0x5653d7e9c0f0 msgr2=0x5653d7ea1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.301+0000 7f12b3988740 1 -- 172.21.15.12:0/3722675598 shutdown_connections 2024-09-16T01:02:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.301+0000 7f12b3988740 1 -- 172.21.15.12:0/3722675598 wait complete. 2024-09-16T01:02:06.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.301+0000 7f12b3988740 20 client.15675 trim_cache size 0 max 16384 2024-09-16T01:02:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.318+0000 7f12b3988740 1 Processor -- start 2024-09-16T01:02:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.318+0000 7f12b3988740 1 -- start start 2024-09-16T01:02:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.318+0000 7f12b3988740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eb64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.318+0000 7f12b3988740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 0x5653d7ebfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.318+0000 7f12b3988740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7eaad40 0x5653d7ec01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.318+0000 7f12b3988740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac0712f0 con 0x5653d7e9fb60 2024-09-16T01:02:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.318+0000 7f12b3988740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac072e30 con 0x5653d7eaad40 2024-09-16T01:02:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12b3988740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac0719c0 con 0x5653d7ea0480 2024-09-16T01:02:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12aaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eb64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12aaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eb64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39396/0 (socket says 172.21.15.12:39396) 2024-09-16T01:02:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12aaffd640 1 -- 172.21.15.12:0/3408301641 learned_addr learned my addr 172.21.15.12:0/3408301641 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/3408301641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 0x5653d7ebfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12ab7fe640 1 --2- 172.21.15.12:0/3408301641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7eaad40 0x5653d7ec01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12aaffd640 1 -- 172.21.15.12:0/3408301641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 msgr2=0x5653d7ebfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12aaffd640 1 --2- 172.21.15.12:0/3408301641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 0x5653d7ebfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12aaffd640 1 -- 172.21.15.12:0/3408301641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7eaad40 msgr2=0x5653d7ec01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12aaffd640 1 --2- 172.21.15.12:0/3408301641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7eaad40 0x5653d7ec01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12aaffd640 1 -- 172.21.15.12:0/3408301641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d7ea6b00 con 0x5653d7e9fb60 2024-09-16T01:02:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.319+0000 7f12aaffd640 1 --2- 172.21.15.12:0/3408301641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eb64e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f129c099b30 tx=0x7f129c0cf480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e462b3dc06954dff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.320+0000 7f1290ff9640 1 -- 172.21.15.12:0/3408301641 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c020070 con 0x5653d7e9fb60 2024-09-16T01:02:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.320+0000 7f1290ff9640 1 -- 172.21.15.12:0/3408301641 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f129c0d5320 con 0x5653d7e9fb60 2024-09-16T01:02:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.320+0000 7f1290ff9640 1 -- 172.21.15.12:0/3408301641 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c09b880 con 0x5653d7e9fb60 2024-09-16T01:02:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 -- 172.21.15.12:0/3408301641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 msgr2=0x5653d7eb64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 --2- 172.21.15.12:0/3408301641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eb64e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f129c099b30 tx=0x7f129c0cf480 comp rx=0 tx=0).stop 2024-09-16T01:02:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 -- 172.21.15.12:0/3408301641 shutdown_connections 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 --2- 172.21.15.12:0/3408301641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7eaad40 0x5653d7ec01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 --2- 172.21.15.12:0/3408301641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7ea0480 0x5653d7ebfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 --2- 172.21.15.12:0/3408301641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7e9fb60 0x5653d7eb64e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 -- 172.21.15.12:0/3408301641 >> 172.21.15.12:0/3408301641 conn(0x5653d7e9c0f0 msgr2=0x5653d7eb5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 -- 172.21.15.12:0/3408301641 shutdown_connections 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 -- 172.21.15.12:0/3408301641 wait complete. 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 -- start start 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.321+0000 7f12b3988740 1 Processor -- start 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12b3988740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7e9fb60 0x5653d7ebc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12b3988740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7ea0480 0x5653d7ebc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12b3988740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7eaad40 0x5653d7f241b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12b3988740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac072760 con 0x5653d7ea0480 2024-09-16T01:02:06.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12b3988740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac072090 con 0x5653d7e9fb60 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12b3988740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac06f2d0 con 0x5653d7eaad40 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12b3988740 10 client.0 _ll_register_callbacks cb 0x7f12a0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12aaffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7e9fb60 0x5653d7ebc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12aaffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7e9fb60 0x5653d7ebc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:58270/0 (socket says 172.21.15.12:58270) 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12aaffd640 1 -- 172.21.15.12:0/1465643281 learned_addr learned my addr 172.21.15.12:0/1465643281 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12ab7fe640 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7eaad40 0x5653d7f241b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7ea0480 0x5653d7ebc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12aaffd640 1 -- 172.21.15.12:0/1465643281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7eaad40 msgr2=0x5653d7f241b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12aaffd640 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7eaad40 0x5653d7f241b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12aaffd640 1 -- 172.21.15.12:0/1465643281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7ea0480 msgr2=0x5653d7ebc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12aaffd640 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7ea0480 0x5653d7ebc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12aaffd640 1 -- 172.21.15.12:0/1465643281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d7f24720 con 0x5653d7e9fb60 2024-09-16T01:02:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.322+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7ea0480 0x5653d7ebc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.323+0000 7f12aaffd640 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7e9fb60 0x5653d7ebc150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f129c098250 tx=0x7f129c0d5680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d9561805e1446d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.323+0000 7f128eff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.323+0000 7f128eff5640 1 -- 172.21.15.12:0/1465643281 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c020070 con 0x5653d7e9fb60 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.323+0000 7f12b3988740 1 -- 172.21.15.12:0/1465643281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f129c0d5320 con 0x5653d7e9fb60 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.323+0000 7f128eff5640 1 -- 172.21.15.12:0/1465643281 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f129c0a4060 con 0x5653d7e9fb60 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.323+0000 7f128eff5640 1 -- 172.21.15.12:0/1465643281 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f129c09b3c0 con 0x5653d7e9fb60 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.323+0000 7f12b3988740 10 client.25310 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.323+0000 7f12b3988740 1 -- 172.21.15.12:0/1465643281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5653d7f24720 con 0x5653d7e9fb60 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.323+0000 7f128eff5640 1 -- 172.21.15.12:0/1465643281 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f129c0d5320 con 0x5653d7e9fb60 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.324+0000 7f128eff5640 1 -- 172.21.15.12:0/1465643281 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f129c09bae0 con 0x5653d7e9fb60 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.324+0000 7f12b3988740 10 client.25310 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.324+0000 7f12b3988740 10 client.25310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.324+0000 7f12b3988740 20 client.25310 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.324+0000 7f12b3988740 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5653d7f25cf0 0x5653d7f280e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.324+0000 7f12b3988740 4 client.25310 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-16T01:02:06.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.324+0000 7f12b3988740 1 -- 172.21.15.12:0/1465643281 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5653d7e0cd00 con 0x5653d7f25cf0 2024-09-16T01:02:06.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.324+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5653d7f25cf0 0x5653d7f280e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:06.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.325+0000 7f128eff5640 10 client.25310 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:06.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.325+0000 7f12aa7fc640 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5653d7f25cf0 0x5653d7f280e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc29939eca922939 server_cookie=981b80040a7774b9 in_seq=0 out_seq=0 2024-09-16T01:02:06.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f128eff5640 1 -- 172.21.15.12:0/1465643281 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5653d7e0cd00 con 0x5653d7f25cf0 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f128eff5640 10 client.25310 handle_command_reply: tid=0 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f12b3988740 1 client.25310 shutdown 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f12b3988740 1 -- 172.21.15.12:0/1465643281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7e9fb60 msgr2=0x5653d7ebc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f12b3988740 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7e9fb60 0x5653d7ebc150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f129c098250 tx=0x7f129c0d5680 comp rx=0 tx=0).stop 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f12b3988740 1 -- 172.21.15.12:0/1465643281 shutdown_connections 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f12b3988740 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5653d7f25cf0 0x5653d7f280e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f12b3988740 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653d7eaad40 0x5653d7f241b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f12b3988740 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653d7ea0480 0x5653d7ebc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f12b3988740 1 --2- 172.21.15.12:0/1465643281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653d7e9fb60 0x5653d7ebc150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f12b3988740 1 -- 172.21.15.12:0/1465643281 >> 172.21.15.12:0/1465643281 conn(0x5653d7e9c0f0 msgr2=0x5653d7e9b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f128eff5640 0 client.25310 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.326+0000 7f12b3988740 1 -- 172.21.15.12:0/1465643281 shutdown_connections 2024-09-16T01:02:06.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.327+0000 7f12b3988740 1 -- 172.21.15.12:0/1465643281 wait complete. 2024-09-16T01:02:06.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.327+0000 7f12b3988740 20 client.25310 trim_cache size 0 max 16384 2024-09-16T01:02:06.334 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:02:06.334 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-16T01:02:06.334 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "d54bba65-286f-4d96-808c-5f3762c6c5d6", 2024-09-16T01:02:06.334 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-16T01:02:06.334 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:02:06.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.327+0000 7f12b15af640 1 -- 172.21.15.12:0/422962640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f12940a3390 msgr2=0x7f12940a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:06.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.327+0000 7f12b15af640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f12940a3390 0x7f12940a5850 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f12a40049d0 tx=0x7f12a40097e0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.327+0000 7f12b15af640 1 -- 172.21.15.12:0/422962640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac1008d0 msgr2=0x7f12ac1a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.327+0000 7f12b15af640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac1008d0 0x7f12ac1a05e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f129c00d6d0 tx=0x7f129c00db90 comp rx=0 tx=0).stop 2024-09-16T01:02:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.328+0000 7f12b15af640 1 -- 172.21.15.12:0/422962640 shutdown_connections 2024-09-16T01:02:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.328+0000 7f12b15af640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f12940a3390 0x7f12940a5850 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.328+0000 7f12b15af640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12ac19a6b0 0x7f12ac19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.328+0000 7f12b15af640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12ac10e480 0x7f12ac1a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.328+0000 7f12b15af640 1 --2- 172.21.15.12:0/422962640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12ac1008d0 0x7f12ac1a05e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.328+0000 7f12b15af640 1 -- 172.21.15.12:0/422962640 >> 172.21.15.12:0/422962640 conn(0x7f12ac0fc7a0 msgr2=0x7f12ac0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.328+0000 7f12b15af640 1 -- 172.21.15.12:0/422962640 shutdown_connections 2024-09-16T01:02:06.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:06.328+0000 7f12b15af640 1 -- 172.21.15.12:0/422962640 wait complete. 2024-09-16T01:02:06.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:06 smithi119 ceph-mon[35049]: pgmap v390: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-16T01:02:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:06 smithi098 ceph-mon[35346]: pgmap v390: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-16T01:02:07.119 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:02:07.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:07 smithi119 ceph-mon[35049]: scrub queued for path: / 2024-09-16T01:02:07.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:07 smithi119 ceph-mon[35049]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:07.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:07 smithi119 ceph-mon[35049]: scrub summary: active paths [/] 2024-09-16T01:02:07.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:07 smithi119 ceph-mon[35049]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:07.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:07 smithi119 ceph-mon[35049]: scrub summary: idle 2024-09-16T01:02:07.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:07 smithi012 ceph-mon[31197]: scrub queued for path: / 2024-09-16T01:02:07.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:07 smithi012 ceph-mon[31197]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:07.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:07 smithi012 ceph-mon[31197]: scrub summary: active paths [/] 2024-09-16T01:02:07.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:07 smithi012 ceph-mon[31197]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:07.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:07 smithi012 ceph-mon[31197]: scrub summary: idle 2024-09-16T01:02:07.403 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:07 smithi098 ceph-mon[35346]: scrub queued for path: / 2024-09-16T01:02:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:07 smithi098 ceph-mon[35346]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:07 smithi098 ceph-mon[35346]: scrub summary: active paths [/] 2024-09-16T01:02:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:07 smithi098 ceph-mon[35346]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:07 smithi098 ceph-mon[35346]: scrub summary: idle 2024-09-16T01:02:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.993+0000 7f32f5b3b640 1 -- 172.21.15.12:0/4257486546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32f0102570 msgr2=0x7f32f01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.993+0000 7f32f5b3b640 1 --2- 172.21.15.12:0/4257486546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32f0102570 0x7f32f01029b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009900 tx=0x7f32d802a480 comp rx=0 tx=0).stop 2024-09-16T01:02:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.994+0000 7f32f5b3b640 1 -- 172.21.15.12:0/4257486546 shutdown_connections 2024-09-16T01:02:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.994+0000 7f32f5b3b640 1 --2- 172.21.15.12:0/4257486546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32f0102ef0 0x7f32f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.994+0000 7f32f5b3b640 1 --2- 172.21.15.12:0/4257486546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32f0102570 0x7f32f01029b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.994+0000 7f32f5b3b640 1 --2- 172.21.15.12:0/4257486546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32f0100e20 0x7f32f0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.994+0000 7f32f5b3b640 1 -- 172.21.15.12:0/4257486546 >> 172.21.15.12:0/4257486546 conn(0x7f32f00fc7d0 msgr2=0x7f32f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.994+0000 7f32f5b3b640 1 -- 172.21.15.12:0/4257486546 shutdown_connections 2024-09-16T01:02:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.994+0000 7f32f5b3b640 1 -- 172.21.15.12:0/4257486546 wait complete. 2024-09-16T01:02:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.995+0000 7f32f5b3b640 1 Processor -- start 2024-09-16T01:02:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.995+0000 7f32f5b3b640 1 -- start start 2024-09-16T01:02:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.995+0000 7f32f5b3b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32f0100e20 0x7f32f0198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.995+0000 7f32f5b3b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32f0102570 0x7f32f0198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.995+0000 7f32f5b3b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32f0102ef0 0x7f32f019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32f5b3b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f32f0110f80 con 0x7f32f0102ef0 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32f5b3b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f32f0110e00 con 0x7f32f0102570 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32f5b3b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32f0111100 con 0x7f32f0100e20 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32ef7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32f0100e20 0x7f32f0198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32e7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32f0102570 0x7f32f0198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32ef7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32f0100e20 0x7f32f0198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:46772/0 (socket says 172.21.15.12:46772) 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32ef7fe640 1 -- 172.21.15.12:0/2714602493 learned_addr learned my addr 172.21.15.12:0/2714602493 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32effff640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32f0102ef0 0x7f32f019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32e7fff640 1 -- 172.21.15.12:0/2714602493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32f0100e20 msgr2=0x7f32f0198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32e7fff640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32f0100e20 0x7f32f0198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32e7fff640 1 -- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32f0102ef0 msgr2=0x7f32f019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32e7fff640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32f0102ef0 0x7f32f019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32e7fff640 1 -- 172.21.15.12:0/2714602493 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f019d480 con 0x7f32f0102570 2024-09-16T01:02:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32f0100e20 0x7f32f0198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.996+0000 7f32effff640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32f0102ef0 0x7f32f019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.997+0000 7f32e7fff640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32f0102570 0x7f32f0198ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32d8005940 tx=0x7f32d8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.997+0000 7f32ed7fa640 1 -- 172.21.15.12:0/2714602493 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d803f070 con 0x7f32f0102570 2024-09-16T01:02:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.997+0000 7f32ed7fa640 1 -- 172.21.15.12:0/2714602493 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32d8031c30 con 0x7f32f0102570 2024-09-16T01:02:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.997+0000 7f32f5b3b640 1 -- 172.21.15.12:0/2714602493 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f019d710 con 0x7f32f0102570 2024-09-16T01:02:08.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.997+0000 7f32ed7fa640 1 -- 172.21.15.12:0/2714602493 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d8035030 con 0x7f32f0102570 2024-09-16T01:02:08.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:07.997+0000 7f32f5b3b640 1 -- 172.21.15.12:0/2714602493 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f019db80 con 0x7f32f0102570 2024-09-16T01:02:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.000+0000 7f32ed7fa640 1 -- 172.21.15.12:0/2714602493 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f32d8042070 con 0x7f32f0102570 2024-09-16T01:02:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.000+0000 7f32f7f14740 1 Processor -- start 2024-09-16T01:02:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.001+0000 7f32f7f14740 1 -- start start 2024-09-16T01:02:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.001+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7d6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.001+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7e1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.001+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7e1680 0x55f4ca7e3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.001+0000 7f32f7f14740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4ca73c2e0 con 0x55f4ca7e1680 2024-09-16T01:02:08.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.001+0000 7f32f7f14740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f4ca6e3ce0 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.001+0000 7f32f7f14740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f4ca7382a0 con 0x55f4ca7d64a0 2024-09-16T01:02:08.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.001+0000 7f32e7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7e1680 0x55f4ca7e3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.001+0000 7f32effff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7d6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32ef7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7e1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32effff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7d6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:46780/0 (socket says 172.21.15.12:46780) 2024-09-16T01:02:08.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32effff640 1 -- 172.21.15.12:0/1407958906 learned_addr learned my addr 172.21.15.12:0/1407958906 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:08.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32ed7fa640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f32dc0a32c0 0x7f32dc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32ef7fe640 1 -- 172.21.15.12:0/1407958906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d64a0 msgr2=0x55f4ca7d6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/1407958906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7d6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32ef7fe640 1 -- 172.21.15.12:0/1407958906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7e1680 msgr2=0x55f4ca7e3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32ed7fa640 1 -- 172.21.15.12:0/2714602493 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f32d80f0510 con 0x7f32f0102570 2024-09-16T01:02:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/1407958906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7e1680 0x55f4ca7e3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32ef7fe640 1 -- 172.21.15.12:0/1407958906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ca6c8440 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32effff640 1 --2- 172.21.15.12:0/1407958906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7d6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32e7fff640 1 --2- 172.21.15.12:0/1407958906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7e1680 0x55f4ca7e3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32effff640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f32dc0a32c0 0x7f32dc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.002+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/1407958906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7e1140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32e0011510 tx=0x7f32e00119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fff4f8abd813be67 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.003+0000 7f32e5ffb640 1 -- 172.21.15.12:0/1407958906 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e001e070 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.003+0000 7f32e5ffb640 1 -- 172.21.15.12:0/1407958906 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32e000fb60 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.003+0000 7f32e5ffb640 1 -- 172.21.15.12:0/1407958906 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0019bd0 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32f7f14740 1 -- 172.21.15.12:0/1407958906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 msgr2=0x55f4ca7e1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32f7f14740 1 --2- 172.21.15.12:0/1407958906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7e1140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32e0011510 tx=0x7f32e00119d0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32effff640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f32dc0a32c0 0x7f32dc0a5780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f32e800f740 tx=0x7f32e8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32f7f14740 1 -- 172.21.15.12:0/1407958906 shutdown_connections 2024-09-16T01:02:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32f7f14740 1 --2- 172.21.15.12:0/1407958906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7e1680 0x55f4ca7e3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32f7f14740 1 --2- 172.21.15.12:0/1407958906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7e1140 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32f7f14740 1 --2- 172.21.15.12:0/1407958906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7d6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32f7f14740 1 -- 172.21.15.12:0/1407958906 >> 172.21.15.12:0/1407958906 conn(0x55f4ca7d2a30 msgr2=0x55f4ca7d2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32f7f14740 1 -- 172.21.15.12:0/1407958906 shutdown_connections 2024-09-16T01:02:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32f7f14740 1 -- 172.21.15.12:0/1407958906 wait complete. 2024-09-16T01:02:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.004+0000 7f32f7f14740 1 -- start start 2024-09-16T01:02:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32f7f14740 1 Processor -- start 2024-09-16T01:02:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7e0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7de1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7e1680 0x55f4ca7de6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32f7f14740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4ca7e4250 con 0x55f4ca7d64a0 2024-09-16T01:02:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32f7f14740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f4ca6f7050 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32f7f14740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f4ca7e43d0 con 0x55f4ca7e1680 2024-09-16T01:02:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32ef7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7e0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32f7f14740 10 client.0 _ll_register_callbacks cb 0x55f4ca737160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32ef7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7e0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39434/0 (socket says 172.21.15.12:39434) 2024-09-16T01:02:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32ef7fe640 1 -- 172.21.15.12:0/3207992586 learned_addr learned my addr 172.21.15.12:0/3207992586 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32e7fff640 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7de1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32effff640 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7e1680 0x55f4ca7de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32ef7fe640 1 -- 172.21.15.12:0/3207992586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7e1680 msgr2=0x55f4ca7de6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7e1680 0x55f4ca7de6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.005+0000 7f32ef7fe640 1 -- 172.21.15.12:0/3207992586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 msgr2=0x55f4ca7de1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7de1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32ef7fe640 1 -- 172.21.15.12:0/3207992586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4ca4ad3c0 con 0x55f4ca7d64a0 2024-09-16T01:02:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32effff640 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7e1680 0x55f4ca7de6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32e7fff640 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7de1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7e0f00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f32e0000c00 tx=0x7f32e000f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895dbd07acd5d31d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32ceffd640 1 -- 172.21.15.12:0/3207992586 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e001e040 con 0x55f4ca7d64a0 2024-09-16T01:02:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32ceffd640 1 -- 172.21.15.12:0/3207992586 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f32e0004040 con 0x55f4ca7d64a0 2024-09-16T01:02:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32f7f14740 1 -- 172.21.15.12:0/3207992586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32e000fb60 con 0x55f4ca7d64a0 2024-09-16T01:02:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32ceffd640 1 -- 172.21.15.12:0/3207992586 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f32e0031050 con 0x55f4ca7d64a0 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32f7f14740 10 client.15690 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.006+0000 7f32f7f14740 1 -- 172.21.15.12:0/3207992586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f4ca7ec9d0 con 0x55f4ca7d64a0 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.007+0000 7f32ceffd640 1 -- 172.21.15.12:0/3207992586 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32e000fb60 con 0x55f4ca7d64a0 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.007+0000 7f32ceffd640 1 -- 172.21.15.12:0/3207992586 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f32e002c030 con 0x55f4ca7d64a0 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.007+0000 7f32f7f14740 10 client.15690 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.007+0000 7f32f7f14740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.007+0000 7f32f7f14740 20 client.15690 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.007+0000 7f32f7f14740 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55f4ca802190 0x55f4ca8045c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.007+0000 7f32f7f14740 4 client.15690 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.007+0000 7f32f7f14740 1 -- 172.21.15.12:0/3207992586 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4ca749850 con 0x55f4ca802190 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.007+0000 7f32e7fff640 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55f4ca802190 0x55f4ca8045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.008+0000 7f32e7fff640 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55f4ca802190 0x55f4ca8045c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a394a6495a122115 server_cookie=4f25d8d8bee8cfdd in_seq=0 out_seq=0 2024-09-16T01:02:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.008+0000 7f32ceffd640 10 client.15690 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.008+0000 7f32ceffd640 1 -- 172.21.15.12:0/3207992586 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4ca749850 con 0x55f4ca802190 2024-09-16T01:02:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.008+0000 7f32ceffd640 10 client.15690 handle_command_reply: tid=0 2024-09-16T01:02:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.008+0000 7f32f7f14740 1 client.15690 shutdown 2024-09-16T01:02:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 1 -- 172.21.15.12:0/3207992586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7d64a0 msgr2=0x55f4ca7e0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7e0f00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f32e0000c00 tx=0x7f32e000f930 comp rx=0 tx=0).stop 2024-09-16T01:02:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 1 -- 172.21.15.12:0/3207992586 shutdown_connections 2024-09-16T01:02:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55f4ca802190 0x55f4ca8045c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7e1680 0x55f4ca7de6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7de1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32ceffd640 0 client.15690 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 1 --2- 172.21.15.12:0/3207992586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca7d64a0 0x55f4ca7e0f00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 1 -- 172.21.15.12:0/3207992586 >> 172.21.15.12:0/3207992586 conn(0x55f4ca7d2a30 msgr2=0x55f4ca7d8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 1 -- 172.21.15.12:0/3207992586 shutdown_connections 2024-09-16T01:02:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 1 -- 172.21.15.12:0/3207992586 wait complete. 2024-09-16T01:02:08.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.009+0000 7f32f7f14740 20 client.15690 trim_cache size 0 max 16384 2024-09-16T01:02:08.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.044+0000 7f32f7f14740 1 Processor -- start 2024-09-16T01:02:08.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.044+0000 7f32f7f14740 1 -- start start 2024-09-16T01:02:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.044+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca809b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.044+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7e1680 0x55f4ca80a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.044+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca7db410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.044+0000 7f32f7f14740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f32f0073570 con 0x55f4ca802190 2024-09-16T01:02:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.044+0000 7f32f7f14740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f32f01a5ce0 con 0x55f4ca7e1680 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.044+0000 7f32f7f14740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32f0073c40 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.044+0000 7f32effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca7db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca7db410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39444/0 (socket says 172.21.15.12:39444) 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32effff640 1 -- 172.21.15.12:0/70001947 learned_addr learned my addr 172.21.15.12:0/70001947 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/70001947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca809b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32e7fff640 1 --2- 172.21.15.12:0/70001947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7e1680 0x55f4ca80a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32ef7fe640 1 -- 172.21.15.12:0/70001947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7e1680 msgr2=0x55f4ca80a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/70001947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7e1680 0x55f4ca80a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32ef7fe640 1 -- 172.21.15.12:0/70001947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 msgr2=0x55f4ca7db410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/70001947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca7db410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32ef7fe640 1 -- 172.21.15.12:0/70001947 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ca7d7a20 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32effff640 1 --2- 172.21.15.12:0/70001947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca7db410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.045+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/70001947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca809b60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32e0019560 tx=0x7f32e0005990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e48ceb1aad0e41bb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.046+0000 7f32e57fa640 1 -- 172.21.15.12:0/70001947 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e001e070 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.046+0000 7f32e57fa640 1 -- 172.21.15.12:0/70001947 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32e0016030 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.046+0000 7f32e57fa640 1 -- 172.21.15.12:0/70001947 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0004610 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.046+0000 7f32f7f14740 1 -- 172.21.15.12:0/70001947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 msgr2=0x55f4ca809b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.046+0000 7f32f7f14740 1 --2- 172.21.15.12:0/70001947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca809b60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32e0019560 tx=0x7f32e0005990 comp rx=0 tx=0).stop 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.047+0000 7f32f7f14740 1 -- 172.21.15.12:0/70001947 shutdown_connections 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.047+0000 7f32f7f14740 1 --2- 172.21.15.12:0/70001947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca7db410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.047+0000 7f32f7f14740 1 --2- 172.21.15.12:0/70001947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7e1680 0x55f4ca80a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.047+0000 7f32f7f14740 1 --2- 172.21.15.12:0/70001947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca809b60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.047+0000 7f32f7f14740 1 -- 172.21.15.12:0/70001947 >> 172.21.15.12:0/70001947 conn(0x55f4ca7d2a30 msgr2=0x55f4ca7d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.047+0000 7f32f7f14740 1 -- 172.21.15.12:0/70001947 shutdown_connections 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.047+0000 7f32f7f14740 1 -- 172.21.15.12:0/70001947 wait complete. 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.047+0000 7f32f7f14740 1 -- start start 2024-09-16T01:02:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.047+0000 7f32f7f14740 1 Processor -- start 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7e7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7e1680 0x55f4ca7e7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32f7f14740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca887340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32f7f14740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f32f01a5610 con 0x55f4ca802190 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32f7f14740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f32f01a5050 con 0x55f4ca7e1680 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32f7f14740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32f0071550 con 0x55f4ca7d6dc0 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32f7f14740 10 client.0 _ll_register_callbacks cb 0x7f32e001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca887340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32ef7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca887340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39450/0 (socket says 172.21.15.12:39450) 2024-09-16T01:02:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32effff640 1 -- 172.21.15.12:0/4164374584 learned_addr learned my addr 172.21.15.12:0/4164374584 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32e7fff640 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7e1680 0x55f4ca7e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32effff640 1 -- 172.21.15.12:0/4164374584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 msgr2=0x55f4ca7e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32effff640 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32effff640 1 -- 172.21.15.12:0/4164374584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7e1680 msgr2=0x55f4ca7e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32effff640 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7e1680 0x55f4ca7e7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32effff640 1 -- 172.21.15.12:0/4164374584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4ca887930 con 0x55f4ca802190 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.048+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.049+0000 7f32effff640 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca887340 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f32e8012a30 tx=0x7f32e8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331922cf2214b48c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.049+0000 7f32ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.049+0000 7f32ceffd640 1 -- 172.21.15.12:0/4164374584 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e802d060 con 0x55f4ca802190 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.049+0000 7f32ceffd640 1 -- 172.21.15.12:0/4164374584 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f32e801b420 con 0x55f4ca802190 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.049+0000 7f32f7f14740 1 -- 172.21.15.12:0/4164374584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32e0016030 con 0x55f4ca802190 2024-09-16T01:02:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.049+0000 7f32ceffd640 1 -- 172.21.15.12:0/4164374584 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f32e801ee20 con 0x55f4ca802190 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.049+0000 7f32f7f14740 10 client.15696 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.049+0000 7f32f7f14740 1 -- 172.21.15.12:0/4164374584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f4ca88ed00 con 0x55f4ca802190 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.050+0000 7f32ceffd640 1 -- 172.21.15.12:0/4164374584 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32e801bb00 con 0x55f4ca802190 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.050+0000 7f32ceffd640 1 -- 172.21.15.12:0/4164374584 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f32e8027070 con 0x55f4ca802190 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.050+0000 7f32f7f14740 10 client.15696 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.050+0000 7f32f7f14740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.050+0000 7f32f7f14740 20 client.15696 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.050+0000 7f32f7f14740 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55f4ca88f480 0x55f4ca8918a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.050+0000 7f32f7f14740 4 client.15696 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.050+0000 7f32f7f14740 1 -- 172.21.15.12:0/4164374584 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f32e0016030 con 0x55f4ca88f480 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.050+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55f4ca88f480 0x55f4ca8918a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.051+0000 7f32ceffd640 10 client.15696 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.051+0000 7f32ef7fe640 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55f4ca88f480 0x55f4ca8918a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31c01af3af54e6d server_cookie=74c714d4a13682f4 in_seq=0 out_seq=0 2024-09-16T01:02:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.051+0000 7f32ceffd640 1 -- 172.21.15.12:0/4164374584 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f32e0016030 con 0x55f4ca88f480 2024-09-16T01:02:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.051+0000 7f32ceffd640 10 client.15696 handle_command_reply: tid=0 2024-09-16T01:02:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.051+0000 7f32f7f14740 1 client.15696 shutdown 2024-09-16T01:02:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.051+0000 7f32f7f14740 1 -- 172.21.15.12:0/4164374584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 msgr2=0x55f4ca887340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.059 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:02:08.059 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-16T01:02:08.059 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-16T01:02:08.059 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:02:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.051+0000 7f32f7f14740 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca887340 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f32e8012a30 tx=0x7f32e8004ab0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.052+0000 7f32f7f14740 1 -- 172.21.15.12:0/4164374584 shutdown_connections 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.052+0000 7f32f7f14740 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55f4ca88f480 0x55f4ca8918a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.052+0000 7f32f7f14740 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca802190 0x55f4ca887340 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.052+0000 7f32ceffd640 0 client.15696 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.052+0000 7f32f7f14740 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ca7e1680 0x55f4ca7e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.052+0000 7f32f7f14740 1 --2- 172.21.15.12:0/4164374584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4ca7d6dc0 0x55f4ca7e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.052+0000 7f32f7f14740 1 -- 172.21.15.12:0/4164374584 >> 172.21.15.12:0/4164374584 conn(0x55f4ca7d2a30 msgr2=0x55f4ca7dfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.052+0000 7f32f7f14740 1 -- 172.21.15.12:0/4164374584 shutdown_connections 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.052+0000 7f32f7f14740 1 -- 172.21.15.12:0/4164374584 wait complete. 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.052+0000 7f32f7f14740 20 client.15696 trim_cache size 0 max 16384 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 -- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f32dc0a32c0 msgr2=0x7f32dc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f32dc0a32c0 0x7f32dc0a5780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f32e800f740 tx=0x7f32e8004a40 comp rx=0 tx=0).stop 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 -- 172.21.15.12:0/2714602493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32f0102570 msgr2=0x7f32f0198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32f0102570 0x7f32f0198ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32d8005940 tx=0x7f32d8003c10 comp rx=0 tx=0).stop 2024-09-16T01:02:08.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 -- 172.21.15.12:0/2714602493 shutdown_connections 2024-09-16T01:02:08.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f32dc0a32c0 0x7f32dc0a5780 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32f0102ef0 0x7f32f019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32f0102570 0x7f32f0198ab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 --2- 172.21.15.12:0/2714602493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32f0100e20 0x7f32f0198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 -- 172.21.15.12:0/2714602493 >> 172.21.15.12:0/2714602493 conn(0x7f32f00fc7d0 msgr2=0x7f32f006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 -- 172.21.15.12:0/2714602493 shutdown_connections 2024-09-16T01:02:08.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:08.053+0000 7f32f5b3b640 1 -- 172.21.15.12:0/2714602493 wait complete. 2024-09-16T01:02:08.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:08 smithi119 ceph-mon[35049]: pgmap v391: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:02:08.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:08 smithi012 ceph-mon[31197]: pgmap v391: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:02:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:08 smithi098 ceph-mon[35346]: pgmap v391: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:02:08.854 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-16T01:02:08.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:02:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:09.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.784+0000 7f96055a7640 1 -- 172.21.15.12:0/1404497878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9600102ef0 msgr2=0x7f960010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.785+0000 7f96055a7640 1 --2- 172.21.15.12:0/1404497878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9600102ef0 0x7f960010da40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009ca0 tx=0x7f95f802a950 comp rx=0 tx=0).stop 2024-09-16T01:02:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.785+0000 7f96055a7640 1 -- 172.21.15.12:0/1404497878 shutdown_connections 2024-09-16T01:02:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.785+0000 7f96055a7640 1 --2- 172.21.15.12:0/1404497878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9600102ef0 0x7f960010da40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.785+0000 7f96055a7640 1 --2- 172.21.15.12:0/1404497878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9600102570 0x7f96001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.785+0000 7f96055a7640 1 --2- 172.21.15.12:0/1404497878 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600100e20 0x7f9600101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.785+0000 7f96055a7640 1 -- 172.21.15.12:0/1404497878 >> 172.21.15.12:0/1404497878 conn(0x7f96000fc7d0 msgr2=0x7f96000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.785+0000 7f96055a7640 1 -- 172.21.15.12:0/1404497878 shutdown_connections 2024-09-16T01:02:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.785+0000 7f96055a7640 1 -- 172.21.15.12:0/1404497878 wait complete. 2024-09-16T01:02:09.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.786+0000 7f96055a7640 1 Processor -- start 2024-09-16T01:02:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.786+0000 7f96055a7640 1 -- start start 2024-09-16T01:02:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.786+0000 7f96055a7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9600100e20 0x7f9600199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.786+0000 7f96055a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600102570 0x7f9600199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.786+0000 7f96055a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9600102ef0 0x7f96001a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.786+0000 7f96055a7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9600110fd0 con 0x7f9600102ef0 2024-09-16T01:02:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.786+0000 7f96055a7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9600110e50 con 0x7f9600100e20 2024-09-16T01:02:09.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.786+0000 7f96055a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9600111150 con 0x7f9600102570 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.786+0000 7f95ff7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9600102ef0 0x7f96001a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.786+0000 7f95ff7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9600102ef0 0x7f96001a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39456/0 (socket says 172.21.15.12:39456) 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95ff7fe640 1 -- 172.21.15.12:0/183913746 learned_addr learned my addr 172.21.15.12:0/183913746 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95fe7fc640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600102570 0x7f9600199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95ff7fe640 1 -- 172.21.15.12:0/183913746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600102570 msgr2=0x7f9600199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95ff7fe640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600102570 0x7f9600199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95feffd640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9600100e20 0x7f9600199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95ff7fe640 1 -- 172.21.15.12:0/183913746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9600100e20 msgr2=0x7f9600199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95ff7fe640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9600100e20 0x7f9600199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95ff7fe640 1 -- 172.21.15.12:0/183913746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96001a48c0 con 0x7f9600102ef0 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95feffd640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9600100e20 0x7f9600199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95fe7fc640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600102570 0x7f9600199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:09.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95ff7fe640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9600102ef0 0x7f96001a4380 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009dc0 tx=0x7f95f8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:09.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.787+0000 7f95e7fff640 1 -- 172.21.15.12:0/183913746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8034040 con 0x7f9600102ef0 2024-09-16T01:02:09.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.788+0000 7f95e7fff640 1 -- 172.21.15.12:0/183913746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95f802f930 con 0x7f9600102ef0 2024-09-16T01:02:09.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.788+0000 7f96055a7640 1 -- 172.21.15.12:0/183913746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96001a4a90 con 0x7f9600102ef0 2024-09-16T01:02:09.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.788+0000 7f95e7fff640 1 -- 172.21.15.12:0/183913746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f80046a0 con 0x7f9600102ef0 2024-09-16T01:02:09.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.788+0000 7f96055a7640 1 -- 172.21.15.12:0/183913746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96001a4f40 con 0x7f9600102ef0 2024-09-16T01:02:09.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.789+0000 7f96055a7640 1 -- 172.21.15.12:0/183913746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9600101200 con 0x7f9600102ef0 2024-09-16T01:02:09.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.791+0000 7f95e7fff640 1 -- 172.21.15.12:0/183913746 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f95f8037020 con 0x7f9600102ef0 2024-09-16T01:02:09.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.792+0000 7f95e7fff640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95e80a3340 0x7f95e80a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:09.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.792+0000 7f95e7fff640 1 -- 172.21.15.12:0/183913746 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f95f80f0b00 con 0x7f9600102ef0 2024-09-16T01:02:09.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.792+0000 7f95feffd640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95e80a3340 0x7f95e80a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:09.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.793+0000 7f95feffd640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95e80a3340 0x7f95e80a5800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009b50 tx=0x7f95f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:09.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:09.794+0000 7f95e7fff640 1 -- 172.21.15.12:0/183913746 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95f80bd460 con 0x7f9600102ef0 2024-09-16T01:02:10.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.007+0000 7f96055a7640 1 -- 172.21.15.12:0/183913746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f960006a560 con 0x7f9600102ef0 2024-09-16T01:02:10.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.008+0000 7f95e7fff640 1 -- 172.21.15.12:0/183913746 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f960006a560 con 0x7f9600102ef0 2024-09-16T01:02:10.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:02:10.009 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:02:10.009 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:02:10.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 -- 172.21.15.12:0/183913746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95e80a3340 msgr2=0x7f95e80a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95e80a3340 0x7f95e80a5800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009b50 tx=0x7f95f0005f90 comp rx=0 tx=0).stop 2024-09-16T01:02:10.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 -- 172.21.15.12:0/183913746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9600102ef0 msgr2=0x7f96001a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9600102ef0 0x7f96001a4380 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009dc0 tx=0x7f95f8003c10 comp rx=0 tx=0).stop 2024-09-16T01:02:10.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 -- 172.21.15.12:0/183913746 shutdown_connections 2024-09-16T01:02:10.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f95e80a3340 0x7f95e80a5800 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9600102ef0 0x7f96001a4380 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600102570 0x7f9600199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 --2- 172.21.15.12:0/183913746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9600100e20 0x7f9600199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 -- 172.21.15.12:0/183913746 >> 172.21.15.12:0/183913746 conn(0x7f96000fc7d0 msgr2=0x7f9600106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:10.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 -- 172.21.15.12:0/183913746 shutdown_connections 2024-09-16T01:02:10.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:10.011+0000 7f96055a7640 1 -- 172.21.15.12:0/183913746 wait complete. 2024-09-16T01:02:10.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:10 smithi119 ceph-mon[35049]: pgmap v392: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:02:10.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:10 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/183913746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:10.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:10 smithi012 ceph-mon[31197]: pgmap v392: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:02:10.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:10 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/183913746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:10 smithi098 ceph-mon[35346]: pgmap v392: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:02:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:10 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/183913746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:10.685 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-16T01:02:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.522+0000 7faabf7ec640 1 -- 172.21.15.12:0/552156251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faab8100e20 msgr2=0x7faab8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.522+0000 7faabf7ec640 1 --2- 172.21.15.12:0/552156251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faab8100e20 0x7faab8101200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faab4009890 tx=0x7faab402a3f0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.522+0000 7faabf7ec640 1 -- 172.21.15.12:0/552156251 shutdown_connections 2024-09-16T01:02:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.522+0000 7faabf7ec640 1 --2- 172.21.15.12:0/552156251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faab8102ef0 0x7faab810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.522+0000 7faabf7ec640 1 --2- 172.21.15.12:0/552156251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faab8102570 0x7faab81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.522+0000 7faabf7ec640 1 --2- 172.21.15.12:0/552156251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faab8100e20 0x7faab8101200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.522+0000 7faabf7ec640 1 -- 172.21.15.12:0/552156251 >> 172.21.15.12:0/552156251 conn(0x7faab80fc7d0 msgr2=0x7faab80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.523+0000 7faabf7ec640 1 -- 172.21.15.12:0/552156251 shutdown_connections 2024-09-16T01:02:11.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.523+0000 7faabf7ec640 1 -- 172.21.15.12:0/552156251 wait complete. 2024-09-16T01:02:11.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.523+0000 7faabf7ec640 1 Processor -- start 2024-09-16T01:02:11.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.523+0000 7faabf7ec640 1 -- start start 2024-09-16T01:02:11.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabf7ec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faab8100e20 0x7faab8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabf7ec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faab8102570 0x7faab8198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabf7ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faab8102ef0 0x7faab819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabf7ec640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faab8110f80 con 0x7faab8102570 2024-09-16T01:02:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabf7ec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faab8110e00 con 0x7faab8100e20 2024-09-16T01:02:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabf7ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faab8111100 con 0x7faab8102ef0 2024-09-16T01:02:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabcd87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faab8102570 0x7faab8198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabcd87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faab8102570 0x7faab8198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39470/0 (socket says 172.21.15.12:39470) 2024-09-16T01:02:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabcd87640 1 -- 172.21.15.12:0/659587711 learned_addr learned my addr 172.21.15.12:0/659587711 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:11.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabd588640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faab8100e20 0x7faab8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabcd87640 1 -- 172.21.15.12:0/659587711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faab8102ef0 msgr2=0x7faab819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabdd89640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faab8102ef0 0x7faab819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabcd87640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faab8102ef0 0x7faab819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.524+0000 7faabcd87640 1 -- 172.21.15.12:0/659587711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faab8100e20 msgr2=0x7faab8198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.525+0000 7faabcd87640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faab8100e20 0x7faab8198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.525+0000 7faabcd87640 1 -- 172.21.15.12:0/659587711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab819d520 con 0x7faab8102570 2024-09-16T01:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.525+0000 7faabd588640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faab8100e20 0x7faab8198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.525+0000 7faabdd89640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faab8102ef0 0x7faab819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.525+0000 7faabcd87640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faab8102570 0x7faab8198ab0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faaa800d950 tx=0x7faaa800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.525+0000 7faaae7fc640 1 -- 172.21.15.12:0/659587711 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8017070 con 0x7faab8102570 2024-09-16T01:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.525+0000 7faaae7fc640 1 -- 172.21.15.12:0/659587711 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaa8009c30 con 0x7faab8102570 2024-09-16T01:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.525+0000 7faabf7ec640 1 -- 172.21.15.12:0/659587711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab819d810 con 0x7faab8102570 2024-09-16T01:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.525+0000 7faaae7fc640 1 -- 172.21.15.12:0/659587711 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa800f690 con 0x7faab8102570 2024-09-16T01:02:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.525+0000 7faabf7ec640 1 -- 172.21.15.12:0/659587711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab80fce50 con 0x7faab8102570 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.529+0000 7faac1bc5740 1 Processor -- start 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.529+0000 7faac1bc5740 1 -- start start 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faaae7fc640 1 -- 172.21.15.12:0/659587711 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faaa80109d0 con 0x7faab8102570 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841eb40 0x55df5841d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df5841da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df58428370 0x55df5842a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faac1bc5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55df583832f0 con 0x55df5841d5d0 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faac1bc5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55df5832acf0 con 0x55df5841eb40 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faac1bc5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55df5837f2b0 con 0x55df58428370 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faabd588640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df5841da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faabd588640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df5841da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39472/0 (socket says 172.21.15.12:39472) 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faabd588640 1 -- 172.21.15.12:0/1074507296 learned_addr learned my addr 172.21.15.12:0/1074507296 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:11.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faabcd87640 1 --2- 172.21.15.12:0/1074507296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df58428370 0x55df5842a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faabd588640 1 -- 172.21.15.12:0/1074507296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df58428370 msgr2=0x55df5842a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faabd588640 1 --2- 172.21.15.12:0/1074507296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df58428370 0x55df5842a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faabd588640 1 -- 172.21.15.12:0/1074507296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841eb40 msgr2=0x55df5841d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faabd588640 1 --2- 172.21.15.12:0/1074507296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841eb40 0x55df5841d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.530+0000 7faabd588640 1 -- 172.21.15.12:0/1074507296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df5830f3a0 con 0x55df5841d5d0 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.531+0000 7faabd588640 1 --2- 172.21.15.12:0/1074507296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df5841da10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faab4005940 tx=0x7faab40303c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dedc9abd4f1bd42 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.531+0000 7faaa37fe640 1 -- 172.21.15.12:0/1074507296 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4040020 con 0x55df5841d5d0 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.531+0000 7faaa37fe640 1 -- 172.21.15.12:0/1074507296 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab4038040 con 0x55df5841d5d0 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.531+0000 7faaa37fe640 1 -- 172.21.15.12:0/1074507296 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4037070 con 0x55df5841d5d0 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.532+0000 7faaae7fc640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faaa40a32c0 0x7faaa40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.532+0000 7faabdd89640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faaa40a32c0 0x7faaa40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.532+0000 7faac1bc5740 1 -- 172.21.15.12:0/1074507296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 msgr2=0x55df5841da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.532+0000 7faac1bc5740 1 --2- 172.21.15.12:0/1074507296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df5841da10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faab4005940 tx=0x7faab40303c0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.532+0000 7faac1bc5740 1 -- 172.21.15.12:0/1074507296 shutdown_connections 2024-09-16T01:02:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.532+0000 7faac1bc5740 1 --2- 172.21.15.12:0/1074507296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df58428370 0x55df5842a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.532+0000 7faac1bc5740 1 --2- 172.21.15.12:0/1074507296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df5841da10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.532+0000 7faac1bc5740 1 --2- 172.21.15.12:0/1074507296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841eb40 0x55df5841d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.532+0000 7faac1bc5740 1 -- 172.21.15.12:0/1074507296 >> 172.21.15.12:0/1074507296 conn(0x55df583e6310 msgr2=0x55df58419c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.533+0000 7faac1bc5740 1 -- 172.21.15.12:0/1074507296 shutdown_connections 2024-09-16T01:02:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.533+0000 7faac1bc5740 1 -- 172.21.15.12:0/1074507296 wait complete. 2024-09-16T01:02:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.533+0000 7faaae7fc640 1 -- 172.21.15.12:0/659587711 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7faaa80cf960 con 0x7faab8102570 2024-09-16T01:02:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.533+0000 7faabdd89640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faaa40a32c0 0x7faaa40a5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faab0009330 tx=0x7faab00092a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.534+0000 7faac1bc5740 1 -- start start 2024-09-16T01:02:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.534+0000 7faac1bc5740 1 Processor -- start 2024-09-16T01:02:11.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df5841d5d0 0x55df58427d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841eb40 0x55df58425010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df58428370 0x55df58425600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faac1bc5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55df5842b010 con 0x55df58428370 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faabd588640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df5841d5d0 0x55df58427d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faabd588640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df5841d5d0 0x55df58427d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:46868/0 (socket says 172.21.15.12:46868) 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faabd588640 1 -- 172.21.15.12:0/2617463442 learned_addr learned my addr 172.21.15.12:0/2617463442 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faabdd89640 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df58428370 0x55df58425600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faabcd87640 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841eb40 0x55df58425010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faac1bc5740 1 -- 172.21.15.12:0/2617463442 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55df5833e060 con 0x55df5841eb40 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.535+0000 7faac1bc5740 1 -- 172.21.15.12:0/2617463442 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55df5842b190 con 0x55df5841d5d0 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.536+0000 7faac1bc5740 10 client.0 _ll_register_callbacks cb 0x55df580918c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.536+0000 7faabdd89640 1 -- 172.21.15.12:0/2617463442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df5841d5d0 msgr2=0x55df58427d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.536+0000 7faabdd89640 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df5841d5d0 0x55df58427d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.536+0000 7faabdd89640 1 -- 172.21.15.12:0/2617463442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841eb40 msgr2=0x55df58425010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.536+0000 7faabdd89640 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841eb40 0x55df58425010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.536+0000 7faabdd89640 1 -- 172.21.15.12:0/2617463442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df580f43c0 con 0x55df58428370 2024-09-16T01:02:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.536+0000 7faabdd89640 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df58428370 0x55df58425600 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faab0005fd0 tx=0x7faab00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674f7fda0b69353b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.536+0000 7faaa0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.536+0000 7faaa0ff9640 1 -- 172.21.15.12:0/2617463442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0028060 con 0x55df58428370 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.536+0000 7faaa0ff9640 1 -- 172.21.15.12:0/2617463442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7faab0019460 con 0x55df58428370 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.537+0000 7faac1bc5740 1 -- 172.21.15.12:0/2617463442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faab4038040 con 0x55df58428370 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.537+0000 7faaa0ff9640 1 -- 172.21.15.12:0/2617463442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faab0019660 con 0x55df58428370 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.537+0000 7faac1bc5740 10 client.15714 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.537+0000 7faac1bc5740 1 -- 172.21.15.12:0/2617463442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55df58436990 con 0x55df58428370 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.538+0000 7faaa0ff9640 1 -- 172.21.15.12:0/2617463442 <== mon.0 v2:172.21.15.12:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faab0017040 con 0x55df58428370 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.538+0000 7faac1bc5740 10 client.15714 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.538+0000 7faac1bc5740 10 client.15714 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.538+0000 7faac1bc5740 20 client.15714 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.538+0000 7faac1bc5740 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55df58437d40 0x55df5843a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.538+0000 7faac1bc5740 4 client.15714 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.538+0000 7faac1bc5740 1 -- 172.21.15.12:0/2617463442 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faab4038040 con 0x55df58437d40 2024-09-16T01:02:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.538+0000 7faabd588640 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55df58437d40 0x55df5843a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.538+0000 7faabd588640 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55df58437d40 0x55df5843a130 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5437d741eb4c5c10 server_cookie=516a5f61778fd0cb in_seq=0 out_seq=0 2024-09-16T01:02:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.539+0000 7faaa0ff9640 10 client.15714 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:02:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.539+0000 7faaa0ff9640 1 -- 172.21.15.12:0/2617463442 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7faab4038040 con 0x55df58437d40 2024-09-16T01:02:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.539+0000 7faaa0ff9640 10 client.15714 handle_command_reply: tid=0 2024-09-16T01:02:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.539+0000 7faac1bc5740 1 client.15714 shutdown 2024-09-16T01:02:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 1 -- 172.21.15.12:0/2617463442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df58428370 msgr2=0x55df58425600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df58428370 0x55df58425600 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faab0005fd0 tx=0x7faab00095c0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 1 -- 172.21.15.12:0/2617463442 shutdown_connections 2024-09-16T01:02:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55df58437d40 0x55df5843a130 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df58428370 0x55df58425600 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841eb40 0x55df58425010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faaa0ff9640 0 client.15714 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:02:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 1 --2- 172.21.15.12:0/2617463442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df5841d5d0 0x55df58427d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 1 -- 172.21.15.12:0/2617463442 >> 172.21.15.12:0/2617463442 conn(0x55df583e6310 msgr2=0x55df5841f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 1 -- 172.21.15.12:0/2617463442 shutdown_connections 2024-09-16T01:02:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 1 -- 172.21.15.12:0/2617463442 wait complete. 2024-09-16T01:02:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.540+0000 7faac1bc5740 20 client.15714 trim_cache size 0 max 16384 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.566+0000 7faac1bc5740 1 Processor -- start 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faac1bc5740 1 -- start start 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df58414c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df5841eb40 0x55df58426f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df58428370 0x55df58420120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faac1bc5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faab81b0fa0 con 0x55df5841d5d0 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faac1bc5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faab81b2ae0 con 0x55df58428370 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faac1bc5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faab81b1670 con 0x55df5841eb40 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faabd588640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df58414c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faabd588640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df58414c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39492/0 (socket says 172.21.15.12:39492) 2024-09-16T01:02:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faabd588640 1 -- 172.21.15.12:0/866959293 learned_addr learned my addr 172.21.15.12:0/866959293 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:11.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faabdd89640 1 --2- 172.21.15.12:0/866959293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df58428370 0x55df58420120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faabd588640 1 -- 172.21.15.12:0/866959293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df5841eb40 msgr2=0x55df58426f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faabd588640 1 --2- 172.21.15.12:0/866959293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df5841eb40 0x55df58426f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.567+0000 7faabd588640 1 -- 172.21.15.12:0/866959293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df58428370 msgr2=0x55df58420120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.568+0000 7faabd588640 1 --2- 172.21.15.12:0/866959293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df58428370 0x55df58420120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.568+0000 7faabd588640 1 -- 172.21.15.12:0/866959293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df58424000 con 0x55df5841d5d0 2024-09-16T01:02:11.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.568+0000 7faabdd89640 1 --2- 172.21.15.12:0/866959293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df58428370 0x55df58420120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:11.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.568+0000 7faabd588640 1 --2- 172.21.15.12:0/866959293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df58414c60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faab4004860 tx=0x7faab4009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f8cec295bc042f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.568+0000 7faaa2ffd640 1 -- 172.21.15.12:0/866959293 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4040040 con 0x55df5841d5d0 2024-09-16T01:02:11.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.568+0000 7faaa2ffd640 1 -- 172.21.15.12:0/866959293 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab4004380 con 0x55df5841d5d0 2024-09-16T01:02:11.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.568+0000 7faaa2ffd640 1 -- 172.21.15.12:0/866959293 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4037040 con 0x55df5841d5d0 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.569+0000 7faac1bc5740 1 -- 172.21.15.12:0/866959293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 msgr2=0x55df58414c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.569+0000 7faac1bc5740 1 --2- 172.21.15.12:0/866959293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df58414c60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faab4004860 tx=0x7faab4009850 comp rx=0 tx=0).stop 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.569+0000 7faac1bc5740 1 -- 172.21.15.12:0/866959293 shutdown_connections 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.569+0000 7faac1bc5740 1 --2- 172.21.15.12:0/866959293 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df58428370 0x55df58420120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.569+0000 7faac1bc5740 1 --2- 172.21.15.12:0/866959293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df5841eb40 0x55df58426f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.569+0000 7faac1bc5740 1 --2- 172.21.15.12:0/866959293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841d5d0 0x55df58414c60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.569+0000 7faac1bc5740 1 -- 172.21.15.12:0/866959293 >> 172.21.15.12:0/866959293 conn(0x55df583e6310 msgr2=0x55df58426870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.570+0000 7faac1bc5740 1 -- 172.21.15.12:0/866959293 shutdown_connections 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.570+0000 7faac1bc5740 1 -- 172.21.15.12:0/866959293 wait complete. 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.570+0000 7faac1bc5740 1 -- start start 2024-09-16T01:02:11.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.570+0000 7faac1bc5740 1 Processor -- start 2024-09-16T01:02:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841d5d0 0x55df58430420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841eb40 0x55df58430960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faac1bc5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df58428370 0x55df5842d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faac1bc5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faab81b2410 con 0x55df5841eb40 2024-09-16T01:02:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faac1bc5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faab81b1d40 con 0x55df5841d5d0 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faac1bc5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faab81aef80 con 0x55df58428370 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faabd588640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841d5d0 0x55df58430420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faabd588640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841d5d0 0x55df58430420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:58412/0 (socket says 172.21.15.12:58412) 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faabd588640 1 -- 172.21.15.12:0/1348632539 learned_addr learned my addr 172.21.15.12:0/1348632539 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faac1bc5740 10 client.0 _ll_register_callbacks cb 0x7faab00097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faabdd89640 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df58428370 0x55df5842d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faabd588640 1 -- 172.21.15.12:0/1348632539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df58428370 msgr2=0x55df5842d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faabd588640 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df58428370 0x55df5842d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faabd588640 1 -- 172.21.15.12:0/1348632539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841eb40 msgr2=0x55df58430960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.571+0000 7faabd588640 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841eb40 0x55df58430960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.572+0000 7faabd588640 1 -- 172.21.15.12:0/1348632539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df5842d930 con 0x55df5841d5d0 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.572+0000 7faabd588640 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841d5d0 0x55df58430420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faab4005e00 tx=0x7faab4030890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45acf25ba4042f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.572+0000 7faaa0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T01:02:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.572+0000 7faaa0ff9640 1 -- 172.21.15.12:0/1348632539 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab405b060 con 0x55df5841d5d0 2024-09-16T01:02:11.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.572+0000 7faaa0ff9640 1 -- 172.21.15.12:0/1348632539 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7faab4030c90 con 0x55df5841d5d0 2024-09-16T01:02:11.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.572+0000 7faac1bc5740 1 -- 172.21.15.12:0/1348632539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faab4004380 con 0x55df5841d5d0 2024-09-16T01:02:11.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.572+0000 7faaa0ff9640 1 -- 172.21.15.12:0/1348632539 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faab4062050 con 0x55df5841d5d0 2024-09-16T01:02:11.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.573+0000 7faac1bc5740 10 client.25337 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:11.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.573+0000 7faac1bc5740 1 -- 172.21.15.12:0/1348632539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55df584ab7d0 con 0x55df5841d5d0 2024-09-16T01:02:11.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.573+0000 7faaa0ff9640 1 -- 172.21.15.12:0/1348632539 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab4004380 con 0x55df5841d5d0 2024-09-16T01:02:11.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.573+0000 7faaa0ff9640 1 -- 172.21.15.12:0/1348632539 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faab404e580 con 0x55df5841d5d0 2024-09-16T01:02:11.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.573+0000 7faac1bc5740 10 client.25337 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:11.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.573+0000 7faac1bc5740 10 client.25337 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-16T01:02:11.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.573+0000 7faac1bc5740 20 client.25337 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.573+0000 7faac1bc5740 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55df584aba50 0x55df584ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.573+0000 7faac1bc5740 4 client.25337 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.574+0000 7faac1bc5740 1 -- 172.21.15.12:0/1348632539 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55df58390860 con 0x55df584aba50 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.574+0000 7faabcd87640 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55df584aba50 0x55df584ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.574+0000 7faabcd87640 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55df584aba50 0x55df584ade40 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1b9c430471770ac6 server_cookie=a86fb26ad898cc3f in_seq=0 out_seq=0 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.574+0000 7faaa0ff9640 10 client.25337 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faaa0ff9640 1 -- 172.21.15.12:0/1348632539 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55df58390860 con 0x55df584aba50 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faaa0ff9640 10 client.25337 handle_command_reply: tid=0 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 client.25337 shutdown 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 -- 172.21.15.12:0/1348632539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841d5d0 msgr2=0x55df58430420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841d5d0 0x55df58430420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faab4005e00 tx=0x7faab4030890 comp rx=0 tx=0).stop 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 -- 172.21.15.12:0/1348632539 shutdown_connections 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x55df584aba50 0x55df584ade40 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df58428370 0x55df5842d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faaa0ff9640 0 client.25337 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:02:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df5841eb40 0x55df58430960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 --2- 172.21.15.12:0/1348632539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55df5841d5d0 0x55df58430420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 -- 172.21.15.12:0/1348632539 >> 172.21.15.12:0/1348632539 conn(0x55df583e6310 msgr2=0x55df58418d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 -- 172.21.15.12:0/1348632539 shutdown_connections 2024-09-16T01:02:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.575+0000 7faac1bc5740 1 -- 172.21.15.12:0/1348632539 wait complete. 2024-09-16T01:02:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.576+0000 7faac1bc5740 20 client.25337 trim_cache size 0 max 16384 2024-09-16T01:02:11.579 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.576+0000 7faabf7ec640 1 -- 172.21.15.12:0/659587711 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faaa40a32c0 msgr2=0x7faaa40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.576+0000 7faabf7ec640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faaa40a32c0 0x7faaa40a5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faab0009330 tx=0x7faab00092a0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.576+0000 7faabf7ec640 1 -- 172.21.15.12:0/659587711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faab8102570 msgr2=0x7faab8198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.576+0000 7faabf7ec640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faab8102570 0x7faab8198ab0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faaa800d950 tx=0x7faaa800de10 comp rx=0 tx=0).stop 2024-09-16T01:02:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.577+0000 7faabf7ec640 1 -- 172.21.15.12:0/659587711 shutdown_connections 2024-09-16T01:02:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.577+0000 7faabf7ec640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faaa40a32c0 0x7faaa40a5780 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.577+0000 7faabf7ec640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faab8102ef0 0x7faab819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.577+0000 7faabf7ec640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faab8102570 0x7faab8198ab0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.577+0000 7faabf7ec640 1 --2- 172.21.15.12:0/659587711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faab8100e20 0x7faab8198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.577+0000 7faabf7ec640 1 -- 172.21.15.12:0/659587711 >> 172.21.15.12:0/659587711 conn(0x7faab80fc7d0 msgr2=0x7faab806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.577+0000 7faabf7ec640 1 -- 172.21.15.12:0/659587711 shutdown_connections 2024-09-16T01:02:11.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:11.577+0000 7faabf7ec640 1 -- 172.21.15.12:0/659587711 wait complete. 2024-09-16T01:02:12.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:12 smithi119 ceph-mon[35049]: pgmap v393: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:02:12.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:12 smithi012 ceph-mon[31197]: pgmap v393: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:02:12.391 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-16T01:02:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:12 smithi098 ceph-mon[35346]: pgmap v393: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:02:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:13.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.250+0000 7ff20157e640 1 -- 172.21.15.12:0/3670144138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1fc102d30 msgr2=0x7ff1fc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.250+0000 7ff20157e640 1 --2- 172.21.15.12:0/3670144138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1fc102d30 0x7ff1fc103110 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009930 tx=0x7ff1ec02a440 comp rx=0 tx=0).stop 2024-09-16T01:02:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.250+0000 7ff20157e640 1 -- 172.21.15.12:0/3670144138 shutdown_connections 2024-09-16T01:02:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.250+0000 7ff20157e640 1 --2- 172.21.15.12:0/3670144138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc1082a0 0x7ff1fc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.250+0000 7ff20157e640 1 --2- 172.21.15.12:0/3670144138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1fc1036e0 0x7ff1fc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.250+0000 7ff20157e640 1 --2- 172.21.15.12:0/3670144138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1fc102d30 0x7ff1fc103110 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.250+0000 7ff20157e640 1 -- 172.21.15.12:0/3670144138 >> 172.21.15.12:0/3670144138 conn(0x7ff1fc0fc7d0 msgr2=0x7ff1fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.250+0000 7ff20157e640 1 -- 172.21.15.12:0/3670144138 shutdown_connections 2024-09-16T01:02:13.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.251+0000 7ff20157e640 1 -- 172.21.15.12:0/3670144138 wait complete. 2024-09-16T01:02:13.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.252+0000 7ff20157e640 1 Processor -- start 2024-09-16T01:02:13.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.252+0000 7ff20157e640 1 -- start start 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.252+0000 7ff20157e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1fc102d30 0x7ff1fc1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.252+0000 7ff20157e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1fc1036e0 0x7ff1fc198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.252+0000 7ff20157e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc1082a0 0x7ff1fc19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.252+0000 7ff20157e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc1120a0 con 0x7ff1fc1036e0 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.252+0000 7ff20157e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc111f20 con 0x7ff1fc102d30 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.252+0000 7ff20157e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc112220 con 0x7ff1fc1082a0 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1faffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1fc102d30 0x7ff1fc1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc1082a0 0x7ff1fc19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1fc1036e0 0x7ff1fc198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc1082a0 0x7ff1fc19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:46902/0 (socket says 172.21.15.12:46902) 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fb7fe640 1 -- 172.21.15.12:0/3353559125 learned_addr learned my addr 172.21.15.12:0/3353559125 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:13.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fb7fe640 1 -- 172.21.15.12:0/3353559125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1fc102d30 msgr2=0x7ff1fc1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fb7fe640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1fc102d30 0x7ff1fc1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fb7fe640 1 -- 172.21.15.12:0/3353559125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1fc1036e0 msgr2=0x7ff1fc198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fb7fe640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1fc1036e0 0x7ff1fc198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fb7fe640 1 -- 172.21.15.12:0/3353559125 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1fc19d570 con 0x7ff1fc1082a0 2024-09-16T01:02:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1faffd640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1fc102d30 0x7ff1fc1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1fc1036e0 0x7ff1fc198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.253+0000 7ff1fb7fe640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc1082a0 0x7ff1fc19ce90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400cad0 tx=0x7ff1f400cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.254+0000 7ff1e3fff640 1 -- 172.21.15.12:0/3353559125 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f400ae20 con 0x7ff1fc1082a0 2024-09-16T01:02:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.254+0000 7ff1e3fff640 1 -- 172.21.15.12:0/3353559125 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1f4005020 con 0x7ff1fc1082a0 2024-09-16T01:02:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.254+0000 7ff1e3fff640 1 -- 172.21.15.12:0/3353559125 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f400f780 con 0x7ff1fc1082a0 2024-09-16T01:02:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.254+0000 7ff20157e640 1 -- 172.21.15.12:0/3353559125 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1fc19d860 con 0x7ff1fc1082a0 2024-09-16T01:02:13.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.254+0000 7ff20157e640 1 -- 172.21.15.12:0/3353559125 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1fc1a5140 con 0x7ff1fc1082a0 2024-09-16T01:02:13.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.257+0000 7ff1e3fff640 1 -- 172.21.15.12:0/3353559125 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff1f4005540 con 0x7ff1fc1082a0 2024-09-16T01:02:13.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.257+0000 7ff203957740 1 Processor -- start 2024-09-16T01:02:13.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff203957740 1 -- start start 2024-09-16T01:02:13.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff203957740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23440 0x55e1bea23820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff203957740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23df0 0x55e1bea28470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff203957740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea28ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff203957740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e1be97f2f0 con 0x55e1bea28a40 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff203957740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e1be926cf0 con 0x55e1bea23440 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff203957740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e1be97b2b0 con 0x55e1bea23df0 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff1fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea28ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff1fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea28ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39534/0 (socket says 172.21.15.12:39534) 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/3337711713 learned_addr learned my addr 172.21.15.12:0/3337711713 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.258+0000 7ff1faffd640 1 --2- 172.21.15.12:0/3337711713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23df0 0x55e1bea28470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.259+0000 7ff1e3fff640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1e40a32c0 0x7ff1e40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.259+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/3337711713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23df0 msgr2=0x55e1bea28470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.259+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/3337711713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23df0 0x55e1bea28470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.259+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/3337711713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23440 msgr2=0x55e1bea23820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:02:13.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.259+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/3337711713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23440 0x55e1bea23820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.259+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/3337711713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1be90b3a0 con 0x55e1bea28a40 2024-09-16T01:02:13.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.259+0000 7ff1fb7fe640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1e40a32c0 0x7ff1e40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.259+0000 7ff1e3fff640 1 -- 172.21.15.12:0/3353559125 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7ff1f40cfd10 con 0x7ff1fc1082a0 2024-09-16T01:02:13.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.259+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/3337711713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea28ef0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000bd00 tx=0x7ff1f000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4305c161d1a01607 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.260+0000 7ff1e17fa640 1 -- 172.21.15.12:0/3337711713 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0015070 con 0x55e1bea28a40 2024-09-16T01:02:13.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.260+0000 7ff1fb7fe640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1e40a32c0 0x7ff1e40a5780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40a46b0 tx=0x7ff1f4091450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.260+0000 7ff1e17fa640 1 -- 172.21.15.12:0/3337711713 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1f001a940 con 0x55e1bea28a40 2024-09-16T01:02:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.261+0000 7ff1e17fa640 1 -- 172.21.15.12:0/3337711713 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0011aa0 con 0x55e1bea28a40 2024-09-16T01:02:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.261+0000 7ff203957740 1 -- 172.21.15.12:0/3337711713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 msgr2=0x55e1bea28ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.261+0000 7ff203957740 1 --2- 172.21.15.12:0/3337711713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea28ef0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000bd00 tx=0x7ff1f000f730 comp rx=0 tx=0).stop 2024-09-16T01:02:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.261+0000 7ff203957740 1 -- 172.21.15.12:0/3337711713 shutdown_connections 2024-09-16T01:02:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.261+0000 7ff203957740 1 --2- 172.21.15.12:0/3337711713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea28ef0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.261+0000 7ff203957740 1 --2- 172.21.15.12:0/3337711713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23df0 0x55e1bea28470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.261+0000 7ff203957740 1 --2- 172.21.15.12:0/3337711713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23440 0x55e1bea23820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.261+0000 7ff203957740 1 -- 172.21.15.12:0/3337711713 >> 172.21.15.12:0/3337711713 conn(0x55e1be9e2310 msgr2=0x55e1bea156e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.261+0000 7ff203957740 1 -- 172.21.15.12:0/3337711713 shutdown_connections 2024-09-16T01:02:13.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.261+0000 7ff203957740 1 -- 172.21.15.12:0/3337711713 wait complete. 2024-09-16T01:02:13.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.262+0000 7ff203957740 1 -- start start 2024-09-16T01:02:13.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.262+0000 7ff203957740 1 Processor -- start 2024-09-16T01:02:13.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.262+0000 7ff203957740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea2edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.262+0000 7ff203957740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23df0 0x55e1bea2c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.262+0000 7ff203957740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea2c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.262+0000 7ff203957740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e1bea2f920 con 0x55e1bea28a40 2024-09-16T01:02:13.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.262+0000 7ff203957740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e1be93a060 con 0x55e1bea23df0 2024-09-16T01:02:13.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.262+0000 7ff203957740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e1bea2faa0 con 0x55e1bea23440 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff203957740 10 client.0 _ll_register_callbacks cb 0x55e1be68d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1fa7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea2edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1fa7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea2edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:46916/0 (socket says 172.21.15.12:46916) 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/2901489031 learned_addr learned my addr 172.21.15.12:0/2901489031 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea2c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1faffd640 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23df0 0x55e1bea2c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/2901489031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23df0 msgr2=0x55e1bea2c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23df0 0x55e1bea2c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/2901489031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 msgr2=0x55e1bea2c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea2c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/2901489031 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1be6f03c0 con 0x55e1bea23440 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea2edd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0011780 tx=0x7ff1f0011680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9feeffa388159e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.263+0000 7ff1deff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-16T01:02:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.264+0000 7ff1deff5640 1 -- 172.21.15.12:0/2901489031 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0015040 con 0x55e1bea23440 2024-09-16T01:02:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.264+0000 7ff1deff5640 1 -- 172.21.15.12:0/2901489031 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7ff1f001aaf0 con 0x55e1bea23440 2024-09-16T01:02:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.264+0000 7ff203957740 1 -- 172.21.15.12:0/2901489031 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1f001a940 con 0x55e1bea23440 2024-09-16T01:02:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.264+0000 7ff1deff5640 1 -- 172.21.15.12:0/2901489031 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff1f001acf0 con 0x55e1bea23440 2024-09-16T01:02:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.264+0000 7ff203957740 10 client.25300 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.264+0000 7ff203957740 1 -- 172.21.15.12:0/2901489031 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e1bea3b2d0 con 0x55e1bea23440 2024-09-16T01:02:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.265+0000 7ff1deff5640 1 -- 172.21.15.12:0/2901489031 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1f001a940 con 0x55e1bea23440 2024-09-16T01:02:13.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.265+0000 7ff1deff5640 1 -- 172.21.15.12:0/2901489031 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff1f0011cb0 con 0x55e1bea23440 2024-09-16T01:02:13.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.265+0000 7ff203957740 10 client.25300 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.265+0000 7ff203957740 10 client.25300 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.265+0000 7ff203957740 20 client.25300 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.265+0000 7ff203957740 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e1bea3c620 0x55e1bea3ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.265+0000 7ff203957740 4 client.25300 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.265+0000 7ff203957740 1 -- 172.21.15.12:0/2901489031 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1be98c860 con 0x55e1bea3c620 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.265+0000 7ff1faffd640 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e1bea3c620 0x55e1bea3ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.266+0000 7ff1deff5640 10 client.25300 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.266+0000 7ff1faffd640 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e1bea3c620 0x55e1bea3ea10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5778d8469f9bf833 server_cookie=e166f747d850ca82 in_seq=0 out_seq=0 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff1deff5640 1 -- 172.21.15.12:0/2901489031 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1be98c860 con 0x55e1bea3c620 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff1deff5640 10 client.25300 handle_command_reply: tid=0 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 client.25300 shutdown 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 -- 172.21.15.12:0/2901489031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 msgr2=0x55e1bea2edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea2edd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0011780 tx=0x7ff1f0011680 comp rx=0 tx=0).stop 2024-09-16T01:02:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 -- 172.21.15.12:0/2901489031 shutdown_connections 2024-09-16T01:02:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e1bea3c620 0x55e1bea3ea10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff1deff5640 0 client.25300 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:02:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea2c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23df0 0x55e1bea2c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 --2- 172.21.15.12:0/2901489031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea2edd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 -- 172.21.15.12:0/2901489031 >> 172.21.15.12:0/2901489031 conn(0x55e1be9e2310 msgr2=0x55e1bea22a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 -- 172.21.15.12:0/2901489031 shutdown_connections 2024-09-16T01:02:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 1 -- 172.21.15.12:0/2901489031 wait complete. 2024-09-16T01:02:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.267+0000 7ff203957740 20 client.25300 trim_cache size 0 max 16384 2024-09-16T01:02:13.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.293+0000 7ff203957740 1 Processor -- start 2024-09-16T01:02:13.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.293+0000 7ff203957740 1 -- start start 2024-09-16T01:02:13.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff203957740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea38c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff203957740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea23df0 0x55e1bea27820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff203957740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea28a40 0x55e1bea27d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff203957740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc1aca30 con 0x55e1bea23df0 2024-09-16T01:02:13.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff203957740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc1ae570 con 0x55e1bea28a40 2024-09-16T01:02:13.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff203957740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc1ad100 con 0x55e1bea23440 2024-09-16T01:02:13.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1fa7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea38c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1fa7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea38c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:46920/0 (socket says 172.21.15.12:46920) 2024-09-16T01:02:13.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/3442199635 learned_addr learned my addr 172.21.15.12:0/3442199635 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:13.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/3442199635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea28a40 0x55e1bea27d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1faffd640 1 --2- 172.21.15.12:0/3442199635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea23df0 0x55e1bea27820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/3442199635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea28a40 msgr2=0x55e1bea27d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/3442199635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea28a40 0x55e1bea27d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/3442199635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea23df0 msgr2=0x55e1bea27820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/3442199635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea23df0 0x55e1bea27820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/3442199635 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1bea2c8f0 con 0x55e1bea23440 2024-09-16T01:02:13.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.294+0000 7ff1faffd640 1 --2- 172.21.15.12:0/3442199635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea23df0 0x55e1bea27820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:13.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.295+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/3442199635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea38c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000b5c0 tx=0x7ff1f000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d4eaadfda2eb686 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.295+0000 7ff1e0ff9640 1 -- 172.21.15.12:0/3442199635 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f003b070 con 0x55e1bea23440 2024-09-16T01:02:13.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.295+0000 7ff1e0ff9640 1 -- 172.21.15.12:0/3442199635 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1f000fc30 con 0x55e1bea23440 2024-09-16T01:02:13.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.295+0000 7ff1e0ff9640 1 -- 172.21.15.12:0/3442199635 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0003ca0 con 0x55e1bea23440 2024-09-16T01:02:13.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.296+0000 7ff203957740 1 -- 172.21.15.12:0/3442199635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 msgr2=0x55e1bea38c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.296+0000 7ff203957740 1 --2- 172.21.15.12:0/3442199635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea38c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000b5c0 tx=0x7ff1f000f730 comp rx=0 tx=0).stop 2024-09-16T01:02:13.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.296+0000 7ff203957740 1 -- 172.21.15.12:0/3442199635 shutdown_connections 2024-09-16T01:02:13.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.296+0000 7ff203957740 1 --2- 172.21.15.12:0/3442199635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea28a40 0x55e1bea27d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.296+0000 7ff203957740 1 --2- 172.21.15.12:0/3442199635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea23df0 0x55e1bea27820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.296+0000 7ff203957740 1 --2- 172.21.15.12:0/3442199635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea38c10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.296+0000 7ff203957740 1 -- 172.21.15.12:0/3442199635 >> 172.21.15.12:0/3442199635 conn(0x55e1be9e2310 msgr2=0x55e1bea22a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.296+0000 7ff203957740 1 -- 172.21.15.12:0/3442199635 shutdown_connections 2024-09-16T01:02:13.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.296+0000 7ff203957740 1 -- 172.21.15.12:0/3442199635 wait complete. 2024-09-16T01:02:13.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.297+0000 7ff203957740 1 -- start start 2024-09-16T01:02:13.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.297+0000 7ff203957740 1 Processor -- start 2024-09-16T01:02:13.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.297+0000 7ff203957740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea355a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.297+0000 7ff203957740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23df0 0x55e1bea43af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.297+0000 7ff203957740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea440b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.297+0000 7ff1fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.297+0000 7ff1fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea440b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39564/0 (socket says 172.21.15.12:39564) 2024-09-16T01:02:13.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/4144044171 learned_addr learned my addr 172.21.15.12:0/4144044171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:13.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff1faffd640 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23df0 0x55e1bea43af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc1adea0 con 0x55e1bea28a40 2024-09-16T01:02:13.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc1ad7d0 con 0x55e1bea23df0 2024-09-16T01:02:13.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc1aaa10 con 0x55e1bea23440 2024-09-16T01:02:13.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/4144044171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 msgr2=0x55e1bea355a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:02:13.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea355a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/4144044171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23df0 msgr2=0x55e1bea43af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23df0 0x55e1bea43af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff1fa7fc640 1 -- 172.21.15.12:0/4144044171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1bea448e0 con 0x55e1bea28a40 2024-09-16T01:02:13.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff203957740 10 client.0 _ll_register_callbacks cb 0x7ff1ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:13.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1f000fc30 con 0x55e1bea28a40 2024-09-16T01:02:13.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.298+0000 7ff1fa7fc640 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea440b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff1f001acc0 tx=0x7ff1f0011680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2abc47ceb455d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff1deff5640 10 client.15735 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:13.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff1deff5640 1 -- 172.21.15.12:0/4144044171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f003b040 con 0x55e1bea28a40 2024-09-16T01:02:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff1deff5640 1 -- 172.21.15.12:0/4144044171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7ff1f0004310 con 0x55e1bea28a40 2024-09-16T01:02:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff1deff5640 1 -- 172.21.15.12:0/4144044171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff1f001a460 con 0x55e1bea28a40 2024-09-16T01:02:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff203957740 10 client.15735 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e1bea33ef0 con 0x55e1bea28a40 2024-09-16T01:02:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff1deff5640 1 -- 172.21.15.12:0/4144044171 <== mon.0 v2:172.21.15.12:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff1f0011730 con 0x55e1bea28a40 2024-09-16T01:02:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff203957740 10 client.15735 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff203957740 10 client.15735 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-16T01:02:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff203957740 20 client.15735 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.299+0000 7ff203957740 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e1bea3c620 0x55e1beaa94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.300+0000 7ff203957740 4 client.15735 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.300+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1be986d70 con 0x55e1bea3c620 2024-09-16T01:02:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.300+0000 7ff1faffd640 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e1bea3c620 0x55e1beaa94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.300+0000 7ff1deff5640 10 client.15735 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:02:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.300+0000 7ff1faffd640 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e1bea3c620 0x55e1beaa94e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9170d41bc72a04d3 server_cookie=d0cb074f3f713224 in_seq=0 out_seq=0 2024-09-16T01:02:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff1deff5640 1 -- 172.21.15.12:0/4144044171 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1be986d70 con 0x55e1bea3c620 2024-09-16T01:02:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff1deff5640 10 client.15735 handle_command_reply: tid=0 2024-09-16T01:02:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 client.15735 shutdown 2024-09-16T01:02:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 msgr2=0x55e1bea440b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea440b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff1f001acc0 tx=0x7ff1f0011680 comp rx=0 tx=0).stop 2024-09-16T01:02:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 shutdown_connections 2024-09-16T01:02:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55e1bea3c620 0x55e1beaa94e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1bea28a40 0x55e1bea440b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff1deff5640 0 client.15735 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:02:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1bea23df0 0x55e1bea43af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 --2- 172.21.15.12:0/4144044171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1bea23440 0x55e1bea355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 >> 172.21.15.12:0/4144044171 conn(0x55e1be9e2310 msgr2=0x55e1bea144e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 shutdown_connections 2024-09-16T01:02:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 1 -- 172.21.15.12:0/4144044171 wait complete. 2024-09-16T01:02:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.301+0000 7ff203957740 20 client.15735 trim_cache size 0 max 16384 2024-09-16T01:02:13.318 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:13.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.302+0000 7ff20157e640 1 -- 172.21.15.12:0/3353559125 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1e40a32c0 msgr2=0x7ff1e40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.302+0000 7ff20157e640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1e40a32c0 0x7ff1e40a5780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40a46b0 tx=0x7ff1f4091450 comp rx=0 tx=0).stop 2024-09-16T01:02:13.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.302+0000 7ff20157e640 1 -- 172.21.15.12:0/3353559125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc1082a0 msgr2=0x7ff1fc19ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.302+0000 7ff20157e640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc1082a0 0x7ff1fc19ce90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400cad0 tx=0x7ff1f400cf90 comp rx=0 tx=0).stop 2024-09-16T01:02:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.302+0000 7ff20157e640 1 -- 172.21.15.12:0/3353559125 shutdown_connections 2024-09-16T01:02:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.302+0000 7ff20157e640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ff1e40a32c0 0x7ff1e40a5780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.302+0000 7ff20157e640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1fc1082a0 0x7ff1fc19ce90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.302+0000 7ff20157e640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1fc1036e0 0x7ff1fc198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.302+0000 7ff20157e640 1 --2- 172.21.15.12:0/3353559125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1fc102d30 0x7ff1fc1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.302+0000 7ff20157e640 1 -- 172.21.15.12:0/3353559125 >> 172.21.15.12:0/3353559125 conn(0x7ff1fc0fc7d0 msgr2=0x7ff1fc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.303+0000 7ff20157e640 1 -- 172.21.15.12:0/3353559125 shutdown_connections 2024-09-16T01:02:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:13.303+0000 7ff20157e640 1 -- 172.21.15.12:0/3353559125 wait complete. 2024-09-16T01:02:14.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-16T01:02:14.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:14 smithi119 ceph-mon[35049]: pgmap v394: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2024-09-16T01:02:14.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:14 smithi012 ceph-mon[31197]: pgmap v394: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2024-09-16T01:02:14.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:14 smithi098 ceph-mon[35346]: pgmap v394: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2024-09-16T01:02:14.557 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.084+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/916012462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc58108290 msgr2=0x7fdc5810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.084+0000 7fdc5cb2e640 1 --2- 172.21.15.12:0/916012462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc58108290 0x7fdc5810ec30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009cd0 tx=0x7fdc5002a8e0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.084+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/916012462 shutdown_connections 2024-09-16T01:02:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.084+0000 7fdc5cb2e640 1 --2- 172.21.15.12:0/916012462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc58108290 0x7fdc5810ec30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.084+0000 7fdc5cb2e640 1 --2- 172.21.15.12:0/916012462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc58103740 0x7fdc58107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.084+0000 7fdc5cb2e640 1 --2- 172.21.15.12:0/916012462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc58102d90 0x7fdc58103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.084+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/916012462 >> 172.21.15.12:0/916012462 conn(0x7fdc580fc7d0 msgr2=0x7fdc580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.085+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/916012462 shutdown_connections 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.085+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/916012462 wait complete. 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5cb2e640 1 Processor -- start 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5cb2e640 1 -- start start 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5cb2e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc58102d90 0x7fdc581963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5cb2e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc58103740 0x7fdc58196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5cb2e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc58108290 0x7fdc5819aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5cb2e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5810fef0 con 0x7fdc58102d90 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5cb2e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5810fd70 con 0x7fdc58108290 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5cb2e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58110070 con 0x7fdc58103740 2024-09-16T01:02:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc58102d90 0x7fdc581963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc58102d90 0x7fdc581963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39576/0 (socket says 172.21.15.12:39576) 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5659c640 1 -- 172.21.15.12:0/1609163544 learned_addr learned my addr 172.21.15.12:0/1609163544 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc55d9b640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc58103740 0x7fdc58196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5659c640 1 -- 172.21.15.12:0/1609163544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc58103740 msgr2=0x7fdc58196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc58108290 0x7fdc5819aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5659c640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc58103740 0x7fdc58196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.086+0000 7fdc5659c640 1 -- 172.21.15.12:0/1609163544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc58108290 msgr2=0x7fdc5819aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.087+0000 7fdc5659c640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc58108290 0x7fdc5819aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.087+0000 7fdc5659c640 1 -- 172.21.15.12:0/1609163544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5819b380 con 0x7fdc58102d90 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.087+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc58108290 0x7fdc5819aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.087+0000 7fdc5659c640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc58102d90 0x7fdc581963d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009be0 tx=0x7fdc480071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:15.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.087+0000 7fdc477fe640 1 -- 172.21.15.12:0/1609163544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48007e00 con 0x7fdc58102d90 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.087+0000 7fdc477fe640 1 -- 172.21.15.12:0/1609163544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc4801e070 con 0x7fdc58102d90 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.087+0000 7fdc477fe640 1 -- 172.21.15.12:0/1609163544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48018890 con 0x7fdc58102d90 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.087+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/1609163544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5819b670 con 0x7fdc58102d90 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.087+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/1609163544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc581a2f50 con 0x7fdc58102d90 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.091+0000 7fdc5ef07740 1 Processor -- start 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.091+0000 7fdc5ef07740 1 -- start start 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.091+0000 7fdc477fe640 1 -- 172.21.15.12:0/1609163544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdc48019b60 con 0x7fdc58102d90 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.091+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d13090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.091+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d135d0 0x5603d8d13a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.091+0000 7fdc56d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d13090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.091+0000 7fdc56d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d13090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39580/0 (socket says 172.21.15.12:39580) 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.091+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d1e370 0x5603d8d20760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc5ef07740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5603d8c792f0 con 0x5603d8d14b40 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc5ef07740 1 -- 172.21.15.12:0/58657608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5603d8c20cf0 con 0x5603d8d135d0 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc56d9d640 1 -- 172.21.15.12:0/58657608 learned_addr learned my addr 172.21.15.12:0/58657608 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc5ef07740 1 -- 172.21.15.12:0/58657608 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5603d8c752b0 con 0x5603d8d1e370 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc5659c640 1 --2- 172.21.15.12:0/58657608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d135d0 0x5603d8d13a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc56d9d640 1 -- 172.21.15.12:0/58657608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d1e370 msgr2=0x5603d8d20760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/58657608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d1e370 0x5603d8d20760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc56d9d640 1 -- 172.21.15.12:0/58657608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d135d0 msgr2=0x5603d8d13a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/58657608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d135d0 0x5603d8d13a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc56d9d640 1 -- 172.21.15.12:0/58657608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603d8c053a0 con 0x5603d8d14b40 2024-09-16T01:02:15.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc5659c640 1 --2- 172.21.15.12:0/58657608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d135d0 0x5603d8d13a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.092+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/58657608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d13090 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009df0 tx=0x7fdc50031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb691efb77471f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.093+0000 7fdc44ff9640 1 -- 172.21.15.12:0/58657608 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc500318c0 con 0x5603d8d14b40 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.093+0000 7fdc477fe640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc400a3340 0x7fdc400a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.093+0000 7fdc44ff9640 1 -- 172.21.15.12:0/58657608 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc50036040 con 0x5603d8d14b40 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.093+0000 7fdc44ff9640 1 -- 172.21.15.12:0/58657608 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc500045d0 con 0x5603d8d14b40 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.093+0000 7fdc477fe640 1 -- 172.21.15.12:0/1609163544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fdc480d3640 con 0x7fdc58102d90 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.093+0000 7fdc5659c640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc400a3340 0x7fdc400a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5659c640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc400a3340 0x7fdc400a5800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800f760 tx=0x7fdc4800fa60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5ef07740 1 -- 172.21.15.12:0/58657608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 msgr2=0x5603d8d13090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/58657608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d13090 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009df0 tx=0x7fdc50031430 comp rx=0 tx=0).stop 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5ef07740 1 -- 172.21.15.12:0/58657608 shutdown_connections 2024-09-16T01:02:15.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/58657608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d1e370 0x5603d8d20760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/58657608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d135d0 0x5603d8d13a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/58657608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d13090 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5ef07740 1 -- 172.21.15.12:0/58657608 >> 172.21.15.12:0/58657608 conn(0x5603d8cdc310 msgr2=0x5603d8d0fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5ef07740 1 -- 172.21.15.12:0/58657608 shutdown_connections 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5ef07740 1 -- 172.21.15.12:0/58657608 wait complete. 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.094+0000 7fdc5ef07740 1 -- start start 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc5ef07740 1 Processor -- start 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d135d0 0x5603d8d1dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d14b40 0x5603d8d1b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d1e370 0x5603d8d1b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc5ef07740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5603d8d21010 con 0x5603d8d1e370 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc5ef07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5603d8c34060 con 0x5603d8d14b40 2024-09-16T01:02:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc5ef07740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5603d8d21190 con 0x5603d8d135d0 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc5ef07740 10 client.0 _ll_register_callbacks cb 0x5603d89878c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc56d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d1e370 0x5603d8d1b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc56d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d1e370 0x5603d8d1b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39588/0 (socket says 172.21.15.12:39588) 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc56d9d640 1 -- 172.21.15.12:0/2081256912 learned_addr learned my addr 172.21.15.12:0/2081256912 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc55d9b640 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d14b40 0x5603d8d1b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d135d0 0x5603d8d1dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc56d9d640 1 -- 172.21.15.12:0/2081256912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d135d0 msgr2=0x5603d8d1dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d135d0 0x5603d8d1dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc56d9d640 1 -- 172.21.15.12:0/2081256912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d14b40 msgr2=0x5603d8d1b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d14b40 0x5603d8d1b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.095+0000 7fdc56d9d640 1 -- 172.21.15.12:0/2081256912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603d89ea3c0 con 0x5603d8d1e370 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.096+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d1e370 0x5603d8d1b7d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdc50006010 tx=0x7fdc50004150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fe4ee67fe61aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.096+0000 7fdc3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.096+0000 7fdc3dffb640 1 -- 172.21.15.12:0/2081256912 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5004e040 con 0x5603d8d1e370 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.096+0000 7fdc3dffb640 1 -- 172.21.15.12:0/2081256912 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fdc50003970 con 0x5603d8d1e370 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.096+0000 7fdc5ef07740 1 -- 172.21.15.12:0/2081256912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc50036040 con 0x5603d8d1e370 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.096+0000 7fdc3dffb640 1 -- 172.21.15.12:0/2081256912 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdc5005b050 con 0x5603d8d1e370 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.096+0000 7fdc5ef07740 10 client.15747 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.096+0000 7fdc5ef07740 1 -- 172.21.15.12:0/2081256912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5603d8d2cab0 con 0x5603d8d1e370 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.096+0000 7fdc3dffb640 1 -- 172.21.15.12:0/2081256912 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc50036040 con 0x5603d8d1e370 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.097+0000 7fdc3dffb640 1 -- 172.21.15.12:0/2081256912 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdc50030070 con 0x5603d8d1e370 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.097+0000 7fdc5ef07740 10 client.15747 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:15.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.097+0000 7fdc5ef07740 10 client.15747 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.097+0000 7fdc5ef07740 20 client.15747 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.097+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5603d8d2de00 0x5603d8d301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.097+0000 7fdc5ef07740 4 client.15747 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.097+0000 7fdc5ef07740 1 -- 172.21.15.12:0/2081256912 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603d8c86860 con 0x5603d8d2de00 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.097+0000 7fdc55d9b640 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5603d8d2de00 0x5603d8d301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.097+0000 7fdc3dffb640 10 client.15747 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.097+0000 7fdc55d9b640 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5603d8d2de00 0x5603d8d301f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45eadea1e5d24d7f server_cookie=4818f7301db6546d in_seq=0 out_seq=0 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc3dffb640 1 -- 172.21.15.12:0/2081256912 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603d8c86860 con 0x5603d8d2de00 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc3dffb640 10 client.15747 handle_command_reply: tid=0 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc5ef07740 1 client.15747 shutdown 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc5ef07740 1 -- 172.21.15.12:0/2081256912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d1e370 msgr2=0x5603d8d1b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d1e370 0x5603d8d1b7d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdc50006010 tx=0x7fdc50004150 comp rx=0 tx=0).stop 2024-09-16T01:02:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc5ef07740 1 -- 172.21.15.12:0/2081256912 shutdown_connections 2024-09-16T01:02:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5603d8d2de00 0x5603d8d301f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc3dffb640 0 client.15747 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d1e370 0x5603d8d1b7d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d14b40 0x5603d8d1b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/2081256912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d135d0 0x5603d8d1dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.098+0000 7fdc5ef07740 1 -- 172.21.15.12:0/2081256912 >> 172.21.15.12:0/2081256912 conn(0x5603d8cdc310 msgr2=0x5603d8d15930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.099+0000 7fdc5ef07740 1 -- 172.21.15.12:0/2081256912 shutdown_connections 2024-09-16T01:02:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.099+0000 7fdc5ef07740 1 -- 172.21.15.12:0/2081256912 wait complete. 2024-09-16T01:02:15.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.099+0000 7fdc5ef07740 20 client.15747 trim_cache size 0 max 16384 2024-09-16T01:02:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.112+0000 7fdc5ef07740 1 Processor -- start 2024-09-16T01:02:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.112+0000 7fdc5ef07740 1 -- start start 2024-09-16T01:02:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.112+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d135d0 0x5603d8d2a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.112+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d14b40 0x5603d8d33210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.112+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d1e370 0x5603d8d33750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.112+0000 7fdc5ef07740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581acb50 con 0x5603d8d135d0 2024-09-16T01:02:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.112+0000 7fdc5ef07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581ae690 con 0x5603d8d1e370 2024-09-16T01:02:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.112+0000 7fdc5ef07740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581ad220 con 0x5603d8d14b40 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc56d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d135d0 0x5603d8d2a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc56d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d135d0 0x5603d8d2a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39594/0 (socket says 172.21.15.12:39594) 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc56d9d640 1 -- 172.21.15.12:0/586612358 learned_addr learned my addr 172.21.15.12:0/586612358 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc55d9b640 1 --2- 172.21.15.12:0/586612358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d14b40 0x5603d8d33210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/586612358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d1e370 0x5603d8d33750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc56d9d640 1 -- 172.21.15.12:0/586612358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d14b40 msgr2=0x5603d8d33210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/586612358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d14b40 0x5603d8d33210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc56d9d640 1 -- 172.21.15.12:0/586612358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d1e370 msgr2=0x5603d8d33750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/586612358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d1e370 0x5603d8d33750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc56d9d640 1 -- 172.21.15.12:0/586612358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603d8d195e0 con 0x5603d8d135d0 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/586612358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d135d0 0x5603d8d2a430 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009430 tx=0x7fdc50000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e321dc5afb8ffe6c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.113+0000 7fdc3ffff640 1 -- 172.21.15.12:0/586612358 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50004860 con 0x5603d8d135d0 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc3ffff640 1 -- 172.21.15.12:0/586612358 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc50036070 con 0x5603d8d135d0 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc3ffff640 1 -- 172.21.15.12:0/586612358 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50003bd0 con 0x5603d8d135d0 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc5ef07740 1 -- 172.21.15.12:0/586612358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d135d0 msgr2=0x5603d8d2a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/586612358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d135d0 0x5603d8d2a430 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009430 tx=0x7fdc50000f40 comp rx=0 tx=0).stop 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc5ef07740 1 -- 172.21.15.12:0/586612358 shutdown_connections 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/586612358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d1e370 0x5603d8d33750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/586612358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d14b40 0x5603d8d33210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/586612358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d135d0 0x5603d8d2a430 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc5ef07740 1 -- 172.21.15.12:0/586612358 >> 172.21.15.12:0/586612358 conn(0x5603d8cdc310 msgr2=0x5603d8d1a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc5ef07740 1 -- 172.21.15.12:0/586612358 shutdown_connections 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.114+0000 7fdc5ef07740 1 -- 172.21.15.12:0/586612358 wait complete. 2024-09-16T01:02:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc5ef07740 1 -- start start 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc5ef07740 1 Processor -- start 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d135d0 0x5603d8d308e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d30e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc5ef07740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d1e370 0x5603d8d98f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc5ef07740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581adfc0 con 0x5603d8d14b40 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc5ef07740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581ad8f0 con 0x5603d8d135d0 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc5ef07740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581aab30 con 0x5603d8d1e370 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc5ef07740 10 client.0 _ll_register_callbacks cb 0x7fdc5003f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc55d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d30e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc55d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d30e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39600/0 (socket says 172.21.15.12:39600) 2024-09-16T01:02:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.115+0000 7fdc55d9b640 1 -- 172.21.15.12:0/3132147067 learned_addr learned my addr 172.21.15.12:0/3132147067 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc55d9b640 1 -- 172.21.15.12:0/3132147067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d1e370 msgr2=0x5603d8d98f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc55d9b640 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d1e370 0x5603d8d98f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc55d9b640 1 -- 172.21.15.12:0/3132147067 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d135d0 msgr2=0x5603d8d308e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc55d9b640 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d135d0 0x5603d8d308e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc55d9b640 1 -- 172.21.15.12:0/3132147067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603d8d99670 con 0x5603d8d14b40 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc55d9b640 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d30e20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdc580fed60 tx=0x7fdc4c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3949f145670565 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc3dffb640 1 -- 172.21.15.12:0/3132147067 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c02a060 con 0x5603d8d14b40 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc3dffb640 1 -- 172.21.15.12:0/3132147067 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fdc4c01e600 con 0x5603d8d14b40 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc5ef07740 1 -- 172.21.15.12:0/3132147067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc50036070 con 0x5603d8d14b40 2024-09-16T01:02:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc3dffb640 1 -- 172.21.15.12:0/3132147067 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdc4c031050 con 0x5603d8d14b40 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.116+0000 7fdc5ef07740 10 client.15753 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.117+0000 7fdc5ef07740 1 -- 172.21.15.12:0/3132147067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5603d8da0a80 con 0x5603d8d14b40 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.117+0000 7fdc3dffb640 1 -- 172.21.15.12:0/3132147067 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc50036070 con 0x5603d8d14b40 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.117+0000 7fdc3dffb640 1 -- 172.21.15.12:0/3132147067 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdc4c011cb0 con 0x5603d8d14b40 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.117+0000 7fdc5ef07740 10 client.15753 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.117+0000 7fdc5ef07740 10 client.15753 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.117+0000 7fdc5ef07740 20 client.15753 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.117+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5603d8d2de00 0x5603d8da3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.117+0000 7fdc5ef07740 4 client.15753 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.117+0000 7fdc5ef07740 1 -- 172.21.15.12:0/3132147067 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5603d8c80d70 con 0x5603d8d2de00 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.117+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5603d8d2de00 0x5603d8da3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc3dffb640 10 client.15753 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc56d9d640 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5603d8d2de00 0x5603d8da3250 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac5f7630ad15b985 server_cookie=4e774fd2bc57216e in_seq=0 out_seq=0 2024-09-16T01:02:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc3dffb640 1 -- 172.21.15.12:0/3132147067 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5603d8c80d70 con 0x5603d8d2de00 2024-09-16T01:02:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc3dffb640 10 client.15753 handle_command_reply: tid=0 2024-09-16T01:02:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 client.15753 shutdown 2024-09-16T01:02:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 -- 172.21.15.12:0/3132147067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 msgr2=0x5603d8d30e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d30e20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdc580fed60 tx=0x7fdc4c012820 comp rx=0 tx=0).stop 2024-09-16T01:02:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 -- 172.21.15.12:0/3132147067 shutdown_connections 2024-09-16T01:02:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x5603d8d2de00 0x5603d8da3250 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc3dffb640 0 client.15753 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:15.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5603d8d1e370 0x5603d8d98f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603d8d14b40 0x5603d8d30e20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.126 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 --2- 172.21.15.12:0/3132147067 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5603d8d135d0 0x5603d8d308e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 -- 172.21.15.12:0/3132147067 >> 172.21.15.12:0/3132147067 conn(0x5603d8cdc310 msgr2=0x5603d8d1c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 -- 172.21.15.12:0/3132147067 shutdown_connections 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 1 -- 172.21.15.12:0/3132147067 wait complete. 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.118+0000 7fdc5ef07740 20 client.15753 trim_cache size 0 max 16384 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/1609163544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc400a3340 msgr2=0x7fdc400a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc400a3340 0x7fdc400a5800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800f760 tx=0x7fdc4800fa60 comp rx=0 tx=0).stop 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/1609163544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc58102d90 msgr2=0x7fdc581963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc58102d90 0x7fdc581963d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009be0 tx=0x7fdc480071c0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/1609163544 shutdown_connections 2024-09-16T01:02:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdc400a3340 0x7fdc400a5800 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc58108290 0x7fdc5819aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc58103740 0x7fdc58196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 --2- 172.21.15.12:0/1609163544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc58102d90 0x7fdc581963d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/1609163544 >> 172.21.15.12:0/1609163544 conn(0x7fdc580fc7d0 msgr2=0x7fdc58106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:15.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/1609163544 shutdown_connections 2024-09-16T01:02:15.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:15.119+0000 7fdc5cb2e640 1 -- 172.21.15.12:0/1609163544 wait complete. 2024-09-16T01:02:15.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-16T01:02:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:16.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:16 smithi119 ceph-mon[35049]: pgmap v395: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-16T01:02:16.354 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:16 smithi012 ceph-mon[31197]: pgmap v395: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-16T01:02:16.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:16 smithi098 ceph-mon[35346]: pgmap v395: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-16T01:02:16.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.734+0000 7fd0eaf00640 1 -- 172.21.15.12:0/14753571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4102ef0 msgr2=0x7fd0e410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.734+0000 7fd0eaf00640 1 --2- 172.21.15.12:0/14753571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4102ef0 0x7fd0e410da40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009ca0 tx=0x7fd0dc02a950 comp rx=0 tx=0).stop 2024-09-16T01:02:16.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.735+0000 7fd0eaf00640 1 -- 172.21.15.12:0/14753571 shutdown_connections 2024-09-16T01:02:16.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.735+0000 7fd0eaf00640 1 --2- 172.21.15.12:0/14753571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4102ef0 0x7fd0e410da40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.735+0000 7fd0eaf00640 1 --2- 172.21.15.12:0/14753571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e4102570 0x7fd0e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.735+0000 7fd0eaf00640 1 --2- 172.21.15.12:0/14753571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0e4100e20 0x7fd0e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.735+0000 7fd0eaf00640 1 -- 172.21.15.12:0/14753571 >> 172.21.15.12:0/14753571 conn(0x7fd0e40fc7d0 msgr2=0x7fd0e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:16.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.735+0000 7fd0eaf00640 1 -- 172.21.15.12:0/14753571 shutdown_connections 2024-09-16T01:02:16.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.735+0000 7fd0eaf00640 1 -- 172.21.15.12:0/14753571 wait complete. 2024-09-16T01:02:16.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.736+0000 7fd0eaf00640 1 Processor -- start 2024-09-16T01:02:16.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.736+0000 7fd0eaf00640 1 -- start start 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.736+0000 7fd0eaf00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e4100e20 0x7fd0e40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.736+0000 7fd0eaf00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4102570 0x7fd0e40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.736+0000 7fd0eaf00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0e4102ef0 0x7fd0e40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0eaf00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e4110f80 con 0x7fd0e4102570 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0eaf00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e4110e00 con 0x7fd0e4100e20 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4102570 0x7fd0e40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4102570 0x7fd0e40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54508/0 (socket says 172.21.15.12:54508) 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e3fff640 1 -- 172.21.15.12:0/4275544784 learned_addr learned my addr 172.21.15.12:0/4275544784 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0eaf00640 1 -- 172.21.15.12:0/4275544784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e4111100 con 0x7fd0e4102ef0 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e4100e20 0x7fd0e40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e949d640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0e4102ef0 0x7fd0e40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e3fff640 1 -- 172.21.15.12:0/4275544784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0e4102ef0 msgr2=0x7fd0e40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e3fff640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0e4102ef0 0x7fd0e40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e3fff640 1 -- 172.21.15.12:0/4275544784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e4100e20 msgr2=0x7fd0e40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e3fff640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e4100e20 0x7fd0e40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e3fff640 1 -- 172.21.15.12:0/4275544784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e41a68f0 con 0x7fd0e4102570 2024-09-16T01:02:16.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e4100e20 0x7fd0e40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:16.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.737+0000 7fd0e3fff640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4102570 0x7fd0e40fd1c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000e9f0 tx=0x7fd0d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.738+0000 7fd0e1ffb640 1 -- 172.21.15.12:0/4275544784 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d000cd80 con 0x7fd0e4102570 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.738+0000 7fd0e1ffb640 1 -- 172.21.15.12:0/4275544784 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d0010910 con 0x7fd0e4102570 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.738+0000 7fd0eaf00640 1 -- 172.21.15.12:0/4275544784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e41a6be0 con 0x7fd0e4102570 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.738+0000 7fd0e1ffb640 1 -- 172.21.15.12:0/4275544784 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0018990 con 0x7fd0e4102570 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.738+0000 7fd0eaf00640 1 -- 172.21.15.12:0/4275544784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e41a7170 con 0x7fd0e4102570 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.741+0000 7fd0e1ffb640 1 -- 172.21.15.12:0/4275544784 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd0d0010ac0 con 0x7fd0e4102570 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0ed2d9740 1 Processor -- start 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0ed2d9740 1 -- start start 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0e1ffb640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd0d40a32c0 0x7fd0d40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 0x56162d576090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d5765d0 0x56162d576a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 0x56162d583760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0ed2d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56162d4dc2f0 con 0x56162d581370 2024-09-16T01:02:16.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0ed2d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56162d483cf0 con 0x56162d577b40 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0ed2d9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56162d4d82b0 con 0x56162d5765d0 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0e1ffb640 1 -- 172.21.15.12:0/4275544784 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fd0d00cfe80 con 0x7fd0e4102570 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0e949d640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd0d40a32c0 0x7fd0d40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.742+0000 7fd0e8c9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 0x56162d576090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e949d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 0x56162d583760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e8c9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 0x56162d576090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:48442/0 (socket says 172.21.15.12:48442) 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/1666868466 learned_addr learned my addr 172.21.15.12:0/1666868466 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e3fff640 1 --2- 172.21.15.12:0/1666868466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d5765d0 0x56162d576a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/1666868466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d5765d0 msgr2=0x56162d576a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/1666868466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d5765d0 0x56162d576a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/1666868466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 msgr2=0x56162d583760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/1666868466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 0x56162d583760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/1666868466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162d4683a0 con 0x56162d577b40 2024-09-16T01:02:16.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/1666868466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 0x56162d576090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8011570 tx=0x7fd0d8011a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8733ddd49fb04eb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0e949d640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd0d40a32c0 0x7fd0d40a5780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc005e30 tx=0x7fd0dc02fa30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.743+0000 7fd0ceffd640 1 -- 172.21.15.12:0/1666868466 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d800f840 con 0x56162d577b40 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.744+0000 7fd0ceffd640 1 -- 172.21.15.12:0/1666868466 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d802a420 con 0x56162d577b40 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.744+0000 7fd0ceffd640 1 -- 172.21.15.12:0/1666868466 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80295e0 con 0x56162d577b40 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.744+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/1666868466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 msgr2=0x56162d576090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.744+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/1666868466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 0x56162d576090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8011570 tx=0x7fd0d8011a30 comp rx=0 tx=0).stop 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.745+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/1666868466 shutdown_connections 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.745+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/1666868466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 0x56162d583760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.745+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/1666868466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d5765d0 0x56162d576a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.745+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/1666868466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 0x56162d576090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.745+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/1666868466 >> 172.21.15.12:0/1666868466 conn(0x56162d53f310 msgr2=0x56162d572c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:16.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.745+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/1666868466 shutdown_connections 2024-09-16T01:02:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.745+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/1666868466 wait complete. 2024-09-16T01:02:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.745+0000 7fd0ed2d9740 1 -- start start 2024-09-16T01:02:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.745+0000 7fd0ed2d9740 1 Processor -- start 2024-09-16T01:02:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d5765d0 0x56162d580c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 0x56162d57df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 0x56162d57e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0ed2d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56162d584070 con 0x56162d581370 2024-09-16T01:02:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0ed2d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56162d497060 con 0x56162d577b40 2024-09-16T01:02:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0ed2d9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56162d5841f0 con 0x56162d5765d0 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0ed2d9740 10 client.0 _ll_register_callbacks cb 0x56162d1ea8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0e949d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 0x56162d57e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0e949d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 0x56162d57e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54538/0 (socket says 172.21.15.12:54538) 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0e949d640 1 -- 172.21.15.12:0/3715568218 learned_addr learned my addr 172.21.15.12:0/3715568218 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.746+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d5765d0 0x56162d580c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.747+0000 7fd0e3fff640 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 0x56162d57df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.747+0000 7fd0e949d640 1 -- 172.21.15.12:0/3715568218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d5765d0 msgr2=0x56162d580c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.747+0000 7fd0e949d640 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d5765d0 0x56162d580c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.747+0000 7fd0e949d640 1 -- 172.21.15.12:0/3715568218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 msgr2=0x56162d57df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.747+0000 7fd0e949d640 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 0x56162d57df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.747+0000 7fd0e949d640 1 -- 172.21.15.12:0/3715568218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56162d24d3c0 con 0x56162d581370 2024-09-16T01:02:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.747+0000 7fd0e949d640 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 0x56162d57e480 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc035000 tx=0x7fd0dc02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e7864d90a82899 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:16.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.747+0000 7fd0c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:16.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.748+0000 7fd0c3fff640 1 -- 172.21.15.12:0/3715568218 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc034040 con 0x56162d581370 2024-09-16T01:02:16.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.748+0000 7fd0c3fff640 1 -- 172.21.15.12:0/3715568218 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fd0dc004250 con 0x56162d581370 2024-09-16T01:02:16.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.748+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/3715568218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0d802a420 con 0x56162d581370 2024-09-16T01:02:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.748+0000 7fd0c3fff640 1 -- 172.21.15.12:0/3715568218 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd0dc004450 con 0x56162d581370 2024-09-16T01:02:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.748+0000 7fd0ed2d9740 10 client.15765 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.748+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/3715568218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56162d58fa30 con 0x56162d581370 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.748+0000 7fd0c3fff640 1 -- 172.21.15.12:0/3715568218 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d802a420 con 0x56162d581370 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.748+0000 7fd0c3fff640 1 -- 172.21.15.12:0/3715568218 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd0dc030b90 con 0x56162d581370 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.749+0000 7fd0ed2d9740 10 client.15765 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.749+0000 7fd0ed2d9740 10 client.15765 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.749+0000 7fd0ed2d9740 20 client.15765 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.749+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56162d590ef0 0x56162d593340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.749+0000 7fd0ed2d9740 4 client.15765 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.749+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/3715568218 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56162d4e9860 con 0x56162d590ef0 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.749+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56162d590ef0 0x56162d593340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.750+0000 7fd0c3fff640 10 client.15765 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.750+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56162d590ef0 0x56162d593340 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ded4925eb05c6185 server_cookie=fe3551a444349df1 in_seq=0 out_seq=0 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0c3fff640 1 -- 172.21.15.12:0/3715568218 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56162d4e9860 con 0x56162d590ef0 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0c3fff640 10 client.15765 handle_command_reply: tid=0 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0ed2d9740 1 client.15765 shutdown 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/3715568218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 msgr2=0x56162d57e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 0x56162d57e480 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc035000 tx=0x7fd0dc02a950 comp rx=0 tx=0).stop 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/3715568218 shutdown_connections 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56162d590ef0 0x56162d593340 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d581370 0x56162d57e480 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0c3fff640 0 client.15765 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d577b40 0x56162d57df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/3715568218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d5765d0 0x56162d580c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.751+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/3715568218 >> 172.21.15.12:0/3715568218 conn(0x56162d53f310 msgr2=0x56162d578960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:16.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.752+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/3715568218 shutdown_connections 2024-09-16T01:02:16.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.752+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/3715568218 wait complete. 2024-09-16T01:02:16.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.752+0000 7fd0ed2d9740 20 client.15765 trim_cache size 0 max 16384 2024-09-16T01:02:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.765+0000 7fd0ed2d9740 1 Processor -- start 2024-09-16T01:02:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.765+0000 7fd0ed2d9740 1 -- start start 2024-09-16T01:02:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d5765d0 0x56162d58d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d577b40 0x56162d579120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d581370 0x56162d579660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0ed2d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e41a8710 con 0x56162d577b40 2024-09-16T01:02:16.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0ed2d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e41aa250 con 0x56162d5765d0 2024-09-16T01:02:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0ed2d9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e41a8de0 con 0x56162d581370 2024-09-16T01:02:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d577b40 0x56162d579120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d577b40 0x56162d579120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54542/0 (socket says 172.21.15.12:54542) 2024-09-16T01:02:16.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0e3fff640 1 -- 172.21.15.12:0/2074219073 learned_addr learned my addr 172.21.15.12:0/2074219073 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:16.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/2074219073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d5765d0 0x56162d58d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/2074219073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d581370 msgr2=0x56162d579660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:16.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/2074219073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d581370 0x56162d579660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/2074219073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d577b40 msgr2=0x56162d579120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:16.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/2074219073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d577b40 0x56162d579120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/2074219073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162d57c490 con 0x56162d5765d0 2024-09-16T01:02:16.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.766+0000 7fd0e3fff640 1 --2- 172.21.15.12:0/2074219073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d577b40 0x56162d579120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:16.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.767+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/2074219073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d5765d0 0x56162d58d310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8000c00 tx=0x7fd0d802ae60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9ddf4f42e856c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:16.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.767+0000 7fd0ce7fc640 1 -- 172.21.15.12:0/2074219073 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8043070 con 0x56162d5765d0 2024-09-16T01:02:16.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.767+0000 7fd0ce7fc640 1 -- 172.21.15.12:0/2074219073 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d802a420 con 0x56162d5765d0 2024-09-16T01:02:16.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.767+0000 7fd0ce7fc640 1 -- 172.21.15.12:0/2074219073 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d800f930 con 0x56162d5765d0 2024-09-16T01:02:16.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.767+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/2074219073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d5765d0 msgr2=0x56162d58d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.767+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/2074219073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d5765d0 0x56162d58d310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8000c00 tx=0x7fd0d802ae60 comp rx=0 tx=0).stop 2024-09-16T01:02:16.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.768+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/2074219073 shutdown_connections 2024-09-16T01:02:16.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.768+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/2074219073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d581370 0x56162d579660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.768+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/2074219073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d577b40 0x56162d579120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.768+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/2074219073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d5765d0 0x56162d58d310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.768+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/2074219073 >> 172.21.15.12:0/2074219073 conn(0x56162d53f310 msgr2=0x56162d57df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:16.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.768+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/2074219073 shutdown_connections 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.768+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/2074219073 wait complete. 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.768+0000 7fd0ed2d9740 1 -- start start 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.768+0000 7fd0ed2d9740 1 Processor -- start 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.768+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d5765d0 0x56162d589cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d577b40 0x56162d585020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0e8c9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d5765d0 0x56162d589cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0e8c9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d5765d0 0x56162d589cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54554/0 (socket says 172.21.15.12:54554) 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0ed2d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d581370 0x56162d585610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/957858250 learned_addr learned my addr 172.21.15.12:0/957858250 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e41a9b80 con 0x56162d5765d0 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e41a94b0 con 0x56162d581370 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e40737c0 con 0x56162d577b40 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0ed2d9740 10 client.0 _ll_register_callbacks cb 0x7fd0dc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0e949d640 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d581370 0x56162d585610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/957858250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d577b40 msgr2=0x56162d585020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d577b40 0x56162d585020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/957858250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d581370 msgr2=0x56162d585610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d581370 0x56162d585610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0e8c9c640 1 -- 172.21.15.12:0/957858250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56162d585e40 con 0x56162d5765d0 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0e8c9c640 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d5765d0 0x56162d589cf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8011570 tx=0x7fd0d8005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7311eda26fca96c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.769+0000 7fd0c3fff640 1 -- 172.21.15.12:0/957858250 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8043040 con 0x56162d5765d0 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.770+0000 7fd0c3fff640 1 -- 172.21.15.12:0/957858250 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fd0d802a850 con 0x56162d5765d0 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.770+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0d802a420 con 0x56162d5765d0 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.770+0000 7fd0c3fff640 1 -- 172.21.15.12:0/957858250 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd0d8005050 con 0x56162d5765d0 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.770+0000 7fd0ed2d9740 10 client.15771 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.770+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56162d604500 con 0x56162d5765d0 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.770+0000 7fd0c3fff640 1 -- 172.21.15.12:0/957858250 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d800f640 con 0x56162d5765d0 2024-09-16T01:02:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.770+0000 7fd0c3fff640 1 -- 172.21.15.12:0/957858250 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd0d80035f0 con 0x56162d5765d0 2024-09-16T01:02:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.770+0000 7fd0ed2d9740 10 client.15771 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.771+0000 7fd0ed2d9740 10 client.15771 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-16T01:02:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.771+0000 7fd0ed2d9740 20 client.15771 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.771+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56162d590ef0 0x56162d6068e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.771+0000 7fd0ed2d9740 4 client.15771 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.771+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd0d802a420 con 0x56162d590ef0 2024-09-16T01:02:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.771+0000 7fd0e3fff640 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56162d590ef0 0x56162d6068e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:16.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0c3fff640 10 client.15771 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:16.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0e3fff640 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56162d590ef0 0x56162d6068e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2f06dcf81b45557 server_cookie=eeab35d51a0d5585 in_seq=0 out_seq=0 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0c3fff640 1 -- 172.21.15.12:0/957858250 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd0d802a420 con 0x56162d590ef0 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0c3fff640 10 client.15771 handle_command_reply: tid=0 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0ed2d9740 1 client.15771 shutdown 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d5765d0 msgr2=0x56162d589cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d5765d0 0x56162d589cf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8011570 tx=0x7fd0d8005db0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 shutdown_connections 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x56162d590ef0 0x56162d6068e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56162d581370 0x56162d585610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56162d577b40 0x56162d585020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0ed2d9740 1 --2- 172.21.15.12:0/957858250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162d5765d0 0x56162d589cf0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 >> 172.21.15.12:0/957858250 conn(0x56162d53f310 msgr2=0x56162d5714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.772+0000 7fd0c3fff640 0 client.15771 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.773+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 shutdown_connections 2024-09-16T01:02:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.773+0000 7fd0ed2d9740 1 -- 172.21.15.12:0/957858250 wait complete. 2024-09-16T01:02:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.773+0000 7fd0ed2d9740 20 client.15771 trim_cache size 0 max 16384 2024-09-16T01:02:16.778 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:16.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.773+0000 7fd0eaf00640 1 -- 172.21.15.12:0/4275544784 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd0d40a32c0 msgr2=0x7fd0d40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.773+0000 7fd0eaf00640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd0d40a32c0 0x7fd0d40a5780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc005e30 tx=0x7fd0dc02fa30 comp rx=0 tx=0).stop 2024-09-16T01:02:16.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.773+0000 7fd0eaf00640 1 -- 172.21.15.12:0/4275544784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4102570 msgr2=0x7fd0e40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.773+0000 7fd0eaf00640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4102570 0x7fd0e40fd1c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000e9f0 tx=0x7fd0d000eeb0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.774+0000 7fd0eaf00640 1 -- 172.21.15.12:0/4275544784 shutdown_connections 2024-09-16T01:02:16.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.774+0000 7fd0eaf00640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd0d40a32c0 0x7fd0d40a5780 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.774+0000 7fd0eaf00640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0e4102ef0 0x7fd0e40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.774+0000 7fd0eaf00640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4102570 0x7fd0e40fd1c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.774+0000 7fd0eaf00640 1 --2- 172.21.15.12:0/4275544784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e4100e20 0x7fd0e40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.774+0000 7fd0eaf00640 1 -- 172.21.15.12:0/4275544784 >> 172.21.15.12:0/4275544784 conn(0x7fd0e40fc7d0 msgr2=0x7fd0e406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:16.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.774+0000 7fd0eaf00640 1 -- 172.21.15.12:0/4275544784 shutdown_connections 2024-09-16T01:02:16.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:16.774+0000 7fd0eaf00640 1 -- 172.21.15.12:0/4275544784 wait complete. 2024-09-16T01:02:17.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-16T01:02:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:18.257 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:18 smithi012 ceph-mon[31197]: pgmap v396: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-16T01:02:18.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:18 smithi119 ceph-mon[35049]: pgmap v396: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-16T01:02:18.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.343+0000 7f62751f4640 1 -- 172.21.15.12:0/3545429845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6270101df0 msgr2=0x7f62701021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:18.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.343+0000 7f62751f4640 1 --2- 172.21.15.12:0/3545429845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6270101df0 0x7f62701021d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6260009900 tx=0x7f626002a410 comp rx=0 tx=0).stop 2024-09-16T01:02:18.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.343+0000 7f62751f4640 1 -- 172.21.15.12:0/3545429845 shutdown_connections 2024-09-16T01:02:18.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.343+0000 7f62751f4640 1 --2- 172.21.15.12:0/3545429845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6270106f20 0x7f627010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.343+0000 7f62751f4640 1 --2- 172.21.15.12:0/3545429845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62701027a0 0x7f62701067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.343+0000 7f62751f4640 1 --2- 172.21.15.12:0/3545429845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6270101df0 0x7f62701021d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.343+0000 7f62751f4640 1 -- 172.21.15.12:0/3545429845 >> 172.21.15.12:0/3545429845 conn(0x7f62700fd8f0 msgr2=0x7f62700ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.343+0000 7f62751f4640 1 -- 172.21.15.12:0/3545429845 shutdown_connections 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.344+0000 7f62751f4640 1 -- 172.21.15.12:0/3545429845 wait complete. 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.345+0000 7f62751f4640 1 Processor -- start 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.345+0000 7f62751f4640 1 -- start start 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f62751f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62701027a0 0x7f6270196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f62751f4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6270106f20 0x7f62701969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f62751f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f627019ad30 0x7f627019b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f62751f4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f627010fd70 con 0x7f6270106f20 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f62751f4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f627010fbf0 con 0x7f627019ad30 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f62751f4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f627010fef0 con 0x7f62701027a0 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f626e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6270106f20 0x7f62701969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f626e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6270106f20 0x7f62701969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54562/0 (socket says 172.21.15.12:54562) 2024-09-16T01:02:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f626e59c640 1 -- 172.21.15.12:0/775249351 learned_addr learned my addr 172.21.15.12:0/775249351 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f626f59e640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f627019ad30 0x7f627019b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f626ed9d640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62701027a0 0x7f6270196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f626f59e640 1 -- 172.21.15.12:0/775249351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62701027a0 msgr2=0x7f6270196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f626f59e640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62701027a0 0x7f6270196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f626f59e640 1 -- 172.21.15.12:0/775249351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6270106f20 msgr2=0x7f62701969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.346+0000 7f626f59e640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6270106f20 0x7f62701969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.347+0000 7f626f59e640 1 -- 172.21.15.12:0/775249351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627019b7f0 con 0x7f627019ad30 2024-09-16T01:02:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.347+0000 7f626e59c640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6270106f20 0x7f62701969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.347+0000 7f626f59e640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f627019ad30 0x7f627019b1e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f626800ed90 tx=0x7f6268012490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.347+0000 7f6257fff640 1 -- 172.21.15.12:0/775249351 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626801c070 con 0x7f627019ad30 2024-09-16T01:02:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.347+0000 7f62751f4640 1 -- 172.21.15.12:0/775249351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627019bae0 con 0x7f627019ad30 2024-09-16T01:02:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.347+0000 7f6257fff640 1 -- 172.21.15.12:0/775249351 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6268005020 con 0x7f627019ad30 2024-09-16T01:02:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.347+0000 7f6257fff640 1 -- 172.21.15.12:0/775249351 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6268018660 con 0x7f627019ad30 2024-09-16T01:02:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.347+0000 7f62751f4640 1 -- 172.21.15.12:0/775249351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62701a3270 con 0x7f627019ad30 2024-09-16T01:02:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.350+0000 7f6257fff640 1 -- 172.21.15.12:0/775249351 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6268017070 con 0x7f627019ad30 2024-09-16T01:02:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f62775cd740 1 Processor -- start 2024-09-16T01:02:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f62775cd740 1 -- start start 2024-09-16T01:02:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f62775cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a950199b40 0x55a950198090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f62775cd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9501985d0 0x55a950198a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f62775cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f62775cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a9500fe2f0 con 0x55a9501a3370 2024-09-16T01:02:18.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f62775cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a9500a5cf0 con 0x55a950199b40 2024-09-16T01:02:18.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f62775cd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a9500fa2b0 con 0x55a9501985d0 2024-09-16T01:02:18.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f626e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f626e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54578/0 (socket says 172.21.15.12:54578) 2024-09-16T01:02:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f626e59c640 1 -- 172.21.15.12:0/2429430489 learned_addr learned my addr 172.21.15.12:0/2429430489 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f626ed9d640 1 --2- 172.21.15.12:0/2429430489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9501985d0 0x55a950198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.351+0000 7f626e59c640 1 --2- 172.21.15.12:0/2429430489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a950199b40 0x55a950198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f6257fff640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f62580a3240 0x7f62580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f626e59c640 1 -- 172.21.15.12:0/2429430489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9501985d0 msgr2=0x55a950198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f626e59c640 1 --2- 172.21.15.12:0/2429430489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9501985d0 0x55a950198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f626e59c640 1 -- 172.21.15.12:0/2429430489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a950199b40 msgr2=0x55a950198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f626e59c640 1 --2- 172.21.15.12:0/2429430489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a950199b40 0x55a950198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f626e59c640 1 -- 172.21.15.12:0/2429430489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a95008a3a0 con 0x55a9501a3370 2024-09-16T01:02:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f626f59e640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f62580a3240 0x7f62580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f6257fff640 1 -- 172.21.15.12:0/775249351 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f62680d3ab0 con 0x7f627019ad30 2024-09-16T01:02:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f626e59c640 1 --2- 172.21.15.12:0/2429430489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a5760 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6264005de0 tx=0x7f626400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f661cca34400a0a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f62557fa640 1 -- 172.21.15.12:0/2429430489 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626400e910 con 0x55a9501a3370 2024-09-16T01:02:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f62557fa640 1 -- 172.21.15.12:0/2429430489 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6264010460 con 0x55a9501a3370 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f62557fa640 1 -- 172.21.15.12:0/2429430489 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626400f620 con 0x55a9501a3370 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.352+0000 7f626f59e640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f62580a3240 0x7f62580a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f626809c170 tx=0x7f6268054040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.353+0000 7f62775cd740 1 -- 172.21.15.12:0/2429430489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 msgr2=0x55a9501a5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.353+0000 7f62775cd740 1 --2- 172.21.15.12:0/2429430489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a5760 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6264005de0 tx=0x7f626400bd70 comp rx=0 tx=0).stop 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 -- 172.21.15.12:0/2429430489 shutdown_connections 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 --2- 172.21.15.12:0/2429430489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a5760 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 --2- 172.21.15.12:0/2429430489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9501985d0 0x55a950198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 --2- 172.21.15.12:0/2429430489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a950199b40 0x55a950198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 -- 172.21.15.12:0/2429430489 >> 172.21.15.12:0/2429430489 conn(0x55a950161310 msgr2=0x55a950194c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 -- 172.21.15.12:0/2429430489 shutdown_connections 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 -- 172.21.15.12:0/2429430489 wait complete. 2024-09-16T01:02:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 -- start start 2024-09-16T01:02:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 Processor -- start 2024-09-16T01:02:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 0x55a9501a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 0x55a9501a0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a9501a6070 con 0x55a9501a3370 2024-09-16T01:02:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a9500b9060 con 0x55a9501985d0 2024-09-16T01:02:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.354+0000 7f62775cd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a9501a61f0 con 0x55a950199b40 2024-09-16T01:02:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f62775cd740 10 client.0 _ll_register_callbacks cb 0x55a94fe0c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54588/0 (socket says 172.21.15.12:54588) 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626e59c640 1 -- 172.21.15.12:0/1793640419 learned_addr learned my addr 172.21.15.12:0/1793640419 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626ed9d640 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 0x55a9501a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626e59c640 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 0x55a9501a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626ed9d640 1 -- 172.21.15.12:0/1793640419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 msgr2=0x55a9501a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626ed9d640 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 0x55a9501a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626ed9d640 1 -- 172.21.15.12:0/1793640419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 msgr2=0x55a9501a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626ed9d640 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626ed9d640 1 -- 172.21.15.12:0/1793640419 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a94fe6f3c0 con 0x55a950199b40 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626e59c640 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 0x55a9501a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f626ed9d640 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 0x55a9501a0090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6260008000 tx=0x7f6260032ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=932c8112d0ec6b00 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.355+0000 7f6252ff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.356+0000 7f6252ff5640 1 -- 172.21.15.12:0/1793640419 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260035040 con 0x55a950199b40 2024-09-16T01:02:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.356+0000 7f6252ff5640 1 -- 172.21.15.12:0/1793640419 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f62600318b0 con 0x55a950199b40 2024-09-16T01:02:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.356+0000 7f62775cd740 1 -- 172.21.15.12:0/1793640419 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6264010460 con 0x55a950199b40 2024-09-16T01:02:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.356+0000 7f6252ff5640 1 -- 172.21.15.12:0/1793640419 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6260060050 con 0x55a950199b40 2024-09-16T01:02:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.356+0000 7f62775cd740 10 client.25339 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.356+0000 7f62775cd740 1 -- 172.21.15.12:0/1793640419 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a9501a64c0 con 0x55a950199b40 2024-09-16T01:02:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.356+0000 7f6252ff5640 1 -- 172.21.15.12:0/1793640419 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6260005030 con 0x55a950199b40 2024-09-16T01:02:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.356+0000 7f6252ff5640 1 -- 172.21.15.12:0/1793640419 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6260004800 con 0x55a950199b40 2024-09-16T01:02:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.357+0000 7f62775cd740 10 client.25339 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.357+0000 7f62775cd740 10 client.25339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.357+0000 7f62775cd740 20 client.25339 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.357+0000 7f62775cd740 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55a9501a7940 0x55a9501a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.357+0000 7f62775cd740 4 client.25339 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.357+0000 7f62775cd740 1 -- 172.21.15.12:0/1793640419 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6264010460 con 0x55a9501a7940 2024-09-16T01:02:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.357+0000 7f626e59c640 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55a9501a7940 0x55a9501a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.357+0000 7f626e59c640 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55a9501a7940 0x55a9501a9d60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8298647e3b7bd7ec server_cookie=b45c64dc6a54c36f in_seq=0 out_seq=0 2024-09-16T01:02:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.357+0000 7f6252ff5640 10 client.25339 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f6252ff5640 1 -- 172.21.15.12:0/1793640419 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f6264010460 con 0x55a9501a7940 2024-09-16T01:02:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f6252ff5640 10 client.25339 handle_command_reply: tid=0 2024-09-16T01:02:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 client.25339 shutdown 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 -- 172.21.15.12:0/1793640419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 msgr2=0x55a9501a0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 0x55a9501a0090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6260008000 tx=0x7f6260032ed0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 -- 172.21.15.12:0/1793640419 shutdown_connections 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55a9501a7940 0x55a9501a9d60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501a3370 0x55a9501a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 0x55a9501a0090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f6252ff5640 0 client.25339 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 --2- 172.21.15.12:0/1793640419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 0x55a9501a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 -- 172.21.15.12:0/1793640419 >> 172.21.15.12:0/1793640419 conn(0x55a950161310 msgr2=0x55a95019a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 -- 172.21.15.12:0/1793640419 shutdown_connections 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 1 -- 172.21.15.12:0/1793640419 wait complete. 2024-09-16T01:02:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.358+0000 7f62775cd740 20 client.25339 trim_cache size 0 max 16384 2024-09-16T01:02:18.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.371+0000 7f62775cd740 1 Processor -- start 2024-09-16T01:02:18.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.371+0000 7f62775cd740 1 -- start start 2024-09-16T01:02:18.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f62775cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501985d0 0x55a9501b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f62775cd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 0x55a9501b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f62775cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501a3370 0x55a95019b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f62775cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62701a47c0 con 0x55a9501985d0 2024-09-16T01:02:18.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f62775cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f62701a6300 con 0x55a9501a3370 2024-09-16T01:02:18.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f62775cd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f62701a4e90 con 0x55a950199b40 2024-09-16T01:02:18.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f626e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501985d0 0x55a9501b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f626e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501985d0 0x55a9501b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54598/0 (socket says 172.21.15.12:54598) 2024-09-16T01:02:18.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f626e59c640 1 -- 172.21.15.12:0/4128543309 learned_addr learned my addr 172.21.15.12:0/4128543309 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:18.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f626ed9d640 1 --2- 172.21.15.12:0/4128543309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 0x55a9501b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f626e59c640 1 -- 172.21.15.12:0/4128543309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 msgr2=0x55a9501b7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:18.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f626e59c640 1 --2- 172.21.15.12:0/4128543309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 0x55a9501b7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f626e59c640 1 -- 172.21.15.12:0/4128543309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501a3370 msgr2=0x55a95019b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f626e59c640 1 --2- 172.21.15.12:0/4128543309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501a3370 0x55a95019b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f626e59c640 1 -- 172.21.15.12:0/4128543309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a95019e5e0 con 0x55a9501985d0 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.372+0000 7f626e59c640 1 --2- 172.21.15.12:0/4128543309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501985d0 0x55a9501b7650 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f626400b4e0 tx=0x7f6264010ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee46207dc2e96352 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.373+0000 7f6254ff9640 1 -- 172.21.15.12:0/4128543309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62640050c0 con 0x55a9501985d0 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.373+0000 7f6254ff9640 1 -- 172.21.15.12:0/4128543309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f626403b040 con 0x55a9501985d0 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.373+0000 7f6254ff9640 1 -- 172.21.15.12:0/4128543309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62640035f0 con 0x55a9501985d0 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.373+0000 7f62775cd740 1 -- 172.21.15.12:0/4128543309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501985d0 msgr2=0x55a9501b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.373+0000 7f62775cd740 1 --2- 172.21.15.12:0/4128543309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501985d0 0x55a9501b7650 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f626400b4e0 tx=0x7f6264010ec0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.373+0000 7f62775cd740 1 -- 172.21.15.12:0/4128543309 shutdown_connections 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 --2- 172.21.15.12:0/4128543309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501a3370 0x55a95019b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 --2- 172.21.15.12:0/4128543309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a950199b40 0x55a9501b7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 --2- 172.21.15.12:0/4128543309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9501985d0 0x55a9501b7650 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 -- 172.21.15.12:0/4128543309 >> 172.21.15.12:0/4128543309 conn(0x55a950161310 msgr2=0x55a950193d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 -- 172.21.15.12:0/4128543309 shutdown_connections 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 -- 172.21.15.12:0/4128543309 wait complete. 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 -- start start 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 Processor -- start 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 0x55a9501bc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a950199b40 0x55a9501bcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9501a3370 0x55a95021c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.374+0000 7f62775cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62701a5c30 con 0x55a950199b40 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f62775cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f62701a5560 con 0x55a9501985d0 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f62775cd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f62700736c0 con 0x55a9501a3370 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f62775cd740 10 client.0 _ll_register_callbacks cb 0x7f6260005dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a950199b40 0x55a9501bcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 0x55a9501bc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a950199b40 0x55a9501bcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54604/0 (socket says 172.21.15.12:54604) 2024-09-16T01:02:18.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626ed9d640 1 -- 172.21.15.12:0/1319884502 learned_addr learned my addr 172.21.15.12:0/1319884502 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:18.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626e59c640 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9501a3370 0x55a95021c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626ed9d640 1 -- 172.21.15.12:0/1319884502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9501a3370 msgr2=0x55a95021c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:18.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626ed9d640 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9501a3370 0x55a95021c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626ed9d640 1 -- 172.21.15.12:0/1319884502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 msgr2=0x55a9501bc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:18.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626ed9d640 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 0x55a9501bc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626ed9d640 1 -- 172.21.15.12:0/1319884502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a95021c8d0 con 0x55a950199b40 2024-09-16T01:02:18.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626e59c640 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 0x55a9501bc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:18.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f626ed9d640 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a950199b40 0x55a9501bcd00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6260004d70 tx=0x7f62600092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2badedf2a10a8fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:18.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f6252ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:18.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f6252ff5640 1 -- 172.21.15.12:0/1319884502 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260035070 con 0x55a950199b40 2024-09-16T01:02:18.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f6252ff5640 1 -- 172.21.15.12:0/1319884502 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f6260005000 con 0x55a950199b40 2024-09-16T01:02:18.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.375+0000 7f62775cd740 1 -- 172.21.15.12:0/1319884502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f626403b040 con 0x55a950199b40 2024-09-16T01:02:18.383 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f6252ff5640 1 -- 172.21.15.12:0/1319884502 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f626005d040 con 0x55a950199b40 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f62775cd740 10 client.15789 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f62775cd740 1 -- 172.21.15.12:0/1319884502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a95021db30 con 0x55a950199b40 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f6252ff5640 1 -- 172.21.15.12:0/1319884502 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f626403b040 con 0x55a950199b40 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f6252ff5640 1 -- 172.21.15.12:0/1319884502 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6260031930 con 0x55a950199b40 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f62775cd740 10 client.15789 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f62775cd740 10 client.15789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f62775cd740 20 client.15789 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f62775cd740 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55a95021e330 0x55a950220750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f62775cd740 4 client.15789 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.376+0000 7f62775cd740 1 -- 172.21.15.12:0/1319884502 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a95010b860 con 0x55a95021e330 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f626e59c640 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55a95021e330 0x55a950220750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:18.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f626e59c640 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55a95021e330 0x55a950220750 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9b70dfd3b153d68 server_cookie=cadbf395b13d4a49 in_seq=0 out_seq=0 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f6252ff5640 10 client.15789 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f6252ff5640 1 -- 172.21.15.12:0/1319884502 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a95010b860 con 0x55a95021e330 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f6252ff5640 10 client.15789 handle_command_reply: tid=0 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f62775cd740 1 client.15789 shutdown 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f62775cd740 1 -- 172.21.15.12:0/1319884502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a950199b40 msgr2=0x55a9501bcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f62775cd740 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a950199b40 0x55a9501bcd00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6260004d70 tx=0x7f62600092c0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f62775cd740 1 -- 172.21.15.12:0/1319884502 shutdown_connections 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f62775cd740 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55a95021e330 0x55a950220750 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f6252ff5640 0 client.15789 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f62775cd740 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9501a3370 0x55a95021c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f62775cd740 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a950199b40 0x55a9501bcd00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f62775cd740 1 --2- 172.21.15.12:0/1319884502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9501985d0 0x55a9501bc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f62775cd740 1 -- 172.21.15.12:0/1319884502 >> 172.21.15.12:0/1319884502 conn(0x55a950161310 msgr2=0x55a9501934e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.377+0000 7f62775cd740 1 -- 172.21.15.12:0/1319884502 shutdown_connections 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.378+0000 7f62775cd740 1 -- 172.21.15.12:0/1319884502 wait complete. 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.378+0000 7f62775cd740 20 client.15789 trim_cache size 0 max 16384 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.378+0000 7f62751f4640 1 -- 172.21.15.12:0/775249351 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f62580a3240 msgr2=0x7f62580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.378+0000 7f62751f4640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f62580a3240 0x7f62580a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f626809c170 tx=0x7f6268054040 comp rx=0 tx=0).stop 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.378+0000 7f62751f4640 1 -- 172.21.15.12:0/775249351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f627019ad30 msgr2=0x7f627019b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.378+0000 7f62751f4640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f627019ad30 0x7f627019b1e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f626800ed90 tx=0x7f6268012490 comp rx=0 tx=0).stop 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.380+0000 7f62751f4640 1 -- 172.21.15.12:0/775249351 shutdown_connections 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.380+0000 7f62751f4640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f62580a3240 0x7f62580a5700 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.380+0000 7f62751f4640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f627019ad30 0x7f627019b1e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.380+0000 7f62751f4640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6270106f20 0x7f62701969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.380+0000 7f62751f4640 1 --2- 172.21.15.12:0/775249351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62701027a0 0x7f6270196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:18.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.380+0000 7f62751f4640 1 -- 172.21.15.12:0/775249351 >> 172.21.15.12:0/775249351 conn(0x7f62700fd8f0 msgr2=0x7f62700fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:18.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.380+0000 7f62751f4640 1 -- 172.21.15.12:0/775249351 shutdown_connections 2024-09-16T01:02:18.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:18.380+0000 7f62751f4640 1 -- 172.21.15.12:0/775249351 wait complete. 2024-09-16T01:02:18.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:18 smithi098 ceph-mon[35346]: pgmap v396: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-16T01:02:20.107 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-16T01:02:20.107 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-16T01:02:20.347 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:20 smithi119 ceph-mon[35049]: pgmap v397: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-16T01:02:20.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:20 smithi012 ceph-mon[31197]: pgmap v397: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-16T01:02:20.393 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:20.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:20 smithi098 ceph-mon[35346]: pgmap v397: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-16T01:02:20.840 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:02:20.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.954+0000 7efc5999d640 1 -- 172.21.15.12:0/978654218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5410c170 msgr2=0x7efc5410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.954+0000 7efc5999d640 1 --2- 172.21.15.12:0/978654218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5410c170 0x7efc5410e600 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009ca0 tx=0x7efc4c02a950 comp rx=0 tx=0).stop 2024-09-16T01:02:20.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.954+0000 7efc5999d640 1 -- 172.21.15.12:0/978654218 shutdown_connections 2024-09-16T01:02:20.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.954+0000 7efc5999d640 1 --2- 172.21.15.12:0/978654218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5410c170 0x7efc5410e600 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.955+0000 7efc5999d640 1 --2- 172.21.15.12:0/978654218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc541036f0 0x7efc5410bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.955+0000 7efc5999d640 1 --2- 172.21.15.12:0/978654218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc54102dd0 0x7efc541031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.955+0000 7efc5999d640 1 -- 172.21.15.12:0/978654218 >> 172.21.15.12:0/978654218 conn(0x7efc540fc790 msgr2=0x7efc540febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:20.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.955+0000 7efc5999d640 1 -- 172.21.15.12:0/978654218 shutdown_connections 2024-09-16T01:02:20.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.955+0000 7efc5999d640 1 -- 172.21.15.12:0/978654218 wait complete. 2024-09-16T01:02:20.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.956+0000 7efc5999d640 1 Processor -- start 2024-09-16T01:02:20.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.956+0000 7efc5999d640 1 -- start start 2024-09-16T01:02:20.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc5999d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc54102dd0 0x7efc54198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc5999d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc541036f0 0x7efc54198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc5999d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc5410c170 0x7efc5419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc5999d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efc54111f60 con 0x7efc54102dd0 2024-09-16T01:02:20.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc5999d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc54111de0 con 0x7efc541036f0 2024-09-16T01:02:20.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc5999d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efc541120e0 con 0x7efc5410c170 2024-09-16T01:02:20.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc527fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc541036f0 0x7efc54198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc52ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc54102dd0 0x7efc54198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc52ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc54102dd0 0x7efc54198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54626/0 (socket says 172.21.15.12:54626) 2024-09-16T01:02:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc52ffd640 1 -- 172.21.15.12:0/425647671 learned_addr learned my addr 172.21.15.12:0/425647671 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.957+0000 7efc537fe640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc5410c170 0x7efc5419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.958+0000 7efc52ffd640 1 -- 172.21.15.12:0/425647671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc5410c170 msgr2=0x7efc5419cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.958+0000 7efc52ffd640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc5410c170 0x7efc5419cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.958+0000 7efc52ffd640 1 -- 172.21.15.12:0/425647671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc541036f0 msgr2=0x7efc54198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.958+0000 7efc52ffd640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc541036f0 0x7efc54198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.958+0000 7efc52ffd640 1 -- 172.21.15.12:0/425647671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5419d1f0 con 0x7efc54102dd0 2024-09-16T01:02:20.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.958+0000 7efc52ffd640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc54102dd0 0x7efc54198240 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efc4400e9f0 tx=0x7efc4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:20.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.958+0000 7efc5899b640 1 -- 172.21.15.12:0/425647671 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4400cd80 con 0x7efc54102dd0 2024-09-16T01:02:20.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.959+0000 7efc5899b640 1 -- 172.21.15.12:0/425647671 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc44010910 con 0x7efc54102dd0 2024-09-16T01:02:20.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.959+0000 7efc5899b640 1 -- 172.21.15.12:0/425647671 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc44018990 con 0x7efc54102dd0 2024-09-16T01:02:20.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.959+0000 7efc5999d640 1 -- 172.21.15.12:0/425647671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5419d4e0 con 0x7efc54102dd0 2024-09-16T01:02:20.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.959+0000 7efc5999d640 1 -- 172.21.15.12:0/425647671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5419d8e0 con 0x7efc54102dd0 2024-09-16T01:02:20.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.961+0000 7efc5899b640 1 -- 172.21.15.12:0/425647671 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efc44010ac0 con 0x7efc54102dd0 2024-09-16T01:02:20.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.962+0000 7efc5bd76740 1 Processor -- start 2024-09-16T01:02:20.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.962+0000 7efc5bd76740 1 -- start start 2024-09-16T01:02:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.962+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf64e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.962+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf653a0 0x555cadf78010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.962+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf78550 0x555cadf7a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.962+0000 7efc5899b640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efc3c0a32c0 0x7efc3c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.962+0000 7efc5bd76740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555cadeca280 con 0x555cadf64a80 2024-09-16T01:02:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.962+0000 7efc5bd76740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555cade71b10 con 0x555cadf78550 2024-09-16T01:02:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.962+0000 7efc5bd76740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555cadec6240 con 0x555cadf653a0 2024-09-16T01:02:20.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.963+0000 7efc537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf64e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.963+0000 7efc5899b640 1 -- 172.21.15.12:0/425647671 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7efc440cfee0 con 0x7efc54102dd0 2024-09-16T01:02:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.963+0000 7efc537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf64e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54636/0 (socket says 172.21.15.12:54636) 2024-09-16T01:02:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.963+0000 7efc537fe640 1 -- 172.21.15.12:0/3290428012 learned_addr learned my addr 172.21.15.12:0/3290428012 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.963+0000 7efc527fc640 1 --2- 172.21.15.12:0/3290428012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf78550 0x555cadf7a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.963+0000 7efc52ffd640 1 --2- 172.21.15.12:0/3290428012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf653a0 0x555cadf78010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.963+0000 7efc537fe640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efc3c0a32c0 0x7efc3c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.964+0000 7efc537fe640 1 -- 172.21.15.12:0/3290428012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf653a0 msgr2=0x555cadf78010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:20.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.964+0000 7efc537fe640 1 --2- 172.21.15.12:0/3290428012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf653a0 0x555cadf78010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.964+0000 7efc537fe640 1 -- 172.21.15.12:0/3290428012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf78550 msgr2=0x555cadf7a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:20.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.964+0000 7efc537fe640 1 --2- 172.21.15.12:0/3290428012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf78550 0x555cadf7a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.964+0000 7efc537fe640 1 -- 172.21.15.12:0/3290428012 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cade7e1f0 con 0x555cadf64a80 2024-09-16T01:02:20.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.964+0000 7efc537fe640 1 --2- 172.21.15.12:0/3290428012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf64e60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009ca0 tx=0x7efc4c02ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77debe44a1c21226 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.964+0000 7efc537fe640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efc3c0a32c0 0x7efc3c0a5780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efc4c03c000 tx=0x7efc4c047000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.964+0000 7efc39ffb640 1 -- 172.21.15.12:0/3290428012 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c04d070 con 0x555cadf64a80 2024-09-16T01:02:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.965+0000 7efc39ffb640 1 -- 172.21.15.12:0/3290428012 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc4c003b80 con 0x555cadf64a80 2024-09-16T01:02:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.965+0000 7efc39ffb640 1 -- 172.21.15.12:0/3290428012 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c034040 con 0x555cadf64a80 2024-09-16T01:02:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.966+0000 7efc5bd76740 1 -- 172.21.15.12:0/3290428012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 msgr2=0x555cadf64e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.966+0000 7efc5bd76740 1 --2- 172.21.15.12:0/3290428012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf64e60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009ca0 tx=0x7efc4c02ff10 comp rx=0 tx=0).stop 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.966+0000 7efc5bd76740 1 -- 172.21.15.12:0/3290428012 shutdown_connections 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.966+0000 7efc5bd76740 1 --2- 172.21.15.12:0/3290428012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf78550 0x555cadf7a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.966+0000 7efc5bd76740 1 --2- 172.21.15.12:0/3290428012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf653a0 0x555cadf78010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.966+0000 7efc5bd76740 1 --2- 172.21.15.12:0/3290428012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf64e60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.966+0000 7efc5bd76740 1 -- 172.21.15.12:0/3290428012 >> 172.21.15.12:0/3290428012 conn(0x555cadf610f0 msgr2=0x555cadf614d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.966+0000 7efc5bd76740 1 -- 172.21.15.12:0/3290428012 shutdown_connections 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.966+0000 7efc5bd76740 1 -- 172.21.15.12:0/3290428012 wait complete. 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.966+0000 7efc5bd76740 1 -- start start 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc5bd76740 1 Processor -- start 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf64a80 0x555cadf75540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf653a0 0x555cadf75a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf78550 0x555cadf75fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc5bd76740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555cadf7b060 con 0x555cadf653a0 2024-09-16T01:02:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc5bd76740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555cade84f10 con 0x555cadf64a80 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc5bd76740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555cadf7b1e0 con 0x555cadf78550 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc5bd76740 10 client.0 _ll_register_callbacks cb 0x555cade4da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc527fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf653a0 0x555cadf75a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc527fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf653a0 0x555cadf75a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54650/0 (socket says 172.21.15.12:54650) 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc527fc640 1 -- 172.21.15.12:0/1884600302 learned_addr learned my addr 172.21.15.12:0/1884600302 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.967+0000 7efc52ffd640 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf64a80 0x555cadf75540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc537fe640 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf78550 0x555cadf75fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc527fc640 1 -- 172.21.15.12:0/1884600302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf78550 msgr2=0x555cadf75fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc527fc640 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf78550 0x555cadf75fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc527fc640 1 -- 172.21.15.12:0/1884600302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf64a80 msgr2=0x555cadf75540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc527fc640 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf64a80 0x555cadf75540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc527fc640 1 -- 172.21.15.12:0/1884600302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cadc3b6a0 con 0x555cadf653a0 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc527fc640 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf653a0 0x555cadf75a80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7efc480126d0 tx=0x7efc48012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846b0c6f0e50b875 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc32ffd640 1 -- 172.21.15.12:0/1884600302 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4800f9e0 con 0x555cadf653a0 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc32ffd640 1 -- 172.21.15.12:0/1884600302 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7efc4800fb80 con 0x555cadf653a0 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc5bd76740 1 -- 172.21.15.12:0/1884600302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc4c003b80 con 0x555cadf653a0 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.968+0000 7efc32ffd640 1 -- 172.21.15.12:0/1884600302 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efc4800fd80 con 0x555cadf653a0 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.969+0000 7efc5bd76740 10 client.15801 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.969+0000 7efc5bd76740 1 -- 172.21.15.12:0/1884600302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555cadf86e10 con 0x555cadf653a0 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.969+0000 7efc32ffd640 1 -- 172.21.15.12:0/1884600302 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc48010910 con 0x555cadf653a0 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.969+0000 7efc32ffd640 1 -- 172.21.15.12:0/1884600302 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7efc4801c630 con 0x555cadf653a0 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.969+0000 7efc5bd76740 10 client.15801 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.969+0000 7efc5bd76740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.969+0000 7efc5bd76740 20 client.15801 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.969+0000 7efc5bd76740 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x555cadf88720 0x555cadf8aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.969+0000 7efc5bd76740 4 client.15801 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.969+0000 7efc5bd76740 1 -- 172.21.15.12:0/1884600302 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efc4c003b80 con 0x555cadf88720 2024-09-16T01:02:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.970+0000 7efc52ffd640 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x555cadf88720 0x555cadf8aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.971+0000 7efc52ffd640 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x555cadf88720 0x555cadf8aba0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fca7a3cb514a509f server_cookie=d57b4a60ccb68e82 in_seq=0 out_seq=0 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.971+0000 7efc32ffd640 10 client.15801 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc32ffd640 1 -- 172.21.15.12:0/1884600302 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7efc4c003b80 con 0x555cadf88720 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc32ffd640 10 client.15801 handle_command_reply: tid=0 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc5bd76740 1 client.15801 shutdown 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc5bd76740 1 -- 172.21.15.12:0/1884600302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf653a0 msgr2=0x555cadf75a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc5bd76740 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf653a0 0x555cadf75a80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7efc480126d0 tx=0x7efc48012b90 comp rx=0 tx=0).stop 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc5bd76740 1 -- 172.21.15.12:0/1884600302 shutdown_connections 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc5bd76740 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x555cadf88720 0x555cadf8aba0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc5bd76740 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf78550 0x555cadf75fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc5bd76740 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf653a0 0x555cadf75a80 secure :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7efc480126d0 tx=0x7efc48012b90 comp rx=0 tx=0).stop 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc5bd76740 1 --2- 172.21.15.12:0/1884600302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf64a80 0x555cadf75540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc5bd76740 1 -- 172.21.15.12:0/1884600302 >> 172.21.15.12:0/1884600302 conn(0x555cadf610f0 msgr2=0x555cadf60270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.972+0000 7efc32ffd640 0 client.15801 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:20.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.973+0000 7efc5bd76740 1 -- 172.21.15.12:0/1884600302 shutdown_connections 2024-09-16T01:02:20.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.973+0000 7efc5bd76740 1 -- 172.21.15.12:0/1884600302 wait complete. 2024-09-16T01:02:20.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:20.973+0000 7efc5bd76740 20 client.15801 trim_cache size 0 max 16384 2024-09-16T01:02:21.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.006+0000 7efc5bd76740 1 Processor -- start 2024-09-16T01:02:21.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.007+0000 7efc5bd76740 1 -- start start 2024-09-16T01:02:21.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.007+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf64a80 0x555cadf773a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.007+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf78550 0x555cadf904b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.007+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf778e0 0x555cadf909f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.007+0000 7efc5bd76740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efc541ac9c0 con 0x555cadf78550 2024-09-16T01:02:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.007+0000 7efc5bd76740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc541ae500 con 0x555cadf64a80 2024-09-16T01:02:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.007+0000 7efc5bd76740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efc541ad090 con 0x555cadf778e0 2024-09-16T01:02:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.007+0000 7efc527fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf78550 0x555cadf904b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.007+0000 7efc527fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf78550 0x555cadf904b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54654/0 (socket says 172.21.15.12:54654) 2024-09-16T01:02:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.007+0000 7efc527fc640 1 -- 172.21.15.12:0/3534675629 learned_addr learned my addr 172.21.15.12:0/3534675629 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.008+0000 7efc537fe640 1 --2- 172.21.15.12:0/3534675629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf778e0 0x555cadf909f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.008+0000 7efc52ffd640 1 --2- 172.21.15.12:0/3534675629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf64a80 0x555cadf773a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.008+0000 7efc527fc640 1 -- 172.21.15.12:0/3534675629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf778e0 msgr2=0x555cadf909f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.008+0000 7efc527fc640 1 --2- 172.21.15.12:0/3534675629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf778e0 0x555cadf909f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.008+0000 7efc527fc640 1 -- 172.21.15.12:0/3534675629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf64a80 msgr2=0x555cadf773a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.008+0000 7efc527fc640 1 --2- 172.21.15.12:0/3534675629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf64a80 0x555cadf773a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.008+0000 7efc527fc640 1 -- 172.21.15.12:0/3534675629 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cadf744f0 con 0x555cadf78550 2024-09-16T01:02:21.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.009+0000 7efc527fc640 1 --2- 172.21.15.12:0/3534675629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf78550 0x555cadf904b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efc4801cc90 tx=0x7efc480096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e8bc8475bf9e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:21.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.009+0000 7efc397fa640 1 -- 172.21.15.12:0/3534675629 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4800f9e0 con 0x555cadf78550 2024-09-16T01:02:21.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.009+0000 7efc397fa640 1 -- 172.21.15.12:0/3534675629 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc4800fb80 con 0x555cadf78550 2024-09-16T01:02:21.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.009+0000 7efc397fa640 1 -- 172.21.15.12:0/3534675629 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4802acc0 con 0x555cadf78550 2024-09-16T01:02:21.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.010+0000 7efc5bd76740 1 -- 172.21.15.12:0/3534675629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf78550 msgr2=0x555cadf904b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:21.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.010+0000 7efc5bd76740 1 --2- 172.21.15.12:0/3534675629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf78550 0x555cadf904b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efc4801cc90 tx=0x7efc480096c0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.011+0000 7efc5bd76740 1 -- 172.21.15.12:0/3534675629 shutdown_connections 2024-09-16T01:02:21.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.011+0000 7efc5bd76740 1 --2- 172.21.15.12:0/3534675629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf778e0 0x555cadf909f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.011+0000 7efc5bd76740 1 --2- 172.21.15.12:0/3534675629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf78550 0x555cadf904b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.011+0000 7efc5bd76740 1 --2- 172.21.15.12:0/3534675629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf64a80 0x555cadf773a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.011+0000 7efc5bd76740 1 -- 172.21.15.12:0/3534675629 >> 172.21.15.12:0/3534675629 conn(0x555cadf610f0 msgr2=0x555cadf76c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.011+0000 7efc5bd76740 1 -- 172.21.15.12:0/3534675629 shutdown_connections 2024-09-16T01:02:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.011+0000 7efc5bd76740 1 -- 172.21.15.12:0/3534675629 wait complete. 2024-09-16T01:02:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.011+0000 7efc5bd76740 1 -- start start 2024-09-16T01:02:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.012+0000 7efc5bd76740 1 Processor -- start 2024-09-16T01:02:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.012+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf80700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.012+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf778e0 0x555cadf80c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.012+0000 7efc5bd76740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf78550 0x555cadf7d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.012+0000 7efc5bd76740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efc541ade30 con 0x555cadf64a80 2024-09-16T01:02:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.012+0000 7efc5bd76740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc541ad760 con 0x555cadf778e0 2024-09-16T01:02:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.012+0000 7efc5bd76740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efc541aa9a0 con 0x555cadf78550 2024-09-16T01:02:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc5bd76740 10 client.0 _ll_register_callbacks cb 0x7efc480097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc527fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf778e0 0x555cadf80c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc527fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf778e0 0x555cadf80c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:48594/0 (socket says 172.21.15.12:48594) 2024-09-16T01:02:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc527fc640 1 -- 172.21.15.12:0/989204322 learned_addr learned my addr 172.21.15.12:0/989204322 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:21.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc52ffd640 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf80700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:21.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc527fc640 1 -- 172.21.15.12:0/989204322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf78550 msgr2=0x555cadf7d440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:02:21.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc527fc640 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf78550 0x555cadf7d440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc527fc640 1 -- 172.21.15.12:0/989204322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 msgr2=0x555cadf80700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:21.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc527fc640 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf80700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc527fc640 1 -- 172.21.15.12:0/989204322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cadf7dc70 con 0x555cadf778e0 2024-09-16T01:02:21.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.013+0000 7efc52ffd640 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf80700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:21.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.014+0000 7efc527fc640 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf778e0 0x555cadf80c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc4800fd50 tx=0x7efc4802a670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fb3b0891d49d39b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:21.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.014+0000 7efc32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T01:02:21.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.014+0000 7efc32ffd640 1 -- 172.21.15.12:0/989204322 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4800f9e0 con 0x555cadf778e0 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.014+0000 7efc32ffd640 1 -- 172.21.15.12:0/989204322 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7efc4802a9f0 con 0x555cadf778e0 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.014+0000 7efc5bd76740 1 -- 172.21.15.12:0/989204322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc4800fb80 con 0x555cadf778e0 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.014+0000 7efc32ffd640 1 -- 172.21.15.12:0/989204322 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efc4802ac10 con 0x555cadf778e0 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.014+0000 7efc5bd76740 10 client.25400 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.015+0000 7efc5bd76740 1 -- 172.21.15.12:0/989204322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555cadff3ff0 con 0x555cadf778e0 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.015+0000 7efc32ffd640 1 -- 172.21.15.12:0/989204322 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc4800fb80 con 0x555cadf778e0 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.015+0000 7efc32ffd640 1 -- 172.21.15.12:0/989204322 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7efc4803e440 con 0x555cadf778e0 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.015+0000 7efc5bd76740 10 client.25400 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.015+0000 7efc5bd76740 10 client.25400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.015+0000 7efc5bd76740 20 client.25400 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.015+0000 7efc5bd76740 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x555cadff4540 0x555cadff6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.015+0000 7efc5bd76740 4 client.25400 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-16T01:02:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.015+0000 7efc5bd76740 1 -- 172.21.15.12:0/989204322 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555caded77f0 con 0x555cadff4540 2024-09-16T01:02:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.016+0000 7efc52ffd640 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x555cadff4540 0x555cadff6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.016+0000 7efc52ffd640 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x555cadff4540 0x555cadff6960 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8d7c8887a012f76 server_cookie=5bb766ccdca002ef in_seq=0 out_seq=0 2024-09-16T01:02:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.016+0000 7efc32ffd640 10 client.25400 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.018+0000 7efc32ffd640 1 -- 172.21.15.12:0/989204322 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555caded77f0 con 0x555cadff4540 2024-09-16T01:02:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.018+0000 7efc32ffd640 10 client.25400 handle_command_reply: tid=0 2024-09-16T01:02:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.019+0000 7efc5bd76740 1 client.25400 shutdown 2024-09-16T01:02:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.019+0000 7efc5bd76740 1 -- 172.21.15.12:0/989204322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf778e0 msgr2=0x555cadf80c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.019+0000 7efc5bd76740 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf778e0 0x555cadf80c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc4800fd50 tx=0x7efc4802a670 comp rx=0 tx=0).stop 2024-09-16T01:02:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.019+0000 7efc5bd76740 1 -- 172.21.15.12:0/989204322 shutdown_connections 2024-09-16T01:02:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.019+0000 7efc5bd76740 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x555cadff4540 0x555cadff6960 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.019+0000 7efc5bd76740 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555cadf78550 0x555cadf7d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.019+0000 7efc32ffd640 0 client.25400 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.019+0000 7efc5bd76740 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555cadf778e0 0x555cadf80c40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.020+0000 7efc5bd76740 1 --2- 172.21.15.12:0/989204322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cadf64a80 0x555cadf80700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.020+0000 7efc5bd76740 1 -- 172.21.15.12:0/989204322 >> 172.21.15.12:0/989204322 conn(0x555cadf610f0 msgr2=0x555cadf5fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.020+0000 7efc5bd76740 1 -- 172.21.15.12:0/989204322 shutdown_connections 2024-09-16T01:02:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.020+0000 7efc5bd76740 1 -- 172.21.15.12:0/989204322 wait complete. 2024-09-16T01:02:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.020+0000 7efc5bd76740 20 client.25400 trim_cache size 0 max 16384 2024-09-16T01:02:21.022 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:02:21.022 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-16T01:02:21.023 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "7ac9d1ee-63ea-4585-ac3e-1981f7c84506", 2024-09-16T01:02:21.023 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-16T01:02:21.023 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.021+0000 7efc5999d640 1 -- 172.21.15.12:0/425647671 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efc3c0a32c0 msgr2=0x7efc3c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.021+0000 7efc5999d640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efc3c0a32c0 0x7efc3c0a5780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efc4c03c000 tx=0x7efc4c047000 comp rx=0 tx=0).stop 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.021+0000 7efc5999d640 1 -- 172.21.15.12:0/425647671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc54102dd0 msgr2=0x7efc54198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.021+0000 7efc5999d640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc54102dd0 0x7efc54198240 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efc4400e9f0 tx=0x7efc4400eeb0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.022+0000 7efc5999d640 1 -- 172.21.15.12:0/425647671 shutdown_connections 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.022+0000 7efc5999d640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efc3c0a32c0 0x7efc3c0a5780 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.022+0000 7efc5999d640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc5410c170 0x7efc5419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.022+0000 7efc5999d640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc541036f0 0x7efc54198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.022+0000 7efc5999d640 1 --2- 172.21.15.12:0/425647671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc54102dd0 0x7efc54198240 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.022+0000 7efc5999d640 1 -- 172.21.15.12:0/425647671 >> 172.21.15.12:0/425647671 conn(0x7efc540fc790 msgr2=0x7efc5410e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:21.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.022+0000 7efc5999d640 1 -- 172.21.15.12:0/425647671 shutdown_connections 2024-09-16T01:02:21.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:21.022+0000 7efc5999d640 1 -- 172.21.15.12:0/425647671 wait complete. 2024-09-16T01:02:21.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:02:21.797 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:22.252 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:22 smithi012 ceph-mon[31197]: pgmap v398: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-16T01:02:22.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:22 smithi012 ceph-mon[31197]: scrub queued for path: / 2024-09-16T01:02:22.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:22 smithi012 ceph-mon[31197]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:22.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:22 smithi012 ceph-mon[31197]: scrub summary: active paths [/] 2024-09-16T01:02:22.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:22 smithi012 ceph-mon[31197]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:22.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:22 smithi012 ceph-mon[31197]: scrub summary: idle 2024-09-16T01:02:22.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:22 smithi119 ceph-mon[35049]: pgmap v398: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-16T01:02:22.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:22 smithi119 ceph-mon[35049]: scrub queued for path: / 2024-09-16T01:02:22.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:22 smithi119 ceph-mon[35049]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:22.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:22 smithi119 ceph-mon[35049]: scrub summary: active paths [/] 2024-09-16T01:02:22.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:22 smithi119 ceph-mon[35049]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:22.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:22 smithi119 ceph-mon[35049]: scrub summary: idle 2024-09-16T01:02:22.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.381+0000 7f3134ed9640 1 -- 172.21.15.12:0/887471287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3130100e20 msgr2=0x7f3130101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:22.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.381+0000 7f3134ed9640 1 --2- 172.21.15.12:0/887471287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3130100e20 0x7f3130101200 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3120009900 tx=0x7f312002a4b0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.382+0000 7f3134ed9640 1 -- 172.21.15.12:0/887471287 shutdown_connections 2024-09-16T01:02:22.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.382+0000 7f3134ed9640 1 --2- 172.21.15.12:0/887471287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3130102ef0 0x7f313010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.382+0000 7f3134ed9640 1 --2- 172.21.15.12:0/887471287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3130102570 0x7f31301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.382+0000 7f3134ed9640 1 --2- 172.21.15.12:0/887471287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3130100e20 0x7f3130101200 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.382+0000 7f3134ed9640 1 -- 172.21.15.12:0/887471287 >> 172.21.15.12:0/887471287 conn(0x7f31300fc7d0 msgr2=0x7f31300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:22.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.382+0000 7f3134ed9640 1 -- 172.21.15.12:0/887471287 shutdown_connections 2024-09-16T01:02:22.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.382+0000 7f3134ed9640 1 -- 172.21.15.12:0/887471287 wait complete. 2024-09-16T01:02:22.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.383+0000 7f3134ed9640 1 Processor -- start 2024-09-16T01:02:22.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.383+0000 7f3134ed9640 1 -- start start 2024-09-16T01:02:22.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.384+0000 7f3134ed9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3130100e20 0x7f3130198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:22.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.384+0000 7f3134ed9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3130102570 0x7f31301988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:22.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.384+0000 7f312e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3130100e20 0x7f3130198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:22.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.384+0000 7f312e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3130100e20 0x7f3130198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54694/0 (socket says 172.21.15.12:54694) 2024-09-16T01:02:22.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.384+0000 7f3134ed9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3130102ef0 0x7f313019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:22.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.384+0000 7f312e59c640 1 -- 172.21.15.12:0/3094131516 learned_addr learned my addr 172.21.15.12:0/3094131516 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:22.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.384+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f31301120a0 con 0x7f3130100e20 2024-09-16T01:02:22.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.385+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3130111f20 con 0x7f3130102570 2024-09-16T01:02:22.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.385+0000 7f312dd9b640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3130102570 0x7f31301988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:22.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.385+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3130112220 con 0x7f3130102ef0 2024-09-16T01:02:22.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.385+0000 7f312ed9d640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3130102ef0 0x7f313019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:22.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.385+0000 7f312dd9b640 1 -- 172.21.15.12:0/3094131516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3130102ef0 msgr2=0x7f313019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:22.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.385+0000 7f312dd9b640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3130102ef0 0x7f313019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.385+0000 7f312dd9b640 1 -- 172.21.15.12:0/3094131516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3130100e20 msgr2=0x7f3130198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.385+0000 7f312dd9b640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3130100e20 0x7f3130198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.385+0000 7f312dd9b640 1 -- 172.21.15.12:0/3094131516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313019d310 con 0x7f3130102570 2024-09-16T01:02:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.386+0000 7f312dd9b640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3130102570 0x7f31301988a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f312400e9f0 tx=0x7f312400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.386+0000 7f311f7fe640 1 -- 172.21.15.12:0/3094131516 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312400ccc0 con 0x7f3130102570 2024-09-16T01:02:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.386+0000 7f311f7fe640 1 -- 172.21.15.12:0/3094131516 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3124010910 con 0x7f3130102570 2024-09-16T01:02:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.386+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313019d600 con 0x7f3130102570 2024-09-16T01:02:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.386+0000 7f311f7fe640 1 -- 172.21.15.12:0/3094131516 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124018960 con 0x7f3130102570 2024-09-16T01:02:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.386+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31301a4ee0 con 0x7f3130102570 2024-09-16T01:02:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.388+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31301996c0 con 0x7f3130102570 2024-09-16T01:02:22.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.389+0000 7f311f7fe640 1 -- 172.21.15.12:0/3094131516 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3124010ac0 con 0x7f3130102570 2024-09-16T01:02:22.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.390+0000 7f311f7fe640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31180a32c0 0x7f31180a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:22.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.391+0000 7f312e59c640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31180a32c0 0x7f31180a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:22.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.391+0000 7f311f7fe640 1 -- 172.21.15.12:0/3094131516 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f31240cff80 con 0x7f3130102570 2024-09-16T01:02:22.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.392+0000 7f312e59c640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31180a32c0 0x7f31180a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3120004770 tx=0x7f312000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:22.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.395+0000 7f311f7fe640 1 -- 172.21.15.12:0/3094131516 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f312409c2f0 con 0x7f3130102570 2024-09-16T01:02:22.417 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:22.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:22 smithi098 ceph-mon[35346]: pgmap v398: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-16T01:02:22.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:22 smithi098 ceph-mon[35346]: scrub queued for path: / 2024-09-16T01:02:22.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:22 smithi098 ceph-mon[35346]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:22.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:22 smithi098 ceph-mon[35346]: scrub summary: active paths [/] 2024-09-16T01:02:22.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:22 smithi098 ceph-mon[35346]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:22.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:22 smithi098 ceph-mon[35346]: scrub summary: idle 2024-09-16T01:02:22.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.669+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31301a5170 con 0x7f3130102570 2024-09-16T01:02:22.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.670+0000 7f311f7fe640 1 -- 172.21.15.12:0/3094131516 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f31240a05f0 con 0x7f3130102570 2024-09-16T01:02:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:02:22.671 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:02:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:02:22.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.672+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31180a32c0 msgr2=0x7f31180a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:22.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.672+0000 7f3134ed9640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31180a32c0 0x7f31180a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3120004770 tx=0x7f312000b040 comp rx=0 tx=0).stop 2024-09-16T01:02:22.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.673+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3130102570 msgr2=0x7f31301988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:22.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.673+0000 7f3134ed9640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3130102570 0x7f31301988a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f312400e9f0 tx=0x7f312400eeb0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.673+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 shutdown_connections 2024-09-16T01:02:22.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.673+0000 7f3134ed9640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f31180a32c0 0x7f31180a5780 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.673+0000 7f3134ed9640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3130102ef0 0x7f313019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.673+0000 7f3134ed9640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3130102570 0x7f31301988a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.673+0000 7f3134ed9640 1 --2- 172.21.15.12:0/3094131516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3130100e20 0x7f3130198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.673+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 >> 172.21.15.12:0/3094131516 conn(0x7f31300fc7d0 msgr2=0x7f31300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.673+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 shutdown_connections 2024-09-16T01:02:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:22.673+0000 7f3134ed9640 1 -- 172.21.15.12:0/3094131516 wait complete. 2024-09-16T01:02:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.137+0000 7f562c3f7640 1 -- 172.21.15.12:0/295055021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5624100e20 msgr2=0x7f5624101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.137+0000 7f562c3f7640 1 --2- 172.21.15.12:0/295055021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5624100e20 0x7f5624101200 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5620009900 tx=0x7f562002a480 comp rx=0 tx=0).stop 2024-09-16T01:02:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.137+0000 7f562c3f7640 1 -- 172.21.15.12:0/295055021 shutdown_connections 2024-09-16T01:02:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.138+0000 7f562c3f7640 1 --2- 172.21.15.12:0/295055021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5624102ef0 0x7f562410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.138+0000 7f562c3f7640 1 --2- 172.21.15.12:0/295055021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5624102570 0x7f56241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.138+0000 7f562c3f7640 1 --2- 172.21.15.12:0/295055021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5624100e20 0x7f5624101200 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.138+0000 7f562c3f7640 1 -- 172.21.15.12:0/295055021 >> 172.21.15.12:0/295055021 conn(0x7f56240fc7d0 msgr2=0x7f56240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.138+0000 7f562c3f7640 1 -- 172.21.15.12:0/295055021 shutdown_connections 2024-09-16T01:02:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.138+0000 7f562c3f7640 1 -- 172.21.15.12:0/295055021 wait complete. 2024-09-16T01:02:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.139+0000 7f562c3f7640 1 Processor -- start 2024-09-16T01:02:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562c3f7640 1 -- start start 2024-09-16T01:02:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562c3f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5624100e20 0x7f56241974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562c3f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5624102570 0x7f56241979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562c3f7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5624102ef0 0x7f562419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562c3f7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5624110fd0 con 0x7f5624100e20 2024-09-16T01:02:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562c3f7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5624110e50 con 0x7f5624102ef0 2024-09-16T01:02:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562c3f7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5624111150 con 0x7f5624102570 2024-09-16T01:02:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562a994640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5624102ef0 0x7f562419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562a193640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5624100e20 0x7f56241974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f5629992640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5624102570 0x7f56241979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562a994640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5624102ef0 0x7f562419bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:48646/0 (socket says 172.21.15.12:48646) 2024-09-16T01:02:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.140+0000 7f562a994640 1 -- 172.21.15.12:0/875141240 learned_addr learned my addr 172.21.15.12:0/875141240 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.141+0000 7f562a994640 1 -- 172.21.15.12:0/875141240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5624102570 msgr2=0x7f56241979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.141+0000 7f562a994640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5624102570 0x7f56241979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.141+0000 7f562a994640 1 -- 172.21.15.12:0/875141240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5624100e20 msgr2=0x7f56241974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.141+0000 7f562a994640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5624100e20 0x7f56241974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.141+0000 7f562a994640 1 -- 172.21.15.12:0/875141240 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562419c460 con 0x7f5624102ef0 2024-09-16T01:02:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.141+0000 7f562a193640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5624100e20 0x7f56241974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.141+0000 7f562a994640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5624102ef0 0x7f562419bd80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f561c00eaa0 tx=0x7f561c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.141+0000 7f561b7fe640 1 -- 172.21.15.12:0/875141240 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c00cdb0 con 0x7f5624102ef0 2024-09-16T01:02:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.142+0000 7f561b7fe640 1 -- 172.21.15.12:0/875141240 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f561c005020 con 0x7f5624102ef0 2024-09-16T01:02:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.142+0000 7f562c3f7640 1 -- 172.21.15.12:0/875141240 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562419c750 con 0x7f5624102ef0 2024-09-16T01:02:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.142+0000 7f562c3f7640 1 -- 172.21.15.12:0/875141240 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5624069f70 con 0x7f5624102ef0 2024-09-16T01:02:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.143+0000 7f561b7fe640 1 -- 172.21.15.12:0/875141240 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0116d0 con 0x7f5624102ef0 2024-09-16T01:02:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.146+0000 7f561b7fe640 1 -- 172.21.15.12:0/875141240 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f561c005540 con 0x7f5624102ef0 2024-09-16T01:02:23.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.146+0000 7f562e7d0740 1 Processor -- start 2024-09-16T01:02:23.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.146+0000 7f562e7d0740 1 -- start start 2024-09-16T01:02:23.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.147+0000 7f562e7d0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e21880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.147+0000 7f562e7d0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e21dc0 0x559f47e2c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.147+0000 7f562a193640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e21dc0 0x559f47e2c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.147+0000 7f562a193640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e21dc0 0x559f47e2c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:48654/0 (socket says 172.21.15.12:48654) 2024-09-16T01:02:23.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.147+0000 7f561b7fe640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56100a3240 0x7f56100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.147+0000 7f562e7d0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e2ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.147+0000 7f562e7d0740 1 -- 172.21.15.12:0/4202039644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f47d872e0 con 0x559f47e2c680 2024-09-16T01:02:23.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.147+0000 7f562a193640 1 -- 172.21.15.12:0/4202039644 learned_addr learned my addr 172.21.15.12:0/4202039644 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.147+0000 7f562e7d0740 1 -- 172.21.15.12:0/4202039644 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559f47d2ece0 con 0x559f47e21dc0 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.147+0000 7f562e7d0740 1 -- 172.21.15.12:0/4202039644 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559f47d832a0 con 0x559f47e214a0 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.148+0000 7f562a193640 1 -- 172.21.15.12:0/4202039644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 msgr2=0x559f47e21880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.148+0000 7f562a193640 1 --2- 172.21.15.12:0/4202039644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e21880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.148+0000 7f562a193640 1 -- 172.21.15.12:0/4202039644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 msgr2=0x559f47e2ea70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.148+0000 7f5629992640 1 --2- 172.21.15.12:0/4202039644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e2ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.148+0000 7f562a193640 1 --2- 172.21.15.12:0/4202039644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e2ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.148+0000 7f562a193640 1 -- 172.21.15.12:0/4202039644 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f47d13440 con 0x559f47e21dc0 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.148+0000 7f5629992640 1 --2- 172.21.15.12:0/4202039644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e2ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.149+0000 7f562a994640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56100a3240 0x7f56100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.149+0000 7f562a193640 1 --2- 172.21.15.12:0/4202039644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e21dc0 0x559f47e2c140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5620009900 tx=0x7f56200044a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed3044ca432b05d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.149+0000 7f5618dea640 1 -- 172.21.15.12:0/4202039644 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620035040 con 0x559f47e21dc0 2024-09-16T01:02:23.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.149+0000 7f5618dea640 1 -- 172.21.15.12:0/4202039644 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5620004760 con 0x559f47e21dc0 2024-09-16T01:02:23.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.149+0000 7f5618dea640 1 -- 172.21.15.12:0/4202039644 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620003a70 con 0x559f47e21dc0 2024-09-16T01:02:23.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.150+0000 7f561b7fe640 1 -- 172.21.15.12:0/875141240 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f561c0cfdf0 con 0x7f5624102ef0 2024-09-16T01:02:23.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.150+0000 7f562e7d0740 1 -- 172.21.15.12:0/4202039644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e21dc0 msgr2=0x559f47e2c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.150+0000 7f562a994640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56100a3240 0x7f56100a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f561c007560 tx=0x7f561c06bd70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.150+0000 7f562e7d0740 1 --2- 172.21.15.12:0/4202039644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e21dc0 0x559f47e2c140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5620009900 tx=0x7f56200044a0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.150+0000 7f562e7d0740 1 -- 172.21.15.12:0/4202039644 shutdown_connections 2024-09-16T01:02:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.150+0000 7f562e7d0740 1 --2- 172.21.15.12:0/4202039644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e2ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.150+0000 7f562e7d0740 1 --2- 172.21.15.12:0/4202039644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e21dc0 0x559f47e2c140 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5620009900 tx=0x7f56200044a0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.150+0000 7f562e7d0740 1 --2- 172.21.15.12:0/4202039644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e21880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.150+0000 7f562e7d0740 1 -- 172.21.15.12:0/4202039644 >> 172.21.15.12:0/4202039644 conn(0x559f47e1da30 msgr2=0x559f47e1de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.151+0000 7f562e7d0740 1 -- 172.21.15.12:0/4202039644 shutdown_connections 2024-09-16T01:02:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.151+0000 7f562e7d0740 1 -- 172.21.15.12:0/4202039644 wait complete. 2024-09-16T01:02:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.151+0000 7f562e7d0740 1 -- start start 2024-09-16T01:02:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.151+0000 7f562e7d0740 1 Processor -- start 2024-09-16T01:02:23.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f562e7d0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e214a0 0x559f47e29520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f562e7d0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e29a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f562a193640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e29a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f562a193640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e29a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54726/0 (socket says 172.21.15.12:54726) 2024-09-16T01:02:23.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f5629992640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e214a0 0x559f47e29520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f5629992640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e214a0 0x559f47e29520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:48670/0 (socket says 172.21.15.12:48670) 2024-09-16T01:02:23.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f562e7d0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e29fa0 0x559f47e386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f562a193640 1 -- 172.21.15.12:0/1078999329 learned_addr learned my addr 172.21.15.12:0/1078999329 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:23.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f47e2f250 con 0x559f47e2c680 2024-09-16T01:02:23.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559f47d42050 con 0x559f47e214a0 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.152+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559f47e2f3d0 con 0x559f47e29fa0 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.153+0000 7f562a193640 1 -- 172.21.15.12:0/1078999329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e29fa0 msgr2=0x559f47e386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.153+0000 7f562a193640 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e29fa0 0x559f47e386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.153+0000 7f562a193640 1 -- 172.21.15.12:0/1078999329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e214a0 msgr2=0x559f47e29520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.153+0000 7f562a193640 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e214a0 0x559f47e29520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.153+0000 7f562a193640 1 -- 172.21.15.12:0/1078999329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f47af83c0 con 0x559f47e2c680 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.153+0000 7f562a193640 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e29a60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5620006010 tx=0x7f56200035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf1ea757eebaa9f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.153+0000 7f562e7d0740 10 client.0 _ll_register_callbacks cb 0x559f47d82160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.153+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5620004760 con 0x559f47e2c680 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.153+0000 7f560dffb640 10 client.15819 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:23.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.154+0000 7f560dffb640 1 -- 172.21.15.12:0/1078999329 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620035030 con 0x559f47e2c680 2024-09-16T01:02:23.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.154+0000 7f560dffb640 1 -- 172.21.15.12:0/1078999329 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f56200052d0 con 0x559f47e2c680 2024-09-16T01:02:23.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.154+0000 7f560dffb640 1 -- 172.21.15.12:0/1078999329 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5620005510 con 0x559f47e2c680 2024-09-16T01:02:23.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.154+0000 7f562e7d0740 10 client.15819 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:23.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.154+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559f47e3adb0 con 0x559f47e2c680 2024-09-16T01:02:23.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.154+0000 7f560dffb640 1 -- 172.21.15.12:0/1078999329 <== mon.0 v2:172.21.15.12:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5620003810 con 0x559f47e2c680 2024-09-16T01:02:23.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.155+0000 7f562e7d0740 10 client.15819 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:23.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.155+0000 7f562e7d0740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:23.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.155+0000 7f562e7d0740 20 client.15819 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:23.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.155+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559f47e3c100 0x559f47e3e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.155+0000 7f562e7d0740 4 client.15819 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:23.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.155+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f47d94850 con 0x559f47e3c100 2024-09-16T01:02:23.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.155+0000 7f5629992640 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559f47e3c100 0x559f47e3e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.155+0000 7f5629992640 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559f47e3c100 0x559f47e3e4f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78577c9f8e11684a server_cookie=5acf629edf6b42b5 in_seq=0 out_seq=0 2024-09-16T01:02:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.155+0000 7f560dffb640 10 client.15819 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.156+0000 7f560dffb640 1 -- 172.21.15.12:0/1078999329 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f47d94850 con 0x559f47e3c100 2024-09-16T01:02:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.156+0000 7f560dffb640 10 client.15819 handle_command_reply: tid=0 2024-09-16T01:02:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.156+0000 7f562e7d0740 1 client.15819 shutdown 2024-09-16T01:02:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.156+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 msgr2=0x559f47e29a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.156+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e29a60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5620006010 tx=0x7f56200035f0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.157+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 shutdown_connections 2024-09-16T01:02:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.157+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559f47e3c100 0x559f47e3e4f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.157+0000 7f560dffb640 0 client.15819 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.157+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e29fa0 0x559f47e386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.157+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e2c680 0x559f47e29a60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.157+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1078999329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e214a0 0x559f47e29520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.157+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 >> 172.21.15.12:0/1078999329 conn(0x559f47e1da30 msgr2=0x559f47e23760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.157+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 shutdown_connections 2024-09-16T01:02:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.157+0000 7f562e7d0740 1 -- 172.21.15.12:0/1078999329 wait complete. 2024-09-16T01:02:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.157+0000 7f562e7d0740 20 client.15819 trim_cache size 0 max 16384 2024-09-16T01:02:23.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.192+0000 7f562e7d0740 1 Processor -- start 2024-09-16T01:02:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.192+0000 7f562e7d0740 1 -- start start 2024-09-16T01:02:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.192+0000 7f562e7d0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e27e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.192+0000 7f562e7d0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e384b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562a193640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562a193640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e384b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54742/0 (socket says 172.21.15.12:54742) 2024-09-16T01:02:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562a193640 1 -- 172.21.15.12:0/2798578848 learned_addr learned my addr 172.21.15.12:0/2798578848 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562e7d0740 1 --2- 172.21.15.12:0/2798578848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e2c680 0x559f47e389f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562e7d0740 1 -- 172.21.15.12:0/2798578848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f56241b0ea0 con 0x559f47e29fa0 2024-09-16T01:02:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562e7d0740 1 -- 172.21.15.12:0/2798578848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f56241b29e0 con 0x559f47e2c680 2024-09-16T01:02:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562e7d0740 1 -- 172.21.15.12:0/2798578848 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f56241b1570 con 0x559f47e214a0 2024-09-16T01:02:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562a193640 1 -- 172.21.15.12:0/2798578848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 msgr2=0x559f47e27e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562a193640 1 --2- 172.21.15.12:0/2798578848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e27e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562a193640 1 -- 172.21.15.12:0/2798578848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e2c680 msgr2=0x559f47e389f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:02:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562a193640 1 --2- 172.21.15.12:0/2798578848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e2c680 0x559f47e389f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562a193640 1 -- 172.21.15.12:0/2798578848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f47e1e6c0 con 0x559f47e29fa0 2024-09-16T01:02:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.193+0000 7f562a193640 1 --2- 172.21.15.12:0/2798578848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e384b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f56200092a0 tx=0x7f5620005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78b3ce28e6b304 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.194+0000 7f560ffff640 1 -- 172.21.15.12:0/2798578848 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620035070 con 0x559f47e29fa0 2024-09-16T01:02:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.194+0000 7f560ffff640 1 -- 172.21.15.12:0/2798578848 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5620004760 con 0x559f47e29fa0 2024-09-16T01:02:23.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.194+0000 7f560ffff640 1 -- 172.21.15.12:0/2798578848 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620031c80 con 0x559f47e29fa0 2024-09-16T01:02:23.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.195+0000 7f562e7d0740 1 -- 172.21.15.12:0/2798578848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 msgr2=0x559f47e384b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.195+0000 7f562e7d0740 1 --2- 172.21.15.12:0/2798578848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e384b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f56200092a0 tx=0x7f5620005c00 comp rx=0 tx=0).stop 2024-09-16T01:02:23.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.195+0000 7f562e7d0740 1 -- 172.21.15.12:0/2798578848 shutdown_connections 2024-09-16T01:02:23.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.195+0000 7f562e7d0740 1 --2- 172.21.15.12:0/2798578848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e2c680 0x559f47e389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.195+0000 7f562e7d0740 1 --2- 172.21.15.12:0/2798578848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e384b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.195+0000 7f562e7d0740 1 --2- 172.21.15.12:0/2798578848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e27e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.195+0000 7f562e7d0740 1 -- 172.21.15.12:0/2798578848 >> 172.21.15.12:0/2798578848 conn(0x559f47e1da30 msgr2=0x559f47e2b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.195+0000 7f562e7d0740 1 -- 172.21.15.12:0/2798578848 shutdown_connections 2024-09-16T01:02:23.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.195+0000 7f562e7d0740 1 -- 172.21.15.12:0/2798578848 wait complete. 2024-09-16T01:02:23.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.195+0000 7f562e7d0740 1 -- start start 2024-09-16T01:02:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.196+0000 7f562e7d0740 1 Processor -- start 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.196+0000 7f562e7d0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e34b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.196+0000 7f562e7d0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e26080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.196+0000 7f562a193640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e26080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.196+0000 7f562a193640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e26080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54758/0 (socket says 172.21.15.12:54758) 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.196+0000 7f5629992640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e34b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.196+0000 7f562a193640 1 -- 172.21.15.12:0/1717386446 learned_addr learned my addr 172.21.15.12:0/1717386446 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.196+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e2c680 0x559f47e265c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.196+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f56241b2310 con 0x559f47e29fa0 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.197+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f56241b1c40 con 0x559f47e2c680 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.197+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f56241aee80 con 0x559f47e214a0 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.197+0000 7f5629992640 1 -- 172.21.15.12:0/1717386446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e2c680 msgr2=0x559f47e265c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.197+0000 7f5629992640 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e2c680 0x559f47e265c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.197+0000 7f5629992640 1 -- 172.21.15.12:0/1717386446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 msgr2=0x559f47e26080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.197+0000 7f5629992640 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e26080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.197+0000 7f5629992640 1 -- 172.21.15.12:0/1717386446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f47e26c00 con 0x559f47e214a0 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.197+0000 7f562a193640 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e26080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.197+0000 7f562e7d0740 10 client.0 _ll_register_callbacks cb 0x7f56200043f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.197+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5620004760 con 0x559f47e214a0 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.198+0000 7f5629992640 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e34b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x559f47e3eaf0 tx=0x7f561400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74cb785fe16babcc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.198+0000 7f560dffb640 10 client.25372 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.198+0000 7f560dffb640 1 -- 172.21.15.12:0/1717386446 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614003dd0 con 0x559f47e214a0 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.198+0000 7f560dffb640 1 -- 172.21.15.12:0/1717386446 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5614005020 con 0x559f47e214a0 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.198+0000 7f560dffb640 1 -- 172.21.15.12:0/1717386446 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5614005240 con 0x559f47e214a0 2024-09-16T01:02:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.198+0000 7f562e7d0740 10 client.25372 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.198+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559f47ea68b0 con 0x559f47e214a0 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.199+0000 7f560dffb640 1 -- 172.21.15.12:0/1717386446 <== mon.1 v2:172.21.15.119:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f56140053e0 con 0x559f47e214a0 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.199+0000 7f562e7d0740 10 client.25372 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.199+0000 7f562e7d0740 10 client.25372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.199+0000 7f562e7d0740 20 client.25372 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.199+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559f47ea6f10 0x559f47ea9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.199+0000 7f562e7d0740 4 client.25372 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.199+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559f47e29df0 con 0x559f47ea6f10 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.199+0000 7f562a193640 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559f47ea6f10 0x559f47ea9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.199+0000 7f560dffb640 10 client.25372 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.199+0000 7f562a193640 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559f47ea6f10 0x559f47ea9320 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbf25d2999bede3e server_cookie=35c39f90a533cbb7 in_seq=0 out_seq=0 2024-09-16T01:02:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f560dffb640 1 -- 172.21.15.12:0/1717386446 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559f47e29df0 con 0x559f47ea6f10 2024-09-16T01:02:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f560dffb640 10 client.25372 handle_command_reply: tid=0 2024-09-16T01:02:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 client.25372 shutdown 2024-09-16T01:02:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 msgr2=0x559f47e34b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e34b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x559f47e3eaf0 tx=0x7f561400be30 comp rx=0 tx=0).stop 2024-09-16T01:02:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 shutdown_connections 2024-09-16T01:02:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559f47ea6f10 0x559f47ea9320 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559f47e2c680 0x559f47e265c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f560dffb640 0 client.25372 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:23.205 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:02:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-16T01:02:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-16T01:02:23.206 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:02:23.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f47e29fa0 0x559f47e26080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 --2- 172.21.15.12:0/1717386446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559f47e214a0 0x559f47e34b50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 >> 172.21.15.12:0/1717386446 conn(0x559f47e1da30 msgr2=0x559f47e1c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 shutdown_connections 2024-09-16T01:02:23.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 1 -- 172.21.15.12:0/1717386446 wait complete. 2024-09-16T01:02:23.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.200+0000 7f562e7d0740 20 client.25372 trim_cache size 0 max 16384 2024-09-16T01:02:23.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.201+0000 7f562c3f7640 1 -- 172.21.15.12:0/875141240 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56100a3240 msgr2=0x7f56100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.201+0000 7f562c3f7640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56100a3240 0x7f56100a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f561c007560 tx=0x7f561c06bd70 comp rx=0 tx=0).stop 2024-09-16T01:02:23.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.201+0000 7f562c3f7640 1 -- 172.21.15.12:0/875141240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5624102ef0 msgr2=0x7f562419bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.201+0000 7f562c3f7640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5624102ef0 0x7f562419bd80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f561c00eaa0 tx=0x7f561c00ef60 comp rx=0 tx=0).stop 2024-09-16T01:02:23.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.201+0000 7f562c3f7640 1 -- 172.21.15.12:0/875141240 shutdown_connections 2024-09-16T01:02:23.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.201+0000 7f562c3f7640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56100a3240 0x7f56100a5700 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.201+0000 7f562c3f7640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5624102ef0 0x7f562419bd80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.202+0000 7f562c3f7640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5624102570 0x7f56241979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.202+0000 7f562c3f7640 1 --2- 172.21.15.12:0/875141240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5624100e20 0x7f56241974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.202+0000 7f562c3f7640 1 -- 172.21.15.12:0/875141240 >> 172.21.15.12:0/875141240 conn(0x7f56240fc7d0 msgr2=0x7f56241068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.202+0000 7f562c3f7640 1 -- 172.21.15.12:0/875141240 shutdown_connections 2024-09-16T01:02:23.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:23.202+0000 7f562c3f7640 1 -- 172.21.15.12:0/875141240 wait complete. 2024-09-16T01:02:23.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:23 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3094131516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:23.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:23 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3094131516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:23.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:23 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3094131516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:23.676 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db --set-id 1ec91d52 --release --await' 2024-09-16T01:02:23.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24518 quiesce db --set-id 1ec91d52 --release --await 2024-09-16T01:02:24.310 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:24 smithi012 ceph-mon[31197]: pgmap v399: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-16T01:02:24.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:24 smithi119 ceph-mon[35049]: pgmap v399: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-16T01:02:24.348 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-16T01:02:24.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:02:24.393 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:24.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:24 smithi098 ceph-mon[35346]: pgmap v399: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-16T01:02:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.924+0000 7fe5c8427640 1 -- 172.21.15.12:0/4032085475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5c0102ef0 msgr2=0x7fe5c010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.924+0000 7fe5c8427640 1 --2- 172.21.15.12:0/4032085475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5c0102ef0 0x7fe5c010da40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009ca0 tx=0x7fe5b802a950 comp rx=0 tx=0).stop 2024-09-16T01:02:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.924+0000 7fe5c8427640 1 -- 172.21.15.12:0/4032085475 shutdown_connections 2024-09-16T01:02:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.924+0000 7fe5c8427640 1 --2- 172.21.15.12:0/4032085475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5c0102ef0 0x7fe5c010da40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.925+0000 7fe5c8427640 1 --2- 172.21.15.12:0/4032085475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5c0102570 0x7fe5c01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.925+0000 7fe5c8427640 1 --2- 172.21.15.12:0/4032085475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5c0100e20 0x7fe5c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.925+0000 7fe5c8427640 1 -- 172.21.15.12:0/4032085475 >> 172.21.15.12:0/4032085475 conn(0x7fe5c00fc7d0 msgr2=0x7fe5c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.925+0000 7fe5c8427640 1 -- 172.21.15.12:0/4032085475 shutdown_connections 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.925+0000 7fe5c8427640 1 -- 172.21.15.12:0/4032085475 wait complete. 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.925+0000 7fe5c8427640 1 Processor -- start 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c8427640 1 -- start start 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c8427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5c0100e20 0x7fe5c010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c8427640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5c0102570 0x7fe5c010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c61c3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5c0100e20 0x7fe5c010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c8427640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5c0102ef0 0x7fe5c010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c61c3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5c0100e20 0x7fe5c010e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54778/0 (socket says 172.21.15.12:54778) 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c61c3640 1 -- 172.21.15.12:0/260293830 learned_addr learned my addr 172.21.15.12:0/260293830 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c01120a0 con 0x7fe5c0100e20 2024-09-16T01:02:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c0111f20 con 0x7fe5c0102570 2024-09-16T01:02:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c0112220 con 0x7fe5c0102ef0 2024-09-16T01:02:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5c0102570 0x7fe5c010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.926+0000 7fe5c69c4640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5c0102ef0 0x7fe5c010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.927+0000 7fe5c61c3640 1 -- 172.21.15.12:0/260293830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5c0102ef0 msgr2=0x7fe5c010ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.927+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5c0102ef0 0x7fe5c010ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.927+0000 7fe5c61c3640 1 -- 172.21.15.12:0/260293830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5c0102570 msgr2=0x7fe5c010ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.927+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5c0102570 0x7fe5c010ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.927+0000 7fe5c61c3640 1 -- 172.21.15.12:0/260293830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c01aacb0 con 0x7fe5c0100e20 2024-09-16T01:02:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.927+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5c0100e20 0x7fe5c010e4d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00b4a0 tx=0x7fe5bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.928+0000 7fe5b77fe640 1 -- 172.21.15.12:0/260293830 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc014070 con 0x7fe5c0100e20 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.928+0000 7fe5b77fe640 1 -- 172.21.15.12:0/260293830 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5bc010af0 con 0x7fe5c0100e20 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.928+0000 7fe5b77fe640 1 -- 172.21.15.12:0/260293830 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc017d10 con 0x7fe5c0100e20 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.928+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c01aaee0 con 0x7fe5c0100e20 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.929+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c01ab390 con 0x7fe5c0100e20 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.932+0000 7fe5ca800740 1 Processor -- start 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.932+0000 7fe5ca800740 1 -- start start 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.932+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba409a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.932+0000 7fe5b77fe640 1 -- 172.21.15.12:0/260293830 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe5bc017070 con 0x7fe5c0100e20 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.932+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 0x559ba40a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5ca800740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559ba3fff620 con 0x559ba40a5240 2024-09-16T01:02:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5ca800740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559ba3fa6e50 con 0x559ba409a060 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5ca800740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559ba3ffb5e0 con 0x559ba409a980 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c59c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c61c3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 0x559ba40a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c59c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54792/0 (socket says 172.21.15.12:54792) 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c59c2640 1 -- 172.21.15.12:0/2988790127 learned_addr learned my addr 172.21.15.12:0/2988790127 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c69c4640 1 --2- 172.21.15.12:0/2988790127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba409a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c61c3640 1 -- 172.21.15.12:0/2988790127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 msgr2=0x559ba409a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/2988790127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba409a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c61c3640 1 -- 172.21.15.12:0/2988790127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 msgr2=0x559ba40a7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/2988790127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c61c3640 1 -- 172.21.15.12:0/2988790127 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ba3f97d40 con 0x559ba409a980 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.933+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/2988790127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.934+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/2988790127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 0x559ba40a4d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0cbff0 tx=0x7fe5bc0d4f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9e1d7c9acb73831 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.934+0000 7fe5b77fe640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe5ac0a32c0 0x7fe5ac0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.934+0000 7fe5b4dea640 1 -- 172.21.15.12:0/2988790127 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0dd070 con 0x559ba409a980 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.934+0000 7fe5b4dea640 1 -- 172.21.15.12:0/2988790127 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5bc0d6de0 con 0x559ba409a980 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.934+0000 7fe5b4dea640 1 -- 172.21.15.12:0/2988790127 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0d88e0 con 0x559ba409a980 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.934+0000 7fe5c69c4640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe5ac0a32c0 0x7fe5ac0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.935+0000 7fe5b77fe640 1 -- 172.21.15.12:0/260293830 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fe5bc0ce880 con 0x7fe5c0100e20 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.935+0000 7fe5c69c4640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe5ac0a32c0 0x7fe5ac0a5780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009a60 tx=0x7fe5b8005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.935+0000 7fe5ca800740 1 -- 172.21.15.12:0/2988790127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 msgr2=0x559ba40a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.935+0000 7fe5ca800740 1 --2- 172.21.15.12:0/2988790127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 0x559ba40a4d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0cbff0 tx=0x7fe5bc0d4f10 comp rx=0 tx=0).stop 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.935+0000 7fe5ca800740 1 -- 172.21.15.12:0/2988790127 shutdown_connections 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.935+0000 7fe5ca800740 1 --2- 172.21.15.12:0/2988790127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.935+0000 7fe5ca800740 1 --2- 172.21.15.12:0/2988790127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 0x559ba40a4d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.935+0000 7fe5ca800740 1 --2- 172.21.15.12:0/2988790127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba409a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.935+0000 7fe5ca800740 1 -- 172.21.15.12:0/2988790127 >> 172.21.15.12:0/2988790127 conn(0x559ba40965f0 msgr2=0x559ba40969d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.936+0000 7fe5ca800740 1 -- 172.21.15.12:0/2988790127 shutdown_connections 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.936+0000 7fe5ca800740 1 -- 172.21.15.12:0/2988790127 wait complete. 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.936+0000 7fe5ca800740 1 -- start start 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.936+0000 7fe5ca800740 1 Processor -- start 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.936+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba40a2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 0x559ba40a2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5ca800740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559ba40a7e10 con 0x559ba40a5240 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5ca800740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559ba3f87f10 con 0x559ba409a060 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5ca800740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559ba40a7f90 con 0x559ba409a980 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c61c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba40a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c61c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba40a2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:48736/0 (socket says 172.21.15.12:48736) 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c61c3640 1 -- 172.21.15.12:0/1279754283 learned_addr learned my addr 172.21.15.12:0/1279754283 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5ca800740 10 client.0 _ll_register_callbacks cb 0x559ba3fabdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c69c4640 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 0x559ba40a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c61c3640 1 -- 172.21.15.12:0/1279754283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 msgr2=0x559ba40a2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 0x559ba40a2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c61c3640 1 -- 172.21.15.12:0/1279754283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 msgr2=0x559ba40a2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c61c3640 1 -- 172.21.15.12:0/1279754283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ba3d0e580 con 0x559ba409a060 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.937+0000 7fe5c69c4640 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.938+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba40a2120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0cc390 tx=0x7fe5bc017630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5d18fac6b1c28c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.938+0000 7fe5a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T01:02:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.939+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/1279754283 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc01e030 con 0x559ba409a060 2024-09-16T01:02:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.939+0000 7fe5ca800740 1 -- 172.21.15.12:0/1279754283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5bc0d6de0 con 0x559ba409a060 2024-09-16T01:02:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.939+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/1279754283 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fe5bc098ef0 con 0x559ba409a060 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.939+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/1279754283 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe5bc0dd070 con 0x559ba409a060 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.939+0000 7fe5ca800740 10 client.25427 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.939+0000 7fe5ca800740 1 -- 172.21.15.12:0/1279754283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559ba3dd8960 con 0x559ba409a060 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.939+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/1279754283 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5bc0d9df0 con 0x559ba409a060 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.940+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/1279754283 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe5bc097260 con 0x559ba409a060 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.940+0000 7fe5ca800740 10 client.25427 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.940+0000 7fe5ca800740 10 client.25427 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.940+0000 7fe5ca800740 20 client.25427 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.940+0000 7fe5ca800740 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559ba40b4ef0 0x559ba40b7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.940+0000 7fe5ca800740 4 client.25427 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.940+0000 7fe5ca800740 1 -- 172.21.15.12:0/1279754283 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe5bc0d6de0 con 0x559ba40b4ef0 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.941+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559ba40b4ef0 0x559ba40b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.941+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559ba40b4ef0 0x559ba40b7310 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3436e65eafc1ed52 server_cookie=cbaa62448f8cd6b3 in_seq=0 out_seq=0 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.941+0000 7fe5a9ffb640 10 client.25427 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/1279754283 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe5bc0d6de0 con 0x559ba40b4ef0 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5a9ffb640 10 client.25427 handle_command_reply: tid=0 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5ca800740 1 client.25427 shutdown 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5ca800740 1 -- 172.21.15.12:0/1279754283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 msgr2=0x559ba40a2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5ca800740 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba40a2120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0cc390 tx=0x7fe5bc017630 comp rx=0 tx=0).stop 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5ca800740 1 -- 172.21.15.12:0/1279754283 shutdown_connections 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5ca800740 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559ba40b4ef0 0x559ba40b7310 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5ca800740 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba40a5240 0x559ba40a2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5ca800740 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba409a980 0x559ba40a2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5ca800740 1 --2- 172.21.15.12:0/1279754283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba40a2120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.942+0000 7fe5ca800740 1 -- 172.21.15.12:0/1279754283 >> 172.21.15.12:0/1279754283 conn(0x559ba40965f0 msgr2=0x559ba409c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.943+0000 7fe5a9ffb640 0 client.25427 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.943+0000 7fe5ca800740 1 -- 172.21.15.12:0/1279754283 shutdown_connections 2024-09-16T01:02:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.943+0000 7fe5ca800740 1 -- 172.21.15.12:0/1279754283 wait complete. 2024-09-16T01:02:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.943+0000 7fe5ca800740 20 client.25427 trim_cache size 0 max 16384 2024-09-16T01:02:24.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.968+0000 7fe5ca800740 1 Processor -- start 2024-09-16T01:02:24.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.968+0000 7fe5ca800740 1 -- start start 2024-09-16T01:02:24.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba409cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a980 0x559ba40a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba40a5240 0x559ba40bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5ca800740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c01b5330 con 0x559ba409a980 2024-09-16T01:02:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5ca800740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c01b6e70 con 0x559ba409a060 2024-09-16T01:02:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5ca800740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c01b5a00 con 0x559ba40a5240 2024-09-16T01:02:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5c59c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a980 0x559ba40a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5c59c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a980 0x559ba40a27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54804/0 (socket says 172.21.15.12:54804) 2024-09-16T01:02:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5c59c2640 1 -- 172.21.15.12:0/3420144789 learned_addr learned my addr 172.21.15.12:0/3420144789 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/3420144789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba409cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5c69c4640 1 --2- 172.21.15.12:0/3420144789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba40a5240 0x559ba40bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5c59c2640 1 -- 172.21.15.12:0/3420144789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba40a5240 msgr2=0x559ba40bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:24.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/3420144789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba40a5240 0x559ba40bcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5c59c2640 1 -- 172.21.15.12:0/3420144789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 msgr2=0x559ba409cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:24.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/3420144789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba409cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.969+0000 7fe5c59c2640 1 -- 172.21.15.12:0/3420144789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ba40a7f70 con 0x559ba409a980 2024-09-16T01:02:24.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.970+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/3420144789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a980 0x559ba40a27f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0005d00 tx=0x7fe5b000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e44452cef2f185 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:24.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.970+0000 7fe5abfff640 1 -- 172.21.15.12:0/3420144789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0005220 con 0x559ba409a980 2024-09-16T01:02:24.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.970+0000 7fe5abfff640 1 -- 172.21.15.12:0/3420144789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5b0004c80 con 0x559ba409a980 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.970+0000 7fe5abfff640 1 -- 172.21.15.12:0/3420144789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00269c0 con 0x559ba409a980 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.971+0000 7fe5ca800740 1 -- 172.21.15.12:0/3420144789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a980 msgr2=0x559ba40a27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.971+0000 7fe5ca800740 1 --2- 172.21.15.12:0/3420144789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a980 0x559ba40a27f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0005d00 tx=0x7fe5b000b410 comp rx=0 tx=0).stop 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.971+0000 7fe5ca800740 1 -- 172.21.15.12:0/3420144789 shutdown_connections 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.971+0000 7fe5ca800740 1 --2- 172.21.15.12:0/3420144789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba40a5240 0x559ba40bcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.971+0000 7fe5ca800740 1 --2- 172.21.15.12:0/3420144789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a980 0x559ba40a27f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.972+0000 7fe5ca800740 1 --2- 172.21.15.12:0/3420144789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a060 0x559ba409cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.972+0000 7fe5ca800740 1 -- 172.21.15.12:0/3420144789 >> 172.21.15.12:0/3420144789 conn(0x559ba40965f0 msgr2=0x559ba40a20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.972+0000 7fe5ca800740 1 -- 172.21.15.12:0/3420144789 shutdown_connections 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.972+0000 7fe5ca800740 1 -- 172.21.15.12:0/3420144789 wait complete. 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5ca800740 1 -- start start 2024-09-16T01:02:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5ca800740 1 Processor -- start 2024-09-16T01:02:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a060 0x559ba40a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a980 0x559ba40a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5ca800740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba40a5240 0x559ba40a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5ca800740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c01b67a0 con 0x559ba409a060 2024-09-16T01:02:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5ca800740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c01b60d0 con 0x559ba409a980 2024-09-16T01:02:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5ca800740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c01b3310 con 0x559ba40a5240 2024-09-16T01:02:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5ca800740 10 client.0 _ll_register_callbacks cb 0x7fe5bc0d6f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5c59c2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a980 0x559ba40a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.973+0000 7fe5c59c2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a980 0x559ba40a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:48756/0 (socket says 172.21.15.12:48756) 2024-09-16T01:02:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5c59c2640 1 -- 172.21.15.12:0/3270657338 learned_addr learned my addr 172.21.15.12:0/3270657338 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5c69c4640 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba40a5240 0x559ba40a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a060 0x559ba40a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5c59c2640 1 -- 172.21.15.12:0/3270657338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba40a5240 msgr2=0x559ba40a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba40a5240 0x559ba40a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5c59c2640 1 -- 172.21.15.12:0/3270657338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a060 msgr2=0x559ba40a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a060 0x559ba40a8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5c59c2640 1 -- 172.21.15.12:0/3270657338 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ba411ebd0 con 0x559ba409a980 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5c59c2640 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a980 0x559ba40a9430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000b7e0 tx=0x7fe5b0026500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=967270b28cc250f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/3270657338 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0004020 con 0x559ba409a980 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/3270657338 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fe5b00041c0 con 0x559ba409a980 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.974+0000 7fe5ca800740 1 -- 172.21.15.12:0/3270657338 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5b0004c80 con 0x559ba409a980 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/3270657338 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe5b0039050 con 0x559ba409a980 2024-09-16T01:02:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5ca800740 10 client.25433 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5ca800740 1 -- 172.21.15.12:0/3270657338 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559ba411fe50 con 0x559ba409a980 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/3270657338 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5b00043c0 con 0x559ba409a980 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/3270657338 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe5b0026bb0 con 0x559ba409a980 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5ca800740 10 client.25433 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5ca800740 10 client.25433 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5ca800740 20 client.25433 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5ca800740 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559ba41204f0 0x559ba4122910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5ca800740 4 client.25433 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1ec91d52", "release": true, "await": true}] 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.975+0000 7fe5ca800740 1 -- 172.21.15.12:0/3270657338 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1ec91d52", "release": true, "await": true}) -- 0x7fe5b0004c80 con 0x559ba41204f0 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.976+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559ba41204f0 0x559ba4122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.976+0000 7fe5c61c3640 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559ba41204f0 0x559ba4122910 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=188997f78089eedd server_cookie=c9e53c9e2a4bbf41 in_seq=0 out_seq=0 2024-09-16T01:02:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.976+0000 7fe5a9ffb640 10 client.25433 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:24.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.978+0000 7fe5a9ffb640 1 -- 172.21.15.12:0/3270657338 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fe5b0004c80 con 0x559ba41204f0 2024-09-16T01:02:24.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.978+0000 7fe5a9ffb640 10 client.25433 handle_command_reply: tid=0 2024-09-16T01:02:24.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.978+0000 7fe5ca800740 1 client.25433 shutdown 2024-09-16T01:02:24.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.978+0000 7fe5ca800740 1 -- 172.21.15.12:0/3270657338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a980 msgr2=0x559ba40a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.978+0000 7fe5ca800740 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a980 0x559ba40a9430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000b7e0 tx=0x7fe5b0026500 comp rx=0 tx=0).stop 2024-09-16T01:02:24.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.979+0000 7fe5ca800740 1 -- 172.21.15.12:0/3270657338 shutdown_connections 2024-09-16T01:02:24.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.979+0000 7fe5ca800740 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559ba41204f0 0x559ba4122910 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.979+0000 7fe5ca800740 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ba40a5240 0x559ba40a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.979+0000 7fe5ca800740 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559ba409a980 0x559ba40a9430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.979+0000 7fe5ca800740 1 --2- 172.21.15.12:0/3270657338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ba409a060 0x559ba40a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.979+0000 7fe5ca800740 1 -- 172.21.15.12:0/3270657338 >> 172.21.15.12:0/3270657338 conn(0x559ba40965f0 msgr2=0x559ba40a2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:24.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.979+0000 7fe5a9ffb640 0 client.25433 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:24.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.979+0000 7fe5ca800740 1 -- 172.21.15.12:0/3270657338 shutdown_connections 2024-09-16T01:02:24.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.979+0000 7fe5ca800740 1 -- 172.21.15.12:0/3270657338 wait complete. 2024-09-16T01:02:24.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.979+0000 7fe5ca800740 20 client.25433 trim_cache size 0 max 16384 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 29, 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24518, 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 4, 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "1ec91d52": { 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 4, 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:02:24.983 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 150.2, 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:02:24.984 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:02:24.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.980+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe5ac0a32c0 msgr2=0x7fe5ac0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.980+0000 7fe5c8427640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe5ac0a32c0 0x7fe5ac0a5780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009a60 tx=0x7fe5b8005d80 comp rx=0 tx=0).stop 2024-09-16T01:02:24.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.981+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5c0100e20 msgr2=0x7fe5c010e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.981+0000 7fe5c8427640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5c0100e20 0x7fe5c010e4d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00b4a0 tx=0x7fe5bc00b960 comp rx=0 tx=0).stop 2024-09-16T01:02:24.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.981+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 shutdown_connections 2024-09-16T01:02:24.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.981+0000 7fe5c8427640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe5ac0a32c0 0x7fe5ac0a5780 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.981+0000 7fe5c8427640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5c0102ef0 0x7fe5c010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.981+0000 7fe5c8427640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5c0102570 0x7fe5c010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.981+0000 7fe5c8427640 1 --2- 172.21.15.12:0/260293830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5c0100e20 0x7fe5c010e4d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.981+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 >> 172.21.15.12:0/260293830 conn(0x7fe5c00fc7d0 msgr2=0x7fe5c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:24.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.981+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 shutdown_connections 2024-09-16T01:02:24.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:24.981+0000 7fe5c8427640 1 -- 172.21.15.12:0/260293830 wait complete. 2024-09-16T01:02:25.001 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:25.683 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1ec91d52', total seconds elapsed: 35.0 2024-09-16T01:02:26.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:26 smithi119 ceph-mon[35049]: pgmap v400: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-16T01:02:26.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:26 smithi012 ceph-mon[31197]: pgmap v400: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-16T01:02:26.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:26 smithi098 ceph-mon[35346]: pgmap v400: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-16T01:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.450+0000 7f64111b2640 1 -- 172.21.15.12:0/2290282119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f640c101df0 msgr2=0x7f640c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.450+0000 7f64111b2640 1 --2- 172.21.15.12:0/2290282119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f640c101df0 0x7f640c1021d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009900 tx=0x7f63fc02a410 comp rx=0 tx=0).stop 2024-09-16T01:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.450+0000 7f64111b2640 1 -- 172.21.15.12:0/2290282119 shutdown_connections 2024-09-16T01:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.450+0000 7f64111b2640 1 --2- 172.21.15.12:0/2290282119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c106f20 0x7f640c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.450+0000 7f64111b2640 1 --2- 172.21.15.12:0/2290282119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f640c1027a0 0x7f640c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.450+0000 7f64111b2640 1 --2- 172.21.15.12:0/2290282119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f640c101df0 0x7f640c1021d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.450+0000 7f64111b2640 1 -- 172.21.15.12:0/2290282119 >> 172.21.15.12:0/2290282119 conn(0x7f640c0fd8f0 msgr2=0x7f640c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.450+0000 7f64111b2640 1 -- 172.21.15.12:0/2290282119 shutdown_connections 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.450+0000 7f64111b2640 1 -- 172.21.15.12:0/2290282119 wait complete. 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.451+0000 7f64111b2640 1 Processor -- start 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.451+0000 7f64111b2640 1 -- start start 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.451+0000 7f64111b2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c101df0 0x7f640c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.451+0000 7f64111b2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f640c1027a0 0x7f640c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.451+0000 7f64111b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f640c106f20 0x7f640c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.451+0000 7f64111b2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f640c111fa0 con 0x7f640c106f20 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.451+0000 7f64111b2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f640c111e20 con 0x7f640c101df0 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.451+0000 7f64111b2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f640c112120 con 0x7f640c1027a0 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640b59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f640c106f20 0x7f640c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640b59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f640c106f20 0x7f640c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39096/0 (socket says 172.21.15.12:39096) 2024-09-16T01:02:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640b59e640 1 -- 172.21.15.12:0/2432798092 learned_addr learned my addr 172.21.15.12:0/2432798092 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640a59c640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f640c1027a0 0x7f640c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640ad9d640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c101df0 0x7f640c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640b59e640 1 -- 172.21.15.12:0/2432798092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f640c1027a0 msgr2=0x7f640c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640b59e640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f640c1027a0 0x7f640c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640b59e640 1 -- 172.21.15.12:0/2432798092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c101df0 msgr2=0x7f640c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640b59e640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c101df0 0x7f640c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640b59e640 1 -- 172.21.15.12:0/2432798092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640c1a6960 con 0x7f640c106f20 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640a59c640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f640c1027a0 0x7f640c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640ad9d640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c101df0 0x7f640c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f640b59e640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f640c106f20 0x7f640c074f70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f640400cad0 tx=0x7f640400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f63f3fff640 1 -- 172.21.15.12:0/2432798092 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640400ae20 con 0x7f640c106f20 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f64111b2640 1 -- 172.21.15.12:0/2432798092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640c1a6c50 con 0x7f640c106f20 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f63f3fff640 1 -- 172.21.15.12:0/2432798092 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6404005020 con 0x7f640c106f20 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.452+0000 7f63f3fff640 1 -- 172.21.15.12:0/2432798092 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640400f6f0 con 0x7f640c106f20 2024-09-16T01:02:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.453+0000 7f64111b2640 1 -- 172.21.15.12:0/2432798092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640c1a7190 con 0x7f640c106f20 2024-09-16T01:02:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.454+0000 7f64111b2640 1 -- 172.21.15.12:0/2432798092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f640c1021d0 con 0x7f640c106f20 2024-09-16T01:02:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.455+0000 7f63f3fff640 1 -- 172.21.15.12:0/2432798092 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f64040051d0 con 0x7f640c106f20 2024-09-16T01:02:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.456+0000 7f63f3fff640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63f40a3240 0x7f63f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.456+0000 7f640ad9d640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63f40a3240 0x7f63f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.456+0000 7f63f3fff640 1 -- 172.21.15.12:0/2432798092 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f64040d0120 con 0x7f640c106f20 2024-09-16T01:02:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.457+0000 7f640ad9d640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63f40a3240 0x7f63f40a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f63fc005ab0 tx=0x7f63fc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.460+0000 7f63f3fff640 1 -- 172.21.15.12:0/2432798092 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6404014030 con 0x7f640c106f20 2024-09-16T01:02:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.674+0000 7f64111b2640 1 -- 172.21.15.12:0/2432798092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f640c10a100 con 0x7f640c106f20 2024-09-16T01:02:26.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.675+0000 7f63f3fff640 1 -- 172.21.15.12:0/2432798092 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f640409cae0 con 0x7f640c106f20 2024-09-16T01:02:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:02:26.676 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:02:26.677 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:02:26.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 -- 172.21.15.12:0/2432798092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63f40a3240 msgr2=0x7f63f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:26.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63f40a3240 0x7f63f40a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f63fc005ab0 tx=0x7f63fc005a20 comp rx=0 tx=0).stop 2024-09-16T01:02:26.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 -- 172.21.15.12:0/2432798092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f640c106f20 msgr2=0x7f640c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:26.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f640c106f20 0x7f640c074f70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f640400cad0 tx=0x7f640400cf90 comp rx=0 tx=0).stop 2024-09-16T01:02:26.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 -- 172.21.15.12:0/2432798092 shutdown_connections 2024-09-16T01:02:26.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f63f40a3240 0x7f63f40a5700 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f640c106f20 0x7f640c074f70 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f640c1027a0 0x7f640c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 --2- 172.21.15.12:0/2432798092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c101df0 0x7f640c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 -- 172.21.15.12:0/2432798092 >> 172.21.15.12:0/2432798092 conn(0x7f640c0fd8f0 msgr2=0x7f640c0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:26.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 -- 172.21.15.12:0/2432798092 shutdown_connections 2024-09-16T01:02:26.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:26.678+0000 7f64111b2640 1 -- 172.21.15.12:0/2432798092 wait complete. 2024-09-16T01:02:27.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:27 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2432798092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:27.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:27 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2432798092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:27.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:27 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2432798092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:27.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-16T01:02:27.857 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:28.054 INFO:tasks.workunit.client.0.smithi012.stderr:Updating files: 91% (11803/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-16T01:02:28.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:28 smithi012 ceph-mon[31197]: pgmap v401: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-16T01:02:28.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:28 smithi119 ceph-mon[35049]: pgmap v401: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-16T01:02:28.363 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:28 smithi098 ceph-mon[35346]: pgmap v401: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-16T01:02:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.385+0000 7f9bed1d1640 1 -- 172.21.15.12:0/4187992592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be8102570 msgr2=0x7f9be81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.385+0000 7f9bed1d1640 1 --2- 172.21.15.12:0/4187992592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be8102570 0x7f9be81029b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009900 tx=0x7f9bdc02a480 comp rx=0 tx=0).stop 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.385+0000 7f9bed1d1640 1 -- 172.21.15.12:0/4187992592 shutdown_connections 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.385+0000 7f9bed1d1640 1 --2- 172.21.15.12:0/4187992592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9be8102ef0 0x7f9be810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.385+0000 7f9bed1d1640 1 --2- 172.21.15.12:0/4187992592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be8102570 0x7f9be81029b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.385+0000 7f9bed1d1640 1 --2- 172.21.15.12:0/4187992592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100e20 0x7f9be8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.385+0000 7f9bed1d1640 1 -- 172.21.15.12:0/4187992592 >> 172.21.15.12:0/4187992592 conn(0x7f9be80fc7d0 msgr2=0x7f9be80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.385+0000 7f9bed1d1640 1 -- 172.21.15.12:0/4187992592 shutdown_connections 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.385+0000 7f9bed1d1640 1 -- 172.21.15.12:0/4187992592 wait complete. 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.386+0000 7f9bed1d1640 1 Processor -- start 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9bed1d1640 1 -- start start 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9bed1d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100e20 0x7f9be81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9bed1d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be8102570 0x7f9be8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9bed1d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9be8102ef0 0x7f9be819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9bed1d1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9be8110f80 con 0x7f9be8102570 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9bed1d1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9be8110e00 con 0x7f9be8100e20 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9bed1d1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9be8111100 con 0x7f9be8102ef0 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9be659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be8102570 0x7f9be8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9be659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be8102570 0x7f9be8198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39120/0 (socket says 172.21.15.12:39120) 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9be659c640 1 -- 172.21.15.12:0/3782381140 learned_addr learned my addr 172.21.15.12:0/3782381140 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100e20 0x7f9be81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9be759e640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9be8102ef0 0x7f9be819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9be659c640 1 -- 172.21.15.12:0/3782381140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9be8102ef0 msgr2=0x7f9be819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9be659c640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9be8102ef0 0x7f9be819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9be659c640 1 -- 172.21.15.12:0/3782381140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100e20 msgr2=0x7f9be81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.387+0000 7f9be659c640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100e20 0x7f9be81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.388+0000 7f9be659c640 1 -- 172.21.15.12:0/3782381140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be819d4a0 con 0x7f9be8102570 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.388+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100e20 0x7f9be81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.388+0000 7f9be659c640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be8102570 0x7f9be8198a30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc006010 tx=0x7f9bdc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.388+0000 7f9bcffff640 1 -- 172.21.15.12:0/3782381140 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc03f070 con 0x7f9be8102570 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.388+0000 7f9bcffff640 1 -- 172.21.15.12:0/3782381140 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bdc031c30 con 0x7f9be8102570 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.388+0000 7f9bed1d1640 1 -- 172.21.15.12:0/3782381140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be819d730 con 0x7f9be8102570 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.388+0000 7f9bcffff640 1 -- 172.21.15.12:0/3782381140 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc035030 con 0x7f9be8102570 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.388+0000 7f9bed1d1640 1 -- 172.21.15.12:0/3782381140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be81a5070 con 0x7f9be8102570 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9bef5aa740 1 Processor -- start 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9bef5aa740 1 -- start start 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae00e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae00ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae01d780 0x564eae01fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564eadf742f0 con 0x564eae00e5d0 2024-09-16T01:02:28.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564eadf1bcf0 con 0x564eae00fb40 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564eadf702b0 con 0x564eae01d780 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9bcffff640 1 -- 172.21.15.12:0/3782381140 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9bdc042070 con 0x7f9be8102570 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9be6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae00ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9be6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae00ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39130/0 (socket says 172.21.15.12:39130) 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.391+0000 7f9be6d9d640 1 -- 172.21.15.12:0/1062125921 learned_addr learned my addr 172.21.15.12:0/1062125921 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9be759e640 1 --2- 172.21.15.12:0/1062125921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae00e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9be6d9d640 1 -- 172.21.15.12:0/1062125921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae01d780 msgr2=0x564eae01fb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/1062125921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae01d780 0x564eae01fb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9be6d9d640 1 -- 172.21.15.12:0/1062125921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 msgr2=0x564eae00e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/1062125921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae00e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9be6d9d640 1 -- 172.21.15.12:0/1062125921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eadf003a0 con 0x564eae00e5d0 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/1062125921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae00ea10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80115f0 tx=0x7f9bd8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42956251b0b91de server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9bcd7fa640 1 -- 172.21.15.12:0/1062125921 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd801e070 con 0x564eae00e5d0 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9bcd7fa640 1 -- 172.21.15.12:0/1062125921 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bd800fb20 con 0x564eae00e5d0 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9bcd7fa640 1 -- 172.21.15.12:0/1062125921 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8019c40 con 0x564eae00e5d0 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9bcffff640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9bd00a3240 0x7f9bd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.392+0000 7f9be759e640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9bd00a3240 0x7f9bd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9bcffff640 1 -- 172.21.15.12:0/3782381140 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f9bdc0f02d0 con 0x7f9be8102570 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9bef5aa740 1 -- 172.21.15.12:0/1062125921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 msgr2=0x564eae00ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9be759e640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9bd00a3240 0x7f9bd00a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9be0005fd0 tx=0x7f9be0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/1062125921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae00ea10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80115f0 tx=0x7f9bd8011ab0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9bef5aa740 1 -- 172.21.15.12:0/1062125921 shutdown_connections 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/1062125921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae01d780 0x564eae01fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/1062125921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae00ea10 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/1062125921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae00e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9bef5aa740 1 -- 172.21.15.12:0/1062125921 >> 172.21.15.12:0/1062125921 conn(0x564eadfd7310 msgr2=0x564eae00ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9bef5aa740 1 -- 172.21.15.12:0/1062125921 shutdown_connections 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.393+0000 7f9bef5aa740 1 -- 172.21.15.12:0/1062125921 wait complete. 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9bef5aa740 1 -- start start 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9bef5aa740 1 Processor -- start 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae00e5d0 0x564eae01d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae01a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 0x564eae01ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564eae020480 con 0x564eae01d780 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564eadf2f060 con 0x564eae00fb40 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564eae020600 con 0x564eae00e5d0 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9bef5aa740 10 client.0 _ll_register_callbacks cb 0x564eadc828c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9be759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 0x564eae01ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9be759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 0x564eae01ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39146/0 (socket says 172.21.15.12:39146) 2024-09-16T01:02:28.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9be759e640 1 -- 172.21.15.12:0/987121261 learned_addr learned my addr 172.21.15.12:0/987121261 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9be659c640 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae01a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.394+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae00e5d0 0x564eae01d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9be759e640 1 -- 172.21.15.12:0/987121261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae00e5d0 msgr2=0x564eae01d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9be759e640 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae00e5d0 0x564eae01d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9be759e640 1 -- 172.21.15.12:0/987121261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 msgr2=0x564eae01a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9be759e640 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae01a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9be759e640 1 -- 172.21.15.12:0/987121261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eadce53c0 con 0x564eae01d780 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae00e5d0 0x564eae01d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9be759e640 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 0x564eae01ac00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9be0003fc0 tx=0x7f9be0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0232468c5da06e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9bcaff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9bcaff5640 1 -- 172.21.15.12:0/987121261 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be000f970 con 0x564eae01d780 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9bcaff5640 1 -- 172.21.15.12:0/987121261 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f9be000fb10 con 0x564eae01d780 2024-09-16T01:02:28.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9bef5aa740 1 -- 172.21.15.12:0/987121261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bd800fb20 con 0x564eae01d780 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9bcaff5640 1 -- 172.21.15.12:0/987121261 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9be000fd10 con 0x564eae01d780 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9bef5aa740 10 client.15861 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9bef5aa740 1 -- 172.21.15.12:0/987121261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564eae02bfd0 con 0x564eae01d780 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.395+0000 7f9bcaff5640 1 -- 172.21.15.12:0/987121261 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bd800fb20 con 0x564eae01d780 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.396+0000 7f9bcaff5640 1 -- 172.21.15.12:0/987121261 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9be0027070 con 0x564eae01d780 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.396+0000 7f9bef5aa740 10 client.15861 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.396+0000 7f9bef5aa740 10 client.15861 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.396+0000 7f9bef5aa740 20 client.15861 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.396+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x564eae02d490 0x564eae02f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.396+0000 7f9bef5aa740 4 client.15861 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.396+0000 7f9bef5aa740 1 -- 172.21.15.12:0/987121261 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564eadf81860 con 0x564eae02d490 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.396+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x564eae02d490 0x564eae02f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.396+0000 7f9bcaff5640 10 client.15861 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:02:28.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.396+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x564eae02d490 0x564eae02f8c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6b4737c6f422aacf server_cookie=ed376a27ed5c355 in_seq=0 out_seq=0 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bcaff5640 1 -- 172.21.15.12:0/987121261 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564eadf81860 con 0x564eae02d490 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bcaff5640 10 client.15861 handle_command_reply: tid=0 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 client.15861 shutdown 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 -- 172.21.15.12:0/987121261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 msgr2=0x564eae01ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 0x564eae01ac00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9be0003fc0 tx=0x7f9be0004a40 comp rx=0 tx=0).stop 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 -- 172.21.15.12:0/987121261 shutdown_connections 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x564eae02d490 0x564eae02f8c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 0x564eae01ac00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae01a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/987121261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae00e5d0 0x564eae01d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 -- 172.21.15.12:0/987121261 >> 172.21.15.12:0/987121261 conn(0x564eadfd7310 msgr2=0x564eae010930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:28.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bcaff5640 0 client.15861 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:02:28.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 -- 172.21.15.12:0/987121261 shutdown_connections 2024-09-16T01:02:28.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 1 -- 172.21.15.12:0/987121261 wait complete. 2024-09-16T01:02:28.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.397+0000 7f9bef5aa740 20 client.15861 trim_cache size 0 max 16384 2024-09-16T01:02:28.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.423+0000 7f9bef5aa740 1 Processor -- start 2024-09-16T01:02:28.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.423+0000 7f9bef5aa740 1 -- start start 2024-09-16T01:02:28.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.423+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae019d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.423+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae01c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.423+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae01d780 0x564eae035160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.423+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9be81aca00 con 0x564eae00e5d0 2024-09-16T01:02:28.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.423+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9be81ae540 con 0x564eae00fb40 2024-09-16T01:02:28.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.423+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9be81ad0d0 con 0x564eae01d780 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae019d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae01c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae019d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39152/0 (socket says 172.21.15.12:39152) 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be6d9d640 1 -- 172.21.15.12:0/1948668043 learned_addr learned my addr 172.21.15.12:0/1948668043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be759e640 1 --2- 172.21.15.12:0/1948668043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae01d780 0x564eae035160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be659c640 1 -- 172.21.15.12:0/1948668043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae01d780 msgr2=0x564eae035160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be659c640 1 --2- 172.21.15.12:0/1948668043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae01d780 0x564eae035160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be659c640 1 -- 172.21.15.12:0/1948668043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 msgr2=0x564eae019d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be659c640 1 --2- 172.21.15.12:0/1948668043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae019d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be659c640 1 -- 172.21.15.12:0/1948668043 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eae0189c0 con 0x564eae00fb40 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.424+0000 7f9be659c640 1 --2- 172.21.15.12:0/1948668043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae01c3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x564eae00f070 tx=0x7f9bdc0058b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbda4bb821dc6cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.425+0000 7f9bccff9640 1 -- 172.21.15.12:0/1948668043 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0d5070 con 0x564eae00fb40 2024-09-16T01:02:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.425+0000 7f9bccff9640 1 -- 172.21.15.12:0/1948668043 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bdc031de0 con 0x564eae00fb40 2024-09-16T01:02:28.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.425+0000 7f9bccff9640 1 -- 172.21.15.12:0/1948668043 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc049050 con 0x564eae00fb40 2024-09-16T01:02:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.425+0000 7f9bef5aa740 1 -- 172.21.15.12:0/1948668043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 msgr2=0x564eae01c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.425+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/1948668043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae01c3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x564eae00f070 tx=0x7f9bdc0058b0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.425+0000 7f9bef5aa740 1 -- 172.21.15.12:0/1948668043 shutdown_connections 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.425+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/1948668043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae01d780 0x564eae035160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.425+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/1948668043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00fb40 0x564eae01c3e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.425+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/1948668043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae00e5d0 0x564eae019d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.425+0000 7f9bef5aa740 1 -- 172.21.15.12:0/1948668043 >> 172.21.15.12:0/1948668043 conn(0x564eadfd7310 msgr2=0x564eae01bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.426+0000 7f9bef5aa740 1 -- 172.21.15.12:0/1948668043 shutdown_connections 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.426+0000 7f9bef5aa740 1 -- 172.21.15.12:0/1948668043 wait complete. 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.426+0000 7f9bef5aa740 1 -- start start 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.426+0000 7f9bef5aa740 1 Processor -- start 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.426+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00e5d0 0x564eae025be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.426+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae00fb40 0x564eae026120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.426+0000 7f9bef5aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 0x564eae011ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.426+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9be81ade70 con 0x564eae01d780 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.426+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9be81ad7a0 con 0x564eae00e5d0 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.426+0000 7f9be6d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00e5d0 0x564eae025be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9be6d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00e5d0 0x564eae025be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:46550/0 (socket says 172.21.15.12:46550) 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9bef5aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9be81aa9e0 con 0x564eae00fb40 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9be6d9d640 1 -- 172.21.15.12:0/4136325472 learned_addr learned my addr 172.21.15.12:0/4136325472 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9bef5aa740 10 client.0 _ll_register_callbacks cb 0x7f9be0009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9be759e640 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 0x564eae011ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9be6d9d640 1 -- 172.21.15.12:0/4136325472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae00fb40 msgr2=0x564eae026120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae00fb40 0x564eae026120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9be6d9d640 1 -- 172.21.15.12:0/4136325472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 msgr2=0x564eae011ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 0x564eae011ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9be6d9d640 1 -- 172.21.15.12:0/4136325472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eae0126f0 con 0x564eae00e5d0 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9be6d9d640 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00e5d0 0x564eae025be0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80058c0 tx=0x7f9bd8005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5505c28606362a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9bcaff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.427+0000 7f9bcaff5640 1 -- 172.21.15.12:0/4136325472 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd801e040 con 0x564eae00e5d0 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bcaff5640 1 -- 172.21.15.12:0/4136325472 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f9bd8019410 con 0x564eae00e5d0 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bef5aa740 1 -- 172.21.15.12:0/4136325472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bdc031de0 con 0x564eae00e5d0 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bcaff5640 1 -- 172.21.15.12:0/4136325472 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9bd800f640 con 0x564eae00e5d0 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bef5aa740 10 client.25454 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bef5aa740 1 -- 172.21.15.12:0/4136325472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564eae023460 con 0x564eae00e5d0 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bcaff5640 1 -- 172.21.15.12:0/4136325472 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bdc031de0 con 0x564eae00e5d0 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bcaff5640 1 -- 172.21.15.12:0/4136325472 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9bd8005040 con 0x564eae00e5d0 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bef5aa740 10 client.25454 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bef5aa740 10 client.25454 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bef5aa740 20 client.25454 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x564eae09ca30 0x564eae09ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bef5aa740 4 client.25454 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9bef5aa740 1 -- 172.21.15.12:0/4136325472 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564eadf7bd70 con 0x564eae09ca30 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.428+0000 7f9be659c640 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x564eae09ca30 0x564eae09ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9bcaff5640 10 client.25454 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9be659c640 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x564eae09ca30 0x564eae09ee20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=55106d607eb95d3f server_cookie=fa49dcf9a571a123 in_seq=0 out_seq=0 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9bcaff5640 1 -- 172.21.15.12:0/4136325472 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564eadf7bd70 con 0x564eae09ca30 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9bcaff5640 10 client.25454 handle_command_reply: tid=0 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9bef5aa740 1 client.25454 shutdown 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9bef5aa740 1 -- 172.21.15.12:0/4136325472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00e5d0 msgr2=0x564eae025be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00e5d0 0x564eae025be0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80058c0 tx=0x7f9bd8005d30 comp rx=0 tx=0).stop 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9bef5aa740 1 -- 172.21.15.12:0/4136325472 shutdown_connections 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x564eae09ca30 0x564eae09ee20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564eae01d780 0x564eae011ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.429+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564eae00fb40 0x564eae026120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.430+0000 7f9bef5aa740 1 --2- 172.21.15.12:0/4136325472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564eae00e5d0 0x564eae025be0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.430+0000 7f9bef5aa740 1 -- 172.21.15.12:0/4136325472 >> 172.21.15.12:0/4136325472 conn(0x564eadfd7310 msgr2=0x564eae01bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.430+0000 7f9bcaff5640 0 client.25454 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:02:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.430+0000 7f9bef5aa740 1 -- 172.21.15.12:0/4136325472 shutdown_connections 2024-09-16T01:02:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.430+0000 7f9bef5aa740 1 -- 172.21.15.12:0/4136325472 wait complete. 2024-09-16T01:02:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.430+0000 7f9bef5aa740 20 client.25454 trim_cache size 0 max 16384 2024-09-16T01:02:28.435 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.430+0000 7f9bed1d1640 1 -- 172.21.15.12:0/3782381140 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9bd00a3240 msgr2=0x7f9bd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.430+0000 7f9bed1d1640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9bd00a3240 0x7f9bd00a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9be0005fd0 tx=0x7f9be0009500 comp rx=0 tx=0).stop 2024-09-16T01:02:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.430+0000 7f9bed1d1640 1 -- 172.21.15.12:0/3782381140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be8102570 msgr2=0x7f9be8198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.431+0000 7f9bed1d1640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be8102570 0x7f9be8198a30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc006010 tx=0x7f9bdc003c10 comp rx=0 tx=0).stop 2024-09-16T01:02:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.431+0000 7f9bed1d1640 1 -- 172.21.15.12:0/3782381140 shutdown_connections 2024-09-16T01:02:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.431+0000 7f9bed1d1640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f9bd00a3240 0x7f9bd00a5700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.431+0000 7f9bed1d1640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9be8102ef0 0x7f9be819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.431+0000 7f9bed1d1640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be8102570 0x7f9be8198a30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.431+0000 7f9bed1d1640 1 --2- 172.21.15.12:0/3782381140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100e20 0x7f9be81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.431+0000 7f9bed1d1640 1 -- 172.21.15.12:0/3782381140 >> 172.21.15.12:0/3782381140 conn(0x7f9be80fc7d0 msgr2=0x7f9be8103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.431+0000 7f9bed1d1640 1 -- 172.21.15.12:0/3782381140 shutdown_connections 2024-09-16T01:02:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:28.431+0000 7f9bed1d1640 1 -- 172.21.15.12:0/3782381140 wait complete. 2024-09-16T01:02:28.490 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-16T01:02:28.490 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-16T01:02:28.490 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T01:02:28.490 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T01:02:28.490 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T01:02:28.490 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-16T01:02:28.490 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T01:02:28.490 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T01:02:28.491 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-16T01:02:28.491 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2024-09-16T01:02:28.491 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-16T01:02:28.491 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2024-09-16T01:02:28.491 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-16T01:02:28.491 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2024-09-16T01:02:28.491 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-16T01:02:28.491 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T01:02:28.491 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-16T01:02:28.491 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-16T01:02:28.499 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T01:02:28.579 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T01:02:28.581 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T01:02:28.581 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T01:02:29.383 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-16T01:02:29.645 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:29.963 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T01:02:30.054 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T01:02:30.096 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T01:02:30.098 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T01:02:30.098 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T01:02:30.141 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T01:02:30.144 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T01:02:30.144 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T01:02:30.161 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-16T01:02:30.163 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-16T01:02:30.163 DEBUG:teuthology.orchestra.run.smithi012:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-16T01:02:30.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.167+0000 7fcd1f841640 1 -- 172.21.15.12:0/470516009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd18106f10 msgr2=0x7fcd1810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:30.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.167+0000 7fcd1f841640 1 --2- 172.21.15.12:0/470516009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd18106f10 0x7fcd1810ea90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009ca0 tx=0x7fcd1002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.167+0000 7fcd1f841640 1 -- 172.21.15.12:0/470516009 shutdown_connections 2024-09-16T01:02:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.167+0000 7fcd1f841640 1 --2- 172.21.15.12:0/470516009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd18106f10 0x7fcd1810ea90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.167+0000 7fcd1f841640 1 --2- 172.21.15.12:0/470516009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd18102790 0x7fcd181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.167+0000 7fcd1f841640 1 --2- 172.21.15.12:0/470516009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18101de0 0x7fcd181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.167+0000 7fcd1f841640 1 -- 172.21.15.12:0/470516009 >> 172.21.15.12:0/470516009 conn(0x7fcd180fd8c0 msgr2=0x7fcd180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.167+0000 7fcd1f841640 1 -- 172.21.15.12:0/470516009 shutdown_connections 2024-09-16T01:02:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.167+0000 7fcd1f841640 1 -- 172.21.15.12:0/470516009 wait complete. 2024-09-16T01:02:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.168+0000 7fcd1f841640 1 Processor -- start 2024-09-16T01:02:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.168+0000 7fcd1f841640 1 -- start start 2024-09-16T01:02:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.168+0000 7fcd1f841640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18101de0 0x7fcd180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.168+0000 7fcd1f841640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd18102790 0x7fcd18074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.168+0000 7fcd1f841640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd18106f10 0x7fcd18074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.168+0000 7fcd1f841640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcd18111f70 con 0x7fcd18106f10 2024-09-16T01:02:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.168+0000 7fcd1f841640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcd18111df0 con 0x7fcd18101de0 2024-09-16T01:02:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.168+0000 7fcd1f841640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181120f0 con 0x7fcd18102790 2024-09-16T01:02:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.168+0000 7fcd1ddde640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd18106f10 0x7fcd18074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1ddde640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd18106f10 0x7fcd18074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39186/0 (socket says 172.21.15.12:39186) 2024-09-16T01:02:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1ddde640 1 -- 172.21.15.12:0/3914349085 learned_addr learned my addr 172.21.15.12:0/3914349085 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18101de0 0x7fcd180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd18102790 0x7fcd18074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1ddde640 1 -- 172.21.15.12:0/3914349085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd18102790 msgr2=0x7fcd18074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1ddde640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd18102790 0x7fcd18074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1ddde640 1 -- 172.21.15.12:0/3914349085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18101de0 msgr2=0x7fcd180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1ddde640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18101de0 0x7fcd180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1ddde640 1 -- 172.21.15.12:0/3914349085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd181a67f0 con 0x7fcd18106f10 2024-09-16T01:02:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1ddde640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd18106f10 0x7fcd18074f70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcd10031a60 tx=0x7fcd10031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:30.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd0e7fc640 1 -- 172.21.15.12:0/3914349085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10003b70 con 0x7fcd18106f10 2024-09-16T01:02:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd0e7fc640 1 -- 172.21.15.12:0/3914349085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd10003d10 con 0x7fcd18106f10 2024-09-16T01:02:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1f841640 1 -- 172.21.15.12:0/3914349085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd181a6a80 con 0x7fcd18106f10 2024-09-16T01:02:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd0e7fc640 1 -- 172.21.15.12:0/3914349085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10004770 con 0x7fcd18106f10 2024-09-16T01:02:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.169+0000 7fcd1f841640 1 -- 172.21.15.12:0/3914349085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd181a6fc0 con 0x7fcd18106f10 2024-09-16T01:02:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.172+0000 7fcd0e7fc640 1 -- 172.21.15.12:0/3914349085 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcd1002f790 con 0x7fcd18106f10 2024-09-16T01:02:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.172+0000 7fcd21c1a740 1 Processor -- start 2024-09-16T01:02:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.172+0000 7fcd21c1a740 1 -- start start 2024-09-16T01:02:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.172+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95fb40 0x55817a95e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.172+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a95ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.172+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a96b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.172+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55817a8c42f0 con 0x55817a95e5d0 2024-09-16T01:02:30.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.172+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55817a86bcf0 con 0x55817a969370 2024-09-16T01:02:30.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.172+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55817a8c02b0 con 0x55817a95fb40 2024-09-16T01:02:30.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1d5dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a95ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1d5dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a95ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39190/0 (socket says 172.21.15.12:39190) 2024-09-16T01:02:30.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/1324909177 learned_addr learned my addr 172.21.15.12:0/1324909177 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:30.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd0e7fc640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcd040a3240 0x7fcd040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/1324909177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95fb40 0x55817a95e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/1324909177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a96b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1ddde640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcd040a3240 0x7fcd040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/1324909177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95fb40 msgr2=0x55817a95e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:30.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/1324909177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95fb40 0x55817a95e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/1324909177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 msgr2=0x55817a96b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:30.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/1324909177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a96b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/1324909177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55817a8503a0 con 0x55817a95e5d0 2024-09-16T01:02:30.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/1324909177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a96b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:30.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd0e7fc640 1 -- 172.21.15.12:0/3914349085 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fcd100f0f30 con 0x7fcd18106f10 2024-09-16T01:02:30.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/1324909177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a95ea10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400ad00 tx=0x7fcd1400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c46eb0cd6c9f431 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:30.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd037fe640 1 -- 172.21.15.12:0/1324909177 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1401d070 con 0x55817a95e5d0 2024-09-16T01:02:30.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd1ddde640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcd040a3240 0x7fcd040a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcd100b9ce0 tx=0x7fcd10087dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:30.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd037fe640 1 -- 172.21.15.12:0/1324909177 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd14018b20 con 0x55817a95e5d0 2024-09-16T01:02:30.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.173+0000 7fcd037fe640 1 -- 172.21.15.12:0/1324909177 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14010c20 con 0x55817a95e5d0 2024-09-16T01:02:30.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.174+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1324909177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 msgr2=0x55817a95ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:30.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.174+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/1324909177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a95ea10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400ad00 tx=0x7fcd1400f790 comp rx=0 tx=0).stop 2024-09-16T01:02:30.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.174+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1324909177 shutdown_connections 2024-09-16T01:02:30.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.174+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/1324909177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a96b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.174+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/1324909177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a95ea10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.174+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/1324909177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95fb40 0x55817a95e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.174+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1324909177 >> 172.21.15.12:0/1324909177 conn(0x55817a927310 msgr2=0x55817a95ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.174+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1324909177 shutdown_connections 2024-09-16T01:02:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.174+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1324909177 wait complete. 2024-09-16T01:02:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.174+0000 7fcd21c1a740 1 -- start start 2024-09-16T01:02:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd21c1a740 1 Processor -- start 2024-09-16T01:02:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95e5d0 0x55817a968da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a966050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a9667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55817a96c070 con 0x55817a95fb40 2024-09-16T01:02:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55817a87f060 con 0x55817a969370 2024-09-16T01:02:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55817a96c1f0 con 0x55817a95e5d0 2024-09-16T01:02:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd21c1a740 10 client.0 _ll_register_callbacks cb 0x55817a5d28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1d5dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a966050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1d5dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a966050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39198/0 (socket says 172.21.15.12:39198) 2024-09-16T01:02:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/546712333 learned_addr learned my addr 172.21.15.12:0/546712333 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95e5d0 0x55817a968da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a9667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/546712333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95e5d0 msgr2=0x55817a968da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95e5d0 0x55817a968da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/546712333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 msgr2=0x55817a9667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a9667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/546712333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55817a6353c0 con 0x55817a95fb40 2024-09-16T01:02:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.175+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a9667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:30.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a966050 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcd14010520 tx=0x7fcd14010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9df69b9ade8fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:30.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:30.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd00ff9640 1 -- 172.21.15.12:0/546712333 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1401d040 con 0x55817a95fb40 2024-09-16T01:02:30.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd00ff9640 1 -- 172.21.15.12:0/546712333 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fcd14018440 con 0x55817a95fb40 2024-09-16T01:02:30.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd21c1a740 1 -- 172.21.15.12:0/546712333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd14018b20 con 0x55817a95fb40 2024-09-16T01:02:30.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd00ff9640 1 -- 172.21.15.12:0/546712333 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd14031050 con 0x55817a95fb40 2024-09-16T01:02:30.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd21c1a740 10 client.15879 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd21c1a740 1 -- 172.21.15.12:0/546712333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55817a977b80 con 0x55817a95fb40 2024-09-16T01:02:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd00ff9640 1 -- 172.21.15.12:0/546712333 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd14018b20 con 0x55817a95fb40 2024-09-16T01:02:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd00ff9640 1 -- 172.21.15.12:0/546712333 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcd14020030 con 0x55817a95fb40 2024-09-16T01:02:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd21c1a740 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd21c1a740 10 client.15879 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-16T01:02:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd21c1a740 20 client.15879 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:30.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55817a978f80 0x55817a97b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd21c1a740 4 client.15879 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:30.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.176+0000 7fcd21c1a740 1 -- 172.21.15.12:0/546712333 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55817a8d1860 con 0x55817a978f80 2024-09-16T01:02:30.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.177+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55817a978f80 0x55817a97b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.177+0000 7fcd00ff9640 10 client.15879 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:02:30.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.177+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55817a978f80 0x55817a97b370 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c58d5af07068b626 server_cookie=70315e55318c7ee5 in_seq=0 out_seq=0 2024-09-16T01:02:30.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd00ff9640 1 -- 172.21.15.12:0/546712333 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55817a8d1860 con 0x55817a978f80 2024-09-16T01:02:30.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd00ff9640 10 client.15879 handle_command_reply: tid=0 2024-09-16T01:02:30.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 client.15879 shutdown 2024-09-16T01:02:30.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 -- 172.21.15.12:0/546712333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 msgr2=0x55817a966050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:30.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a966050 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcd14010520 tx=0x7fcd14010b50 comp rx=0 tx=0).stop 2024-09-16T01:02:30.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 -- 172.21.15.12:0/546712333 shutdown_connections 2024-09-16T01:02:30.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55817a978f80 0x55817a97b370 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a9667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a966050 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/546712333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95e5d0 0x55817a968da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 -- 172.21.15.12:0/546712333 >> 172.21.15.12:0/546712333 conn(0x55817a927310 msgr2=0x55817a960930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd00ff9640 0 client.15879 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:02:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 -- 172.21.15.12:0/546712333 shutdown_connections 2024-09-16T01:02:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 1 -- 172.21.15.12:0/546712333 wait complete. 2024-09-16T01:02:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.178+0000 7fcd21c1a740 20 client.15879 trim_cache size 0 max 16384 2024-09-16T01:02:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.191+0000 7fcd21c1a740 1 Processor -- start 2024-09-16T01:02:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.191+0000 7fcd21c1a740 1 -- start start 2024-09-16T01:02:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a967fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95fb40 0x55817a961120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a961660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181b0d40 con 0x55817a95e5d0 2024-09-16T01:02:30.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181b2880 con 0x55817a969370 2024-09-16T01:02:30.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181b1410 con 0x55817a95fb40 2024-09-16T01:02:30.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd1cddc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a967fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd1cddc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a967fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39208/0 (socket says 172.21.15.12:39208) 2024-09-16T01:02:30.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd1cddc640 1 -- 172.21.15.12:0/3978923403 learned_addr learned my addr 172.21.15.12:0/3978923403 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:30.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd1cddc640 1 -- 172.21.15.12:0/3978923403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95fb40 msgr2=0x55817a961120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:30.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/3978923403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95fb40 0x55817a961120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/3978923403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95fb40 0x55817a961120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd1cddc640 1 -- 172.21.15.12:0/3978923403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 msgr2=0x55817a961660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:30.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/3978923403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a961660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd1cddc640 1 -- 172.21.15.12:0/3978923403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55817a95b960 con 0x55817a95e5d0 2024-09-16T01:02:30.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/3978923403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a967fc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800b010 tx=0x7fcd0800a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72ad87d1f2df854 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:30.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.192+0000 7fcd02ffd640 1 -- 172.21.15.12:0/3978923403 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08005220 con 0x55817a95e5d0 2024-09-16T01:02:30.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd02ffd640 1 -- 172.21.15.12:0/3978923403 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd08004c80 con 0x55817a95e5d0 2024-09-16T01:02:30.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd02ffd640 1 -- 172.21.15.12:0/3978923403 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0801d930 con 0x55817a95e5d0 2024-09-16T01:02:30.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd21c1a740 1 -- 172.21.15.12:0/3978923403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 msgr2=0x55817a967fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:30.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/3978923403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a967fc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800b010 tx=0x7fcd0800a5e0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd21c1a740 1 -- 172.21.15.12:0/3978923403 shutdown_connections 2024-09-16T01:02:30.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/3978923403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a969370 0x55817a961660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/3978923403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a95fb40 0x55817a961120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/3978923403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95e5d0 0x55817a967fc0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd21c1a740 1 -- 172.21.15.12:0/3978923403 >> 172.21.15.12:0/3978923403 conn(0x55817a927310 msgr2=0x55817a9678b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:30.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd21c1a740 1 -- 172.21.15.12:0/3978923403 shutdown_connections 2024-09-16T01:02:30.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd21c1a740 1 -- 172.21.15.12:0/3978923403 wait complete. 2024-09-16T01:02:30.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.193+0000 7fcd21c1a740 1 -- start start 2024-09-16T01:02:30.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd21c1a740 1 Processor -- start 2024-09-16T01:02:30.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a95e5d0 0x55817a9714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a9719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd21c1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a969370 0x55817a9626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181b21b0 con 0x55817a95fb40 2024-09-16T01:02:30.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181b1ae0 con 0x55817a95e5d0 2024-09-16T01:02:30.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd21c1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181aed20 con 0x55817a969370 2024-09-16T01:02:30.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd21c1a740 10 client.0 _ll_register_callbacks cb 0x7fcd1401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:30.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd1d5dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a9719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd1d5dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a9719f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39220/0 (socket says 172.21.15.12:39220) 2024-09-16T01:02:30.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/1487423546 learned_addr learned my addr 172.21.15.12:0/1487423546 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:30.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a969370 0x55817a9626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.194+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a95e5d0 0x55817a9714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/1487423546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a969370 msgr2=0x55817a9626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:30.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a969370 0x55817a9626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/1487423546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a95e5d0 msgr2=0x55817a9714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:30.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a95e5d0 0x55817a9714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd1d5dd640 1 -- 172.21.15.12:0/1487423546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55817a962c30 con 0x55817a95fb40 2024-09-16T01:02:30.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a95e5d0 0x55817a9714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:30.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd1d5dd640 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a9719f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcd14000c00 tx=0x7fcd140105e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38226337d2e2ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:30.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:30.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd00ff9640 1 -- 172.21.15.12:0/1487423546 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14039020 con 0x55817a95fb40 2024-09-16T01:02:30.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd00ff9640 1 -- 172.21.15.12:0/1487423546 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fcd14004750 con 0x55817a95fb40 2024-09-16T01:02:30.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1487423546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd08004c80 con 0x55817a95fb40 2024-09-16T01:02:30.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd00ff9640 1 -- 172.21.15.12:0/1487423546 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd1401d040 con 0x55817a95fb40 2024-09-16T01:02:30.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd21c1a740 10 client.15885 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:30.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1487423546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55817a9e3200 con 0x55817a95fb40 2024-09-16T01:02:30.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd00ff9640 1 -- 172.21.15.12:0/1487423546 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd08004c80 con 0x55817a95fb40 2024-09-16T01:02:30.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.195+0000 7fcd00ff9640 1 -- 172.21.15.12:0/1487423546 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcd14020070 con 0x55817a95fb40 2024-09-16T01:02:30.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd21c1a740 10 client.15885 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:30.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd21c1a740 10 client.15885 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-16T01:02:30.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd21c1a740 20 client.15885 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:30.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55817a9e38b0 0x55817a9e5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:30.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd21c1a740 4 client.15885 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:30.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1487423546 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55817a8cbd70 con 0x55817a9e38b0 2024-09-16T01:02:30.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55817a9e38b0 0x55817a9e5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:30.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd00ff9640 10 client.15885 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:02:30.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd1cddc640 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55817a9e38b0 0x55817a9e5cd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cdaab27dccb175e0 server_cookie=da8e46fc7b772b29 in_seq=0 out_seq=0 2024-09-16T01:02:30.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd00ff9640 1 -- 172.21.15.12:0/1487423546 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55817a8cbd70 con 0x55817a9e38b0 2024-09-16T01:02:30.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd00ff9640 10 client.15885 handle_command_reply: tid=0 2024-09-16T01:02:30.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.196+0000 7fcd21c1a740 1 client.15885 shutdown 2024-09-16T01:02:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1487423546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 msgr2=0x55817a9719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a9719f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcd14000c00 tx=0x7fcd140105e0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1487423546 shutdown_connections 2024-09-16T01:02:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x55817a9e38b0 0x55817a9e5cd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55817a969370 0x55817a9626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55817a95fb40 0x55817a9719f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 1 --2- 172.21.15.12:0/1487423546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55817a95e5d0 0x55817a9714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1487423546 >> 172.21.15.12:0/1487423546 conn(0x55817a927310 msgr2=0x55817a965050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:30.690 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd00ff9640 0 client.15885 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:02:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1487423546 shutdown_connections 2024-09-16T01:02:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 1 -- 172.21.15.12:0/1487423546 wait complete. 2024-09-16T01:02:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd21c1a740 20 client.15885 trim_cache size 0 max 16384 2024-09-16T01:02:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd1f841640 1 -- 172.21.15.12:0/3914349085 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcd040a3240 msgr2=0x7fcd040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd1f841640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcd040a3240 0x7fcd040a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcd100b9ce0 tx=0x7fcd10087dc0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd1f841640 1 -- 172.21.15.12:0/3914349085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd18106f10 msgr2=0x7fcd18074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd1f841640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd18106f10 0x7fcd18074f70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcd10031a60 tx=0x7fcd10031a90 comp rx=0 tx=0).stop 2024-09-16T01:02:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd1f841640 1 -- 172.21.15.12:0/3914349085 shutdown_connections 2024-09-16T01:02:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd1f841640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fcd040a3240 0x7fcd040a5700 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd1f841640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd18106f10 0x7fcd18074f70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd1f841640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd18102790 0x7fcd18074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd1f841640 1 --2- 172.21.15.12:0/3914349085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18101de0 0x7fcd180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.197+0000 7fcd1f841640 1 -- 172.21.15.12:0/3914349085 >> 172.21.15.12:0/3914349085 conn(0x7fcd180fd8c0 msgr2=0x7fcd180febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.198+0000 7fcd1f841640 1 -- 172.21.15.12:0/3914349085 shutdown_connections 2024-09-16T01:02:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:30.198+0000 7fcd1f841640 1 -- 172.21.15.12:0/3914349085 wait complete. 2024-09-16T01:02:30.694 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:30 smithi098 ceph-mon[35346]: pgmap v402: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-16T01:02:30.694 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:30 smithi119 ceph-mon[35049]: pgmap v402: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-16T01:02:30.695 INFO:tasks.workunit.client.0.smithi012.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-16T01:02:30.695 INFO:tasks.workunit.client.0.smithi012.stderr:--2024-09-16 01:02:30-- http://download.ceph.com/qa/fsync-tester.c 2024-09-16T01:02:30.696 INFO:tasks.workunit.client.0.smithi012.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-16T01:02:30.696 INFO:tasks.workunit.client.0.smithi012.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-16T01:02:30.696 INFO:tasks.workunit.client.0.smithi012.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-16T01:02:30.696 INFO:tasks.workunit.client.0.smithi012.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-16T01:02:30.696 INFO:tasks.workunit.client.0.smithi012.stderr:Saving to: ‘fsync-tester.c’ 2024-09-16T01:02:30.696 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-16T01:02:30.696 INFO:tasks.workunit.client.0.smithi012.stderr: 0K .. 100% 606M=0s 2024-09-16T01:02:30.696 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-16T01:02:30.696 INFO:tasks.workunit.client.0.smithi012.stderr:2024-09-16 01:02:30 (606 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-16T01:02:30.697 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-16T01:02:30.697 INFO:tasks.workunit.client.0.smithi012.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-16T01:02:30.697 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:30 smithi012 ceph-mon[31197]: pgmap v402: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-16T01:02:30.697 INFO:tasks.workunit.client.0.smithi012.stderr:+ ./fsync-tester 2024-09-16T01:02:31.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-16T01:02:31.352 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 -- 172.21.15.12:0/1100795946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4358102da0 msgr2=0x7f4358103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 --2- 172.21.15.12:0/1100795946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4358102da0 0x7f4358103180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4348009900 tx=0x7f434802a480 comp rx=0 tx=0).stop 2024-09-16T01:02:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 -- 172.21.15.12:0/1100795946 shutdown_connections 2024-09-16T01:02:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 --2- 172.21.15.12:0/1100795946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f435810c180 0x7f435810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 --2- 172.21.15.12:0/1100795946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43581036c0 0x7f435810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 --2- 172.21.15.12:0/1100795946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4358102da0 0x7f4358103180 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 -- 172.21.15.12:0/1100795946 >> 172.21.15.12:0/1100795946 conn(0x7f43580fc780 msgr2=0x7f43580feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 -- 172.21.15.12:0/1100795946 shutdown_connections 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 -- 172.21.15.12:0/1100795946 wait complete. 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 Processor -- start 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.833+0000 7f435da0c640 1 -- start start 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f435da0c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4358102da0 0x7f4358198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f435da0c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43581036c0 0x7f4358198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f435da0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f435810c180 0x7f435819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f435da0c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4358111f50 con 0x7f4358102da0 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f435da0c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4358111dd0 con 0x7f435810c180 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f435da0c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f43581120d0 con 0x7f43581036c0 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4358102da0 0x7f4358198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4358102da0 0x7f4358198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39252/0 (socket says 172.21.15.12:39252) 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f4356ffd640 1 -- 172.21.15.12:0/4111753593 learned_addr learned my addr 172.21.15.12:0/4111753593 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f434ffff640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43581036c0 0x7f4358198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f43577fe640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f435810c180 0x7f435819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f4356ffd640 1 -- 172.21.15.12:0/4111753593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43581036c0 msgr2=0x7f4358198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f4356ffd640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43581036c0 0x7f4358198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f4356ffd640 1 -- 172.21.15.12:0/4111753593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f435810c180 msgr2=0x7f435819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f4356ffd640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f435810c180 0x7f435819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f4356ffd640 1 -- 172.21.15.12:0/4111753593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435819d400 con 0x7f4358102da0 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f434ffff640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43581036c0 0x7f4358198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.834+0000 7f43577fe640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f435810c180 0x7f435819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.835+0000 7f4356ffd640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4358102da0 0x7f4358198450 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4348006010 tx=0x7f43480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.835+0000 7f435ca0a640 1 -- 172.21.15.12:0/4111753593 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434803f030 con 0x7f4358102da0 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.835+0000 7f435ca0a640 1 -- 172.21.15.12:0/4111753593 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4348003ce0 con 0x7f4358102da0 2024-09-16T01:02:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.835+0000 7f435da0c640 1 -- 172.21.15.12:0/4111753593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435819d690 con 0x7f4358102da0 2024-09-16T01:02:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.835+0000 7f435ca0a640 1 -- 172.21.15.12:0/4111753593 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348035070 con 0x7f4358102da0 2024-09-16T01:02:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.835+0000 7f435da0c640 1 -- 172.21.15.12:0/4111753593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4358100930 con 0x7f4358102da0 2024-09-16T01:02:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.838+0000 7f435fde5740 1 Processor -- start 2024-09-16T01:02:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.838+0000 7f435ca0a640 1 -- 172.21.15.12:0/4111753593 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4348042030 con 0x7f4358102da0 2024-09-16T01:02:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.838+0000 7f435fde5740 1 -- start start 2024-09-16T01:02:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.838+0000 7f435fde5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557284306b40 0x557284305090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.838+0000 7f435fde5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 0x557284305a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.838+0000 7f435fde5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x557284312760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.838+0000 7f435fde5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55728426b2f0 con 0x557284310370 2024-09-16T01:02:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.838+0000 7f435fde5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557284212cf0 con 0x557284306b40 2024-09-16T01:02:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.838+0000 7f435fde5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5572842672b0 con 0x5572843055d0 2024-09-16T01:02:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f434ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x557284312760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f434ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x557284312760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39262/0 (socket says 172.21.15.12:39262) 2024-09-16T01:02:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f434ffff640 1 -- 172.21.15.12:0/769070309 learned_addr learned my addr 172.21.15.12:0/769070309 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f43577fe640 1 --2- 172.21.15.12:0/769070309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557284306b40 0x557284305090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f4356ffd640 1 --2- 172.21.15.12:0/769070309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 0x557284305a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f434ffff640 1 -- 172.21.15.12:0/769070309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 msgr2=0x557284305a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f434ffff640 1 --2- 172.21.15.12:0/769070309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 0x557284305a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f434ffff640 1 -- 172.21.15.12:0/769070309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557284306b40 msgr2=0x557284305090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f434ffff640 1 --2- 172.21.15.12:0/769070309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557284306b40 0x557284305090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f434ffff640 1 -- 172.21.15.12:0/769070309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572841f73a0 con 0x557284310370 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f4356ffd640 1 --2- 172.21.15.12:0/769070309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 0x557284305a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.839+0000 7f434ffff640 1 --2- 172.21.15.12:0/769070309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x557284312760 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4340005fd0 tx=0x7f4340009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df412f86e42d4784 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.840+0000 7f434dffb640 1 -- 172.21.15.12:0/769070309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400100d0 con 0x557284310370 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.840+0000 7f434dffb640 1 -- 172.21.15.12:0/769070309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4340005500 con 0x557284310370 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.840+0000 7f434dffb640 1 -- 172.21.15.12:0/769070309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340004d30 con 0x557284310370 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.840+0000 7f435ca0a640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f43440a3240 0x7f43440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.840+0000 7f43577fe640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f43440a3240 0x7f43440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.840+0000 7f435ca0a640 1 -- 172.21.15.12:0/4111753593 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f43480f0340 con 0x7f4358102da0 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 -- 172.21.15.12:0/769070309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 msgr2=0x557284312760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f43577fe640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f43440a3240 0x7f43440a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4350007f10 tx=0x7f43500076a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 --2- 172.21.15.12:0/769070309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x557284312760 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4340005fd0 tx=0x7f4340009730 comp rx=0 tx=0).stop 2024-09-16T01:02:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 -- 172.21.15.12:0/769070309 shutdown_connections 2024-09-16T01:02:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 --2- 172.21.15.12:0/769070309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x557284312760 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 --2- 172.21.15.12:0/769070309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 0x557284305a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 --2- 172.21.15.12:0/769070309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557284306b40 0x557284305090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 -- 172.21.15.12:0/769070309 >> 172.21.15.12:0/769070309 conn(0x5572842ce310 msgr2=0x557284301c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 -- 172.21.15.12:0/769070309 shutdown_connections 2024-09-16T01:02:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 -- 172.21.15.12:0/769070309 wait complete. 2024-09-16T01:02:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 -- start start 2024-09-16T01:02:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.841+0000 7f435fde5740 1 Processor -- start 2024-09-16T01:02:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f435fde5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 0x55728430fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f435fde5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557284306b40 0x55728430cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f435fde5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f435fde5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557284313010 con 0x557284310370 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f435fde5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557284226060 con 0x557284306b40 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f435fde5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557284313190 con 0x5572843055d0 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f435fde5740 10 client.0 _ll_register_callbacks cb 0x557283f798c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f43577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f43577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39268/0 (socket says 172.21.15.12:39268) 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f43577fe640 1 -- 172.21.15.12:0/3943035258 learned_addr learned my addr 172.21.15.12:0/3943035258 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f434ffff640 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557284306b40 0x55728430cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f4356ffd640 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 0x55728430fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f43577fe640 1 -- 172.21.15.12:0/3943035258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 msgr2=0x55728430fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f43577fe640 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 0x55728430fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f43577fe640 1 -- 172.21.15.12:0/3943035258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557284306b40 msgr2=0x55728430cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f43577fe640 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557284306b40 0x55728430cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f43577fe640 1 -- 172.21.15.12:0/3943035258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557283fdc3c0 con 0x557284310370 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f43577fe640 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430d4a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f435000edf0 tx=0x7f4350004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e1df362a86e278 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.842+0000 7f4336ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f4336ffd640 1 -- 172.21.15.12:0/3943035258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435001cd30 con 0x557284310370 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f435fde5740 1 -- 172.21.15.12:0/3943035258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4340005500 con 0x557284310370 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f4336ffd640 1 -- 172.21.15.12:0/3943035258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f4350004b20 con 0x557284310370 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f4336ffd640 1 -- 172.21.15.12:0/3943035258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4350030050 con 0x557284310370 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f435fde5740 10 client.15897 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f435fde5740 1 -- 172.21.15.12:0/3943035258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55728431ea60 con 0x557284310370 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f4336ffd640 1 -- 172.21.15.12:0/3943035258 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4340005500 con 0x557284310370 2024-09-16T01:02:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f4336ffd640 1 -- 172.21.15.12:0/3943035258 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f435001d410 con 0x557284310370 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f435fde5740 10 client.15897 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f435fde5740 10 client.15897 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f435fde5740 20 client.15897 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f435fde5740 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55728431ff20 0x557284322370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f435fde5740 4 client.15897 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.843+0000 7f435fde5740 1 -- 172.21.15.12:0/3943035258 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557284278860 con 0x55728431ff20 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.844+0000 7f4356ffd640 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55728431ff20 0x557284322370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.844+0000 7f4356ffd640 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55728431ff20 0x557284322370 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d3c910ca1bb9a21e server_cookie=c621cdf6922e087a in_seq=0 out_seq=0 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.844+0000 7f4336ffd640 10 client.15897 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f4336ffd640 1 -- 172.21.15.12:0/3943035258 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557284278860 con 0x55728431ff20 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f4336ffd640 10 client.15897 handle_command_reply: tid=0 2024-09-16T01:02:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 client.15897 shutdown 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 -- 172.21.15.12:0/3943035258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 msgr2=0x55728430d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430d4a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f435000edf0 tx=0x7f4350004a40 comp rx=0 tx=0).stop 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 -- 172.21.15.12:0/3943035258 shutdown_connections 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55728431ff20 0x557284322370 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430d4a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557284306b40 0x55728430cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 --2- 172.21.15.12:0/3943035258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572843055d0 0x55728430fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 -- 172.21.15.12:0/3943035258 >> 172.21.15.12:0/3943035258 conn(0x5572842ce310 msgr2=0x557284307960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f4336ffd640 0 client.15897 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 -- 172.21.15.12:0/3943035258 shutdown_connections 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 1 -- 172.21.15.12:0/3943035258 wait complete. 2024-09-16T01:02:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.845+0000 7f435fde5740 20 client.15897 trim_cache size 0 max 16384 2024-09-16T01:02:31.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f435fde5740 1 Processor -- start 2024-09-16T01:02:31.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f435fde5740 1 -- start start 2024-09-16T01:02:31.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f435fde5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572843055d0 0x557284301e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f435fde5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284306b40 0x55728431c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f435fde5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f435fde5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f43581ac9a0 con 0x557284310370 2024-09-16T01:02:31.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f435fde5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f43581ae4e0 con 0x5572843055d0 2024-09-16T01:02:31.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f435fde5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f43581ad070 con 0x557284306b40 2024-09-16T01:02:31.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f43577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f43577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39280/0 (socket says 172.21.15.12:39280) 2024-09-16T01:02:31.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f43577fe640 1 -- 172.21.15.12:0/2605726897 learned_addr learned my addr 172.21.15.12:0/2605726897 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:31.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f434ffff640 1 --2- 172.21.15.12:0/2605726897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284306b40 0x55728431c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.859+0000 7f4356ffd640 1 --2- 172.21.15.12:0/2605726897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572843055d0 0x557284301e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.860+0000 7f43577fe640 1 -- 172.21.15.12:0/2605726897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284306b40 msgr2=0x55728431c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:31.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.860+0000 7f43577fe640 1 --2- 172.21.15.12:0/2605726897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284306b40 0x55728431c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.860+0000 7f43577fe640 1 -- 172.21.15.12:0/2605726897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572843055d0 msgr2=0x557284301e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:31.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.860+0000 7f43577fe640 1 --2- 172.21.15.12:0/2605726897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572843055d0 0x557284301e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.860+0000 7f43577fe640 1 -- 172.21.15.12:0/2605726897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55728430bf10 con 0x557284310370 2024-09-16T01:02:31.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.860+0000 7f43577fe640 1 --2- 172.21.15.12:0/2605726897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430c820 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4350011c80 tx=0x7f4350007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1433d054da960df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.860+0000 7f434d7fa640 1 -- 172.21.15.12:0/2605726897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435001cb30 con 0x557284310370 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.860+0000 7f434d7fa640 1 -- 172.21.15.12:0/2605726897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f435001ccd0 con 0x557284310370 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.860+0000 7f434d7fa640 1 -- 172.21.15.12:0/2605726897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43500052a0 con 0x557284310370 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.861+0000 7f435fde5740 1 -- 172.21.15.12:0/2605726897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 msgr2=0x55728430c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.861+0000 7f435fde5740 1 --2- 172.21.15.12:0/2605726897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430c820 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4350011c80 tx=0x7f4350007d60 comp rx=0 tx=0).stop 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.861+0000 7f435fde5740 1 -- 172.21.15.12:0/2605726897 shutdown_connections 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.861+0000 7f435fde5740 1 --2- 172.21.15.12:0/2605726897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284310370 0x55728430c820 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.861+0000 7f435fde5740 1 --2- 172.21.15.12:0/2605726897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284306b40 0x55728431c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.861+0000 7f435fde5740 1 --2- 172.21.15.12:0/2605726897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572843055d0 0x557284301e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.861+0000 7f435fde5740 1 -- 172.21.15.12:0/2605726897 >> 172.21.15.12:0/2605726897 conn(0x5572842ce310 msgr2=0x557284301700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.861+0000 7f435fde5740 1 -- 172.21.15.12:0/2605726897 shutdown_connections 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.861+0000 7f435fde5740 1 -- 172.21.15.12:0/2605726897 wait complete. 2024-09-16T01:02:31.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.861+0000 7f435fde5740 1 -- start start 2024-09-16T01:02:31.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f435fde5740 1 Processor -- start 2024-09-16T01:02:31.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f435fde5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572843055d0 0x557284318600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f435fde5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284306b40 0x557284318b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f435fde5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284310370 0x557284309790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f435fde5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f43581ade10 con 0x557284306b40 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f435fde5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f43581ad740 con 0x5572843055d0 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f435fde5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f43581aa980 con 0x557284310370 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f435fde5740 10 client.0 _ll_register_callbacks cb 0x7f435000ea70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f43577fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284310370 0x557284309790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f43577fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284310370 0x557284309790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.12:58000/0 (socket says 172.21.15.12:58000) 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f43577fe640 1 -- 172.21.15.12:0/3157367923 learned_addr learned my addr 172.21.15.12:0/3157367923 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f4356ffd640 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572843055d0 0x557284318600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.862+0000 7f434ffff640 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284306b40 0x557284318b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f43577fe640 1 -- 172.21.15.12:0/3157367923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572843055d0 msgr2=0x557284318600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f43577fe640 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572843055d0 0x557284318600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f43577fe640 1 -- 172.21.15.12:0/3157367923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284306b40 msgr2=0x557284318b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f43577fe640 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284306b40 0x557284318b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f43577fe640 1 -- 172.21.15.12:0/3157367923 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557284309ed0 con 0x557284310370 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f43577fe640 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284310370 0x557284309790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4350016040 tx=0x7f435001dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e850fc4d188815b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f4336ffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f4336ffd640 1 -- 172.21.15.12:0/3157367923 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350045030 con 0x557284310370 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f435fde5740 1 -- 172.21.15.12:0/3157367923 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f435001ccd0 con 0x557284310370 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f4336ffd640 1 -- 172.21.15.12:0/3157367923 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f4350004bf0 con 0x557284310370 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f4336ffd640 1 -- 172.21.15.12:0/3157367923 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f435004e050 con 0x557284310370 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f435fde5740 10 client.25423 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.863+0000 7f435fde5740 1 -- 172.21.15.12:0/3157367923 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55728438a610 con 0x557284310370 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.864+0000 7f4336ffd640 1 -- 172.21.15.12:0/3157367923 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f435001ccd0 con 0x557284310370 2024-09-16T01:02:31.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.864+0000 7f4336ffd640 1 -- 172.21.15.12:0/3157367923 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4350033030 con 0x557284310370 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.864+0000 7f435fde5740 10 client.25423 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.864+0000 7f435fde5740 10 client.25423 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.864+0000 7f435fde5740 20 client.25423 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.864+0000 7f435fde5740 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55728438ac20 0x55728438d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.864+0000 7f435fde5740 4 client.25423 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.864+0000 7f435fde5740 1 -- 172.21.15.12:0/3157367923 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557284272d70 con 0x55728438ac20 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.864+0000 7f4356ffd640 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55728438ac20 0x55728438d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f4356ffd640 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55728438ac20 0x55728438d040 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=660fdc5e9e5bbfc0 server_cookie=cd8abe88699e5048 in_seq=0 out_seq=0 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f4336ffd640 10 client.25423 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f4336ffd640 1 -- 172.21.15.12:0/3157367923 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557284272d70 con 0x55728438ac20 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f4336ffd640 10 client.25423 handle_command_reply: tid=0 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 client.25423 shutdown 2024-09-16T01:02:31.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 -- 172.21.15.12:0/3157367923 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284310370 msgr2=0x557284309790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284310370 0x557284309790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4350016040 tx=0x7f435001dc00 comp rx=0 tx=0).stop 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 -- 172.21.15.12:0/3157367923 shutdown_connections 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55728438ac20 0x55728438d040 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557284310370 0x557284309790 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557284306b40 0x557284318b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 --2- 172.21.15.12:0/3157367923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572843055d0 0x557284318600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f4336ffd640 0 client.25423 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 -- 172.21.15.12:0/3157367923 >> 172.21.15.12:0/3157367923 conn(0x5572842ce310 msgr2=0x55728430efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 -- 172.21.15.12:0/3157367923 shutdown_connections 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 1 -- 172.21.15.12:0/3157367923 wait complete. 2024-09-16T01:02:31.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.865+0000 7f435fde5740 20 client.25423 trim_cache size 0 max 16384 2024-09-16T01:02:31.871 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 -- 172.21.15.12:0/4111753593 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f43440a3240 msgr2=0x7f43440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f43440a3240 0x7f43440a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4350007f10 tx=0x7f43500076a0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 -- 172.21.15.12:0/4111753593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4358102da0 msgr2=0x7f4358198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4358102da0 0x7f4358198450 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4348006010 tx=0x7f43480042f0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 -- 172.21.15.12:0/4111753593 shutdown_connections 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f43440a3240 0x7f43440a5700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f435810c180 0x7f435819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43581036c0 0x7f4358198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 --2- 172.21.15.12:0/4111753593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4358102da0 0x7f4358198450 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 -- 172.21.15.12:0/4111753593 >> 172.21.15.12:0/4111753593 conn(0x7f43580fc780 msgr2=0x7f43580fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 -- 172.21.15.12:0/4111753593 shutdown_connections 2024-09-16T01:02:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:31.866+0000 7f435da0c640 1 -- 172.21.15.12:0/4111753593 wait complete. 2024-09-16T01:02:32.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:32 smithi119 ceph-mon[35049]: pgmap v403: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-16T01:02:32.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:32 smithi012 ceph-mon[31197]: pgmap v403: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-16T01:02:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:32 smithi098 ceph-mon[35346]: pgmap v403: 129 pgs: 129 active+clean; 663 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-16T01:02:32.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-16T01:02:32.863 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:33.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.342+0000 7fbac66b4640 1 -- 172.21.15.12:0/3988292297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac0102790 msgr2=0x7fbac01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:33.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.342+0000 7fbac66b4640 1 --2- 172.21.15.12:0/3988292297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac0102790 0x7fbac01067e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009900 tx=0x7fbaa802a410 comp rx=0 tx=0).stop 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.342+0000 7fbac66b4640 1 -- 172.21.15.12:0/3988292297 shutdown_connections 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.342+0000 7fbac66b4640 1 --2- 172.21.15.12:0/3988292297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac0106f10 0x7fbac010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.342+0000 7fbac66b4640 1 --2- 172.21.15.12:0/3988292297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac0102790 0x7fbac01067e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.342+0000 7fbac66b4640 1 --2- 172.21.15.12:0/3988292297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbac0101de0 0x7fbac01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.342+0000 7fbac66b4640 1 -- 172.21.15.12:0/3988292297 >> 172.21.15.12:0/3988292297 conn(0x7fbac00fd8c0 msgr2=0x7fbac00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.342+0000 7fbac66b4640 1 -- 172.21.15.12:0/3988292297 shutdown_connections 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.342+0000 7fbac66b4640 1 -- 172.21.15.12:0/3988292297 wait complete. 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbac66b4640 1 Processor -- start 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbac66b4640 1 -- start start 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbac66b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac0101de0 0x7fbac0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbac66b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac0102790 0x7fbac01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbac66b4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbac0106f10 0x7fbac019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbac66b4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbac0111f70 con 0x7fbac0102790 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbac66b4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbac0111df0 con 0x7fbac0106f10 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbac66b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01120f0 con 0x7fbac0101de0 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbab7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac0102790 0x7fbac01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbab7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac0102790 0x7fbac01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39308/0 (socket says 172.21.15.12:39308) 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbab7fff640 1 -- 172.21.15.12:0/33050388 learned_addr learned my addr 172.21.15.12:0/33050388 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbac4c51640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbac0106f10 0x7fbac019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.343+0000 7fbabffff640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac0101de0 0x7fbac0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbab7fff640 1 -- 172.21.15.12:0/33050388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac0101de0 msgr2=0x7fbac0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbab7fff640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac0101de0 0x7fbac0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbab7fff640 1 -- 172.21.15.12:0/33050388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbac0106f10 msgr2=0x7fbac019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbab7fff640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbac0106f10 0x7fbac019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbab7fff640 1 -- 172.21.15.12:0/33050388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac019d440 con 0x7fbac0102790 2024-09-16T01:02:33.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbabffff640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac0101de0 0x7fbac0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:33.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbab7fff640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac0102790 0x7fbac01989d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8006010 tx=0x7fbaa80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:33.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbabdffb640 1 -- 172.21.15.12:0/33050388 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa803f030 con 0x7fbac0102790 2024-09-16T01:02:33.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbac66b4640 1 -- 172.21.15.12:0/33050388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac019d6d0 con 0x7fbac0102790 2024-09-16T01:02:33.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbabdffb640 1 -- 172.21.15.12:0/33050388 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa8003ce0 con 0x7fbac0102790 2024-09-16T01:02:33.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbabdffb640 1 -- 172.21.15.12:0/33050388 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8035070 con 0x7fbac0102790 2024-09-16T01:02:33.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.344+0000 7fbac66b4640 1 -- 172.21.15.12:0/33050388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac01a5010 con 0x7fbac0102790 2024-09-16T01:02:33.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.347+0000 7fbabdffb640 1 -- 172.21.15.12:0/33050388 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbaa8042030 con 0x7fbac0102790 2024-09-16T01:02:33.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.347+0000 7fbac8a8d740 1 Processor -- start 2024-09-16T01:02:33.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.347+0000 7fbac8a8d740 1 -- start start 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.347+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249acb40 0x55b3249ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.347+0000 7fbabdffb640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbaac0a3240 0x7fbaac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.347+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249ab5d0 0x55b3249aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.347+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.347+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b3249112f0 con 0x55b3249b6370 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.347+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b3248b8cf0 con 0x55b3249acb40 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.347+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b32490d2b0 con 0x55b3249ab5d0 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbabffff640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbaac0a3240 0x7fbaac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbabdffb640 1 -- 172.21.15.12:0/33050388 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fbaa80f0390 con 0x7fbac0102790 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbac4c51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbab7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249ab5d0 0x55b3249aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbac4c51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39310/0 (socket says 172.21.15.12:39310) 2024-09-16T01:02:33.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbac4c51640 1 -- 172.21.15.12:0/1064077309 learned_addr learned my addr 172.21.15.12:0/1064077309 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbac4c51640 1 --2- 172.21.15.12:0/1064077309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249acb40 0x55b3249ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbac4c51640 1 -- 172.21.15.12:0/1064077309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249ab5d0 msgr2=0x55b3249aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbac4c51640 1 --2- 172.21.15.12:0/1064077309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249ab5d0 0x55b3249aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbac4c51640 1 -- 172.21.15.12:0/1064077309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249acb40 msgr2=0x55b3249ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbac4c51640 1 --2- 172.21.15.12:0/1064077309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249acb40 0x55b3249ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbac4c51640 1 -- 172.21.15.12:0/1064077309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b32489d3a0 con 0x55b3249b6370 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.348+0000 7fbac4c51640 1 --2- 172.21.15.12:0/1064077309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b8760 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbab8012a20 tx=0x7fbab8009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81abd6446a530c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbabffff640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbaac0a3240 0x7fbaac0a5700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbab0005fd0 tx=0x7fbab000b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbab67fc640 1 -- 172.21.15.12:0/1064077309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8004b20 con 0x55b3249b6370 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbab67fc640 1 -- 172.21.15.12:0/1064077309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab8003e50 con 0x55b3249b6370 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbab67fc640 1 -- 172.21.15.12:0/1064077309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8004030 con 0x55b3249b6370 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1064077309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 msgr2=0x55b3249b8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/1064077309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b8760 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbab8012a20 tx=0x7fbab8009a50 comp rx=0 tx=0).stop 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1064077309 shutdown_connections 2024-09-16T01:02:33.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/1064077309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b8760 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/1064077309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249ab5d0 0x55b3249aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/1064077309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249acb40 0x55b3249ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.349+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1064077309 >> 172.21.15.12:0/1064077309 conn(0x55b324974310 msgr2=0x55b3249a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.350+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1064077309 shutdown_connections 2024-09-16T01:02:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.350+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1064077309 wait complete. 2024-09-16T01:02:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.350+0000 7fbac8a8d740 1 -- start start 2024-09-16T01:02:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.350+0000 7fbac8a8d740 1 Processor -- start 2024-09-16T01:02:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.350+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249ab5d0 0x55b3249b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.350+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249acb40 0x55b3249b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.350+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.350+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b3249b9070 con 0x55b3249b6370 2024-09-16T01:02:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.350+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b3248cc060 con 0x55b3249acb40 2024-09-16T01:02:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.350+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b3249b91f0 con 0x55b3249ab5d0 2024-09-16T01:02:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac8a8d740 10 client.0 _ll_register_callbacks cb 0x55b32461f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac4c51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac4c51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39322/0 (socket says 172.21.15.12:39322) 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac4c51640 1 -- 172.21.15.12:0/822338202 learned_addr learned my addr 172.21.15.12:0/822338202 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbab7fff640 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249acb40 0x55b3249b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbabffff640 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249ab5d0 0x55b3249b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac4c51640 1 -- 172.21.15.12:0/822338202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249ab5d0 msgr2=0x55b3249b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac4c51640 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249ab5d0 0x55b3249b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac4c51640 1 -- 172.21.15.12:0/822338202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249acb40 msgr2=0x55b3249b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac4c51640 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249acb40 0x55b3249b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac4c51640 1 -- 172.21.15.12:0/822338202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3246823c0 con 0x55b3249b6370 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac4c51640 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b35e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbab8010c10 tx=0x7fbab8009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0419f10678a2c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fba9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fba9f7fe640 1 -- 172.21.15.12:0/822338202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8003970 con 0x55b3249b6370 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fba9f7fe640 1 -- 172.21.15.12:0/822338202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fbab8003b10 con 0x55b3249b6370 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.351+0000 7fbac8a8d740 1 -- 172.21.15.12:0/822338202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbab8003e50 con 0x55b3249b6370 2024-09-16T01:02:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fba9f7fe640 1 -- 172.21.15.12:0/822338202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbab8030050 con 0x55b3249b6370 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fbac8a8d740 10 client.15915 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fbac8a8d740 1 -- 172.21.15.12:0/822338202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b3249c4ae0 con 0x55b3249b6370 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fba9f7fe640 1 -- 172.21.15.12:0/822338202 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab8003e50 con 0x55b3249b6370 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fba9f7fe640 1 -- 172.21.15.12:0/822338202 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbab8004680 con 0x55b3249b6370 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fbac8a8d740 10 client.15915 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fbac8a8d740 10 client.15915 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fbac8a8d740 20 client.15915 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55b3249c5e30 0x55b3249c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fbac8a8d740 4 client.15915 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fbac8a8d740 1 -- 172.21.15.12:0/822338202 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b32491e860 con 0x55b3249c5e30 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.352+0000 7fbabffff640 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55b3249c5e30 0x55b3249c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.353+0000 7fbabffff640 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55b3249c5e30 0x55b3249c8220 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed9fcb4af53bea8f server_cookie=3ad7d7abf5c21b60 in_seq=0 out_seq=0 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.353+0000 7fba9f7fe640 10 client.15915 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.353+0000 7fba9f7fe640 1 -- 172.21.15.12:0/822338202 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b32491e860 con 0x55b3249c5e30 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.353+0000 7fba9f7fe640 10 client.15915 handle_command_reply: tid=0 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 client.15915 shutdown 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 -- 172.21.15.12:0/822338202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 msgr2=0x55b3249b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b35e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbab8010c10 tx=0x7fbab8009950 comp rx=0 tx=0).stop 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 -- 172.21.15.12:0/822338202 shutdown_connections 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55b3249c5e30 0x55b3249c8220 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b35e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fba9f7fe640 0 client.15915 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249acb40 0x55b3249b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/822338202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249ab5d0 0x55b3249b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 -- 172.21.15.12:0/822338202 >> 172.21.15.12:0/822338202 conn(0x55b324974310 msgr2=0x55b3249ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 -- 172.21.15.12:0/822338202 shutdown_connections 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 1 -- 172.21.15.12:0/822338202 wait complete. 2024-09-16T01:02:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.354+0000 7fbac8a8d740 20 client.15915 trim_cache size 0 max 16384 2024-09-16T01:02:33.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.367+0000 7fbac8a8d740 1 Processor -- start 2024-09-16T01:02:33.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.367+0000 7fbac8a8d740 1 -- start start 2024-09-16T01:02:33.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.367+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 0x55b3249c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.367+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249acb40 0x55b3249b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249b6370 0x55b3249cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01aebc0 con 0x55b3249acb40 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01b0700 con 0x55b3249ab5d0 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01af290 con 0x55b3249b6370 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbab7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249acb40 0x55b3249b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbab7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249acb40 0x55b3249b4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39336/0 (socket says 172.21.15.12:39336) 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbab7fff640 1 -- 172.21.15.12:0/2738141333 learned_addr learned my addr 172.21.15.12:0/2738141333 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbabffff640 1 --2- 172.21.15.12:0/2738141333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 0x55b3249c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbac4c51640 1 --2- 172.21.15.12:0/2738141333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249b6370 0x55b3249cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbab7fff640 1 -- 172.21.15.12:0/2738141333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249b6370 msgr2=0x55b3249cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbab7fff640 1 --2- 172.21.15.12:0/2738141333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249b6370 0x55b3249cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbab7fff640 1 -- 172.21.15.12:0/2738141333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 msgr2=0x55b3249c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbab7fff640 1 --2- 172.21.15.12:0/2738141333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 0x55b3249c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbab7fff640 1 -- 172.21.15.12:0/2738141333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3249b60b0 con 0x55b3249acb40 2024-09-16T01:02:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbab7fff640 1 --2- 172.21.15.12:0/2738141333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249acb40 0x55b3249b4f60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80b8b10 tx=0x7fbaa80b89d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db65e1ee8e17217 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.368+0000 7fbab5ffb640 1 -- 172.21.15.12:0/2738141333 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8049040 con 0x55b3249acb40 2024-09-16T01:02:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbab5ffb640 1 -- 172.21.15.12:0/2738141333 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa803b580 con 0x55b3249acb40 2024-09-16T01:02:33.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbab5ffb640 1 -- 172.21.15.12:0/2738141333 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80bc6b0 con 0x55b3249acb40 2024-09-16T01:02:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbac8a8d740 1 -- 172.21.15.12:0/2738141333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249acb40 msgr2=0x55b3249b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/2738141333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249acb40 0x55b3249b4f60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80b8b10 tx=0x7fbaa80b89d0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbac8a8d740 1 -- 172.21.15.12:0/2738141333 shutdown_connections 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/2738141333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249b6370 0x55b3249cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/2738141333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249acb40 0x55b3249b4f60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/2738141333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 0x55b3249c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbac8a8d740 1 -- 172.21.15.12:0/2738141333 >> 172.21.15.12:0/2738141333 conn(0x55b324974310 msgr2=0x55b3249b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbac8a8d740 1 -- 172.21.15.12:0/2738141333 shutdown_connections 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.369+0000 7fbac8a8d740 1 -- 172.21.15.12:0/2738141333 wait complete. 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.370+0000 7fbac8a8d740 1 -- start start 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.370+0000 7fbac8a8d740 1 Processor -- start 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.370+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 0x55b3249bea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.370+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249acb40 0x55b3249afb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.370+0000 7fbac8a8d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.370+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01b0030 con 0x55b3249b6370 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.370+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01af960 con 0x55b3249ab5d0 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.370+0000 7fbac8a8d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01acba0 con 0x55b3249acb40 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.370+0000 7fbac8a8d740 10 client.0 _ll_register_callbacks cb 0x7fbab8012510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac4c51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac4c51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39344/0 (socket says 172.21.15.12:39344) 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac4c51640 1 -- 172.21.15.12:0/1343878363 learned_addr learned my addr 172.21.15.12:0/1343878363 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbabffff640 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 0x55b3249bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbab7fff640 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249acb40 0x55b3249afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac4c51640 1 -- 172.21.15.12:0/1343878363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249acb40 msgr2=0x55b3249afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac4c51640 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249acb40 0x55b3249afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac4c51640 1 -- 172.21.15.12:0/1343878363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 msgr2=0x55b3249bea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac4c51640 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 0x55b3249bea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac4c51640 1 -- 172.21.15.12:0/1343878363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3249b0680 con 0x55b3249b6370 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbabffff640 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 0x55b3249bea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac4c51640 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b0040 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbab8012670 tx=0x7fbab8012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a7fc0aba8a8c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fba9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fba9f7fe640 1 -- 172.21.15.12:0/1343878363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab80120b0 con 0x55b3249b6370 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fba9f7fe640 1 -- 172.21.15.12:0/1343878363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fbab802a080 con 0x55b3249b6370 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1343878363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b324918d70 con 0x55b3249b6370 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fba9f7fe640 1 -- 172.21.15.12:0/1343878363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbab803b050 con 0x55b3249b6370 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac8a8d740 10 client.15921 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.371+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1343878363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b324a30730 con 0x55b3249b6370 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.372+0000 7fba9f7fe640 1 -- 172.21.15.12:0/1343878363 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b324918d70 con 0x55b3249b6370 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.372+0000 7fba9f7fe640 1 -- 172.21.15.12:0/1343878363 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbab802ac80 con 0x55b3249b6370 2024-09-16T01:02:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.372+0000 7fbac8a8d740 10 client.15921 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.372+0000 7fbac8a8d740 10 client.15921 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.372+0000 7fbac8a8d740 20 client.15921 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.372+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55b3249c5e30 0x55b324a32e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.372+0000 7fbac8a8d740 4 client.15921 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.372+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1343878363 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b324895170 con 0x55b3249c5e30 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.372+0000 7fbabffff640 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55b3249c5e30 0x55b324a32e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fba9f7fe640 10 client.15921 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbabffff640 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55b3249c5e30 0x55b324a32e90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f0fa4f3e3eebace3 server_cookie=deff5f6c23a99018 in_seq=0 out_seq=0 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fba9f7fe640 1 -- 172.21.15.12:0/1343878363 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b324895170 con 0x55b3249c5e30 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fba9f7fe640 10 client.15921 handle_command_reply: tid=0 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 client.15921 shutdown 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1343878363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 msgr2=0x55b3249b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b0040 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbab8012670 tx=0x7fbab8012920 comp rx=0 tx=0).stop 2024-09-16T01:02:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1343878363 shutdown_connections 2024-09-16T01:02:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x55b3249c5e30 0x55b324a32e90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b3249b6370 0x55b3249b0040 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b3249acb40 0x55b3249afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 --2- 172.21.15.12:0/1343878363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3249ab5d0 0x55b3249bea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1343878363 >> 172.21.15.12:0/1343878363 conn(0x55b324974310 msgr2=0x55b3249b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fba9f7fe640 0 client.15921 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:02:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1343878363 shutdown_connections 2024-09-16T01:02:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 1 -- 172.21.15.12:0/1343878363 wait complete. 2024-09-16T01:02:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.373+0000 7fbac8a8d740 20 client.15921 trim_cache size 0 max 16384 2024-09-16T01:02:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 -- 172.21.15.12:0/33050388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbaac0a3240 msgr2=0x7fbaac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbaac0a3240 0x7fbaac0a5700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbab0005fd0 tx=0x7fbab000b5f0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 -- 172.21.15.12:0/33050388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac0102790 msgr2=0x7fbac01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac0102790 0x7fbac01989d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8006010 tx=0x7fbaa80042f0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 -- 172.21.15.12:0/33050388 shutdown_connections 2024-09-16T01:02:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbaac0a3240 0x7fbaac0a5700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbac0106f10 0x7fbac019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac0102790 0x7fbac01989d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 --2- 172.21.15.12:0/33050388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac0101de0 0x7fbac0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 -- 172.21.15.12:0/33050388 >> 172.21.15.12:0/33050388 conn(0x7fbac00fd8c0 msgr2=0x7fbac00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 -- 172.21.15.12:0/33050388 shutdown_connections 2024-09-16T01:02:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:33.374+0000 7fbac66b4640 1 -- 172.21.15.12:0/33050388 wait complete. 2024-09-16T01:02:34.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-16T01:02:34.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:34 smithi119 ceph-mon[35049]: pgmap v404: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 256 KiB/s wr, 10 op/s 2024-09-16T01:02:34.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:34 smithi012 ceph-mon[31197]: pgmap v404: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 256 KiB/s wr, 10 op/s 2024-09-16T01:02:34.367 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:34 smithi098 ceph-mon[35346]: pgmap v404: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 256 KiB/s wr, 10 op/s 2024-09-16T01:02:34.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.883+0000 7fca40283640 1 -- 172.21.15.12:0/513341310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca38101df0 msgr2=0x7fca381021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.883+0000 7fca40283640 1 --2- 172.21.15.12:0/513341310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca38101df0 0x7fca381021d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009900 tx=0x7fca2c02a410 comp rx=0 tx=0).stop 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.883+0000 7fca40283640 1 -- 172.21.15.12:0/513341310 shutdown_connections 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.883+0000 7fca40283640 1 --2- 172.21.15.12:0/513341310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca38106f20 0x7fca3810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.883+0000 7fca40283640 1 --2- 172.21.15.12:0/513341310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca381027a0 0x7fca381067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.883+0000 7fca40283640 1 --2- 172.21.15.12:0/513341310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca38101df0 0x7fca381021d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.883+0000 7fca40283640 1 -- 172.21.15.12:0/513341310 >> 172.21.15.12:0/513341310 conn(0x7fca380fd8f0 msgr2=0x7fca380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.883+0000 7fca40283640 1 -- 172.21.15.12:0/513341310 shutdown_connections 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.883+0000 7fca40283640 1 -- 172.21.15.12:0/513341310 wait complete. 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca40283640 1 Processor -- start 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca40283640 1 -- start start 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca40283640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca38101df0 0x7fca38198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca40283640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca381027a0 0x7fca38198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca40283640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca38106f20 0x7fca3819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca40283640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fca38111f80 con 0x7fca38106f20 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca40283640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fca38111e00 con 0x7fca381027a0 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca40283640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca38112100 con 0x7fca38101df0 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca3e820640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca38106f20 0x7fca3819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca3e820640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca38106f20 0x7fca3819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39364/0 (socket says 172.21.15.12:39364) 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca3d81e640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca381027a0 0x7fca38198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca3e820640 1 -- 172.21.15.12:0/821449468 learned_addr learned my addr 172.21.15.12:0/821449468 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.884+0000 7fca3e01f640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca38101df0 0x7fca38198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca3d81e640 1 -- 172.21.15.12:0/821449468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca38101df0 msgr2=0x7fca38198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca3d81e640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca38101df0 0x7fca38198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca3d81e640 1 -- 172.21.15.12:0/821449468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca38106f20 msgr2=0x7fca3819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca3d81e640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca38106f20 0x7fca3819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca3d81e640 1 -- 172.21.15.12:0/821449468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3819d400 con 0x7fca381027a0 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca3e820640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca38106f20 0x7fca3819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca3d81e640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca381027a0 0x7fca38198990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca3400e9f0 tx=0x7fca3400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca2b7fe640 1 -- 172.21.15.12:0/821449468 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400ccc0 con 0x7fca381027a0 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca2b7fe640 1 -- 172.21.15.12:0/821449468 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca34010910 con 0x7fca381027a0 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca40283640 1 -- 172.21.15.12:0/821449468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3819d6f0 con 0x7fca381027a0 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca2b7fe640 1 -- 172.21.15.12:0/821449468 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34018960 con 0x7fca381027a0 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.885+0000 7fca40283640 1 -- 172.21.15.12:0/821449468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca381a4fd0 con 0x7fca381027a0 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.888+0000 7fca2b7fe640 1 -- 172.21.15.12:0/821449468 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fca34010ac0 con 0x7fca381027a0 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.888+0000 7fca2b7fe640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fca240a3240 0x7fca240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.889+0000 7fca2b7fe640 1 -- 172.21.15.12:0/821449468 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fca340d0060 con 0x7fca381027a0 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.889+0000 7fca3e01f640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fca240a3240 0x7fca240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.889+0000 7fca3e01f640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fca240a3240 0x7fca240a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009230 tx=0x7fca2c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.889+0000 7fca4265c740 1 Processor -- start 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.889+0000 7fca4265c740 1 -- start start 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca4265c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d018090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca4265c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d018a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca4265c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d025760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca4265c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563f9cf7e2f0 con 0x563f9d0185d0 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca4265c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563f9cf25cf0 con 0x563f9d019b40 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca4265c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563f9cf7a2b0 con 0x563f9d023370 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca3d81e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d018a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca3d81e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d018a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39376/0 (socket says 172.21.15.12:39376) 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca3d81e640 1 -- 172.21.15.12:0/3632292232 learned_addr learned my addr 172.21.15.12:0/3632292232 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca3e01f640 1 --2- 172.21.15.12:0/3632292232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d018090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca3e820640 1 --2- 172.21.15.12:0/3632292232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d025760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca3d81e640 1 -- 172.21.15.12:0/3632292232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 msgr2=0x563f9d025760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca3d81e640 1 --2- 172.21.15.12:0/3632292232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d025760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca3d81e640 1 -- 172.21.15.12:0/3632292232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 msgr2=0x563f9d018090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca3d81e640 1 --2- 172.21.15.12:0/3632292232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d018090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.890+0000 7fca3d81e640 1 -- 172.21.15.12:0/3632292232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9cf0a3a0 con 0x563f9d0185d0 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.891+0000 7fca3d81e640 1 --2- 172.21.15.12:0/3632292232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d018a10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca34098d40 tx=0x7fca3409c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf37b13ec5f9dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.891+0000 7fca28dea640 1 -- 172.21.15.12:0/3632292232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca340a4f30 con 0x563f9d0185d0 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.891+0000 7fca28dea640 1 -- 172.21.15.12:0/3632292232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca3409a670 con 0x563f9d0185d0 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.891+0000 7fca28dea640 1 -- 172.21.15.12:0/3632292232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3409baa0 con 0x563f9d0185d0 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.891+0000 7fca4265c740 1 -- 172.21.15.12:0/3632292232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 msgr2=0x563f9d018a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.891+0000 7fca4265c740 1 --2- 172.21.15.12:0/3632292232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d018a10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca34098d40 tx=0x7fca3409c370 comp rx=0 tx=0).stop 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 -- 172.21.15.12:0/3632292232 shutdown_connections 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 --2- 172.21.15.12:0/3632292232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d025760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 --2- 172.21.15.12:0/3632292232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d018a10 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 --2- 172.21.15.12:0/3632292232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d018090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 -- 172.21.15.12:0/3632292232 >> 172.21.15.12:0/3632292232 conn(0x563f9cfe1310 msgr2=0x563f9d014c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 -- 172.21.15.12:0/3632292232 shutdown_connections 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 -- 172.21.15.12:0/3632292232 wait complete. 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 -- start start 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 Processor -- start 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d022d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d020020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d020610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563f9d026010 con 0x563f9d0185d0 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563f9cf39060 con 0x563f9d019b40 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563f9d026190 con 0x563f9d023370 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca4265c740 10 client.0 _ll_register_callbacks cb 0x563f9cc8c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.892+0000 7fca3e01f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d022d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca3e01f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d022d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39382/0 (socket says 172.21.15.12:39382) 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca3e01f640 1 -- 172.21.15.12:0/4246947691 learned_addr learned my addr 172.21.15.12:0/4246947691 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca3d81e640 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d020020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca3e820640 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d020610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca3e01f640 1 -- 172.21.15.12:0/4246947691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 msgr2=0x563f9d020610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca3e01f640 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d020610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca3e01f640 1 -- 172.21.15.12:0/4246947691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 msgr2=0x563f9d020020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca3e01f640 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d020020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca3e01f640 1 -- 172.21.15.12:0/4246947691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f9ccef3c0 con 0x563f9d0185d0 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca3e01f640 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d022d70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009900 tx=0x7fca2c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711ca0dc58991182 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca21ffb640 1 -- 172.21.15.12:0/4246947691 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c035040 con 0x563f9d0185d0 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca21ffb640 1 -- 172.21.15.12:0/4246947691 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fca2c0035f0 con 0x563f9d0185d0 2024-09-16T01:02:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.893+0000 7fca4265c740 1 -- 172.21.15.12:0/4246947691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca3409a670 con 0x563f9d0185d0 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca21ffb640 1 -- 172.21.15.12:0/4246947691 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fca2c05b050 con 0x563f9d0185d0 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca4265c740 10 client.15933 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca4265c740 1 -- 172.21.15.12:0/4246947691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563f9d031ab0 con 0x563f9d0185d0 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca21ffb640 1 -- 172.21.15.12:0/4246947691 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca3409a670 con 0x563f9d0185d0 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca21ffb640 1 -- 172.21.15.12:0/4246947691 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fca2c03c860 con 0x563f9d0185d0 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca4265c740 10 client.15933 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca4265c740 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca4265c740 20 client.15933 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca4265c740 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x563f9d032f70 0x563f9d035360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca4265c740 4 client.15933 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca4265c740 1 -- 172.21.15.12:0/4246947691 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f9cf8b860 con 0x563f9d032f70 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.894+0000 7fca3d81e640 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x563f9d032f70 0x563f9d035360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.895+0000 7fca21ffb640 10 client.15933 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.895+0000 7fca3d81e640 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x563f9d032f70 0x563f9d035360 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c1ee54e505c536 server_cookie=3784832fdb70381f in_seq=0 out_seq=0 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.896+0000 7fca21ffb640 1 -- 172.21.15.12:0/4246947691 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f9cf8b860 con 0x563f9d032f70 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.896+0000 7fca21ffb640 10 client.15933 handle_command_reply: tid=0 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.896+0000 7fca4265c740 1 client.15933 shutdown 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.896+0000 7fca4265c740 1 -- 172.21.15.12:0/4246947691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 msgr2=0x563f9d022d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.896+0000 7fca4265c740 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d022d70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009900 tx=0x7fca2c009260 comp rx=0 tx=0).stop 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.897+0000 7fca4265c740 1 -- 172.21.15.12:0/4246947691 shutdown_connections 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.897+0000 7fca4265c740 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x563f9d032f70 0x563f9d035360 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.897+0000 7fca4265c740 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d020610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.897+0000 7fca4265c740 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d020020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.897+0000 7fca21ffb640 0 client.15933 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.897+0000 7fca4265c740 1 --2- 172.21.15.12:0/4246947691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d0185d0 0x563f9d022d70 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.897+0000 7fca4265c740 1 -- 172.21.15.12:0/4246947691 >> 172.21.15.12:0/4246947691 conn(0x563f9cfe1310 msgr2=0x563f9d01a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.897+0000 7fca4265c740 1 -- 172.21.15.12:0/4246947691 shutdown_connections 2024-09-16T01:02:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.897+0000 7fca4265c740 1 -- 172.21.15.12:0/4246947691 wait complete. 2024-09-16T01:02:34.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.897+0000 7fca4265c740 20 client.15933 trim_cache size 0 max 16384 2024-09-16T01:02:34.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.910+0000 7fca4265c740 1 Processor -- start 2024-09-16T01:02:34.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.910+0000 7fca4265c740 1 -- start start 2024-09-16T01:02:34.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca4265c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d0185d0 0x563f9d014e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca4265c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d019b40 0x563f9d019300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca4265c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d02f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca4265c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fca381aecc0 con 0x563f9d019b40 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca4265c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fca381b0800 con 0x563f9d0185d0 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca4265c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca381af390 con 0x563f9d023370 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca3d81e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d019b40 0x563f9d019300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca3e01f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d0185d0 0x563f9d014e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca3d81e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d019b40 0x563f9d019300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39392/0 (socket says 172.21.15.12:39392) 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca3d81e640 1 -- 172.21.15.12:0/197243956 learned_addr learned my addr 172.21.15.12:0/197243956 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca3e820640 1 --2- 172.21.15.12:0/197243956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d02f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca3e820640 1 -- 172.21.15.12:0/197243956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d0185d0 msgr2=0x563f9d014e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca3e820640 1 --2- 172.21.15.12:0/197243956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d0185d0 0x563f9d014e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca3e820640 1 -- 172.21.15.12:0/197243956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d019b40 msgr2=0x563f9d019300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca3e820640 1 --2- 172.21.15.12:0/197243956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d019b40 0x563f9d019300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.911+0000 7fca3e820640 1 -- 172.21.15.12:0/197243956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9d020940 con 0x563f9d023370 2024-09-16T01:02:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.912+0000 7fca3e820640 1 --2- 172.21.15.12:0/197243956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d02f2b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fca300049d0 tx=0x7fca30012cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc976f6521ca448b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.912+0000 7fca23fff640 1 -- 172.21.15.12:0/197243956 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30004b20 con 0x563f9d023370 2024-09-16T01:02:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.912+0000 7fca23fff640 1 -- 172.21.15.12:0/197243956 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca30004cc0 con 0x563f9d023370 2024-09-16T01:02:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.912+0000 7fca23fff640 1 -- 172.21.15.12:0/197243956 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30005900 con 0x563f9d023370 2024-09-16T01:02:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 -- 172.21.15.12:0/197243956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 msgr2=0x563f9d02f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 --2- 172.21.15.12:0/197243956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d02f2b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fca300049d0 tx=0x7fca30012cb0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 -- 172.21.15.12:0/197243956 shutdown_connections 2024-09-16T01:02:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 --2- 172.21.15.12:0/197243956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d023370 0x563f9d02f2b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 --2- 172.21.15.12:0/197243956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d019b40 0x563f9d019300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 --2- 172.21.15.12:0/197243956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d0185d0 0x563f9d014e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 -- 172.21.15.12:0/197243956 >> 172.21.15.12:0/197243956 conn(0x563f9cfe1310 msgr2=0x563f9d014700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 -- 172.21.15.12:0/197243956 shutdown_connections 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 -- 172.21.15.12:0/197243956 wait complete. 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 -- start start 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.913+0000 7fca4265c740 1 Processor -- start 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca4265c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d0185d0 0x563f9d02b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca4265c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d02bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca4265c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d023370 0x563f9d026bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca4265c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fca381b0130 con 0x563f9d023370 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca4265c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fca381afa60 con 0x563f9d019b40 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca4265c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca381acca0 con 0x563f9d0185d0 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca4265c740 10 client.0 _ll_register_callbacks cb 0x7fca300093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3e820640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d023370 0x563f9d026bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3e01f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d0185d0 0x563f9d02b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3e820640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d023370 0x563f9d026bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39398/0 (socket says 172.21.15.12:39398) 2024-09-16T01:02:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3e820640 1 -- 172.21.15.12:0/2986658045 learned_addr learned my addr 172.21.15.12:0/2986658045 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3d81e640 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d02bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3e820640 1 -- 172.21.15.12:0/2986658045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d0185d0 msgr2=0x563f9d02b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3e820640 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d0185d0 0x563f9d02b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3e820640 1 -- 172.21.15.12:0/2986658045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 msgr2=0x563f9d02bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3e820640 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d02bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3e820640 1 -- 172.21.15.12:0/2986658045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f9d027400 con 0x563f9d023370 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3d81e640 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d02bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca3e820640 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d023370 0x563f9d026bd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fca3001d040 tx=0x7fca30005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7763f6f2ac01e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.914+0000 7fca21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca21ffb640 1 -- 172.21.15.12:0/2986658045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30029020 con 0x563f9d023370 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca21ffb640 1 -- 172.21.15.12:0/2986658045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fca3000ec40 con 0x563f9d023370 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca4265c740 1 -- 172.21.15.12:0/2986658045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca30004cc0 con 0x563f9d023370 2024-09-16T01:02:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca21ffb640 1 -- 172.21.15.12:0/2986658045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fca30034050 con 0x563f9d023370 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca4265c740 10 client.15939 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca4265c740 1 -- 172.21.15.12:0/2986658045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563f9d09d7e0 con 0x563f9d023370 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca21ffb640 1 -- 172.21.15.12:0/2986658045 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca30004cc0 con 0x563f9d023370 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca21ffb640 1 -- 172.21.15.12:0/2986658045 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fca30024b30 con 0x563f9d023370 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca4265c740 10 client.15939 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca4265c740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca4265c740 20 client.15939 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca4265c740 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x563f9d032f70 0x563f9d09ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca4265c740 4 client.15939 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.915+0000 7fca4265c740 1 -- 172.21.15.12:0/2986658045 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f9cf85d70 con 0x563f9d032f70 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.916+0000 7fca3e01f640 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x563f9d032f70 0x563f9d09ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.916+0000 7fca21ffb640 10 client.15939 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.916+0000 7fca3e01f640 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x563f9d032f70 0x563f9d09ff30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=868a2d8c19422404 server_cookie=29722d58683612e5 in_seq=0 out_seq=0 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.916+0000 7fca21ffb640 1 -- 172.21.15.12:0/2986658045 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f9cf85d70 con 0x563f9d032f70 2024-09-16T01:02:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.916+0000 7fca21ffb640 10 client.15939 handle_command_reply: tid=0 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.916+0000 7fca4265c740 1 client.15939 shutdown 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.916+0000 7fca4265c740 1 -- 172.21.15.12:0/2986658045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d023370 msgr2=0x563f9d026bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca4265c740 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d023370 0x563f9d026bd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fca3001d040 tx=0x7fca30005bd0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca4265c740 1 -- 172.21.15.12:0/2986658045 shutdown_connections 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca4265c740 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x563f9d032f70 0x563f9d09ff30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca21ffb640 0 client.15939 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca4265c740 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563f9d023370 0x563f9d026bd0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca4265c740 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563f9d019b40 0x563f9d02bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca4265c740 1 --2- 172.21.15.12:0/2986658045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f9d0185d0 0x563f9d02b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca4265c740 1 -- 172.21.15.12:0/2986658045 >> 172.21.15.12:0/2986658045 conn(0x563f9cfe1310 msgr2=0x563f9d01a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca4265c740 1 -- 172.21.15.12:0/2986658045 shutdown_connections 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca4265c740 1 -- 172.21.15.12:0/2986658045 wait complete. 2024-09-16T01:02:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.917+0000 7fca4265c740 20 client.15939 trim_cache size 0 max 16384 2024-09-16T01:02:34.923 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:02:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 -- 172.21.15.12:0/821449468 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fca240a3240 msgr2=0x7fca240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fca240a3240 0x7fca240a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009230 tx=0x7fca2c0058d0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 -- 172.21.15.12:0/821449468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca381027a0 msgr2=0x7fca38198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca381027a0 0x7fca38198990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca3400e9f0 tx=0x7fca3400eeb0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 -- 172.21.15.12:0/821449468 shutdown_connections 2024-09-16T01:02:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fca240a3240 0x7fca240a5700 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca38106f20 0x7fca3819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca381027a0 0x7fca38198990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 --2- 172.21.15.12:0/821449468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca38101df0 0x7fca38198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 -- 172.21.15.12:0/821449468 >> 172.21.15.12:0/821449468 conn(0x7fca380fd8f0 msgr2=0x7fca380fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 -- 172.21.15.12:0/821449468 shutdown_connections 2024-09-16T01:02:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:34.918+0000 7fca40283640 1 -- 172.21.15.12:0/821449468 wait complete. 2024-09-16T01:02:36.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:36 smithi119 ceph-mon[35049]: pgmap v405: 129 pgs: 129 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 KiB/s wr, 13 op/s 2024-09-16T01:02:36.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:36 smithi012 ceph-mon[31197]: pgmap v405: 129 pgs: 129 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 KiB/s wr, 13 op/s 2024-09-16T01:02:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:36 smithi098 ceph-mon[35346]: pgmap v405: 129 pgs: 129 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 262 KiB/s wr, 13 op/s 2024-09-16T01:02:36.640 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-16T01:02:36.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-16T01:02:36.913 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.447+0000 7f71cc268640 1 -- 172.21.15.12:0/146980148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71c4102ef0 msgr2=0x7f71c410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.447+0000 7f71cc268640 1 --2- 172.21.15.12:0/146980148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71c4102ef0 0x7f71c410da40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009ca0 tx=0x7f71bc02a950 comp rx=0 tx=0).stop 2024-09-16T01:02:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.447+0000 7f71cc268640 1 -- 172.21.15.12:0/146980148 shutdown_connections 2024-09-16T01:02:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.447+0000 7f71cc268640 1 --2- 172.21.15.12:0/146980148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71c4102ef0 0x7f71c410da40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.447+0000 7f71cc268640 1 --2- 172.21.15.12:0/146980148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c4102570 0x7f71c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.447+0000 7f71cc268640 1 --2- 172.21.15.12:0/146980148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c4100e20 0x7f71c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.447+0000 7f71cc268640 1 -- 172.21.15.12:0/146980148 >> 172.21.15.12:0/146980148 conn(0x7f71c40fc7d0 msgr2=0x7f71c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.447+0000 7f71cc268640 1 -- 172.21.15.12:0/146980148 shutdown_connections 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.447+0000 7f71cc268640 1 -- 172.21.15.12:0/146980148 wait complete. 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.448+0000 7f71cc268640 1 Processor -- start 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.448+0000 7f71cc268640 1 -- start start 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.448+0000 7f71cc268640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c4100e20 0x7f71c40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.448+0000 7f71cc268640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c4102570 0x7f71c40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.448+0000 7f71cc268640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71c4102ef0 0x7f71c40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.448+0000 7f71cc268640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f71c4110fd0 con 0x7f71c4102ef0 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.448+0000 7f71cc268640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f71c4110e50 con 0x7f71c4100e20 2024-09-16T01:02:37.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.448+0000 7f71cc268640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f71c4111150 con 0x7f71c4102570 2024-09-16T01:02:37.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71ca805640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71c4102ef0 0x7f71c40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71ca805640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71c4102ef0 0x7f71c40fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55382/0 (socket says 172.21.15.12:55382) 2024-09-16T01:02:37.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71ca805640 1 -- 172.21.15.12:0/2856600682 learned_addr learned my addr 172.21.15.12:0/2856600682 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:37.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71ca004640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c4100e20 0x7f71c40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71c9803640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c4102570 0x7f71c40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71ca805640 1 -- 172.21.15.12:0/2856600682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c4102570 msgr2=0x7f71c40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71ca805640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c4102570 0x7f71c40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71ca805640 1 -- 172.21.15.12:0/2856600682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c4100e20 msgr2=0x7f71c40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71ca805640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c4100e20 0x7f71c40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71ca805640 1 -- 172.21.15.12:0/2856600682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c41a68c0 con 0x7f71c4102ef0 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71ca805640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71c4102ef0 0x7f71c40fd700 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009dc0 tx=0x7f71bc003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71bb7fe640 1 -- 172.21.15.12:0/2856600682 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc034040 con 0x7f71c4102ef0 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71bb7fe640 1 -- 172.21.15.12:0/2856600682 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71bc02fe10 con 0x7f71c4102ef0 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71cc268640 1 -- 172.21.15.12:0/2856600682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c41a6b50 con 0x7f71c4102ef0 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.449+0000 7f71bb7fe640 1 -- 172.21.15.12:0/2856600682 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc004740 con 0x7f71c4102ef0 2024-09-16T01:02:37.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.450+0000 7f71cc268640 1 -- 172.21.15.12:0/2856600682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c41a7030 con 0x7f71c4102ef0 2024-09-16T01:02:37.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.453+0000 7f71bb7fe640 1 -- 172.21.15.12:0/2856600682 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f71bc037020 con 0x7f71c4102ef0 2024-09-16T01:02:37.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.453+0000 7f71ce641740 1 Processor -- start 2024-09-16T01:02:37.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.453+0000 7f71ce641740 1 -- start start 2024-09-16T01:02:37.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.453+0000 7f71ce641740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb8579b60 0x55efb8579f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.453+0000 7f71ce641740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb857a480 0x55efb8584800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.453+0000 7f71ce641740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8587130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.453+0000 7f71ce641740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55efb84df280 con 0x55efb8584d40 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.453+0000 7f71ce641740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55efb8486b10 con 0x55efb8579b60 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.453+0000 7f71ce641740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55efb84db240 con 0x55efb857a480 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71c9803640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8587130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71c9803640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8587130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55390/0 (socket says 172.21.15.12:55390) 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71c9803640 1 -- 172.21.15.12:0/539239043 learned_addr learned my addr 172.21.15.12:0/539239043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71c9803640 1 --2- 172.21.15.12:0/539239043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb8579b60 0x55efb8579f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71bb7fe640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f71b00a3240 0x7f71b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71ca004640 1 --2- 172.21.15.12:0/539239043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb857a480 0x55efb8584800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71ca805640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f71b00a3240 0x7f71b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71c9803640 1 -- 172.21.15.12:0/539239043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb857a480 msgr2=0x55efb8584800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:37.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71c9803640 1 --2- 172.21.15.12:0/539239043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb857a480 0x55efb8584800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71c9803640 1 -- 172.21.15.12:0/539239043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb8579b60 msgr2=0x55efb8579f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:37.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71c9803640 1 --2- 172.21.15.12:0/539239043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb8579b60 0x55efb8579f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71c9803640 1 -- 172.21.15.12:0/539239043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efb84931f0 con 0x55efb8584d40 2024-09-16T01:02:37.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71bb7fe640 1 -- 172.21.15.12:0/2856600682 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f71bc0f0b90 con 0x7f71c4102ef0 2024-09-16T01:02:37.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.454+0000 7f71c9803640 1 --2- 172.21.15.12:0/539239043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8587130 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f71b4011770 tx=0x7f71b400a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57986ea752b1135e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:37.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.455+0000 7f71ca805640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f71b00a3240 0x7f71b00a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f71bc041000 tx=0x7f71bc02ce80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:37.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.455+0000 7f71b8dea640 1 -- 172.21.15.12:0/539239043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4005020 con 0x55efb8584d40 2024-09-16T01:02:37.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.455+0000 7f71b8dea640 1 -- 172.21.15.12:0/539239043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b40047a0 con 0x55efb8584d40 2024-09-16T01:02:37.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.455+0000 7f71b8dea640 1 -- 172.21.15.12:0/539239043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b400fab0 con 0x55efb8584d40 2024-09-16T01:02:37.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.455+0000 7f71ce641740 1 -- 172.21.15.12:0/539239043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 msgr2=0x55efb8587130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:37.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.455+0000 7f71ce641740 1 --2- 172.21.15.12:0/539239043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8587130 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f71b4011770 tx=0x7f71b400a6e0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.456+0000 7f71ce641740 1 -- 172.21.15.12:0/539239043 shutdown_connections 2024-09-16T01:02:37.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.456+0000 7f71ce641740 1 --2- 172.21.15.12:0/539239043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8587130 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.456+0000 7f71ce641740 1 --2- 172.21.15.12:0/539239043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb857a480 0x55efb8584800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.456+0000 7f71ce641740 1 --2- 172.21.15.12:0/539239043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb8579b60 0x55efb8579f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.456+0000 7f71ce641740 1 -- 172.21.15.12:0/539239043 >> 172.21.15.12:0/539239043 conn(0x55efb85760f0 msgr2=0x55efb85764d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.456+0000 7f71ce641740 1 -- 172.21.15.12:0/539239043 shutdown_connections 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.456+0000 7f71ce641740 1 -- 172.21.15.12:0/539239043 wait complete. 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.456+0000 7f71ce641740 1 -- start start 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.456+0000 7f71ce641740 1 Processor -- start 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71ce641740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb8579b60 0x55efb8581c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71ce641740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 0x55efb8582150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71ce641740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8582690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71ce641740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55efb8587910 con 0x55efb8584d40 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71ce641740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55efb8499f10 con 0x55efb857a480 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71ce641740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55efb8587a90 con 0x55efb8579b60 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71ce641740 10 client.0 _ll_register_callbacks cb 0x55efb8462a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71c9803640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8582690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71c9803640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8582690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55396/0 (socket says 172.21.15.12:55396) 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71c9803640 1 -- 172.21.15.12:0/151507238 learned_addr learned my addr 172.21.15.12:0/151507238 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71ca004640 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 0x55efb8582150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71c9803640 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb8579b60 0x55efb8581c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71c9803640 1 -- 172.21.15.12:0/151507238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb8579b60 msgr2=0x55efb8581c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71c9803640 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb8579b60 0x55efb8581c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71c9803640 1 -- 172.21.15.12:0/151507238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 msgr2=0x55efb8582150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71c9803640 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 0x55efb8582150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.457+0000 7f71c9803640 1 -- 172.21.15.12:0/151507238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efb82506a0 con 0x55efb8584d40 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.458+0000 7f71ca004640 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 0x55efb8582150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.458+0000 7f71c9803640 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8582690 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f71b4004de0 tx=0x7f71b401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09b6ae9f4a61c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.458+0000 7f71adffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.458+0000 7f71adffb640 1 -- 172.21.15.12:0/151507238 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4011320 con 0x55efb8584d40 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.458+0000 7f71ce641740 1 -- 172.21.15.12:0/151507238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b40047a0 con 0x55efb8584d40 2024-09-16T01:02:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.458+0000 7f71adffb640 1 -- 172.21.15.12:0/151507238 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f71b4005050 con 0x55efb8584d40 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.458+0000 7f71adffb640 1 -- 172.21.15.12:0/151507238 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f71b4005250 con 0x55efb8584d40 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.458+0000 7f71ce641740 10 client.15951 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.458+0000 7f71ce641740 1 -- 172.21.15.12:0/151507238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55efb8593570 con 0x55efb8584d40 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.458+0000 7f71adffb640 1 -- 172.21.15.12:0/151507238 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b40047a0 con 0x55efb8584d40 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.459+0000 7f71adffb640 1 -- 172.21.15.12:0/151507238 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f71b401e680 con 0x55efb8584d40 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.459+0000 7f71ce641740 10 client.15951 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.459+0000 7f71ce641740 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.459+0000 7f71ce641740 20 client.15951 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.459+0000 7f71ce641740 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55efb85948c0 0x55efb8596cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.459+0000 7f71ce641740 4 client.15951 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.459+0000 7f71ce641740 1 -- 172.21.15.12:0/151507238 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efb84ec7f0 con 0x55efb85948c0 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.459+0000 7f71ca004640 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55efb85948c0 0x55efb8596cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.459+0000 7f71ca004640 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55efb85948c0 0x55efb8596cb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=964ba018a4cb364a server_cookie=f28c2e0dd81a44fa in_seq=0 out_seq=0 2024-09-16T01:02:37.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.459+0000 7f71adffb640 10 client.15951 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:37.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71adffb640 1 -- 172.21.15.12:0/151507238 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55efb84ec7f0 con 0x55efb85948c0 2024-09-16T01:02:37.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71adffb640 10 client.15951 handle_command_reply: tid=0 2024-09-16T01:02:37.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71ce641740 1 client.15951 shutdown 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71ce641740 1 -- 172.21.15.12:0/151507238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 msgr2=0x55efb8582690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71ce641740 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8582690 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f71b4004de0 tx=0x7f71b401a040 comp rx=0 tx=0).stop 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71ce641740 1 -- 172.21.15.12:0/151507238 shutdown_connections 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71ce641740 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55efb85948c0 0x55efb8596cb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71ce641740 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8584d40 0x55efb8582690 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71ce641740 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 0x55efb8582150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71ce641740 1 --2- 172.21.15.12:0/151507238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb8579b60 0x55efb8581c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71ce641740 1 -- 172.21.15.12:0/151507238 >> 172.21.15.12:0/151507238 conn(0x55efb85760f0 msgr2=0x55efb857bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.460+0000 7f71adffb640 0 client.15951 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.461+0000 7f71ce641740 1 -- 172.21.15.12:0/151507238 shutdown_connections 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.461+0000 7f71ce641740 1 -- 172.21.15.12:0/151507238 wait complete. 2024-09-16T01:02:37.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.461+0000 7f71ce641740 20 client.15951 trim_cache size 0 max 16384 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.478+0000 7f71ce641740 1 Processor -- start 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.478+0000 7f71ce641740 1 -- start start 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.478+0000 7f71ce641740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb8580e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.478+0000 7f71ce641740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 0x55efb859c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.478+0000 7f71ce641740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb8584d40 0x55efb859c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.478+0000 7f71ce641740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f71c41b0cd0 con 0x55efb8579b60 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.478+0000 7f71ce641740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f71c41b2810 con 0x55efb857a480 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.478+0000 7f71ce641740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f71c41b13a0 con 0x55efb8584d40 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71c9803640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb8580e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71c9803640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb8580e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55400/0 (socket says 172.21.15.12:55400) 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71c9803640 1 -- 172.21.15.12:0/1874020811 learned_addr learned my addr 172.21.15.12:0/1874020811 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71ca004640 1 --2- 172.21.15.12:0/1874020811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 0x55efb859c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71c9803640 1 -- 172.21.15.12:0/1874020811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb8584d40 msgr2=0x55efb859c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:37.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71c9803640 1 --2- 172.21.15.12:0/1874020811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb8584d40 0x55efb859c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71c9803640 1 -- 172.21.15.12:0/1874020811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 msgr2=0x55efb859c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:37.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71c9803640 1 --2- 172.21.15.12:0/1874020811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 0x55efb859c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71c9803640 1 -- 172.21.15.12:0/1874020811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efb857a2b0 con 0x55efb8579b60 2024-09-16T01:02:37.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71c9803640 1 --2- 172.21.15.12:0/1874020811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb8580e90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f71b4014000 tx=0x7f71b40116a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6943174a42514d9b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71affff640 1 -- 172.21.15.12:0/1874020811 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b400aa30 con 0x55efb8579b60 2024-09-16T01:02:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71affff640 1 -- 172.21.15.12:0/1874020811 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b400a630 con 0x55efb8579b60 2024-09-16T01:02:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.479+0000 7f71affff640 1 -- 172.21.15.12:0/1874020811 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4005650 con 0x55efb8579b60 2024-09-16T01:02:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.480+0000 7f71ce641740 1 -- 172.21.15.12:0/1874020811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 msgr2=0x55efb8580e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.480+0000 7f71ce641740 1 --2- 172.21.15.12:0/1874020811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb8580e90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f71b4014000 tx=0x7f71b40116a0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.480+0000 7f71ce641740 1 -- 172.21.15.12:0/1874020811 shutdown_connections 2024-09-16T01:02:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.480+0000 7f71ce641740 1 --2- 172.21.15.12:0/1874020811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb8584d40 0x55efb859c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.480+0000 7f71ce641740 1 --2- 172.21.15.12:0/1874020811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb857a480 0x55efb859c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.480+0000 7f71ce641740 1 --2- 172.21.15.12:0/1874020811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb8580e90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.480+0000 7f71ce641740 1 -- 172.21.15.12:0/1874020811 >> 172.21.15.12:0/1874020811 conn(0x55efb85760f0 msgr2=0x55efb8583b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.480+0000 7f71ce641740 1 -- 172.21.15.12:0/1874020811 shutdown_connections 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.480+0000 7f71ce641740 1 -- 172.21.15.12:0/1874020811 wait complete. 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71ce641740 1 -- start start 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71ce641740 1 Processor -- start 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71ce641740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb858cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71ce641740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb857a480 0x55efb858d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71ce641740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb8584d40 0x55efb857df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71ce641740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f71c41b2140 con 0x55efb8579b60 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71ce641740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f71c41b1a70 con 0x55efb8584d40 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71ce641740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f71c41aecb0 con 0x55efb857a480 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71ce641740 10 client.0 _ll_register_callbacks cb 0x7f71b400adf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71c9803640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb858cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71c9803640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb858cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55404/0 (socket says 172.21.15.12:55404) 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71c9803640 1 -- 172.21.15.12:0/2399550895 learned_addr learned my addr 172.21.15.12:0/2399550895 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71ca004640 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb857a480 0x55efb858d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.481+0000 7f71c9803640 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb8584d40 0x55efb857df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71c9803640 1 -- 172.21.15.12:0/2399550895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb857a480 msgr2=0x55efb858d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71c9803640 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb857a480 0x55efb858d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71c9803640 1 -- 172.21.15.12:0/2399550895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb8584d40 msgr2=0x55efb857df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71c9803640 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb8584d40 0x55efb857df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71c9803640 1 -- 172.21.15.12:0/2399550895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efb857e460 con 0x55efb8579b60 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71c9803640 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb858cd40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f71b4000c00 tx=0x7f71b4004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df18a8e59b91f9d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71adffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71adffb640 1 -- 172.21.15.12:0/2399550895 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4042060 con 0x55efb8579b60 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71adffb640 1 -- 172.21.15.12:0/2399550895 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f71b4005050 con 0x55efb8579b60 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71ce641740 1 -- 172.21.15.12:0/2399550895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b400a630 con 0x55efb8579b60 2024-09-16T01:02:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71adffb640 1 -- 172.21.15.12:0/2399550895 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f71b4049050 con 0x55efb8579b60 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71ce641740 10 client.15957 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71ce641740 1 -- 172.21.15.12:0/2399550895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55efb85fea30 con 0x55efb8579b60 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.482+0000 7f71adffb640 1 -- 172.21.15.12:0/2399550895 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b400a630 con 0x55efb8579b60 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.483+0000 7f71adffb640 1 -- 172.21.15.12:0/2399550895 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f71b400fc20 con 0x55efb8579b60 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.483+0000 7f71ce641740 10 client.15957 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.483+0000 7f71ce641740 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.483+0000 7f71ce641740 20 client.15957 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.483+0000 7f71ce641740 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55efb85ff040 0x55efb8601460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.483+0000 7f71ce641740 4 client.15957 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.483+0000 7f71ce641740 1 -- 172.21.15.12:0/2399550895 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55efb84e6d00 con 0x55efb85ff040 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.483+0000 7f71ca004640 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55efb85ff040 0x55efb8601460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.483+0000 7f71adffb640 10 client.15957 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.483+0000 7f71ca004640 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55efb85ff040 0x55efb8601460 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40dc65f587e36298 server_cookie=211384458c5471d1 in_seq=0 out_seq=0 2024-09-16T01:02:37.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71adffb640 1 -- 172.21.15.12:0/2399550895 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55efb84e6d00 con 0x55efb85ff040 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71adffb640 10 client.15957 handle_command_reply: tid=0 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 client.15957 shutdown 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 -- 172.21.15.12:0/2399550895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 msgr2=0x55efb858cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb858cd40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f71b4000c00 tx=0x7f71b4004f70 comp rx=0 tx=0).stop 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 -- 172.21.15.12:0/2399550895 shutdown_connections 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55efb85ff040 0x55efb8601460 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb8584d40 0x55efb857df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55efb857a480 0x55efb858d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 --2- 172.21.15.12:0/2399550895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55efb8579b60 0x55efb858cd40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 -- 172.21.15.12:0/2399550895 >> 172.21.15.12:0/2399550895 conn(0x55efb85760f0 msgr2=0x55efb8581bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71adffb640 0 client.15957 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 -- 172.21.15.12:0/2399550895 shutdown_connections 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 1 -- 172.21.15.12:0/2399550895 wait complete. 2024-09-16T01:02:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.485+0000 7f71ce641740 20 client.15957 trim_cache size 0 max 16384 2024-09-16T01:02:37.490 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:02:37.490 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-16T01:02:37.490 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "efc81fa1-ede3-46c8-b246-73708e71371f", 2024-09-16T01:02:37.490 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-16T01:02:37.490 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:02:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.486+0000 7f71cc268640 1 -- 172.21.15.12:0/2856600682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f71b00a3240 msgr2=0x7f71b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.486+0000 7f71cc268640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f71b00a3240 0x7f71b00a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f71bc041000 tx=0x7f71bc02ce80 comp rx=0 tx=0).stop 2024-09-16T01:02:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.486+0000 7f71cc268640 1 -- 172.21.15.12:0/2856600682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71c4102ef0 msgr2=0x7f71c40fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.486+0000 7f71cc268640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71c4102ef0 0x7f71c40fd700 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009dc0 tx=0x7f71bc003d00 comp rx=0 tx=0).stop 2024-09-16T01:02:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.486+0000 7f71cc268640 1 -- 172.21.15.12:0/2856600682 shutdown_connections 2024-09-16T01:02:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.486+0000 7f71cc268640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f71b00a3240 0x7f71b00a5700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.486+0000 7f71cc268640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71c4102ef0 0x7f71c40fd700 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.486+0000 7f71cc268640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c4102570 0x7f71c40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.486+0000 7f71cc268640 1 --2- 172.21.15.12:0/2856600682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c4100e20 0x7f71c40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.486+0000 7f71cc268640 1 -- 172.21.15.12:0/2856600682 >> 172.21.15.12:0/2856600682 conn(0x7f71c40fc7d0 msgr2=0x7f71c406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.487+0000 7f71cc268640 1 -- 172.21.15.12:0/2856600682 shutdown_connections 2024-09-16T01:02:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:37.487+0000 7f71cc268640 1 -- 172.21.15.12:0/2856600682 wait complete. 2024-09-16T01:02:38.288 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:02:38.346 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:38 smithi119 ceph-mon[35049]: pgmap v406: 129 pgs: 129 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 262 KiB/s wr, 11 op/s 2024-09-16T01:02:38.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:38 smithi012 ceph-mon[31197]: pgmap v406: 129 pgs: 129 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 262 KiB/s wr, 11 op/s 2024-09-16T01:02:38.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:38 smithi098 ceph-mon[35346]: pgmap v406: 129 pgs: 129 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 262 KiB/s wr, 11 op/s 2024-09-16T01:02:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:39.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.056+0000 7f3cf83b7640 1 -- 172.21.15.12:0/2772658920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cf0101e10 msgr2=0x7f3cf01021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.056+0000 7f3cf83b7640 1 --2- 172.21.15.12:0/2772658920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cf0101e10 0x7f3cf01021f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009900 tx=0x7f3cec02a410 comp rx=0 tx=0).stop 2024-09-16T01:02:39.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.057+0000 7f3cf83b7640 1 -- 172.21.15.12:0/2772658920 shutdown_connections 2024-09-16T01:02:39.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.057+0000 7f3cf83b7640 1 --2- 172.21.15.12:0/2772658920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf0106f40 0x7f3cf010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.057+0000 7f3cf83b7640 1 --2- 172.21.15.12:0/2772658920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cf01027c0 0x7f3cf0106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.057+0000 7f3cf83b7640 1 --2- 172.21.15.12:0/2772658920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cf0101e10 0x7f3cf01021f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.057+0000 7f3cf83b7640 1 -- 172.21.15.12:0/2772658920 >> 172.21.15.12:0/2772658920 conn(0x7f3cf00fd8d0 msgr2=0x7f3cf00ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.057+0000 7f3cf83b7640 1 -- 172.21.15.12:0/2772658920 shutdown_connections 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.057+0000 7f3cf83b7640 1 -- 172.21.15.12:0/2772658920 wait complete. 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.057+0000 7f3cf83b7640 1 Processor -- start 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.057+0000 7f3cf83b7640 1 -- start start 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf83b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cf0101e10 0x7f3cf01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf83b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf01027c0 0x7f3cf0198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf83b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cf0106f40 0x7f3cf019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf83b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf0112010 con 0x7f3cf0106f40 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf83b7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf0111e90 con 0x7f3cf01027c0 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf83b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf0112190 con 0x7f3cf0101e10 2024-09-16T01:02:39.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf6954640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cf0106f40 0x7f3cf019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf6954640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cf0106f40 0x7f3cf019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55424/0 (socket says 172.21.15.12:55424) 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf6954640 1 -- 172.21.15.12:0/680144345 learned_addr learned my addr 172.21.15.12:0/680144345 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf6153640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cf0101e10 0x7f3cf01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf5952640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf01027c0 0x7f3cf0198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf6954640 1 -- 172.21.15.12:0/680144345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cf0101e10 msgr2=0x7f3cf01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf6954640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cf0101e10 0x7f3cf01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf6954640 1 -- 172.21.15.12:0/680144345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf01027c0 msgr2=0x7f3cf0198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf6954640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf01027c0 0x7f3cf0198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf6954640 1 -- 172.21.15.12:0/680144345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf019d480 con 0x7f3cf0106f40 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.058+0000 7f3cf6954640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cf0106f40 0x7f3cf019cda0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800eaa0 tx=0x7f3ce800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.059+0000 7f3ce77fe640 1 -- 172.21.15.12:0/680144345 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8004d20 con 0x7f3cf0106f40 2024-09-16T01:02:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.059+0000 7f3cf83b7640 1 -- 172.21.15.12:0/680144345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf019d770 con 0x7f3cf0106f40 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.059+0000 7f3ce77fe640 1 -- 172.21.15.12:0/680144345 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ce8005020 con 0x7f3cf0106f40 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.059+0000 7f3ce77fe640 1 -- 172.21.15.12:0/680144345 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80116d0 con 0x7f3cf0106f40 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.059+0000 7f3cf83b7640 1 -- 172.21.15.12:0/680144345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf01a5050 con 0x7f3cf0106f40 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.061+0000 7f3cfa790740 1 Processor -- start 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.061+0000 7f3ce77fe640 1 -- 172.21.15.12:0/680144345 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3ce800caf0 con 0x7f3cf0106f40 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cfa790740 1 -- start start 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f4f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f5a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f5ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cfa790740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b1c6eb52e0 con 0x55b1c6f5a680 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cfa790740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b1c6e5cce0 con 0x55b1c6f4fdc0 2024-09-16T01:02:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cfa790740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b1c6eb12a0 con 0x55b1c6f4f4a0 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cf5952640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f5ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cf5952640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f5ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55432/0 (socket says 172.21.15.12:55432) 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cf5952640 1 -- 172.21.15.12:0/2617735632 learned_addr learned my addr 172.21.15.12:0/2617735632 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cf6153640 1 --2- 172.21.15.12:0/2617735632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f5a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.062+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2617735632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f4f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3cf5952640 1 -- 172.21.15.12:0/2617735632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 msgr2=0x55b1c6f4f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2617735632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f4f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3ce77fe640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3cdc0a3240 0x7f3cdc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3cf5952640 1 -- 172.21.15.12:0/2617735632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 msgr2=0x55b1c6f5a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2617735632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f5a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3cf5952640 1 -- 172.21.15.12:0/2617735632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c6e41440 con 0x55b1c6f5a680 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3cf6153640 1 --2- 172.21.15.12:0/2617735632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3cf6954640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3cdc0a3240 0x7f3cdc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3ce77fe640 1 -- 172.21.15.12:0/680144345 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f3ce80cfe00 con 0x7f3cf0106f40 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2617735632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f5ca70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0006aa0 tx=0x7f3ce0009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422feeeca91f605a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3ce4dea640 1 -- 172.21.15.12:0/2617735632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0015760 con 0x55b1c6f5a680 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3ce4dea640 1 -- 172.21.15.12:0/2617735632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ce001d070 con 0x55b1c6f5a680 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3cf6954640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3cdc0a3240 0x7f3cdc0a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8098520 tx=0x7f3ce801d690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.063+0000 7f3ce4dea640 1 -- 172.21.15.12:0/2617735632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0018b00 con 0x55b1c6f5a680 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.064+0000 7f3cfa790740 1 -- 172.21.15.12:0/2617735632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 msgr2=0x55b1c6f5ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.064+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2617735632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f5ca70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0006aa0 tx=0x7f3ce0009510 comp rx=0 tx=0).stop 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.064+0000 7f3cfa790740 1 -- 172.21.15.12:0/2617735632 shutdown_connections 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.064+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2617735632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f5ca70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.064+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2617735632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.064+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2617735632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f4f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.064+0000 7f3cfa790740 1 -- 172.21.15.12:0/2617735632 >> 172.21.15.12:0/2617735632 conn(0x55b1c6f4ba30 msgr2=0x55b1c6f4be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.064+0000 7f3cfa790740 1 -- 172.21.15.12:0/2617735632 shutdown_connections 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.064+0000 7f3cfa790740 1 -- 172.21.15.12:0/2617735632 wait complete. 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cfa790740 1 -- start start 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cfa790740 1 Processor -- start 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f5a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f57330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f57920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cfa790740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b1c6f5d250 con 0x55b1c6f5a680 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cfa790740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b1c6e70050 con 0x55b1c6f4fdc0 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cfa790740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b1c6f5d3d0 con 0x55b1c6f4f4a0 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cfa790740 10 client.0 _ll_register_callbacks cb 0x55b1c6eb0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cf5952640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f57920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cf5952640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f57920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55444/0 (socket says 172.21.15.12:55444) 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cf5952640 1 -- 172.21.15.12:0/2276986413 learned_addr learned my addr 172.21.15.12:0/2276986413 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f5a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.065+0000 7f3cf6153640 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f57330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cf5952640 1 -- 172.21.15.12:0/2276986413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 msgr2=0x55b1c6f5a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f5a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cf5952640 1 -- 172.21.15.12:0/2276986413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 msgr2=0x55b1c6f57330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f57330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cf5952640 1 -- 172.21.15.12:0/2276986413 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1c6c263c0 con 0x55b1c6f5a680 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f57920 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009b60 tx=0x7f3ce0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fecaf65383da7a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/2276986413 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0027020 con 0x55b1c6f5a680 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/2276986413 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f3ce0015730 con 0x55b1c6f5a680 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cfa790740 1 -- 172.21.15.12:0/2276986413 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ce001d070 con 0x55b1c6f5a680 2024-09-16T01:02:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/2276986413 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3ce0018450 con 0x55b1c6f5a680 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cfa790740 10 client.15969 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.066+0000 7f3cfa790740 1 -- 172.21.15.12:0/2276986413 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b1c6f68cb0 con 0x55b1c6f5a680 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.067+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/2276986413 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ce001d070 con 0x55b1c6f5a680 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.067+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/2276986413 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3ce0023a10 con 0x55b1c6f5a680 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.067+0000 7f3cfa790740 10 client.15969 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.067+0000 7f3cfa790740 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.067+0000 7f3cfa790740 20 client.15969 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.067+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b1c6f6a0b0 0x55b1c6f6c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.067+0000 7f3cfa790740 4 client.15969 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.067+0000 7f3cfa790740 1 -- 172.21.15.12:0/2276986413 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1c6ec2850 con 0x55b1c6f6a0b0 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.067+0000 7f3cf6153640 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b1c6f6a0b0 0x55b1c6f6c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.068+0000 7f3cf6153640 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b1c6f6a0b0 0x55b1c6f6c4a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82e29fbd4d42356e server_cookie=7dce1785539de661 in_seq=0 out_seq=0 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.068+0000 7f3cd9ffb640 10 client.15969 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.068+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/2276986413 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b1c6ec2850 con 0x55b1c6f6a0b0 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.068+0000 7f3cd9ffb640 10 client.15969 handle_command_reply: tid=0 2024-09-16T01:02:39.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.068+0000 7f3cfa790740 1 client.15969 shutdown 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 1 -- 172.21.15.12:0/2276986413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 msgr2=0x55b1c6f57920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f57920 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009b60 tx=0x7f3ce0008040 comp rx=0 tx=0).stop 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 1 -- 172.21.15.12:0/2276986413 shutdown_connections 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b1c6f6a0b0 0x55b1c6f6c4a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f57920 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f57330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cd9ffb640 0 client.15969 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2276986413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f5a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 1 -- 172.21.15.12:0/2276986413 >> 172.21.15.12:0/2276986413 conn(0x55b1c6f4ba30 msgr2=0x55b1c6f51710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 1 -- 172.21.15.12:0/2276986413 shutdown_connections 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 1 -- 172.21.15.12:0/2276986413 wait complete. 2024-09-16T01:02:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.069+0000 7f3cfa790740 20 client.15969 trim_cache size 0 max 16384 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cfa790740 1 Processor -- start 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cfa790740 1 -- start start 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f52090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f6f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cfa790740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01aec30 con 0x55b1c6f5a680 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cfa790740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01b0770 con 0x55b1c6f4f4a0 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cfa790740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01af300 con 0x55b1c6f4fdc0 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cf5952640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cf5952640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55446/0 (socket says 172.21.15.12:55446) 2024-09-16T01:02:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cf5952640 1 -- 172.21.15.12:0/2468927454 learned_addr learned my addr 172.21.15.12:0/2468927454 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2468927454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cf6153640 1 --2- 172.21.15.12:0/2468927454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f6f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cf5952640 1 -- 172.21.15.12:0/2468927454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4fdc0 msgr2=0x55b1c6f6f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2468927454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f6f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cf5952640 1 -- 172.21.15.12:0/2468927454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4f4a0 msgr2=0x55b1c6f52090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2468927454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f52090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.087+0000 7f3cf5952640 1 -- 172.21.15.12:0/2468927454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c6f5d2d0 con 0x55b1c6f5a680 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.088+0000 7f3cf5952640 1 --2- 172.21.15.12:0/2468927454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6fa00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00163f0 tx=0x7f3ce00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d13004e80ac359 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.088+0000 7f3cdbfff640 1 -- 172.21.15.12:0/2468927454 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce003e070 con 0x55b1c6f5a680 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.088+0000 7f3cdbfff640 1 -- 172.21.15.12:0/2468927454 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ce001d070 con 0x55b1c6f5a680 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.088+0000 7f3cdbfff640 1 -- 172.21.15.12:0/2468927454 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0027040 con 0x55b1c6f5a680 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 -- 172.21.15.12:0/2468927454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 msgr2=0x55b1c6f6fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2468927454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6fa00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00163f0 tx=0x7f3ce00047d0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 -- 172.21.15.12:0/2468927454 shutdown_connections 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2468927454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6fa00 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2468927454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f6f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 --2- 172.21.15.12:0/2468927454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f52090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 -- 172.21.15.12:0/2468927454 >> 172.21.15.12:0/2468927454 conn(0x55b1c6f4ba30 msgr2=0x55b1c6f593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 -- 172.21.15.12:0/2468927454 shutdown_connections 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 -- 172.21.15.12:0/2468927454 wait complete. 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 -- start start 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.089+0000 7f3cfa790740 1 Processor -- start 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f6f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f6cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cfa790740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cfa790740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01b00a0 con 0x55b1c6f5a680 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cfa790740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01af9d0 con 0x55b1c6f4fdc0 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cfa790740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01acc10 con 0x55b1c6f4f4a0 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cfa790740 10 client.0 _ll_register_callbacks cb 0x7f3cec009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf5952640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf5952640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55448/0 (socket says 172.21.15.12:55448) 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf5952640 1 -- 172.21.15.12:0/1765663514 learned_addr learned my addr 172.21.15.12:0/1765663514 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf5952640 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f6f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf6153640 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f6cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf5952640 1 -- 172.21.15.12:0/1765663514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 msgr2=0x55b1c6f6f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf5952640 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f6f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf5952640 1 -- 172.21.15.12:0/1765663514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 msgr2=0x55b1c6f6cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf5952640 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f6cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf5952640 1 -- 172.21.15.12:0/1765663514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1c6f6d840 con 0x55b1c6f5a680 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf6153640 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f6cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cf5952640 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6d280 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3ce003c040 tx=0x7f3ce0023b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebf9c3010516fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/1765663514 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce003e040 con 0x55b1c6f5a680 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/1765663514 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f3ce0015a50 con 0x55b1c6f5a680 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.090+0000 7f3cfa790740 1 -- 172.21.15.12:0/1765663514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ce001d070 con 0x55b1c6f5a680 2024-09-16T01:02:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/1765663514 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3ce0027040 con 0x55b1c6f5a680 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cfa790740 10 client.15975 fetch_fsmap learned FSMap version 29 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cfa790740 1 -- 172.21.15.12:0/1765663514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b1c6fd47d0 con 0x55b1c6f5a680 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/1765663514 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ce001d070 con 0x55b1c6f5a680 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/1765663514 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3ce0016bd0 con 0x55b1c6f5a680 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cfa790740 10 client.15975 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cfa790740 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cfa790740 20 client.15975 populate_metadata read hostname 'smithi012' 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cfa790740 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b1c6fd4e80 0x55b1c6fd7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cfa790740 4 client.15975 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.091+0000 7f3cfa790740 1 -- 172.21.15.12:0/1765663514 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b1c6ebcd60 con 0x55b1c6fd4e80 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cf6153640 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b1c6fd4e80 0x55b1c6fd7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cf6153640 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b1c6fd4e80 0x55b1c6fd7270 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2db76808116c74c server_cookie=8cc86a72406976e7 in_seq=0 out_seq=0 2024-09-16T01:02:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cd9ffb640 10 client.15975 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cd9ffb640 1 -- 172.21.15.12:0/1765663514 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b1c6ebcd60 con 0x55b1c6fd4e80 2024-09-16T01:02:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cd9ffb640 10 client.15975 handle_command_reply: tid=0 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cfa790740 1 client.15975 shutdown 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cfa790740 1 -- 172.21.15.12:0/1765663514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 msgr2=0x55b1c6f6d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cfa790740 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6d280 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3ce003c040 tx=0x7f3ce0023b90 comp rx=0 tx=0).stop 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cfa790740 1 -- 172.21.15.12:0/1765663514 shutdown_connections 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cfa790740 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b1c6fd4e80 0x55b1c6fd7270 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cfa790740 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1c6f5a680 0x55b1c6f6d280 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cfa790740 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1c6f4fdc0 0x55b1c6f6cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cd9ffb640 0 client.15975 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cfa790740 1 --2- 172.21.15.12:0/1765663514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1c6f4f4a0 0x55b1c6f6f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.092+0000 7f3cfa790740 1 -- 172.21.15.12:0/1765663514 >> 172.21.15.12:0/1765663514 conn(0x55b1c6f4ba30 msgr2=0x55b1c6f593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.093+0000 7f3cfa790740 1 -- 172.21.15.12:0/1765663514 shutdown_connections 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.093+0000 7f3cfa790740 1 -- 172.21.15.12:0/1765663514 wait complete. 2024-09-16T01:02:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.093+0000 7f3cfa790740 20 client.15975 trim_cache size 0 max 16384 2024-09-16T01:02:39.099 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:02:39.099 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-16T01:02:39.099 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-16T01:02:39.099 INFO:teuthology.orchestra.run.smithi012.stdout: "efc81fa1-ede3-46c8-b246-73708e71371f": { 2024-09-16T01:02:39.099 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-16T01:02:39.099 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "efc81fa1-ede3-46c8-b246-73708e71371f", 2024-09-16T01:02:39.099 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-16T01:02:39.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:02:39.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:02:39.099 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:02:39.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.093+0000 7f3cf83b7640 1 -- 172.21.15.12:0/680144345 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3cdc0a3240 msgr2=0x7f3cdc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.093+0000 7f3cf83b7640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3cdc0a3240 0x7f3cdc0a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8098520 tx=0x7f3ce801d690 comp rx=0 tx=0).stop 2024-09-16T01:02:39.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.093+0000 7f3cf83b7640 1 -- 172.21.15.12:0/680144345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cf0106f40 msgr2=0x7f3cf019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.093+0000 7f3cf83b7640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cf0106f40 0x7f3cf019cda0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800eaa0 tx=0x7f3ce800eea0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.094+0000 7f3cf83b7640 1 -- 172.21.15.12:0/680144345 shutdown_connections 2024-09-16T01:02:39.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.094+0000 7f3cf83b7640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f3cdc0a3240 0x7f3cdc0a5700 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.094+0000 7f3cf83b7640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cf0106f40 0x7f3cf019cda0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.094+0000 7f3cf83b7640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf01027c0 0x7f3cf0198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.094+0000 7f3cf83b7640 1 --2- 172.21.15.12:0/680144345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cf0101e10 0x7f3cf01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.094+0000 7f3cf83b7640 1 -- 172.21.15.12:0/680144345 >> 172.21.15.12:0/680144345 conn(0x7f3cf00fd8d0 msgr2=0x7f3cf00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.094+0000 7f3cf83b7640 1 -- 172.21.15.12:0/680144345 shutdown_connections 2024-09-16T01:02:39.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:02:39.094+0000 7f3cf83b7640 1 -- 172.21.15.12:0/680144345 wait complete. 2024-09-16T01:02:39.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:39 smithi012 ceph-mon[31197]: scrub queued for path: / 2024-09-16T01:02:39.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:39 smithi012 ceph-mon[31197]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:39.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:39 smithi012 ceph-mon[31197]: scrub summary: active paths [/] 2024-09-16T01:02:39.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:39 smithi012 ceph-mon[31197]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:39 smithi098 ceph-mon[35346]: scrub queued for path: / 2024-09-16T01:02:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:39 smithi098 ceph-mon[35346]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:39 smithi098 ceph-mon[35346]: scrub summary: active paths [/] 2024-09-16T01:02:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:39 smithi098 ceph-mon[35346]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:39.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:39 smithi119 ceph-mon[35049]: scrub queued for path: / 2024-09-16T01:02:39.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:39 smithi119 ceph-mon[35049]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:39.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:39 smithi119 ceph-mon[35049]: scrub summary: active paths [/] 2024-09-16T01:02:39.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:39 smithi119 ceph-mon[35049]: scrub summary: idle+waiting paths [/] 2024-09-16T01:02:39.865 INFO:tasks.cephfs.filesystem:scrub status for tag:efc81fa1-ede3-46c8-b246-73708e71371f - {'path': '/', 'tag': 'efc81fa1-ede3-46c8-b246-73708e71371f', 'options': 'recursive,force'} 2024-09-16T01:02:40.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:40 smithi012 ceph-mon[31197]: pgmap v407: 129 pgs: 129 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 603 KiB/s wr, 12 op/s 2024-09-16T01:02:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:40 smithi098 ceph-mon[35346]: pgmap v407: 129 pgs: 129 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 603 KiB/s wr, 12 op/s 2024-09-16T01:02:40.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:40 smithi119 ceph-mon[35049]: pgmap v407: 129 pgs: 129 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 603 KiB/s wr, 12 op/s 2024-09-16T01:02:41.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:41.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:41.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:41.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:41.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:42.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:42 smithi012 ceph-mon[31197]: pgmap v408: 129 pgs: 129 active+clean; 1.7 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 606 KiB/s wr, 14 op/s 2024-09-16T01:02:42.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:42.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:42.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:42.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:42 smithi012 ceph-mon[31197]: scrub summary: idle 2024-09-16T01:02:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:42 smithi098 ceph-mon[35346]: pgmap v408: 129 pgs: 129 active+clean; 1.7 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 606 KiB/s wr, 14 op/s 2024-09-16T01:02:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:42 smithi098 ceph-mon[35346]: scrub summary: idle 2024-09-16T01:02:42.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:42 smithi119 ceph-mon[35049]: pgmap v408: 129 pgs: 129 active+clean; 1.7 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 606 KiB/s wr, 14 op/s 2024-09-16T01:02:42.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:42.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:42.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:02:42.597 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:42 smithi119 ceph-mon[35049]: scrub summary: idle 2024-09-16T01:02:44.356 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:44 smithi012 ceph-mon[31197]: pgmap v409: 129 pgs: 129 active+clean; 1.7 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2024-09-16T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:44 smithi098 ceph-mon[35346]: pgmap v409: 129 pgs: 129 active+clean; 1.7 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2024-09-16T01:02:44.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:44 smithi119 ceph-mon[35049]: pgmap v409: 129 pgs: 129 active+clean; 1.7 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2024-09-16T01:02:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:46 smithi098 ceph-mon[35346]: pgmap v410: 129 pgs: 129 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 780 KiB/s wr, 15 op/s 2024-09-16T01:02:46.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:46 smithi119 ceph-mon[35049]: pgmap v410: 129 pgs: 129 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 780 KiB/s wr, 15 op/s 2024-09-16T01:02:46.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:46 smithi012 ceph-mon[31197]: pgmap v410: 129 pgs: 129 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 780 KiB/s wr, 15 op/s 2024-09-16T01:02:48.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:48 smithi098 ceph-mon[35346]: pgmap v411: 129 pgs: 129 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 774 KiB/s wr, 11 op/s 2024-09-16T01:02:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:48 smithi119 ceph-mon[35049]: pgmap v411: 129 pgs: 129 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 774 KiB/s wr, 11 op/s 2024-09-16T01:02:49.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:48 smithi012 ceph-mon[31197]: pgmap v411: 129 pgs: 129 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 774 KiB/s wr, 11 op/s 2024-09-16T01:02:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:50 smithi098 ceph-mon[35346]: pgmap v412: 129 pgs: 129 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-16T01:02:51.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:50 smithi119 ceph-mon[35049]: pgmap v412: 129 pgs: 129 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-16T01:02:51.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:50 smithi012 ceph-mon[31197]: pgmap v412: 129 pgs: 129 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-16T01:02:52.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:52 smithi098 ceph-mon[35346]: pgmap v413: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-16T01:02:53.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:52 smithi119 ceph-mon[35049]: pgmap v413: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-16T01:02:53.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:52 smithi012 ceph-mon[31197]: pgmap v413: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-16T01:02:54.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:54 smithi098 ceph-mon[35346]: pgmap v414: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2024-09-16T01:02:55.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:54 smithi119 ceph-mon[35049]: pgmap v414: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2024-09-16T01:02:55.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:54 smithi012 ceph-mon[31197]: pgmap v414: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2024-09-16T01:02:56.898 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:56 smithi119 ceph-mon[35049]: pgmap v415: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-16T01:02:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:56 smithi098 ceph-mon[35346]: pgmap v415: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-16T01:02:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:56 smithi012 ceph-mon[31197]: pgmap v415: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-16T01:02:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:02:58 smithi098 ceph-mon[35346]: pgmap v416: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-16T01:02:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:02:58 smithi119 ceph-mon[35049]: pgmap v416: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-16T01:02:59.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:02:58 smithi012 ceph-mon[31197]: pgmap v416: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 859 KiB/s wr, 11 op/s 2024-09-16T01:03:00.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:00 smithi098 ceph-mon[35346]: pgmap v417: 129 pgs: 129 active+clean; 1.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-16T01:03:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:00 smithi119 ceph-mon[35049]: pgmap v417: 129 pgs: 129 active+clean; 1.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-16T01:03:01.110 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:00 smithi012 ceph-mon[31197]: pgmap v417: 129 pgs: 129 active+clean; 1.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-16T01:03:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:02 smithi098 ceph-mon[35346]: pgmap v418: 129 pgs: 129 active+clean; 1.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 863 KiB/s wr, 14 op/s 2024-09-16T01:03:03.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:02 smithi119 ceph-mon[35049]: pgmap v418: 129 pgs: 129 active+clean; 1.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 863 KiB/s wr, 14 op/s 2024-09-16T01:03:03.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:02 smithi012 ceph-mon[31197]: pgmap v418: 129 pgs: 129 active+clean; 1.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 863 KiB/s wr, 14 op/s 2024-09-16T01:03:04.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:04 smithi098 ceph-mon[35346]: pgmap v419: 129 pgs: 129 active+clean; 118 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 15 op/s 2024-09-16T01:03:05.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:04 smithi119 ceph-mon[35049]: pgmap v419: 129 pgs: 129 active+clean; 118 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 15 op/s 2024-09-16T01:03:05.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:04 smithi012 ceph-mon[31197]: pgmap v419: 129 pgs: 129 active+clean; 118 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 15 op/s 2024-09-16T01:03:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:06 smithi098 ceph-mon[35346]: pgmap v420: 129 pgs: 129 active+clean; 174 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 18 op/s 2024-09-16T01:03:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:06 smithi119 ceph-mon[35049]: pgmap v420: 129 pgs: 129 active+clean; 174 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 18 op/s 2024-09-16T01:03:07.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:06 smithi012 ceph-mon[31197]: pgmap v420: 129 pgs: 129 active+clean; 174 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 18 op/s 2024-09-16T01:03:08.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:08 smithi098 ceph-mon[35346]: pgmap v421: 129 pgs: 129 active+clean; 210 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 17 op/s 2024-09-16T01:03:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:08 smithi119 ceph-mon[35049]: pgmap v421: 129 pgs: 129 active+clean; 210 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 17 op/s 2024-09-16T01:03:09.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:08 smithi012 ceph-mon[31197]: pgmap v421: 129 pgs: 129 active+clean; 210 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 17 op/s 2024-09-16T01:03:09.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:03:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:10.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.633+0000 7faa83ef9640 1 -- 172.21.15.12:0/839357861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c102d90 msgr2=0x7faa7c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:10.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.633+0000 7faa83ef9640 1 --2- 172.21.15.12:0/839357861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c102d90 0x7faa7c103170 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7faa78009930 tx=0x7faa7802a420 comp rx=0 tx=0).stop 2024-09-16T01:03:10.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.633+0000 7faa83ef9640 1 -- 172.21.15.12:0/839357861 shutdown_connections 2024-09-16T01:03:10.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.633+0000 7faa83ef9640 1 --2- 172.21.15.12:0/839357861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa7c108290 0x7faa7c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.633+0000 7faa83ef9640 1 --2- 172.21.15.12:0/839357861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c103740 0x7faa7c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.633+0000 7faa83ef9640 1 --2- 172.21.15.12:0/839357861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c102d90 0x7faa7c103170 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.633+0000 7faa83ef9640 1 -- 172.21.15.12:0/839357861 >> 172.21.15.12:0/839357861 conn(0x7faa7c0fc7d0 msgr2=0x7faa7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.634+0000 7faa83ef9640 1 -- 172.21.15.12:0/839357861 shutdown_connections 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.634+0000 7faa83ef9640 1 -- 172.21.15.12:0/839357861 wait complete. 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.634+0000 7faa83ef9640 1 Processor -- start 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.634+0000 7faa83ef9640 1 -- start start 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.634+0000 7faa83ef9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c102d90 0x7faa7c1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.634+0000 7faa83ef9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c103740 0x7faa7c100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa83ef9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa7c108290 0x7faa7c101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa83ef9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c1120d0 con 0x7faa7c102d90 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa83ef9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c111f50 con 0x7faa7c108290 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa83ef9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c112250 con 0x7faa7c103740 2024-09-16T01:03:10.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa81c95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c102d90 0x7faa7c1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa81c95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c102d90 0x7faa7c1009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47844/0 (socket says 172.21.15.12:47844) 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa81c95640 1 -- 172.21.15.12:0/2469460643 learned_addr learned my addr 172.21.15.12:0/2469460643 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa81494640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c103740 0x7faa7c100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa82496640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa7c108290 0x7faa7c101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa81c95640 1 -- 172.21.15.12:0/2469460643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c103740 msgr2=0x7faa7c100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa81c95640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c103740 0x7faa7c100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa81c95640 1 -- 172.21.15.12:0/2469460643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa7c108290 msgr2=0x7faa7c101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa81c95640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa7c108290 0x7faa7c101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa81c95640 1 -- 172.21.15.12:0/2469460643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7c1a6ab0 con 0x7faa7c102d90 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa81c95640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c102d90 0x7faa7c1009f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7faa7802a940 tx=0x7faa78003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.635+0000 7faa72ffd640 1 -- 172.21.15.12:0/2469460643 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7803f070 con 0x7faa7c102d90 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.636+0000 7faa72ffd640 1 -- 172.21.15.12:0/2469460643 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa78031c90 con 0x7faa7c102d90 2024-09-16T01:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.636+0000 7faa83ef9640 1 -- 172.21.15.12:0/2469460643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7c1a6d40 con 0x7faa7c102d90 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.636+0000 7faa72ffd640 1 -- 172.21.15.12:0/2469460643 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78035030 con 0x7faa7c102d90 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.636+0000 7faa83ef9640 1 -- 172.21.15.12:0/2469460643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa7c1a71c0 con 0x7faa7c102d90 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.638+0000 7faa72ffd640 1 -- 172.21.15.12:0/2469460643 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faa78042070 con 0x7faa7c102d90 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.638+0000 7faa862d2740 1 Processor -- start 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa862d2740 1 -- start start 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa862d2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686307880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa862d2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e686312140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa862d2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686312680 0x55e686314a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa862d2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e68626d2e0 con 0x55e6863074a0 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa862d2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e686214ce0 con 0x55e686307dc0 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa862d2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e6862692a0 con 0x55e686312680 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa82496640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686307880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa82496640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686307880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47856/0 (socket says 172.21.15.12:47856) 2024-09-16T01:03:10.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa82496640 1 -- 172.21.15.12:0/2481211341 learned_addr learned my addr 172.21.15.12:0/2481211341 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa72ffd640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faa680a3240 0x7faa680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa81494640 1 --2- 172.21.15.12:0/2481211341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686312680 0x55e686314a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa81c95640 1 --2- 172.21.15.12:0/2481211341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e686312140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.639+0000 7faa72ffd640 1 -- 172.21.15.12:0/2469460643 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7faa780efff0 con 0x7faa7c102d90 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa82496640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faa680a3240 0x7faa680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa82496640 1 -- 172.21.15.12:0/2481211341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686312680 msgr2=0x55e686314a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa82496640 1 --2- 172.21.15.12:0/2481211341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686312680 0x55e686314a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa82496640 1 -- 172.21.15.12:0/2481211341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 msgr2=0x55e686312140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa82496640 1 --2- 172.21.15.12:0/2481211341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e686312140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa82496640 1 -- 172.21.15.12:0/2481211341 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6861f9440 con 0x55e6863074a0 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa82496640 1 --2- 172.21.15.12:0/2481211341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686307880 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7faa74005f40 tx=0x7faa74012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424f757dd4187964 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa67fff640 1 -- 172.21.15.12:0/2481211341 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa740124b0 con 0x55e6863074a0 2024-09-16T01:03:10.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa67fff640 1 -- 172.21.15.12:0/2481211341 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa74022070 con 0x55e6863074a0 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa67fff640 1 -- 172.21.15.12:0/2481211341 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7401ce40 con 0x55e6863074a0 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.640+0000 7faa82496640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faa680a3240 0x7faa680a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faa74021000 tx=0x7faa7401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.641+0000 7faa862d2740 1 -- 172.21.15.12:0/2481211341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 msgr2=0x55e686307880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.641+0000 7faa862d2740 1 --2- 172.21.15.12:0/2481211341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686307880 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7faa74005f40 tx=0x7faa74012f00 comp rx=0 tx=0).stop 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.641+0000 7faa862d2740 1 -- 172.21.15.12:0/2481211341 shutdown_connections 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.641+0000 7faa862d2740 1 --2- 172.21.15.12:0/2481211341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686312680 0x55e686314a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.641+0000 7faa862d2740 1 --2- 172.21.15.12:0/2481211341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e686312140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.641+0000 7faa862d2740 1 --2- 172.21.15.12:0/2481211341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686307880 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.641+0000 7faa862d2740 1 -- 172.21.15.12:0/2481211341 >> 172.21.15.12:0/2481211341 conn(0x55e686303a30 msgr2=0x55e686303e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.641+0000 7faa862d2740 1 -- 172.21.15.12:0/2481211341 shutdown_connections 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.641+0000 7faa862d2740 1 -- 172.21.15.12:0/2481211341 wait complete. 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.641+0000 7faa862d2740 1 -- start start 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa862d2740 1 Processor -- start 2024-09-16T01:03:10.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa862d2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686311f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa862d2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e68630f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa862d2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686312680 0x55e68630f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa862d2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e686315250 con 0x55e6863074a0 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa862d2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e686228050 con 0x55e686307dc0 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa862d2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e6863153d0 con 0x55e686312680 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa862d2740 10 client.0 _ll_register_callbacks cb 0x55e686268160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa81c95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686311f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa81c95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686311f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47866/0 (socket says 172.21.15.12:47866) 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa81c95640 1 -- 172.21.15.12:0/941922657 learned_addr learned my addr 172.21.15.12:0/941922657 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.642+0000 7faa81494640 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e68630f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.643+0000 7faa82496640 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686312680 0x55e68630f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.643+0000 7faa81c95640 1 -- 172.21.15.12:0/941922657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686312680 msgr2=0x55e68630f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:10.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.643+0000 7faa81c95640 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686312680 0x55e68630f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.643+0000 7faa81c95640 1 -- 172.21.15.12:0/941922657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 msgr2=0x55e68630f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.643+0000 7faa81c95640 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e68630f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.643+0000 7faa81c95640 1 -- 172.21.15.12:0/941922657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e685fde3c0 con 0x55e6863074a0 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.643+0000 7faa81494640 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e68630f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.643+0000 7faa81c95640 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686311f20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7faa78004650 tx=0x7faa78009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a773622075324f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.643+0000 7faa657fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.645+0000 7faa657fa640 1 -- 172.21.15.12:0/941922657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78049040 con 0x55e6863074a0 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa657fa640 1 -- 172.21.15.12:0/941922657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7faa7803b5f0 con 0x55e6863074a0 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa862d2740 1 -- 172.21.15.12:0/941922657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa74022070 con 0x55e6863074a0 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa657fa640 1 -- 172.21.15.12:0/941922657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa780bc320 con 0x55e6863074a0 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa862d2740 10 client.15987 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa862d2740 1 -- 172.21.15.12:0/941922657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e686320b70 con 0x55e6863074a0 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa657fa640 1 -- 172.21.15.12:0/941922657 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa74022070 con 0x55e6863074a0 2024-09-16T01:03:10.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa657fa640 1 -- 172.21.15.12:0/941922657 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faa7804c060 con 0x55e6863074a0 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa862d2740 10 client.15987 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa862d2740 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa862d2740 20 client.15987 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa862d2740 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55e6863220b0 0x55e686324520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa862d2740 4 client.15987 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.646+0000 7faa862d2740 1 -- 172.21.15.12:0/941922657 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e68627a850 con 0x55e6863220b0 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.647+0000 7faa81494640 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55e6863220b0 0x55e686324520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.647+0000 7faa81494640 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55e6863220b0 0x55e686324520 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c49bd5d4937a223 server_cookie=51c80413fde8c444 in_seq=0 out_seq=0 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.647+0000 7faa657fa640 10 client.15987 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa657fa640 1 -- 172.21.15.12:0/941922657 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e68627a850 con 0x55e6863220b0 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa657fa640 10 client.15987 handle_command_reply: tid=0 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 client.15987 shutdown 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 -- 172.21.15.12:0/941922657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 msgr2=0x55e686311f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:10.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686311f20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7faa78004650 tx=0x7faa78009260 comp rx=0 tx=0).stop 2024-09-16T01:03:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 -- 172.21.15.12:0/941922657 shutdown_connections 2024-09-16T01:03:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55e6863220b0 0x55e686324520 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686312680 0x55e68630f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e68630f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 --2- 172.21.15.12:0/941922657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686311f20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa657fa640 0 client.15987 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 -- 172.21.15.12:0/941922657 >> 172.21.15.12:0/941922657 conn(0x55e686303a30 msgr2=0x55e686302b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 -- 172.21.15.12:0/941922657 shutdown_connections 2024-09-16T01:03:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 1 -- 172.21.15.12:0/941922657 wait complete. 2024-09-16T01:03:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.648+0000 7faa862d2740 20 client.15987 trim_cache size 0 max 16384 2024-09-16T01:03:10.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa862d2740 1 Processor -- start 2024-09-16T01:03:10.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa862d2740 1 -- start start 2024-09-16T01:03:10.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa862d2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686303a30 0x55e686302a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa862d2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686329e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa862d2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e68632a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa862d2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c1b0e20 con 0x55e6863074a0 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa862d2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c1b2960 con 0x55e686307dc0 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa862d2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c1b14f0 con 0x55e686303a30 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa81494640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686329e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa81494640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686329e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47880/0 (socket says 172.21.15.12:47880) 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa81494640 1 -- 172.21.15.12:0/4133560008 learned_addr learned my addr 172.21.15.12:0/4133560008 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa82496640 1 --2- 172.21.15.12:0/4133560008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e68632a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa81c95640 1 --2- 172.21.15.12:0/4133560008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686303a30 0x55e686302a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa81494640 1 -- 172.21.15.12:0/4133560008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686303a30 msgr2=0x55e686302a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa81494640 1 --2- 172.21.15.12:0/4133560008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686303a30 0x55e686302a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa81494640 1 -- 172.21.15.12:0/4133560008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 msgr2=0x55e68632a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.666+0000 7faa81494640 1 --2- 172.21.15.12:0/4133560008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e68632a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.667+0000 7faa81494640 1 -- 172.21.15.12:0/4133560008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6863072d0 con 0x55e6863074a0 2024-09-16T01:03:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.667+0000 7faa82496640 1 --2- 172.21.15.12:0/4133560008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e68632a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.667+0000 7faa81494640 1 --2- 172.21.15.12:0/4133560008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686329e00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7faa7c102480 tx=0x7faa6c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bf59eb8c54db06 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.667+0000 7faa677fe640 1 -- 172.21.15.12:0/4133560008 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c005020 con 0x55e6863074a0 2024-09-16T01:03:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.667+0000 7faa677fe640 1 -- 172.21.15.12:0/4133560008 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa6c0047a0 con 0x55e6863074a0 2024-09-16T01:03:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.667+0000 7faa677fe640 1 -- 172.21.15.12:0/4133560008 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0116a0 con 0x55e6863074a0 2024-09-16T01:03:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 -- 172.21.15.12:0/4133560008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 msgr2=0x55e686329e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 --2- 172.21.15.12:0/4133560008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686329e00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7faa7c102480 tx=0x7faa6c00b390 comp rx=0 tx=0).stop 2024-09-16T01:03:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 -- 172.21.15.12:0/4133560008 shutdown_connections 2024-09-16T01:03:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 --2- 172.21.15.12:0/4133560008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686307dc0 0x55e68632a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 --2- 172.21.15.12:0/4133560008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6863074a0 0x55e686329e00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 --2- 172.21.15.12:0/4133560008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e686303a30 0x55e686302a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 -- 172.21.15.12:0/4133560008 >> 172.21.15.12:0/4133560008 conn(0x55e68630f870 msgr2=0x55e686302370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 -- 172.21.15.12:0/4133560008 shutdown_connections 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 -- 172.21.15.12:0/4133560008 wait complete. 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 -- start start 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.668+0000 7faa862d2740 1 Processor -- start 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa862d2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686303a30 0x55e68631af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa862d2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6863074a0 0x55e686318270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa862d2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e686307dc0 0x55e686318a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa862d2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c1b2290 con 0x55e686307dc0 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa862d2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c1b1bc0 con 0x55e686303a30 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa862d2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c1aee00 con 0x55e6863074a0 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa862d2740 10 client.0 _ll_register_callbacks cb 0x7faa78031ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa82496640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e686307dc0 0x55e686318a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa82496640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e686307dc0 0x55e686318a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47894/0 (socket says 172.21.15.12:47894) 2024-09-16T01:03:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa82496640 1 -- 172.21.15.12:0/3414671358 learned_addr learned my addr 172.21.15.12:0/3414671358 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa81494640 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6863074a0 0x55e686318270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa81c95640 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686303a30 0x55e68631af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa82496640 1 -- 172.21.15.12:0/3414671358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6863074a0 msgr2=0x55e686318270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa82496640 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6863074a0 0x55e686318270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa82496640 1 -- 172.21.15.12:0/3414671358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686303a30 msgr2=0x55e68631af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa82496640 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686303a30 0x55e68631af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa82496640 1 -- 172.21.15.12:0/3414671358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e68638bde0 con 0x55e686307dc0 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa81c95640 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686303a30 0x55e68631af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.669+0000 7faa81494640 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6863074a0 0x55e686318270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.670+0000 7faa82496640 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e686307dc0 0x55e686318a00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faa74012fd0 tx=0x7faa74009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b22bd5c7ef265e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.670+0000 7faa657fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.670+0000 7faa657fa640 1 -- 172.21.15.12:0/3414671358 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74035020 con 0x55e686307dc0 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.670+0000 7faa657fa640 1 -- 172.21.15.12:0/3414671358 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7faa7401caf0 con 0x55e686307dc0 2024-09-16T01:03:10.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.670+0000 7faa862d2740 1 -- 172.21.15.12:0/3414671358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa6c0047a0 con 0x55e686307dc0 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.670+0000 7faa657fa640 1 -- 172.21.15.12:0/3414671358 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa74040050 con 0x55e686307dc0 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.670+0000 7faa862d2740 10 client.15993 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.670+0000 7faa862d2740 1 -- 172.21.15.12:0/3414671358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e68638cfb0 con 0x55e686307dc0 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.670+0000 7faa657fa640 1 -- 172.21.15.12:0/3414671358 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa6c0047a0 con 0x55e686307dc0 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.671+0000 7faa657fa640 1 -- 172.21.15.12:0/3414671358 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faa74026530 con 0x55e686307dc0 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.671+0000 7faa862d2740 10 client.15993 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.671+0000 7faa862d2740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.671+0000 7faa862d2740 20 client.15993 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.671+0000 7faa862d2740 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55e686312680 0x55e68638f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.671+0000 7faa862d2740 4 client.15993 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.671+0000 7faa862d2740 1 -- 172.21.15.12:0/3414671358 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e686274d60 con 0x55e686312680 2024-09-16T01:03:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.671+0000 7faa81c95640 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55e686312680 0x55e68638f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.671+0000 7faa81c95640 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55e686312680 0x55e68638f590 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa83f5f4d108d1a server_cookie=9ecf9c1724e593bd in_seq=0 out_seq=0 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.671+0000 7faa657fa640 10 client.15993 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa657fa640 1 -- 172.21.15.12:0/3414671358 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e686274d60 con 0x55e686312680 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa657fa640 10 client.15993 handle_command_reply: tid=0 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 client.15993 shutdown 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 -- 172.21.15.12:0/3414671358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e686307dc0 msgr2=0x55e686318a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e686307dc0 0x55e686318a00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faa74012fd0 tx=0x7faa74009a50 comp rx=0 tx=0).stop 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 -- 172.21.15.12:0/3414671358 shutdown_connections 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55e686312680 0x55e68638f590 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e686307dc0 0x55e686318a00 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6863074a0 0x55e686318270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 --2- 172.21.15.12:0/3414671358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e686303a30 0x55e68631af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa657fa640 0 client.15993 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 -- 172.21.15.12:0/3414671358 >> 172.21.15.12:0/3414671358 conn(0x55e68630f870 msgr2=0x55e686302b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 -- 172.21.15.12:0/3414671358 shutdown_connections 2024-09-16T01:03:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 1 -- 172.21.15.12:0/3414671358 wait complete. 2024-09-16T01:03:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.672+0000 7faa862d2740 20 client.15993 trim_cache size 0 max 16384 2024-09-16T01:03:10.678 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:03:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-16T01:03:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-16T01:03:10.678 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:03:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 -- 172.21.15.12:0/2469460643 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faa680a3240 msgr2=0x7faa680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faa680a3240 0x7faa680a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faa74021000 tx=0x7faa7401f000 comp rx=0 tx=0).stop 2024-09-16T01:03:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 -- 172.21.15.12:0/2469460643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c102d90 msgr2=0x7faa7c1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c102d90 0x7faa7c1009f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7faa7802a940 tx=0x7faa78003b90 comp rx=0 tx=0).stop 2024-09-16T01:03:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 -- 172.21.15.12:0/2469460643 shutdown_connections 2024-09-16T01:03:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7faa680a3240 0x7faa680a5700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa7c108290 0x7faa7c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c103740 0x7faa7c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 --2- 172.21.15.12:0/2469460643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa7c102d90 0x7faa7c1009f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 -- 172.21.15.12:0/2469460643 >> 172.21.15.12:0/2469460643 conn(0x7faa7c0fc7d0 msgr2=0x7faa7c106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 -- 172.21.15.12:0/2469460643 shutdown_connections 2024-09-16T01:03:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:10.673+0000 7faa83ef9640 1 -- 172.21.15.12:0/2469460643 wait complete. 2024-09-16T01:03:10.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:10 smithi012 ceph-mon[31197]: pgmap v422: 129 pgs: 129 active+clean; 222 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 19 op/s 2024-09-16T01:03:10.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:10 smithi098 ceph-mon[35346]: pgmap v422: 129 pgs: 129 active+clean; 222 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 19 op/s 2024-09-16T01:03:11.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:10 smithi119 ceph-mon[35049]: pgmap v422: 129 pgs: 129 active+clean; 222 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 19 op/s 2024-09-16T01:03:11.491 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-16T01:03:11.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:03:11.765 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.273+0000 7f553d93d640 1 -- 172.21.15.12:0/1168956869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55381037a0 msgr2=0x7f553810bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.273+0000 7f553d93d640 1 --2- 172.21.15.12:0/1168956869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55381037a0 0x7f553810bc00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f552c009900 tx=0x7f552c02a410 comp rx=0 tx=0).stop 2024-09-16T01:03:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.273+0000 7f553d93d640 1 -- 172.21.15.12:0/1168956869 shutdown_connections 2024-09-16T01:03:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.273+0000 7f553d93d640 1 --2- 172.21.15.12:0/1168956869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553810c2f0 0x7f553810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.273+0000 7f553d93d640 1 --2- 172.21.15.12:0/1168956869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55381037a0 0x7f553810bc00 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.273+0000 7f553d93d640 1 --2- 172.21.15.12:0/1168956869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5538102df0 0x7f55381031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.273+0000 7f553d93d640 1 -- 172.21.15.12:0/1168956869 >> 172.21.15.12:0/1168956869 conn(0x7f55380fc7d0 msgr2=0x7f55380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.273+0000 7f553d93d640 1 -- 172.21.15.12:0/1168956869 shutdown_connections 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.273+0000 7f553d93d640 1 -- 172.21.15.12:0/1168956869 wait complete. 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.273+0000 7f553d93d640 1 Processor -- start 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f553d93d640 1 -- start start 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f553d93d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5538102df0 0x7f5538198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f553d93d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55381037a0 0x7f5538198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f553d93d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f553810c2f0 0x7f553819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f553d93d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55381120d0 con 0x7f5538102df0 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f553d93d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5538111f50 con 0x7f55381037a0 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f553d93d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5538112250 con 0x7f553810c2f0 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f5536ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5538102df0 0x7f5538198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f5536ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5538102df0 0x7f5538198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47902/0 (socket says 172.21.15.12:47902) 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f5536ffd640 1 -- 172.21.15.12:0/4031335608 learned_addr learned my addr 172.21.15.12:0/4031335608 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f55377fe640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f553810c2f0 0x7f553819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f55367fc640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55381037a0 0x7f5538198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f5536ffd640 1 -- 172.21.15.12:0/4031335608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f553810c2f0 msgr2=0x7f553819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f5536ffd640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f553810c2f0 0x7f553819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f5536ffd640 1 -- 172.21.15.12:0/4031335608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55381037a0 msgr2=0x7f5538198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.274+0000 7f5536ffd640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55381037a0 0x7f5538198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.275+0000 7f5536ffd640 1 -- 172.21.15.12:0/4031335608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553819d5c0 con 0x7f5538102df0 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.275+0000 7f5536ffd640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5538102df0 0x7f5538198610 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f552800d770 tx=0x7f552800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.275+0000 7f553c93b640 1 -- 172.21.15.12:0/4031335608 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528017070 con 0x7f5538102df0 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.275+0000 7f553d93d640 1 -- 172.21.15.12:0/4031335608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553819d8b0 con 0x7f5538102df0 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.275+0000 7f553c93b640 1 -- 172.21.15.12:0/4031335608 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5528005500 con 0x7f5538102df0 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.275+0000 7f553c93b640 1 -- 172.21.15.12:0/4031335608 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528004e00 con 0x7f5538102df0 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.275+0000 7f553d93d640 1 -- 172.21.15.12:0/4031335608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55381a5190 con 0x7f5538102df0 2024-09-16T01:03:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.276+0000 7f553d93d640 1 -- 172.21.15.12:0/4031335608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55381031d0 con 0x7f5538102df0 2024-09-16T01:03:12.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.277+0000 7f553c93b640 1 -- 172.21.15.12:0/4031335608 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5528004fa0 con 0x7f5538102df0 2024-09-16T01:03:12.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.278+0000 7f553c93b640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55200a3240 0x7f55200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:12.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.278+0000 7f553c93b640 1 -- 172.21.15.12:0/4031335608 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f55280cf760 con 0x7f5538102df0 2024-09-16T01:03:12.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.278+0000 7f55367fc640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55200a3240 0x7f55200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:12.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.279+0000 7f55367fc640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55200a3240 0x7f55200a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f552c009230 tx=0x7f552c0314b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:12.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.283+0000 7f553c93b640 1 -- 172.21.15.12:0/4031335608 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f552809c0c0 con 0x7f5538102df0 2024-09-16T01:03:12.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.496+0000 7f553d93d640 1 -- 172.21.15.12:0/4031335608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55381072c0 con 0x7f5538102df0 2024-09-16T01:03:12.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.497+0000 7f553c93b640 1 -- 172.21.15.12:0/4031335608 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f552809b9c0 con 0x7f5538102df0 2024-09-16T01:03:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:03:12.498 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:03:12.498 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:03:12.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.499+0000 7f553d93d640 1 -- 172.21.15.12:0/4031335608 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55200a3240 msgr2=0x7f55200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:12.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.499+0000 7f553d93d640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55200a3240 0x7f55200a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f552c009230 tx=0x7f552c0314b0 comp rx=0 tx=0).stop 2024-09-16T01:03:12.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.499+0000 7f553d93d640 1 -- 172.21.15.12:0/4031335608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5538102df0 msgr2=0x7f5538198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.499+0000 7f553d93d640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5538102df0 0x7f5538198610 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f552800d770 tx=0x7f552800dc30 comp rx=0 tx=0).stop 2024-09-16T01:03:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.499+0000 7f553d93d640 1 -- 172.21.15.12:0/4031335608 shutdown_connections 2024-09-16T01:03:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.499+0000 7f553d93d640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55200a3240 0x7f55200a5700 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.499+0000 7f553d93d640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f553810c2f0 0x7f553819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.499+0000 7f553d93d640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55381037a0 0x7f5538198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.499+0000 7f553d93d640 1 --2- 172.21.15.12:0/4031335608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5538102df0 0x7f5538198610 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.499+0000 7f553d93d640 1 -- 172.21.15.12:0/4031335608 >> 172.21.15.12:0/4031335608 conn(0x7f55380fc7d0 msgr2=0x7f55380fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.500+0000 7f553d93d640 1 -- 172.21.15.12:0/4031335608 shutdown_connections 2024-09-16T01:03:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:12.500+0000 7f553d93d640 1 -- 172.21.15.12:0/4031335608 wait complete. 2024-09-16T01:03:12.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:12 smithi012 ceph-mon[31197]: pgmap v423: 129 pgs: 129 active+clean; 258 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 22 op/s 2024-09-16T01:03:12.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:12 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/4031335608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:12.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:12 smithi098 ceph-mon[35346]: pgmap v423: 129 pgs: 129 active+clean; 258 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 22 op/s 2024-09-16T01:03:12.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:12 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/4031335608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:13.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:12 smithi119 ceph-mon[35049]: pgmap v423: 129 pgs: 129 active+clean; 258 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 22 op/s 2024-09-16T01:03:13.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:12 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/4031335608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:13.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-16T01:03:13.537 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:14.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.047+0000 7fe90fa99640 1 -- 172.21.15.12:0/1763938742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9081082a0 msgr2=0x7fe90810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.047+0000 7fe90fa99640 1 --2- 172.21.15.12:0/1763938742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9081082a0 0x7fe90810ec40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe900009cd0 tx=0x7fe90002a8e0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.047+0000 7fe90fa99640 1 -- 172.21.15.12:0/1763938742 shutdown_connections 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.047+0000 7fe90fa99640 1 --2- 172.21.15.12:0/1763938742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9081082a0 0x7fe90810ec40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.047+0000 7fe90fa99640 1 --2- 172.21.15.12:0/1763938742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9081036e0 0x7fe908107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.047+0000 7fe90fa99640 1 --2- 172.21.15.12:0/1763938742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe908102d30 0x7fe908103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.047+0000 7fe90fa99640 1 -- 172.21.15.12:0/1763938742 >> 172.21.15.12:0/1763938742 conn(0x7fe9080fc7d0 msgr2=0x7fe9080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.047+0000 7fe90fa99640 1 -- 172.21.15.12:0/1763938742 shutdown_connections 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.047+0000 7fe90fa99640 1 -- 172.21.15.12:0/1763938742 wait complete. 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90fa99640 1 Processor -- start 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90fa99640 1 -- start start 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90fa99640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe908102d30 0x7fe908100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90fa99640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9081036e0 0x7fe908100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90fa99640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9081082a0 0x7fe908101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90fa99640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081120a0 con 0x7fe908102d30 2024-09-16T01:03:14.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90fa99640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe908111f20 con 0x7fe9081082a0 2024-09-16T01:03:14.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90fa99640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe908112220 con 0x7fe9081036e0 2024-09-16T01:03:14.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90d835640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe908102d30 0x7fe908100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90d835640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe908102d30 0x7fe908100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47922/0 (socket says 172.21.15.12:47922) 2024-09-16T01:03:14.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90d835640 1 -- 172.21.15.12:0/2463446704 learned_addr learned my addr 172.21.15.12:0/2463446704 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:14.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90d034640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9081036e0 0x7fe908100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90e036640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9081082a0 0x7fe908101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90d835640 1 -- 172.21.15.12:0/2463446704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9081036e0 msgr2=0x7fe908100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90d835640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9081036e0 0x7fe908100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90d835640 1 -- 172.21.15.12:0/2463446704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9081082a0 msgr2=0x7fe908101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90d835640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9081082a0 0x7fe908101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.048+0000 7fe90d835640 1 -- 172.21.15.12:0/2463446704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9081a6a30 con 0x7fe908102d30 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.049+0000 7fe90e036640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9081082a0 0x7fe908101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.049+0000 7fe90d835640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe908102d30 0x7fe908100990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe90400d770 tx=0x7fe90400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.049+0000 7fe8feffd640 1 -- 172.21.15.12:0/2463446704 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904017070 con 0x7fe908102d30 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.049+0000 7fe90fa99640 1 -- 172.21.15.12:0/2463446704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9081a6d20 con 0x7fe908102d30 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.049+0000 7fe8feffd640 1 -- 172.21.15.12:0/2463446704 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe904005500 con 0x7fe908102d30 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.049+0000 7fe8feffd640 1 -- 172.21.15.12:0/2463446704 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904004e00 con 0x7fe908102d30 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.049+0000 7fe90fa99640 1 -- 172.21.15.12:0/2463446704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9081a71b0 con 0x7fe908102d30 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.052+0000 7fe8feffd640 1 -- 172.21.15.12:0/2463446704 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe904004fa0 con 0x7fe908102d30 2024-09-16T01:03:14.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.052+0000 7fe911e72740 1 Processor -- start 2024-09-16T01:03:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.052+0000 7fe911e72740 1 -- start start 2024-09-16T01:03:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe911e72740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac7b40 0x558be7ac6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe911e72740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7ac6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe911e72740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ad1370 0x558be7ad3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe911e72740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558be7a2c2f0 con 0x558be7ac7b40 2024-09-16T01:03:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe911e72740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558be79d3cf0 con 0x558be7ad1370 2024-09-16T01:03:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe911e72740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558be7a282b0 con 0x558be7ac65d0 2024-09-16T01:03:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe90e036640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac7b40 0x558be7ac6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe90e036640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac7b40 0x558be7ac6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47936/0 (socket says 172.21.15.12:47936) 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe90e036640 1 -- 172.21.15.12:0/3255492772 learned_addr learned my addr 172.21.15.12:0/3255492772 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe90d835640 1 --2- 172.21.15.12:0/3255492772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7ac6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe90d034640 1 --2- 172.21.15.12:0/3255492772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ad1370 0x558be7ad3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe90e036640 1 -- 172.21.15.12:0/3255492772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 msgr2=0x558be7ac6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe90e036640 1 --2- 172.21.15.12:0/3255492772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7ac6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe90e036640 1 -- 172.21.15.12:0/3255492772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ad1370 msgr2=0x558be7ad3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe90e036640 1 --2- 172.21.15.12:0/3255492772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ad1370 0x558be7ad3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe8feffd640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe8f40a3240 0x7fe8f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.053+0000 7fe90e036640 1 -- 172.21.15.12:0/3255492772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be79b83a0 con 0x558be7ac7b40 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.054+0000 7fe90d835640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe8f40a3240 0x7fe8f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.054+0000 7fe90e036640 1 --2- 172.21.15.12:0/3255492772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac7b40 0x558be7ac6090 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe900005e30 tx=0x7fe900009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42494d96abe57a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.054+0000 7fe8feffd640 1 -- 172.21.15.12:0/2463446704 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fe9040cf7a0 con 0x7fe908102d30 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.054+0000 7fe8f3fff640 1 -- 172.21.15.12:0/3255492772 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9000318c0 con 0x558be7ac7b40 2024-09-16T01:03:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.054+0000 7fe8f3fff640 1 -- 172.21.15.12:0/3255492772 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe900036040 con 0x558be7ac7b40 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.054+0000 7fe8f3fff640 1 -- 172.21.15.12:0/3255492772 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9000044d0 con 0x558be7ac7b40 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 -- 172.21.15.12:0/3255492772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac7b40 msgr2=0x558be7ac6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe90d835640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe8f40a3240 0x7fe8f40a5700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe9040cd2b0 tx=0x7fe9040048a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 --2- 172.21.15.12:0/3255492772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac7b40 0x558be7ac6090 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe900005e30 tx=0x7fe900009a20 comp rx=0 tx=0).stop 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 -- 172.21.15.12:0/3255492772 shutdown_connections 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 --2- 172.21.15.12:0/3255492772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ad1370 0x558be7ad3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 --2- 172.21.15.12:0/3255492772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7ac6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 --2- 172.21.15.12:0/3255492772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac7b40 0x558be7ac6090 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 -- 172.21.15.12:0/3255492772 >> 172.21.15.12:0/3255492772 conn(0x558be7a8f310 msgr2=0x558be7ac2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 -- 172.21.15.12:0/3255492772 shutdown_connections 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 -- 172.21.15.12:0/3255492772 wait complete. 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 -- start start 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.055+0000 7fe911e72740 1 Processor -- start 2024-09-16T01:03:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe911e72740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7ad0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe911e72740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ace000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe911e72740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7ace5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe911e72740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558be7ad4010 con 0x558be7ad1370 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe911e72740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558be79e7060 con 0x558be7ac7b40 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe911e72740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558be7ad4190 con 0x558be7ac65d0 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe911e72740 10 client.0 _ll_register_callbacks cb 0x558be773a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe90e036640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7ace5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe90e036640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7ace5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47950/0 (socket says 172.21.15.12:47950) 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe90e036640 1 -- 172.21.15.12:0/2914199547 learned_addr learned my addr 172.21.15.12:0/2914199547 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe90d034640 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ace000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.056+0000 7fe90e036640 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7ad0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe90d034640 1 -- 172.21.15.12:0/2914199547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 msgr2=0x558be7ad0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe90d034640 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7ad0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe90d034640 1 -- 172.21.15.12:0/2914199547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 msgr2=0x558be7ace5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe90d034640 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7ace5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe90d034640 1 -- 172.21.15.12:0/2914199547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be779d3c0 con 0x558be7ac7b40 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe90e036640 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7ace5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe90d034640 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ace000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe908102420 tx=0x7fe8f8013940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74d53ba6e3662ce server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe8f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe8f17fa640 1 -- 172.21.15.12:0/2914199547 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8020060 con 0x558be7ac7b40 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe8f17fa640 1 -- 172.21.15.12:0/2914199547 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fe8f8004460 con 0x558be7ac7b40 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe911e72740 1 -- 172.21.15.12:0/2914199547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe900036040 con 0x558be7ac7b40 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe8f17fa640 1 -- 172.21.15.12:0/2914199547 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe8f8027050 con 0x558be7ac7b40 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe911e72740 10 client.25583 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.057+0000 7fe911e72740 1 -- 172.21.15.12:0/2914199547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558be7adfb40 con 0x558be7ac7b40 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe8f17fa640 1 -- 172.21.15.12:0/2914199547 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe900036040 con 0x558be7ac7b40 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe8f17fa640 1 -- 172.21.15.12:0/2914199547 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe8f801a030 con 0x558be7ac7b40 2024-09-16T01:03:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe911e72740 10 client.25583 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe911e72740 10 client.25583 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe911e72740 20 client.25583 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe911e72740 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558be7ae1000 0x558be7ae3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe911e72740 4 client.25583 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe911e72740 1 -- 172.21.15.12:0/2914199547 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558be7a39860 con 0x558be7ae1000 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe90e036640 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558be7ae1000 0x558be7ae3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe8f17fa640 10 client.25583 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.058+0000 7fe90e036640 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558be7ae1000 0x558be7ae3420 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1be14158538d8b55 server_cookie=d0db0be3766a40fc in_seq=0 out_seq=0 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe8f17fa640 1 -- 172.21.15.12:0/2914199547 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558be7a39860 con 0x558be7ae1000 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe8f17fa640 10 client.25583 handle_command_reply: tid=0 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 client.25583 shutdown 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 -- 172.21.15.12:0/2914199547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 msgr2=0x558be7ace000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ace000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe908102420 tx=0x7fe8f8013940 comp rx=0 tx=0).stop 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 -- 172.21.15.12:0/2914199547 shutdown_connections 2024-09-16T01:03:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558be7ae1000 0x558be7ae3420 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7ace5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ace000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 --2- 172.21.15.12:0/2914199547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7ad0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe8f17fa640 0 client.25583 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:03:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 -- 172.21.15.12:0/2914199547 >> 172.21.15.12:0/2914199547 conn(0x558be7a8f310 msgr2=0x558be7ac8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 -- 172.21.15.12:0/2914199547 shutdown_connections 2024-09-16T01:03:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.059+0000 7fe911e72740 1 -- 172.21.15.12:0/2914199547 wait complete. 2024-09-16T01:03:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.060+0000 7fe911e72740 20 client.25583 trim_cache size 0 max 16384 2024-09-16T01:03:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.073+0000 7fe911e72740 1 Processor -- start 2024-09-16T01:03:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.073+0000 7fe911e72740 1 -- start start 2024-09-16T01:03:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.073+0000 7fe911e72740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7add310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.073+0000 7fe911e72740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ac7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.073+0000 7fe911e72740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7acd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.073+0000 7fe911e72740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b0e20 con 0x558be7ad1370 2024-09-16T01:03:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.073+0000 7fe911e72740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b2960 con 0x558be7ac7b40 2024-09-16T01:03:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.073+0000 7fe911e72740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b14f0 con 0x558be7ac65d0 2024-09-16T01:03:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90e036640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7acd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90e036640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7acd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47964/0 (socket says 172.21.15.12:47964) 2024-09-16T01:03:14.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90e036640 1 -- 172.21.15.12:0/301386957 learned_addr learned my addr 172.21.15.12:0/301386957 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:14.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90e036640 1 --2- 172.21.15.12:0/301386957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7add310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90d034640 1 --2- 172.21.15.12:0/301386957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ac7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90e036640 1 -- 172.21.15.12:0/301386957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 msgr2=0x558be7ac7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:14.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90e036640 1 --2- 172.21.15.12:0/301386957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ac7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90e036640 1 -- 172.21.15.12:0/301386957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 msgr2=0x558be7acd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:14.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90e036640 1 --2- 172.21.15.12:0/301386957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7acd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90e036640 1 -- 172.21.15.12:0/301386957 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be7acc550 con 0x558be7ac65d0 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.074+0000 7fe90e036640 1 --2- 172.21.15.12:0/301386957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7add310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe900004140 tx=0x7fe900004060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1daf6fa95add777 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.075+0000 7fe8f37fe640 1 -- 172.21.15.12:0/301386957 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900003a30 con 0x558be7ac65d0 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.075+0000 7fe8f37fe640 1 -- 172.21.15.12:0/301386957 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9000046c0 con 0x558be7ac65d0 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.075+0000 7fe8f37fe640 1 -- 172.21.15.12:0/301386957 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9000568f0 con 0x558be7ac65d0 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.075+0000 7fe911e72740 1 -- 172.21.15.12:0/301386957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 msgr2=0x558be7add310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.075+0000 7fe911e72740 1 --2- 172.21.15.12:0/301386957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7add310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe900004140 tx=0x7fe900004060 comp rx=0 tx=0).stop 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.075+0000 7fe911e72740 1 -- 172.21.15.12:0/301386957 shutdown_connections 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.075+0000 7fe911e72740 1 --2- 172.21.15.12:0/301386957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ad1370 0x558be7acd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.075+0000 7fe911e72740 1 --2- 172.21.15.12:0/301386957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ac7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.075+0000 7fe911e72740 1 --2- 172.21.15.12:0/301386957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ac65d0 0x558be7add310 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.075+0000 7fe911e72740 1 -- 172.21.15.12:0/301386957 >> 172.21.15.12:0/301386957 conn(0x558be7a8f310 msgr2=0x558be7acd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.076+0000 7fe911e72740 1 -- 172.21.15.12:0/301386957 shutdown_connections 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.076+0000 7fe911e72740 1 -- 172.21.15.12:0/301386957 wait complete. 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.076+0000 7fe911e72740 1 -- start start 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.076+0000 7fe911e72740 1 Processor -- start 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.076+0000 7fe911e72740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac65d0 0x558be7ad95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.076+0000 7fe911e72740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ad9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.076+0000 7fe911e72740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ad1370 0x558be7ad49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.076+0000 7fe911e72740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b2290 con 0x558be7ac65d0 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe911e72740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b1bc0 con 0x558be7ac7b40 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe911e72740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081aee00 con 0x558be7ad1370 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe911e72740 10 client.0 _ll_register_callbacks cb 0x7fe8f8009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90e036640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac65d0 0x558be7ad95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90e036640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac65d0 0x558be7ad95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47968/0 (socket says 172.21.15.12:47968) 2024-09-16T01:03:14.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90e036640 1 -- 172.21.15.12:0/140643454 learned_addr learned my addr 172.21.15.12:0/140643454 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90d034640 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ad9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90e036640 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ad1370 0x558be7ad49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90e036640 1 -- 172.21.15.12:0/140643454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ad1370 msgr2=0x558be7ad49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90e036640 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ad1370 0x558be7ad49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90e036640 1 -- 172.21.15.12:0/140643454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 msgr2=0x558be7ad9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90e036640 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ad9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90e036640 1 -- 172.21.15.12:0/140643454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be7ad51d0 con 0x558be7ac65d0 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe90e036640 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac65d0 0x558be7ad95e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe900004af0 tx=0x7fe900009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332a5d0077d6db6d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe8f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe8f17fa640 1 -- 172.21.15.12:0/140643454 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900004dd0 con 0x558be7ac65d0 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe8f17fa640 1 -- 172.21.15.12:0/140643454 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fe900004170 con 0x558be7ac65d0 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.077+0000 7fe911e72740 1 -- 172.21.15.12:0/140643454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9000046c0 con 0x558be7ac65d0 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe8f17fa640 1 -- 172.21.15.12:0/140643454 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe90006e050 con 0x558be7ac65d0 2024-09-16T01:03:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe911e72740 10 client.16017 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:14.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe911e72740 1 -- 172.21.15.12:0/140643454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558be7b4b7e0 con 0x558be7ac65d0 2024-09-16T01:03:14.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe8f17fa640 1 -- 172.21.15.12:0/140643454 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9000046c0 con 0x558be7ac65d0 2024-09-16T01:03:14.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe8f17fa640 1 -- 172.21.15.12:0/140643454 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe90005c030 con 0x558be7ac65d0 2024-09-16T01:03:14.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe911e72740 10 client.16017 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:14.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe911e72740 10 client.16017 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-16T01:03:14.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe911e72740 20 client.16017 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:14.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe911e72740 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558be7b4b9b0 0x558be7b4dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:14.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe911e72740 4 client.16017 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:03:14.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe911e72740 1 -- 172.21.15.12:0/140643454 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558be7a33d70 con 0x558be7b4b9b0 2024-09-16T01:03:14.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.078+0000 7fe90d034640 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558be7b4b9b0 0x558be7b4dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:14.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.079+0000 7fe8f17fa640 10 client.16017 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.079+0000 7fe90d034640 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558be7b4b9b0 0x558be7b4dda0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=40d5432e5f073e65 server_cookie=46b0ca34e694e16e in_seq=0 out_seq=0 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.079+0000 7fe8f17fa640 1 -- 172.21.15.12:0/140643454 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558be7a33d70 con 0x558be7b4b9b0 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.079+0000 7fe8f17fa640 10 client.16017 handle_command_reply: tid=0 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.079+0000 7fe911e72740 1 client.16017 shutdown 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.079+0000 7fe911e72740 1 -- 172.21.15.12:0/140643454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac65d0 msgr2=0x558be7ad95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.079+0000 7fe911e72740 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac65d0 0x558be7ad95e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe900004af0 tx=0x7fe900009a20 comp rx=0 tx=0).stop 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.080+0000 7fe911e72740 1 -- 172.21.15.12:0/140643454 shutdown_connections 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.080+0000 7fe911e72740 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x558be7b4b9b0 0x558be7b4dda0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.080+0000 7fe911e72740 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558be7ad1370 0x558be7ad49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.080+0000 7fe911e72740 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558be7ac7b40 0x558be7ad9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.080+0000 7fe8f17fa640 0 client.16017 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.080+0000 7fe911e72740 1 --2- 172.21.15.12:0/140643454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558be7ac65d0 0x558be7ad95e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.080+0000 7fe911e72740 1 -- 172.21.15.12:0/140643454 >> 172.21.15.12:0/140643454 conn(0x558be7a8f310 msgr2=0x558be7ac14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:14.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.080+0000 7fe911e72740 1 -- 172.21.15.12:0/140643454 shutdown_connections 2024-09-16T01:03:14.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.080+0000 7fe911e72740 1 -- 172.21.15.12:0/140643454 wait complete. 2024-09-16T01:03:14.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.080+0000 7fe911e72740 20 client.16017 trim_cache size 0 max 16384 2024-09-16T01:03:14.087 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:03:14.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 -- 172.21.15.12:0/2463446704 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe8f40a3240 msgr2=0x7fe8f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe8f40a3240 0x7fe8f40a5700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe9040cd2b0 tx=0x7fe9040048a0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 -- 172.21.15.12:0/2463446704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe908102d30 msgr2=0x7fe908100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe908102d30 0x7fe908100990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe90400d770 tx=0x7fe90400dc30 comp rx=0 tx=0).stop 2024-09-16T01:03:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 -- 172.21.15.12:0/2463446704 shutdown_connections 2024-09-16T01:03:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe8f40a3240 0x7fe8f40a5700 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9081082a0 0x7fe908101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9081036e0 0x7fe908100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 --2- 172.21.15.12:0/2463446704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe908102d30 0x7fe908100990 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 -- 172.21.15.12:0/2463446704 >> 172.21.15.12:0/2463446704 conn(0x7fe9080fc7d0 msgr2=0x7fe908105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 -- 172.21.15.12:0/2463446704 shutdown_connections 2024-09-16T01:03:14.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:14.081+0000 7fe90fa99640 1 -- 172.21.15.12:0/2463446704 wait complete. 2024-09-16T01:03:14.746 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:14 smithi012 ceph-mon[31197]: pgmap v424: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 21 op/s 2024-09-16T01:03:14.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-16T01:03:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:14 smithi098 ceph-mon[35346]: pgmap v424: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 21 op/s 2024-09-16T01:03:15.052 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:15.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:14 smithi119 ceph-mon[35049]: pgmap v424: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 21 op/s 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.589+0000 7fd2c5472640 1 -- 172.21.15.12:0/2565598960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2c0100e20 msgr2=0x7fd2c0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.589+0000 7fd2c5472640 1 --2- 172.21.15.12:0/2565598960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2c0100e20 0x7fd2c0101200 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009900 tx=0x7fd2b002a480 comp rx=0 tx=0).stop 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.589+0000 7fd2c5472640 1 -- 172.21.15.12:0/2565598960 shutdown_connections 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.589+0000 7fd2c5472640 1 --2- 172.21.15.12:0/2565598960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2c0102ef0 0x7fd2c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.589+0000 7fd2c5472640 1 --2- 172.21.15.12:0/2565598960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2c0102570 0x7fd2c01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.589+0000 7fd2c5472640 1 --2- 172.21.15.12:0/2565598960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2c0100e20 0x7fd2c0101200 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.589+0000 7fd2c5472640 1 -- 172.21.15.12:0/2565598960 >> 172.21.15.12:0/2565598960 conn(0x7fd2c00fc7d0 msgr2=0x7fd2c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.589+0000 7fd2c5472640 1 -- 172.21.15.12:0/2565598960 shutdown_connections 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.589+0000 7fd2c5472640 1 -- 172.21.15.12:0/2565598960 wait complete. 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.590+0000 7fd2c5472640 1 Processor -- start 2024-09-16T01:03:15.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.590+0000 7fd2c5472640 1 -- start start 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.590+0000 7fd2c5472640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2c0100e20 0x7fd2c00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.590+0000 7fd2c5472640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2c0102570 0x7fd2c00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.590+0000 7fd2c5472640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2c0102ef0 0x7fd2c00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.590+0000 7fd2c5472640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0110fa0 con 0x7fd2c0102570 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.590+0000 7fd2c5472640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0110e20 con 0x7fd2c0102ef0 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.590+0000 7fd2c5472640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0111120 con 0x7fd2c0100e20 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.590+0000 7fd2be7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2c0102570 0x7fd2c00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2be7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2c0102570 0x7fd2c00fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47992/0 (socket says 172.21.15.12:47992) 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2be7fc640 1 -- 172.21.15.12:0/2652627397 learned_addr learned my addr 172.21.15.12:0/2652627397 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2bf7fe640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2c0102ef0 0x7fd2c00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2beffd640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2c0100e20 0x7fd2c00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2be7fc640 1 -- 172.21.15.12:0/2652627397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2c0100e20 msgr2=0x7fd2c00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2be7fc640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2c0100e20 0x7fd2c00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2be7fc640 1 -- 172.21.15.12:0/2652627397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2c0102ef0 msgr2=0x7fd2c00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2be7fc640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2c0102ef0 0x7fd2c00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2be7fc640 1 -- 172.21.15.12:0/2652627397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c01a69b0 con 0x7fd2c0102570 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2bf7fe640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2c0102ef0 0x7fd2c00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2be7fc640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2c0102570 0x7fd2c00fd1c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800d950 tx=0x7fd2a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2b7fff640 1 -- 172.21.15.12:0/2652627397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8017030 con 0x7fd2c0102570 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2b7fff640 1 -- 172.21.15.12:0/2652627397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2a8004020 con 0x7fd2c0102570 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2c5472640 1 -- 172.21.15.12:0/2652627397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c01a6ca0 con 0x7fd2c0102570 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2b7fff640 1 -- 172.21.15.12:0/2652627397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80047a0 con 0x7fd2c0102570 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.591+0000 7fd2c5472640 1 -- 172.21.15.12:0/2652627397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c01a7190 con 0x7fd2c0102570 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2b7fff640 1 -- 172.21.15.12:0/2652627397 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd2a80041d0 con 0x7fd2c0102570 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2c784b740 1 Processor -- start 2024-09-16T01:03:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2c784b740 1 -- start start 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259649090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 0x565259649a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 0x565259656760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2c784b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5652595af2f0 con 0x56525964ab40 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2c784b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x565259556cf0 con 0x5652596495d0 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2c784b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5652595ab2b0 con 0x565259654370 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2bf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259649090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2bf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259649090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48000/0 (socket says 172.21.15.12:48000) 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2bf7fe640 1 -- 172.21.15.12:0/692199222 learned_addr learned my addr 172.21.15.12:0/692199222 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2beffd640 1 --2- 172.21.15.12:0/692199222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 0x565259649a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.595+0000 7fd2be7fc640 1 --2- 172.21.15.12:0/692199222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 0x565259656760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2beffd640 1 -- 172.21.15.12:0/692199222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 msgr2=0x565259656760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2beffd640 1 --2- 172.21.15.12:0/692199222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 0x565259656760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2beffd640 1 -- 172.21.15.12:0/692199222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 msgr2=0x565259649090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2beffd640 1 --2- 172.21.15.12:0/692199222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259649090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2beffd640 1 -- 172.21.15.12:0/692199222 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56525953b3a0 con 0x5652596495d0 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2b7fff640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2ac0a3240 0x7fd2ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2beffd640 1 --2- 172.21.15.12:0/692199222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 0x565259649a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2b002aa70 tx=0x7fd2b00040f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bc34b09d5db2334 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2bf7fe640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2ac0a3240 0x7fd2ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2b57fa640 1 -- 172.21.15.12:0/692199222 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0035040 con 0x5652596495d0 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2b7fff640 1 -- 172.21.15.12:0/2652627397 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fd2a80cf5a0 con 0x7fd2c0102570 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2b57fa640 1 -- 172.21.15.12:0/692199222 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b0005520 con 0x5652596495d0 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.596+0000 7fd2b57fa640 1 -- 172.21.15.12:0/692199222 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0003850 con 0x5652596495d0 2024-09-16T01:03:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.597+0000 7fd2c784b740 1 -- 172.21.15.12:0/692199222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 msgr2=0x565259649a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.597+0000 7fd2bf7fe640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2ac0a3240 0x7fd2ac0a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80092f0 tx=0x7fd2b8009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.597+0000 7fd2c784b740 1 --2- 172.21.15.12:0/692199222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 0x565259649a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2b002aa70 tx=0x7fd2b00040f0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.597+0000 7fd2c784b740 1 -- 172.21.15.12:0/692199222 shutdown_connections 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.597+0000 7fd2c784b740 1 --2- 172.21.15.12:0/692199222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 0x565259656760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.597+0000 7fd2c784b740 1 --2- 172.21.15.12:0/692199222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 0x565259649a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.597+0000 7fd2c784b740 1 --2- 172.21.15.12:0/692199222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259649090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.597+0000 7fd2c784b740 1 -- 172.21.15.12:0/692199222 >> 172.21.15.12:0/692199222 conn(0x565259612310 msgr2=0x565259645c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.597+0000 7fd2c784b740 1 -- 172.21.15.12:0/692199222 shutdown_connections 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.597+0000 7fd2c784b740 1 -- 172.21.15.12:0/692199222 wait complete. 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2c784b740 1 -- start start 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2c784b740 1 Processor -- start 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652596495d0 0x565259653cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56525964ab40 0x565259650fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565259654370 0x565259651520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2c784b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5652596570b0 con 0x5652596495d0 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2c784b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56525956a060 con 0x565259654370 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2c784b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x565259657230 con 0x56525964ab40 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2c784b740 10 client.0 _ll_register_callbacks cb 0x5652592bd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2beffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652596495d0 0x565259653cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2beffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652596495d0 0x565259653cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48008/0 (socket says 172.21.15.12:48008) 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2beffd640 1 -- 172.21.15.12:0/1923383786 learned_addr learned my addr 172.21.15.12:0/1923383786 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.598+0000 7fd2bf7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565259654370 0x565259651520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2be7fc640 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56525964ab40 0x565259650fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2beffd640 1 -- 172.21.15.12:0/1923383786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56525964ab40 msgr2=0x565259650fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2beffd640 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56525964ab40 0x565259650fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2beffd640 1 -- 172.21.15.12:0/1923383786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565259654370 msgr2=0x565259651520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2beffd640 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565259654370 0x565259651520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2beffd640 1 -- 172.21.15.12:0/1923383786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652593203c0 con 0x5652596495d0 2024-09-16T01:03:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2beffd640 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652596495d0 0x565259653cf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0005ec0 tx=0x7fd2b00045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2159a070010255e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2a67fc640 1 -- 172.21.15.12:0/1923383786 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0035050 con 0x5652596495d0 2024-09-16T01:03:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2a67fc640 1 -- 172.21.15.12:0/1923383786 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fd2b00048d0 con 0x5652596495d0 2024-09-16T01:03:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2c784b740 1 -- 172.21.15.12:0/1923383786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2b0005520 con 0x5652596495d0 2024-09-16T01:03:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2a67fc640 1 -- 172.21.15.12:0/1923383786 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd2b0009520 con 0x5652596495d0 2024-09-16T01:03:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2c784b740 10 client.16029 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.599+0000 7fd2c784b740 1 -- 172.21.15.12:0/1923383786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x565259662b10 con 0x5652596495d0 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.600+0000 7fd2a67fc640 1 -- 172.21.15.12:0/1923383786 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b0005520 con 0x5652596495d0 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.600+0000 7fd2a67fc640 1 -- 172.21.15.12:0/1923383786 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd2b0003c40 con 0x5652596495d0 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.600+0000 7fd2c784b740 10 client.16029 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.600+0000 7fd2c784b740 10 client.16029 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.600+0000 7fd2c784b740 20 client.16029 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.600+0000 7fd2c784b740 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x565259663e60 0x565259666250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.600+0000 7fd2c784b740 4 client.16029 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.600+0000 7fd2c784b740 1 -- 172.21.15.12:0/1923383786 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652595bc860 con 0x565259663e60 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.600+0000 7fd2be7fc640 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x565259663e60 0x565259666250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.601+0000 7fd2be7fc640 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x565259663e60 0x565259666250 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e796bcd61437d78c server_cookie=11860612a5d98c79 in_seq=0 out_seq=0 2024-09-16T01:03:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.601+0000 7fd2a67fc640 10 client.16029 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:03:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2a67fc640 1 -- 172.21.15.12:0/1923383786 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652595bc860 con 0x565259663e60 2024-09-16T01:03:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2a67fc640 10 client.16029 handle_command_reply: tid=0 2024-09-16T01:03:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 client.16029 shutdown 2024-09-16T01:03:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 -- 172.21.15.12:0/1923383786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652596495d0 msgr2=0x565259653cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652596495d0 0x565259653cf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0005ec0 tx=0x7fd2b00045d0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 -- 172.21.15.12:0/1923383786 shutdown_connections 2024-09-16T01:03:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x565259663e60 0x565259666250 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565259654370 0x565259651520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56525964ab40 0x565259650fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2a67fc640 0 client.16029 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:03:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 --2- 172.21.15.12:0/1923383786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5652596495d0 0x565259653cf0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 -- 172.21.15.12:0/1923383786 >> 172.21.15.12:0/1923383786 conn(0x565259612310 msgr2=0x56525964b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 -- 172.21.15.12:0/1923383786 shutdown_connections 2024-09-16T01:03:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 1 -- 172.21.15.12:0/1923383786 wait complete. 2024-09-16T01:03:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.602+0000 7fd2c784b740 20 client.16029 trim_cache size 0 max 16384 2024-09-16T01:03:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.615+0000 7fd2c784b740 1 Processor -- start 2024-09-16T01:03:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.615+0000 7fd2c784b740 1 -- start start 2024-09-16T01:03:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.616+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 0x565259640ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.616+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x56525964ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.616+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 0x565259669270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.617+0000 7fd2be7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x56525964ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.617+0000 7fd2beffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 0x565259640ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.617+0000 7fd2be7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x56525964ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48016/0 (socket says 172.21.15.12:48016) 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.617+0000 7fd2be7fc640 1 -- 172.21.15.12:0/3914661914 learned_addr learned my addr 172.21.15.12:0/3914661914 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.617+0000 7fd2c784b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01b0e30 con 0x56525964ab40 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.617+0000 7fd2c784b740 1 -- 172.21.15.12:0/3914661914 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01b2970 con 0x5652596495d0 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.617+0000 7fd2c784b740 1 -- 172.21.15.12:0/3914661914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01b1500 con 0x565259654370 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.617+0000 7fd2bf7fe640 1 --2- 172.21.15.12:0/3914661914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 0x565259669270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.618+0000 7fd2bf7fe640 1 -- 172.21.15.12:0/3914661914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 msgr2=0x565259640ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.618+0000 7fd2bf7fe640 1 --2- 172.21.15.12:0/3914661914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 0x565259640ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.618+0000 7fd2bf7fe640 1 -- 172.21.15.12:0/3914661914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 msgr2=0x56525964ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.618+0000 7fd2bf7fe640 1 --2- 172.21.15.12:0/3914661914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x56525964ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.618+0000 7fd2bf7fe640 1 -- 172.21.15.12:0/3914661914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56525964f4f0 con 0x565259654370 2024-09-16T01:03:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.618+0000 7fd2bf7fe640 1 --2- 172.21.15.12:0/3914661914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 0x565259669270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x565259654340 tx=0x7fd2b800b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33da32b1a504344b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:15.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.618+0000 7fd2b4ff9640 1 -- 172.21.15.12:0/3914661914 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b801ddd0 con 0x565259654370 2024-09-16T01:03:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.618+0000 7fd2b4ff9640 1 -- 172.21.15.12:0/3914661914 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b8005020 con 0x565259654370 2024-09-16T01:03:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.618+0000 7fd2b4ff9640 1 -- 172.21.15.12:0/3914661914 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b801c680 con 0x565259654370 2024-09-16T01:03:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.619+0000 7fd2c784b740 1 -- 172.21.15.12:0/3914661914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 msgr2=0x565259669270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.619+0000 7fd2c784b740 1 --2- 172.21.15.12:0/3914661914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 0x565259669270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x565259654340 tx=0x7fd2b800b000 comp rx=0 tx=0).stop 2024-09-16T01:03:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.619+0000 7fd2c784b740 1 -- 172.21.15.12:0/3914661914 shutdown_connections 2024-09-16T01:03:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.619+0000 7fd2c784b740 1 --2- 172.21.15.12:0/3914661914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x565259654370 0x565259669270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.619+0000 7fd2c784b740 1 --2- 172.21.15.12:0/3914661914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x56525964ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.619+0000 7fd2c784b740 1 --2- 172.21.15.12:0/3914661914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5652596495d0 0x565259640ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.619+0000 7fd2c784b740 1 -- 172.21.15.12:0/3914661914 >> 172.21.15.12:0/3914661914 conn(0x565259612310 msgr2=0x56525964f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.619+0000 7fd2c784b740 1 -- 172.21.15.12:0/3914661914 shutdown_connections 2024-09-16T01:03:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.619+0000 7fd2c784b740 1 -- 172.21.15.12:0/3914661914 wait complete. 2024-09-16T01:03:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2c784b740 1 -- start start 2024-09-16T01:03:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2c784b740 1 Processor -- start 2024-09-16T01:03:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5652596495d0 0x5652596669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259666f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2c784b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565259654370 0x5652596c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2c784b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01b22a0 con 0x56525964ab40 2024-09-16T01:03:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2c784b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01b1bd0 con 0x565259654370 2024-09-16T01:03:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2c784b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01aee10 con 0x5652596495d0 2024-09-16T01:03:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2c784b740 10 client.0 _ll_register_callbacks cb 0x7fd2b8009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2be7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259666f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2be7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259666f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48024/0 (socket says 172.21.15.12:48024) 2024-09-16T01:03:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2be7fc640 1 -- 172.21.15.12:0/3271386833 learned_addr learned my addr 172.21.15.12:0/3271386833 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.620+0000 7fd2beffd640 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5652596495d0 0x5652596669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.621+0000 7fd2bf7fe640 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565259654370 0x5652596c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.621+0000 7fd2be7fc640 1 -- 172.21.15.12:0/3271386833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5652596495d0 msgr2=0x5652596669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.621+0000 7fd2be7fc640 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5652596495d0 0x5652596669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.621+0000 7fd2be7fc640 1 -- 172.21.15.12:0/3271386833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565259654370 msgr2=0x5652596c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.621+0000 7fd2be7fc640 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565259654370 0x5652596c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.621+0000 7fd2be7fc640 1 -- 172.21.15.12:0/3271386833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652596c6dc0 con 0x56525964ab40 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.621+0000 7fd2be7fc640 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259666f10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80ccd90 tx=0x7fd2a80861a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cb7e7f22904704 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.621+0000 7fd2a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.621+0000 7fd2a67fc640 1 -- 172.21.15.12:0/3271386833 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a809b630 con 0x56525964ab40 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2a67fc640 1 -- 172.21.15.12:0/3271386833 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fd2a80cf2e0 con 0x56525964ab40 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2c784b740 1 -- 172.21.15.12:0/3271386833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2b8005020 con 0x56525964ab40 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2a67fc640 1 -- 172.21.15.12:0/3271386833 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd2a80b9050 con 0x56525964ab40 2024-09-16T01:03:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2c784b740 10 client.16035 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2c784b740 1 -- 172.21.15.12:0/3271386833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5652596ce1d0 con 0x56525964ab40 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2a67fc640 1 -- 172.21.15.12:0/3271386833 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b8005020 con 0x56525964ab40 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2a67fc640 1 -- 172.21.15.12:0/3271386833 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd2a8097ed0 con 0x56525964ab40 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2c784b740 10 client.16035 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2c784b740 10 client.16035 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2c784b740 20 client.16035 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2c784b740 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x5652596ce8e0 0x5652596d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2c784b740 4 client.16035 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.622+0000 7fd2c784b740 1 -- 172.21.15.12:0/3271386833 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5652595b6d70 con 0x5652596ce8e0 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2beffd640 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x5652596ce8e0 0x5652596d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2beffd640 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x5652596ce8e0 0x5652596d0d00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=698f694ae658cd8 server_cookie=ab8293ea65727e67 in_seq=0 out_seq=0 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2a67fc640 10 client.16035 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2a67fc640 1 -- 172.21.15.12:0/3271386833 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5652595b6d70 con 0x5652596ce8e0 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2a67fc640 10 client.16035 handle_command_reply: tid=0 2024-09-16T01:03:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2c784b740 1 client.16035 shutdown 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2c784b740 1 -- 172.21.15.12:0/3271386833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 msgr2=0x565259666f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2c784b740 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259666f10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80ccd90 tx=0x7fd2a80861a0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2c784b740 1 -- 172.21.15.12:0/3271386833 shutdown_connections 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2c784b740 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x5652596ce8e0 0x5652596d0d00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2c784b740 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565259654370 0x5652596c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2c784b740 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56525964ab40 0x565259666f10 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2c784b740 1 --2- 172.21.15.12:0/3271386833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5652596495d0 0x5652596669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2c784b740 1 -- 172.21.15.12:0/3271386833 >> 172.21.15.12:0/3271386833 conn(0x565259612310 msgr2=0x56525964f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.623+0000 7fd2a67fc640 0 client.16035 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c784b740 1 -- 172.21.15.12:0/3271386833 shutdown_connections 2024-09-16T01:03:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c784b740 1 -- 172.21.15.12:0/3271386833 wait complete. 2024-09-16T01:03:15.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c784b740 20 client.16035 trim_cache size 0 max 16384 2024-09-16T01:03:15.629 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c5472640 1 -- 172.21.15.12:0/2652627397 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2ac0a3240 msgr2=0x7fd2ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c5472640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2ac0a3240 0x7fd2ac0a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80092f0 tx=0x7fd2b8009600 comp rx=0 tx=0).stop 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c5472640 1 -- 172.21.15.12:0/2652627397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2c0102570 msgr2=0x7fd2c00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c5472640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2c0102570 0x7fd2c00fd1c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800d950 tx=0x7fd2a800de10 comp rx=0 tx=0).stop 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c5472640 1 -- 172.21.15.12:0/2652627397 shutdown_connections 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c5472640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd2ac0a3240 0x7fd2ac0a5700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c5472640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2c0102ef0 0x7fd2c00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c5472640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2c0102570 0x7fd2c00fd1c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c5472640 1 --2- 172.21.15.12:0/2652627397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2c0100e20 0x7fd2c00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.624+0000 7fd2c5472640 1 -- 172.21.15.12:0/2652627397 >> 172.21.15.12:0/2652627397 conn(0x7fd2c00fc7d0 msgr2=0x7fd2c006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.625+0000 7fd2c5472640 1 -- 172.21.15.12:0/2652627397 shutdown_connections 2024-09-16T01:03:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:15.625+0000 7fd2c5472640 1 -- 172.21.15.12:0/2652627397 wait complete. 2024-09-16T01:03:16.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-16T01:03:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:16.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:16 smithi012 ceph-mon[31197]: pgmap v425: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 19 op/s 2024-09-16T01:03:16.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:16 smithi098 ceph-mon[35346]: pgmap v425: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 19 op/s 2024-09-16T01:03:17.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:16 smithi119 ceph-mon[35049]: pgmap v425: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 19 op/s 2024-09-16T01:03:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 -- 172.21.15.12:0/2995280452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90a8100e20 msgr2=0x7f90a8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 --2- 172.21.15.12:0/2995280452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90a8100e20 0x7f90a8101200 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009900 tx=0x7f90a402a480 comp rx=0 tx=0).stop 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 -- 172.21.15.12:0/2995280452 shutdown_connections 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 --2- 172.21.15.12:0/2995280452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90a8102ef0 0x7f90a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 --2- 172.21.15.12:0/2995280452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a8102570 0x7f90a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 --2- 172.21.15.12:0/2995280452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90a8100e20 0x7f90a8101200 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 -- 172.21.15.12:0/2995280452 >> 172.21.15.12:0/2995280452 conn(0x7f90a80fc7d0 msgr2=0x7f90a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 -- 172.21.15.12:0/2995280452 shutdown_connections 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 -- 172.21.15.12:0/2995280452 wait complete. 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 Processor -- start 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.307+0000 7f90af4a7640 1 -- start start 2024-09-16T01:03:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90af4a7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a8100e20 0x7f90a8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90af4a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90a8102570 0x7f90a8199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90af4a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90a8102ef0 0x7f90a81a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90af4a7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8110f80 con 0x7f90a8102ef0 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90af4a7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8110e00 con 0x7f90a8100e20 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90af4a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8111100 con 0x7f90a8102570 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ada44640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90a8102ef0 0x7f90a81a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ada44640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90a8102ef0 0x7f90a81a43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46850/0 (socket says 172.21.15.12:46850) 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ada44640 1 -- 172.21.15.12:0/948954847 learned_addr learned my addr 172.21.15.12:0/948954847 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90aca42640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90a8102570 0x7f90a8199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ad243640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a8100e20 0x7f90a8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ada44640 1 -- 172.21.15.12:0/948954847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90a8102570 msgr2=0x7f90a8199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ada44640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90a8102570 0x7f90a8199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ada44640 1 -- 172.21.15.12:0/948954847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a8100e20 msgr2=0x7f90a8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ada44640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a8100e20 0x7f90a8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ada44640 1 -- 172.21.15.12:0/948954847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a81a48f0 con 0x7f90a8102ef0 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ad243640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a8100e20 0x7f90a8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.308+0000 7f90ada44640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90a8102ef0 0x7f90a81a43b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f90a000eb10 tx=0x7f90a000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.309+0000 7f909e7fc640 1 -- 172.21.15.12:0/948954847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0004b20 con 0x7f90a8102ef0 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.309+0000 7f90af4a7640 1 -- 172.21.15.12:0/948954847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a81a4ac0 con 0x7f90a8102ef0 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.309+0000 7f909e7fc640 1 -- 172.21.15.12:0/948954847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90a0004cc0 con 0x7f90a8102ef0 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.309+0000 7f909e7fc640 1 -- 172.21.15.12:0/948954847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0010760 con 0x7f90a8102ef0 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.309+0000 7f90af4a7640 1 -- 172.21.15.12:0/948954847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a81a5000 con 0x7f90a8102ef0 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.312+0000 7f90b1880740 1 Processor -- start 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.312+0000 7f909e7fc640 1 -- 172.21.15.12:0/948954847 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f90a0005020 con 0x7f90a8102ef0 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.312+0000 7f90b1880740 1 -- start start 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.312+0000 7f90b1880740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d993090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.312+0000 7f90b1880740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d9935d0 0x56300d993a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.312+0000 7f90b1880740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d99e370 0x56300d9a0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.312+0000 7f90b1880740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56300d8f92f0 con 0x56300d994b40 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90b1880740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56300d8a0cf0 con 0x56300d99e370 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90b1880740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56300d8f52b0 con 0x56300d9935d0 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90aca42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d993090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90aca42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d993090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46858/0 (socket says 172.21.15.12:46858) 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90aca42640 1 -- 172.21.15.12:0/3976770039 learned_addr learned my addr 172.21.15.12:0/3976770039 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90ad243640 1 --2- 172.21.15.12:0/3976770039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d9935d0 0x56300d993a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90aca42640 1 --2- 172.21.15.12:0/3976770039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d99e370 0x56300d9a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90aca42640 1 -- 172.21.15.12:0/3976770039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d9935d0 msgr2=0x56300d993a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90aca42640 1 --2- 172.21.15.12:0/3976770039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d9935d0 0x56300d993a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90aca42640 1 -- 172.21.15.12:0/3976770039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d99e370 msgr2=0x56300d9a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90aca42640 1 --2- 172.21.15.12:0/3976770039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d99e370 0x56300d9a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90aca42640 1 -- 172.21.15.12:0/3976770039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56300d8853a0 con 0x56300d994b40 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90aca42640 1 --2- 172.21.15.12:0/3976770039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d993090 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f909800b6c0 tx=0x7f909800b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6056c6104073ede server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f909e7fc640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90940a3240 0x7f90940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.313+0000 7f90937fe640 1 -- 172.21.15.12:0/3976770039 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098005020 con 0x56300d994b40 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90937fe640 1 -- 172.21.15.12:0/3976770039 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90980056a0 con 0x56300d994b40 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90937fe640 1 -- 172.21.15.12:0/3976770039 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909800f6e0 con 0x56300d994b40 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90ad243640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90940a3240 0x7f90940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f909e7fc640 1 -- 172.21.15.12:0/948954847 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f90a00d0350 con 0x7f90a8102ef0 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90b1880740 1 -- 172.21.15.12:0/3976770039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 msgr2=0x56300d993090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90b1880740 1 --2- 172.21.15.12:0/3976770039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d993090 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f909800b6c0 tx=0x7f909800b650 comp rx=0 tx=0).stop 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90ad243640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90940a3240 0x7f90940a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x56300d990ac0 tx=0x7f90a4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90b1880740 1 -- 172.21.15.12:0/3976770039 shutdown_connections 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90b1880740 1 --2- 172.21.15.12:0/3976770039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d99e370 0x56300d9a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90b1880740 1 --2- 172.21.15.12:0/3976770039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d9935d0 0x56300d993a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90b1880740 1 --2- 172.21.15.12:0/3976770039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d993090 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.314+0000 7f90b1880740 1 -- 172.21.15.12:0/3976770039 >> 172.21.15.12:0/3976770039 conn(0x56300d95c310 msgr2=0x56300d98fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.315+0000 7f90b1880740 1 -- 172.21.15.12:0/3976770039 shutdown_connections 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.315+0000 7f90b1880740 1 -- 172.21.15.12:0/3976770039 wait complete. 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.315+0000 7f90b1880740 1 -- start start 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.315+0000 7f90b1880740 1 Processor -- start 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90b1880740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d9935d0 0x56300d99dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90b1880740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d994b40 0x56300d99b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90b1880740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 0x56300d99b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90b1880740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56300d9a1070 con 0x56300d9935d0 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90b1880740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56300d8b4060 con 0x56300d994b40 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90b1880740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56300d9a11f0 con 0x56300d99e370 2024-09-16T01:03:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90b1880740 10 client.0 _ll_register_callbacks cb 0x56300d6078c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ad243640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d9935d0 0x56300d99dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ad243640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d9935d0 0x56300d99dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46872/0 (socket says 172.21.15.12:46872) 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ad243640 1 -- 172.21.15.12:0/2797078791 learned_addr learned my addr 172.21.15.12:0/2797078791 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90aca42640 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d994b40 0x56300d99b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ada44640 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 0x56300d99b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ad243640 1 -- 172.21.15.12:0/2797078791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 msgr2=0x56300d99b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ad243640 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 0x56300d99b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ad243640 1 -- 172.21.15.12:0/2797078791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d994b40 msgr2=0x56300d99b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ad243640 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d994b40 0x56300d99b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ad243640 1 -- 172.21.15.12:0/2797078791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56300d66a3c0 con 0x56300d9935d0 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ada44640 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 0x56300d99b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f90ad243640 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d9935d0 0x56300d99dd50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009900 tx=0x7f90a4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78e87b4bea846eb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.316+0000 7f9090ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f9090ff9640 1 -- 172.21.15.12:0/2797078791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a404d070 con 0x56300d9935d0 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f9090ff9640 1 -- 172.21.15.12:0/2797078791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f90a4032550 con 0x56300d9935d0 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f90b1880740 1 -- 172.21.15.12:0/2797078791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90980056a0 con 0x56300d9935d0 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f9090ff9640 1 -- 172.21.15.12:0/2797078791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f90a4059050 con 0x56300d9935d0 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f90b1880740 10 client.16047 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f90b1880740 1 -- 172.21.15.12:0/2797078791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56300d9acb20 con 0x56300d9935d0 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f9090ff9640 1 -- 172.21.15.12:0/2797078791 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90980056a0 con 0x56300d9935d0 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f9090ff9640 1 -- 172.21.15.12:0/2797078791 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f90a4003b20 con 0x56300d9935d0 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f90b1880740 10 client.16047 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f90b1880740 10 client.16047 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f90b1880740 20 client.16047 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f90b1880740 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56300d9adf30 0x56300d9b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f90b1880740 4 client.16047 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.317+0000 7f90b1880740 1 -- 172.21.15.12:0/2797078791 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56300d906860 con 0x56300d9adf30 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.318+0000 7f90aca42640 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56300d9adf30 0x56300d9b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.318+0000 7f90aca42640 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56300d9adf30 0x56300d9b0390 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4822356adb3a40df server_cookie=d51818c16da59781 in_seq=0 out_seq=0 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.318+0000 7f9090ff9640 10 client.16047 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f9090ff9640 1 -- 172.21.15.12:0/2797078791 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56300d906860 con 0x56300d9adf30 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f9090ff9640 10 client.16047 handle_command_reply: tid=0 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f90b1880740 1 client.16047 shutdown 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f90b1880740 1 -- 172.21.15.12:0/2797078791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d9935d0 msgr2=0x56300d99dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f90b1880740 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d9935d0 0x56300d99dd50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009900 tx=0x7f90a4009260 comp rx=0 tx=0).stop 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f90b1880740 1 -- 172.21.15.12:0/2797078791 shutdown_connections 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f90b1880740 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56300d9adf30 0x56300d9b0390 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f90b1880740 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 0x56300d99b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f90b1880740 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d994b40 0x56300d99b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f90b1880740 1 --2- 172.21.15.12:0/2797078791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d9935d0 0x56300d99dd50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f90b1880740 1 -- 172.21.15.12:0/2797078791 >> 172.21.15.12:0/2797078791 conn(0x56300d95c310 msgr2=0x56300d995930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.319+0000 7f9090ff9640 0 client.16047 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:03:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.320+0000 7f90b1880740 1 -- 172.21.15.12:0/2797078791 shutdown_connections 2024-09-16T01:03:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.320+0000 7f90b1880740 1 -- 172.21.15.12:0/2797078791 wait complete. 2024-09-16T01:03:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.320+0000 7f90b1880740 20 client.16047 trim_cache size 0 max 16384 2024-09-16T01:03:17.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90b1880740 1 Processor -- start 2024-09-16T01:03:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90b1880740 1 -- start start 2024-09-16T01:03:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90b1880740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 0x56300d98fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90b1880740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d994b40 0x56300d9aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90b1880740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d99e370 0x56300d996120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90b1880740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81aec70 con 0x56300d99e370 2024-09-16T01:03:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90b1880740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81b07b0 con 0x56300d9935d0 2024-09-16T01:03:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90b1880740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81af340 con 0x56300d994b40 2024-09-16T01:03:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90ada44640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d99e370 0x56300d996120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90ada44640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d99e370 0x56300d996120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46886/0 (socket says 172.21.15.12:46886) 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90ada44640 1 -- 172.21.15.12:0/1169985763 learned_addr learned my addr 172.21.15.12:0/1169985763 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90aca42640 1 --2- 172.21.15.12:0/1169985763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d994b40 0x56300d9aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.333+0000 7f90ad243640 1 --2- 172.21.15.12:0/1169985763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 0x56300d98fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.334+0000 7f90ada44640 1 -- 172.21.15.12:0/1169985763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d994b40 msgr2=0x56300d9aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.334+0000 7f90ada44640 1 --2- 172.21.15.12:0/1169985763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d994b40 0x56300d9aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.334+0000 7f90ada44640 1 -- 172.21.15.12:0/1169985763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 msgr2=0x56300d98fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.334+0000 7f90ada44640 1 --2- 172.21.15.12:0/1169985763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 0x56300d98fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.334+0000 7f90ada44640 1 -- 172.21.15.12:0/1169985763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56300d98f320 con 0x56300d99e370 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.334+0000 7f90ad243640 1 --2- 172.21.15.12:0/1169985763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 0x56300d98fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.334+0000 7f90ada44640 1 --2- 172.21.15.12:0/1169985763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d99e370 0x56300d996120 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f90a0098a70 tx=0x7f90a0098970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e73be786812fcd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.334+0000 7f9092ffd640 1 -- 172.21.15.12:0/1169985763 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a009cd10 con 0x56300d99e370 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.334+0000 7f9092ffd640 1 -- 172.21.15.12:0/1169985763 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90a0098040 con 0x56300d99e370 2024-09-16T01:03:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.334+0000 7f9092ffd640 1 -- 172.21.15.12:0/1169985763 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0098c80 con 0x56300d99e370 2024-09-16T01:03:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.335+0000 7f90b1880740 1 -- 172.21.15.12:0/1169985763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d99e370 msgr2=0x56300d996120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.335+0000 7f90b1880740 1 --2- 172.21.15.12:0/1169985763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d99e370 0x56300d996120 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f90a0098a70 tx=0x7f90a0098970 comp rx=0 tx=0).stop 2024-09-16T01:03:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.335+0000 7f90b1880740 1 -- 172.21.15.12:0/1169985763 shutdown_connections 2024-09-16T01:03:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.335+0000 7f90b1880740 1 --2- 172.21.15.12:0/1169985763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d99e370 0x56300d996120 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.335+0000 7f90b1880740 1 --2- 172.21.15.12:0/1169985763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d994b40 0x56300d9aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.335+0000 7f90b1880740 1 --2- 172.21.15.12:0/1169985763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 0x56300d98fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.335+0000 7f90b1880740 1 -- 172.21.15.12:0/1169985763 >> 172.21.15.12:0/1169985763 conn(0x56300d95c310 msgr2=0x56300d98f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.335+0000 7f90b1880740 1 -- 172.21.15.12:0/1169985763 shutdown_connections 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.335+0000 7f90b1880740 1 -- 172.21.15.12:0/1169985763 wait complete. 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.335+0000 7f90b1880740 1 -- start start 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90b1880740 1 Processor -- start 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90b1880740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 0x56300d9a1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90b1880740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d9a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90b1880740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 0x56300d9a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90b1880740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81b00e0 con 0x56300d994b40 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90b1880740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81afa10 con 0x56300d9935d0 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90b1880740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81acc50 con 0x56300d99e370 2024-09-16T01:03:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90b1880740 10 client.0 _ll_register_callbacks cb 0x7f90a4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90aca42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d9a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90aca42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d9a19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46896/0 (socket says 172.21.15.12:46896) 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90aca42640 1 -- 172.21.15.12:0/3992523352 learned_addr learned my addr 172.21.15.12:0/3992523352 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.336+0000 7f90ad243640 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 0x56300d9a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f90ada44640 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 0x56300d9a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f90aca42640 1 -- 172.21.15.12:0/3992523352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 msgr2=0x56300d9a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f90aca42640 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 0x56300d9a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f90aca42640 1 -- 172.21.15.12:0/3992523352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 msgr2=0x56300d9a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f90aca42640 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 0x56300d9a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f90aca42640 1 -- 172.21.15.12:0/3992523352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56300da16ec0 con 0x56300d994b40 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f90aca42640 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d9a19b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9098000c00 tx=0x7f90980120a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db84f8b87fb9c07e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f9090ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f9090ff9640 1 -- 172.21.15.12:0/3992523352 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098004020 con 0x56300d994b40 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f9090ff9640 1 -- 172.21.15.12:0/3992523352 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f90980041c0 con 0x56300d994b40 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f90b1880740 1 -- 172.21.15.12:0/3992523352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90a0098040 con 0x56300d994b40 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f9090ff9640 1 -- 172.21.15.12:0/3992523352 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f90980043c0 con 0x56300d994b40 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f90b1880740 10 client.16053 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.337+0000 7f90b1880740 1 -- 172.21.15.12:0/3992523352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56300da18180 con 0x56300d994b40 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.338+0000 7f9090ff9640 1 -- 172.21.15.12:0/3992523352 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90a0098040 con 0x56300d994b40 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.338+0000 7f9090ff9640 1 -- 172.21.15.12:0/3992523352 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f90980035f0 con 0x56300d994b40 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.338+0000 7f90b1880740 10 client.16053 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.338+0000 7f90b1880740 10 client.16053 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.338+0000 7f90b1880740 20 client.16053 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.338+0000 7f90b1880740 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56300da186e0 0x56300da1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.338+0000 7f90b1880740 4 client.16053 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.338+0000 7f90b1880740 1 -- 172.21.15.12:0/3992523352 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56300d900d70 con 0x56300da186e0 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.338+0000 7f90ad243640 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56300da186e0 0x56300da1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90ad243640 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56300da186e0 0x56300da1ab00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fc7d261786aede6b server_cookie=18fbb90d08758009 in_seq=0 out_seq=0 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f9090ff9640 10 client.16053 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f9090ff9640 1 -- 172.21.15.12:0/3992523352 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56300d900d70 con 0x56300da186e0 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f9090ff9640 10 client.16053 handle_command_reply: tid=0 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 client.16053 shutdown 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 -- 172.21.15.12:0/3992523352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 msgr2=0x56300d9a19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d9a19b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9098000c00 tx=0x7f90980120a0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 -- 172.21.15.12:0/3992523352 shutdown_connections 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x56300da186e0 0x56300da1ab00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56300d99e370 0x56300d9a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56300d994b40 0x56300d9a19b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f9090ff9640 0 client.16053 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:03:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 --2- 172.21.15.12:0/3992523352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56300d9935d0 0x56300d9a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 -- 172.21.15.12:0/3992523352 >> 172.21.15.12:0/3992523352 conn(0x56300d95c310 msgr2=0x56300d98e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 -- 172.21.15.12:0/3992523352 shutdown_connections 2024-09-16T01:03:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 1 -- 172.21.15.12:0/3992523352 wait complete. 2024-09-16T01:03:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.339+0000 7f90b1880740 20 client.16053 trim_cache size 0 max 16384 2024-09-16T01:03:17.345 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:03:17.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 -- 172.21.15.12:0/948954847 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90940a3240 msgr2=0x7f90940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:17.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90940a3240 0x7f90940a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x56300d990ac0 tx=0x7f90a4031400 comp rx=0 tx=0).stop 2024-09-16T01:03:17.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 -- 172.21.15.12:0/948954847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90a8102ef0 msgr2=0x7f90a81a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:17.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90a8102ef0 0x7f90a81a43b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f90a000eb10 tx=0x7f90a000c2d0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 -- 172.21.15.12:0/948954847 shutdown_connections 2024-09-16T01:03:17.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90940a3240 0x7f90940a5700 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90a8102ef0 0x7f90a81a43b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90a8102570 0x7f90a8199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 --2- 172.21.15.12:0/948954847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90a8100e20 0x7f90a8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:17.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 -- 172.21.15.12:0/948954847 >> 172.21.15.12:0/948954847 conn(0x7f90a80fc7d0 msgr2=0x7f90a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:17.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.340+0000 7f90af4a7640 1 -- 172.21.15.12:0/948954847 shutdown_connections 2024-09-16T01:03:17.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:17.341+0000 7f90af4a7640 1 -- 172.21.15.12:0/948954847 wait complete. 2024-09-16T01:03:18.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-16T01:03:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:18.755 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:18 smithi012 ceph-mon[31197]: pgmap v426: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 MiB/s wr, 15 op/s 2024-09-16T01:03:18.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 -- 172.21.15.12:0/2684304731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83c0102570 msgr2=0x7f83c01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 --2- 172.21.15.12:0/2684304731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83c0102570 0x7f83c01029b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009900 tx=0x7f83b002a480 comp rx=0 tx=0).stop 2024-09-16T01:03:18.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 -- 172.21.15.12:0/2684304731 shutdown_connections 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 --2- 172.21.15.12:0/2684304731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c0102ef0 0x7f83c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 --2- 172.21.15.12:0/2684304731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83c0102570 0x7f83c01029b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 --2- 172.21.15.12:0/2684304731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83c0100e20 0x7f83c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 -- 172.21.15.12:0/2684304731 >> 172.21.15.12:0/2684304731 conn(0x7f83c00fc7d0 msgr2=0x7f83c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 -- 172.21.15.12:0/2684304731 shutdown_connections 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 -- 172.21.15.12:0/2684304731 wait complete. 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 Processor -- start 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.842+0000 7f83c7a0f640 1 -- start start 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c7a0f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c0100e20 0x7f83c0197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c7a0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83c0102570 0x7f83c01976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c7a0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83c0102ef0 0x7f83c0197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c7a0f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f83c0110fd0 con 0x7f83c0102ef0 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c7a0f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f83c0110e50 con 0x7f83c0100e20 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c7a0f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83c0111150 con 0x7f83c0102570 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c5fac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83c0102ef0 0x7f83c0197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c5fac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83c0102ef0 0x7f83c0197c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46914/0 (socket says 172.21.15.12:46914) 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c5fac640 1 -- 172.21.15.12:0/1199224633 learned_addr learned my addr 172.21.15.12:0/1199224633 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c57ab640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c0100e20 0x7f83c0197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c4faa640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83c0102570 0x7f83c01976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c5fac640 1 -- 172.21.15.12:0/1199224633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83c0102570 msgr2=0x7f83c01976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c5fac640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83c0102570 0x7f83c01976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c5fac640 1 -- 172.21.15.12:0/1199224633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c0100e20 msgr2=0x7f83c0197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c5fac640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c0100e20 0x7f83c0197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c5fac640 1 -- 172.21.15.12:0/1199224633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c01a6a00 con 0x7f83c0102ef0 2024-09-16T01:03:18.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.843+0000 7f83c5fac640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83c0102ef0 0x7f83c0197c10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f83b800eaa0 tx=0x7f83b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.844+0000 7f83b67fc640 1 -- 172.21.15.12:0/1199224633 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b800cdb0 con 0x7f83c0102ef0 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.844+0000 7f83c7a0f640 1 -- 172.21.15.12:0/1199224633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c01a6cf0 con 0x7f83c0102ef0 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.844+0000 7f83b67fc640 1 -- 172.21.15.12:0/1199224633 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b8005020 con 0x7f83c0102ef0 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.844+0000 7f83b67fc640 1 -- 172.21.15.12:0/1199224633 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b80116b0 con 0x7f83c0102ef0 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.844+0000 7f83c7a0f640 1 -- 172.21.15.12:0/1199224633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c01a7200 con 0x7f83c0102ef0 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.847+0000 7f83b67fc640 1 -- 172.21.15.12:0/1199224633 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f83b8005560 con 0x7f83c0102ef0 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.847+0000 7f83c9de8740 1 Processor -- start 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.847+0000 7f83c9de8740 1 -- start start 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f38b40 0x558038f37090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 0x558038f37a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f44760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c9de8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558038e9d2f0 con 0x558038f42370 2024-09-16T01:03:18.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c9de8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558038e44cf0 con 0x558038f38b40 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c9de8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558038e992b0 con 0x558038f375d0 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83b67fc640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83ac0a3240 0x7f83ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c4faa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f44760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c4faa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f44760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46926/0 (socket says 172.21.15.12:46926) 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c4faa640 1 -- 172.21.15.12:0/629246537 learned_addr learned my addr 172.21.15.12:0/629246537 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c57ab640 1 --2- 172.21.15.12:0/629246537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 0x558038f37a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c4faa640 1 --2- 172.21.15.12:0/629246537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f38b40 0x558038f37090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83b67fc640 1 -- 172.21.15.12:0/1199224633 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f83b80cfee0 con 0x7f83c0102ef0 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c5fac640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83ac0a3240 0x7f83ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c4faa640 1 -- 172.21.15.12:0/629246537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 msgr2=0x558038f37a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c4faa640 1 --2- 172.21.15.12:0/629246537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 0x558038f37a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c4faa640 1 -- 172.21.15.12:0/629246537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f38b40 msgr2=0x558038f37090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c4faa640 1 --2- 172.21.15.12:0/629246537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f38b40 0x558038f37090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c4faa640 1 -- 172.21.15.12:0/629246537 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558038e293a0 con 0x558038f42370 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c57ab640 1 --2- 172.21.15.12:0/629246537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 0x558038f37a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.848+0000 7f83c4faa640 1 --2- 172.21.15.12:0/629246537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f44760 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f83b0005ec0 tx=0x7f83b0005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4904d0aa965da server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83c5fac640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83ac0a3240 0x7f83ac0a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f83b80cd620 tx=0x7f83b8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83ab7fe640 1 -- 172.21.15.12:0/629246537 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0035040 con 0x558038f42370 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83ab7fe640 1 -- 172.21.15.12:0/629246537 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b0003e10 con 0x558038f42370 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83ab7fe640 1 -- 172.21.15.12:0/629246537 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0031db0 con 0x558038f42370 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83c9de8740 1 -- 172.21.15.12:0/629246537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 msgr2=0x558038f44760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83c9de8740 1 --2- 172.21.15.12:0/629246537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f44760 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f83b0005ec0 tx=0x7f83b0005b50 comp rx=0 tx=0).stop 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83c9de8740 1 -- 172.21.15.12:0/629246537 shutdown_connections 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83c9de8740 1 --2- 172.21.15.12:0/629246537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f44760 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83c9de8740 1 --2- 172.21.15.12:0/629246537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 0x558038f37a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83c9de8740 1 --2- 172.21.15.12:0/629246537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f38b40 0x558038f37090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.849+0000 7f83c9de8740 1 -- 172.21.15.12:0/629246537 >> 172.21.15.12:0/629246537 conn(0x558038f00310 msgr2=0x558038f33c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 1 -- 172.21.15.12:0/629246537 shutdown_connections 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 1 -- 172.21.15.12:0/629246537 wait complete. 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 1 -- start start 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 1 Processor -- start 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f375d0 0x558038f41d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f38b40 0x558038f3f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f3f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558038f45010 con 0x558038f42370 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558038e58060 con 0x558038f375d0 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558038f45190 con 0x558038f38b40 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.850+0000 7f83c9de8740 10 client.0 _ll_register_callbacks cb 0x558038bab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c4faa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f3f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c4faa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f3f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46940/0 (socket says 172.21.15.12:46940) 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c4faa640 1 -- 172.21.15.12:0/3905807299 learned_addr learned my addr 172.21.15.12:0/3905807299 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c4faa640 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f375d0 0x558038f41d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c57ab640 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f38b40 0x558038f3f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c4faa640 1 -- 172.21.15.12:0/3905807299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f38b40 msgr2=0x558038f3f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c4faa640 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f38b40 0x558038f3f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c4faa640 1 -- 172.21.15.12:0/3905807299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f375d0 msgr2=0x558038f41d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c4faa640 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f375d0 0x558038f41d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c4faa640 1 -- 172.21.15.12:0/3905807299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558038c0e3c0 con 0x558038f42370 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c4faa640 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f3f610 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f83b0031af0 tx=0x7f83b00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23196b65274e617f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3905807299 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0035070 con 0x558038f42370 2024-09-16T01:03:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3905807299 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f83b0003730 con 0x558038f42370 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.851+0000 7f83c9de8740 1 -- 172.21.15.12:0/3905807299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83b0003e10 con 0x558038f42370 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3905807299 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f83b0031810 con 0x558038f42370 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83c9de8740 10 client.16065 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83c9de8740 1 -- 172.21.15.12:0/3905807299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558038f50ab0 con 0x558038f42370 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3905807299 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b0003e10 con 0x558038f42370 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3905807299 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f83b003a040 con 0x558038f42370 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83c9de8740 10 client.16065 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83c9de8740 10 client.16065 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83c9de8740 20 client.16065 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x558038f51e00 0x558038f541f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83c9de8740 4 client.16065 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83c9de8740 1 -- 172.21.15.12:0/3905807299 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558038eaa860 con 0x558038f51e00 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.852+0000 7f83c57ab640 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x558038f51e00 0x558038f541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.853+0000 7f83a8ff9640 10 client.16065 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.853+0000 7f83c57ab640 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x558038f51e00 0x558038f541f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2acfd6c7bafcdb61 server_cookie=d3a2f0718e27c3e in_seq=0 out_seq=0 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3905807299 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558038eaa860 con 0x558038f51e00 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83a8ff9640 10 client.16065 handle_command_reply: tid=0 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 client.16065 shutdown 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 -- 172.21.15.12:0/3905807299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 msgr2=0x558038f3f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f3f610 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f83b0031af0 tx=0x7f83b00319f0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 -- 172.21.15.12:0/3905807299 shutdown_connections 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x558038f51e00 0x558038f541f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83a8ff9640 0 client.16065 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f3f610 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f38b40 0x558038f3f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3905807299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f375d0 0x558038f41d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 -- 172.21.15.12:0/3905807299 >> 172.21.15.12:0/3905807299 conn(0x558038f00310 msgr2=0x558038f39960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 -- 172.21.15.12:0/3905807299 shutdown_connections 2024-09-16T01:03:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 1 -- 172.21.15.12:0/3905807299 wait complete. 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.854+0000 7f83c9de8740 20 client.16065 trim_cache size 0 max 16384 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.867+0000 7f83c9de8740 1 Processor -- start 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c9de8740 1 -- start start 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 0x558038f57210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f38b40 0x558038f57750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f42370 0x558038f3c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c9de8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f83c01b0dd0 con 0x558038f38b40 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c9de8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f83c01b2910 con 0x558038f42370 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c9de8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83c01b14a0 con 0x558038f375d0 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c57ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f38b40 0x558038f57750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c57ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f38b40 0x558038f57750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46948/0 (socket says 172.21.15.12:46948) 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c57ab640 1 -- 172.21.15.12:0/651482603 learned_addr learned my addr 172.21.15.12:0/651482603 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c4faa640 1 --2- 172.21.15.12:0/651482603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 0x558038f57210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c4faa640 1 --2- 172.21.15.12:0/651482603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f42370 0x558038f3c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c57ab640 1 -- 172.21.15.12:0/651482603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 msgr2=0x558038f57210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c57ab640 1 --2- 172.21.15.12:0/651482603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 0x558038f57210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c57ab640 1 -- 172.21.15.12:0/651482603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f42370 msgr2=0x558038f3c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c57ab640 1 --2- 172.21.15.12:0/651482603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f42370 0x558038f3c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c57ab640 1 -- 172.21.15.12:0/651482603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558038f44f50 con 0x558038f38b40 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.868+0000 7f83c4faa640 1 --2- 172.21.15.12:0/651482603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 0x558038f57210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.869+0000 7f83c57ab640 1 --2- 172.21.15.12:0/651482603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f38b40 0x558038f57750 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x558038f40660 tx=0x7f83bc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622ee6e8e1b965a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.869+0000 7f83aaffd640 1 -- 172.21.15.12:0/651482603 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc01d470 con 0x558038f38b40 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.869+0000 7f83aaffd640 1 -- 172.21.15.12:0/651482603 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83bc01daf0 con 0x558038f38b40 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.869+0000 7f83aaffd640 1 -- 172.21.15.12:0/651482603 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc011d10 con 0x558038f38b40 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 -- 172.21.15.12:0/651482603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f38b40 msgr2=0x558038f57750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 --2- 172.21.15.12:0/651482603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f38b40 0x558038f57750 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x558038f40660 tx=0x7f83bc0039c0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 -- 172.21.15.12:0/651482603 shutdown_connections 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 --2- 172.21.15.12:0/651482603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f42370 0x558038f3c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 --2- 172.21.15.12:0/651482603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f38b40 0x558038f57750 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 --2- 172.21.15.12:0/651482603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f375d0 0x558038f57210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 -- 172.21.15.12:0/651482603 >> 172.21.15.12:0/651482603 conn(0x558038f00310 msgr2=0x558038f410a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 -- 172.21.15.12:0/651482603 shutdown_connections 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 -- 172.21.15.12:0/651482603 wait complete. 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 -- start start 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.870+0000 7f83c9de8740 1 Processor -- start 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f375d0 0x558038f551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f38b40 0x558038f556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c9de8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f55c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c9de8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f83c01b2240 con 0x558038f42370 2024-09-16T01:03:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c9de8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f83c01b1b70 con 0x558038f375d0 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c9de8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83c01aedb0 con 0x558038f38b40 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c9de8740 10 client.0 _ll_register_callbacks cb 0x7f83b00041d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c4faa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f55c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c4faa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f55c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46960/0 (socket says 172.21.15.12:46960) 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c4faa640 1 -- 172.21.15.12:0/3458827340 learned_addr learned my addr 172.21.15.12:0/3458827340 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c4faa640 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f375d0 0x558038f551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c57ab640 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f38b40 0x558038f556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c4faa640 1 -- 172.21.15.12:0/3458827340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f38b40 msgr2=0x558038f556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c4faa640 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f38b40 0x558038f556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c4faa640 1 -- 172.21.15.12:0/3458827340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f375d0 msgr2=0x558038f551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c4faa640 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f375d0 0x558038f551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c4faa640 1 -- 172.21.15.12:0/3458827340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558038fbb940 con 0x558038f42370 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83c4faa640 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f55c20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f83b0005ec0 tx=0x7f83b0040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f765475856ccb8fc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.871+0000 7f83a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3458827340 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b003de60 con 0x558038f42370 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3458827340 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f83b0003730 con 0x558038f42370 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83c9de8740 1 -- 172.21.15.12:0/3458827340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83bc01daf0 con 0x558038f42370 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3458827340 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f83b0009520 con 0x558038f42370 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83c9de8740 10 client.16071 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83c9de8740 1 -- 172.21.15.12:0/3458827340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558038fbcc20 con 0x558038f42370 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3458827340 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83bc01daf0 con 0x558038f42370 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3458827340 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f83b0063530 con 0x558038f42370 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83c9de8740 10 client.16071 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83c9de8740 10 client.16071 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-16T01:03:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83c9de8740 20 client.16071 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x558038f51e00 0x558038fbf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83c9de8740 4 client.16071 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.872+0000 7f83c9de8740 1 -- 172.21.15.12:0/3458827340 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558038ea4d70 con 0x558038f51e00 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c57ab640 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x558038f51e00 0x558038fbf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c57ab640 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x558038f51e00 0x558038fbf110 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=958592df12c6f660 server_cookie=c64605a6a525317f in_seq=0 out_seq=0 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83a8ff9640 10 client.16071 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83a8ff9640 1 -- 172.21.15.12:0/3458827340 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558038ea4d70 con 0x558038f51e00 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83a8ff9640 10 client.16071 handle_command_reply: tid=0 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c9de8740 1 client.16071 shutdown 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c9de8740 1 -- 172.21.15.12:0/3458827340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 msgr2=0x558038f55c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f55c20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f83b0005ec0 tx=0x7f83b0040040 comp rx=0 tx=0).stop 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c9de8740 1 -- 172.21.15.12:0/3458827340 shutdown_connections 2024-09-16T01:03:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x558038f51e00 0x558038fbf110 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558038f42370 0x558038f55c20 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558038f38b40 0x558038f556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83a8ff9640 0 client.16071 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:03:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c9de8740 1 --2- 172.21.15.12:0/3458827340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558038f375d0 0x558038f551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.873+0000 7f83c9de8740 1 -- 172.21.15.12:0/3458827340 >> 172.21.15.12:0/3458827340 conn(0x558038f00310 msgr2=0x558038f3d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.874+0000 7f83c9de8740 1 -- 172.21.15.12:0/3458827340 shutdown_connections 2024-09-16T01:03:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.874+0000 7f83c9de8740 1 -- 172.21.15.12:0/3458827340 wait complete. 2024-09-16T01:03:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.874+0000 7f83c9de8740 20 client.16071 trim_cache size 0 max 16384 2024-09-16T01:03:18.897 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:03:18.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.874+0000 7f83c7a0f640 1 -- 172.21.15.12:0/1199224633 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83ac0a3240 msgr2=0x7f83ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.874+0000 7f83c7a0f640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83ac0a3240 0x7f83ac0a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f83b80cd620 tx=0x7f83b8005850 comp rx=0 tx=0).stop 2024-09-16T01:03:18.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.875+0000 7f83c7a0f640 1 -- 172.21.15.12:0/1199224633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83c0102ef0 msgr2=0x7f83c0197c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.875+0000 7f83c7a0f640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83c0102ef0 0x7f83c0197c10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f83b800eaa0 tx=0x7f83b800ef60 comp rx=0 tx=0).stop 2024-09-16T01:03:18.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.875+0000 7f83c7a0f640 1 -- 172.21.15.12:0/1199224633 shutdown_connections 2024-09-16T01:03:18.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.875+0000 7f83c7a0f640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f83ac0a3240 0x7f83ac0a5700 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.875+0000 7f83c7a0f640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83c0102ef0 0x7f83c0197c10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.875+0000 7f83c7a0f640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83c0102570 0x7f83c01976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.875+0000 7f83c7a0f640 1 --2- 172.21.15.12:0/1199224633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c0100e20 0x7f83c0197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.875+0000 7f83c7a0f640 1 -- 172.21.15.12:0/1199224633 >> 172.21.15.12:0/1199224633 conn(0x7f83c00fc7d0 msgr2=0x7f83c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.875+0000 7f83c7a0f640 1 -- 172.21.15.12:0/1199224633 shutdown_connections 2024-09-16T01:03:18.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:18.875+0000 7f83c7a0f640 1 -- 172.21.15.12:0/1199224633 wait complete. 2024-09-16T01:03:18.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:18 smithi098 ceph-mon[35346]: pgmap v426: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 MiB/s wr, 15 op/s 2024-09-16T01:03:19.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:18 smithi119 ceph-mon[35049]: pgmap v426: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 MiB/s wr, 15 op/s 2024-09-16T01:03:19.634 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-16T01:03:19.908 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:20.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.412+0000 7f4198252640 1 -- 172.21.15.12:0/2618253169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102ef0 msgr2=0x7f419010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:20.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.412+0000 7f4198252640 1 --2- 172.21.15.12:0/2618253169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102ef0 0x7f419010da40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4188009ca0 tx=0x7f418802a950 comp rx=0 tx=0).stop 2024-09-16T01:03:20.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.412+0000 7f4198252640 1 -- 172.21.15.12:0/2618253169 shutdown_connections 2024-09-16T01:03:20.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.412+0000 7f4198252640 1 --2- 172.21.15.12:0/2618253169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102ef0 0x7f419010da40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.412+0000 7f4198252640 1 --2- 172.21.15.12:0/2618253169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4190102570 0x7f41901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.412+0000 7f4198252640 1 --2- 172.21.15.12:0/2618253169 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190100e20 0x7f4190101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.412+0000 7f4198252640 1 -- 172.21.15.12:0/2618253169 >> 172.21.15.12:0/2618253169 conn(0x7f41900fc7d0 msgr2=0x7f41900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:20.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.412+0000 7f4198252640 1 -- 172.21.15.12:0/2618253169 shutdown_connections 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.412+0000 7f4198252640 1 -- 172.21.15.12:0/2618253169 wait complete. 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f4198252640 1 Processor -- start 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f4198252640 1 -- start start 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f4198252640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190100e20 0x7f419019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f4198252640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102570 0x7f419019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f4198252640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4190102ef0 0x7f419019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f4198252640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4190110f80 con 0x7f4190102570 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f4198252640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4190110e00 con 0x7f4190100e20 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f4198252640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4190111100 con 0x7f4190102ef0 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f41957ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102570 0x7f419019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f41957ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102570 0x7f419019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46984/0 (socket says 172.21.15.12:46984) 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f41957ed640 1 -- 172.21.15.12:0/2230705604 learned_addr learned my addr 172.21.15.12:0/2230705604 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:20.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f4195fee640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190100e20 0x7f419019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.413+0000 7f41967ef640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4190102ef0 0x7f419019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f41957ed640 1 -- 172.21.15.12:0/2230705604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4190102ef0 msgr2=0x7f419019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f41957ed640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4190102ef0 0x7f419019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f41957ed640 1 -- 172.21.15.12:0/2230705604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190100e20 msgr2=0x7f419019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f41957ed640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190100e20 0x7f419019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f41957ed640 1 -- 172.21.15.12:0/2230705604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419019f650 con 0x7f4190102570 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f41957ed640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102570 0x7f419019abe0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f418000e9f0 tx=0x7f418000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f4186ffd640 1 -- 172.21.15.12:0/2230705604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418000cd80 con 0x7f4190102570 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f4186ffd640 1 -- 172.21.15.12:0/2230705604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4180005500 con 0x7f4190102570 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f4198252640 1 -- 172.21.15.12:0/2230705604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419019f940 con 0x7f4190102570 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f4186ffd640 1 -- 172.21.15.12:0/2230705604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180010690 con 0x7f4190102570 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.414+0000 7f4198252640 1 -- 172.21.15.12:0/2230705604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41901a7220 con 0x7f4190102570 2024-09-16T01:03:20.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.417+0000 7f4186ffd640 1 -- 172.21.15.12:0/2230705604 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f41800046c0 con 0x7f4190102570 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.417+0000 7f4186ffd640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f417c0a3240 0x7f417c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.418+0000 7f4186ffd640 1 -- 172.21.15.12:0/2230705604 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f41800d0050 con 0x7f4190102570 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.418+0000 7f4195fee640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f417c0a3240 0x7f417c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.418+0000 7f4195fee640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f417c0a3240 0x7f417c0a5700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f418c00bbe0 tx=0x7f418c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.418+0000 7f419a62b740 1 Processor -- start 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f419a62b740 1 -- start start 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f419a62b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01c2b40 0x5572d01c1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f419a62b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f419a62b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01cc370 0x5572d01ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f419a62b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5572d01272f0 con 0x5572d01c15d0 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f419a62b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5572d00cecf0 con 0x5572d01cc370 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f419a62b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5572d01232b0 con 0x5572d01c2b40 2024-09-16T01:03:20.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f41957ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f41957ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46988/0 (socket says 172.21.15.12:46988) 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f41957ed640 1 -- 172.21.15.12:0/3302112791 learned_addr learned my addr 172.21.15.12:0/3302112791 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f41967ef640 1 --2- 172.21.15.12:0/3302112791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01cc370 0x5572d01ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f4195fee640 1 --2- 172.21.15.12:0/3302112791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01c2b40 0x5572d01c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f41957ed640 1 -- 172.21.15.12:0/3302112791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01c2b40 msgr2=0x5572d01c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f41957ed640 1 --2- 172.21.15.12:0/3302112791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01c2b40 0x5572d01c1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.419+0000 7f41957ed640 1 -- 172.21.15.12:0/3302112791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01cc370 msgr2=0x5572d01ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.420+0000 7f41957ed640 1 --2- 172.21.15.12:0/3302112791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01cc370 0x5572d01ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.420+0000 7f41957ed640 1 -- 172.21.15.12:0/3302112791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d00b33a0 con 0x5572d01c15d0 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.420+0000 7f4195fee640 1 --2- 172.21.15.12:0/3302112791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01c2b40 0x5572d01c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.420+0000 7f41957ed640 1 --2- 172.21.15.12:0/3302112791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01c1a10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4180098770 tx=0x7f418009bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18825ba0ca923a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.420+0000 7f417bfff640 1 -- 172.21.15.12:0/3302112791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800b5070 con 0x5572d01c15d0 2024-09-16T01:03:20.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.420+0000 7f417bfff640 1 -- 172.21.15.12:0/3302112791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41800a06c0 con 0x5572d01c15d0 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.420+0000 7f417bfff640 1 -- 172.21.15.12:0/3302112791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800a4af0 con 0x5572d01c15d0 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 -- 172.21.15.12:0/3302112791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 msgr2=0x5572d01c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 --2- 172.21.15.12:0/3302112791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01c1a10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4180098770 tx=0x7f418009bc70 comp rx=0 tx=0).stop 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 -- 172.21.15.12:0/3302112791 shutdown_connections 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 --2- 172.21.15.12:0/3302112791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01cc370 0x5572d01ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 --2- 172.21.15.12:0/3302112791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01c1a10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 --2- 172.21.15.12:0/3302112791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01c2b40 0x5572d01c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 -- 172.21.15.12:0/3302112791 >> 172.21.15.12:0/3302112791 conn(0x5572d018a310 msgr2=0x5572d01bdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 -- 172.21.15.12:0/3302112791 shutdown_connections 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 -- 172.21.15.12:0/3302112791 wait complete. 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 -- start start 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.421+0000 7f419a62b740 1 Processor -- start 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f419a62b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c15d0 0x5572d01cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f419a62b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f419a62b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01c9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f419a62b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5572d01cf070 con 0x5572d01c2b40 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f419a62b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5572d00e2060 con 0x5572d01c15d0 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f419a62b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5572d01cf1f0 con 0x5572d01cc370 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f419a62b740 10 client.0 _ll_register_callbacks cb 0x5572cfe358c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f41957ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f41957ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46992/0 (socket says 172.21.15.12:46992) 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f41957ed640 1 -- 172.21.15.12:0/3058055617 learned_addr learned my addr 172.21.15.12:0/3058055617 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f41967ef640 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f4195fee640 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c15d0 0x5572d01cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f41957ed640 1 -- 172.21.15.12:0/3058055617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 msgr2=0x5572d01c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f41957ed640 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f41957ed640 1 -- 172.21.15.12:0/3058055617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c15d0 msgr2=0x5572d01cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f41957ed640 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c15d0 0x5572d01cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.422+0000 7f41957ed640 1 -- 172.21.15.12:0/3058055617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572cfe983c0 con 0x5572d01c2b40 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f41957ed640 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01c90b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f418009c2a0 tx=0x7f4180005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd05f1322e275f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f41797fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f41797fa640 1 -- 172.21.15.12:0/3058055617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800ba060 con 0x5572d01c2b40 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f419a62b740 1 -- 172.21.15.12:0/3058055617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41800a06c0 con 0x5572d01c2b40 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f41797fa640 1 -- 172.21.15.12:0/3058055617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f41800b51e0 con 0x5572d01c2b40 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f41797fa640 1 -- 172.21.15.12:0/3058055617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f41800ac050 con 0x5572d01c2b40 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f419a62b740 10 client.16083 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f419a62b740 1 -- 172.21.15.12:0/3058055617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5572d01cf070 con 0x5572d01c2b40 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f41797fa640 1 -- 172.21.15.12:0/3058055617 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41800a06c0 con 0x5572d01c2b40 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f41797fa640 1 -- 172.21.15.12:0/3058055617 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4180098060 con 0x5572d01c2b40 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.423+0000 7f419a62b740 10 client.16083 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.424+0000 7f419a62b740 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:20.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.424+0000 7f419a62b740 20 client.16083 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.424+0000 7f419a62b740 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5572d01dbd40 0x5572d01de130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.424+0000 7f419a62b740 4 client.16083 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.424+0000 7f419a62b740 1 -- 172.21.15.12:0/3058055617 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572d0134860 con 0x5572d01dbd40 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.424+0000 7f4195fee640 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5572d01dbd40 0x5572d01de130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.424+0000 7f41797fa640 10 client.16083 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.424+0000 7f4195fee640 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5572d01dbd40 0x5572d01de130 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b1745d21d999d8 server_cookie=4a2a0f3af5f4eaba in_seq=0 out_seq=0 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f41797fa640 1 -- 172.21.15.12:0/3058055617 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572d0134860 con 0x5572d01dbd40 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f41797fa640 10 client.16083 handle_command_reply: tid=0 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 client.16083 shutdown 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 -- 172.21.15.12:0/3058055617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 msgr2=0x5572d01c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01c90b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f418009c2a0 tx=0x7f4180005760 comp rx=0 tx=0).stop 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 -- 172.21.15.12:0/3058055617 shutdown_connections 2024-09-16T01:03:20.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5572d01dbd40 0x5572d01de130 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01c90b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f41797fa640 0 client.16083 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:20.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 --2- 172.21.15.12:0/3058055617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c15d0 0x5572d01cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 -- 172.21.15.12:0/3058055617 >> 172.21.15.12:0/3058055617 conn(0x5572d018a310 msgr2=0x5572d01c3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:20.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 -- 172.21.15.12:0/3058055617 shutdown_connections 2024-09-16T01:03:20.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.425+0000 7f419a62b740 1 -- 172.21.15.12:0/3058055617 wait complete. 2024-09-16T01:03:20.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.426+0000 7f419a62b740 20 client.16083 trim_cache size 0 max 16384 2024-09-16T01:03:20.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.439+0000 7f419a62b740 1 Processor -- start 2024-09-16T01:03:20.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.439+0000 7f419a62b740 1 -- start start 2024-09-16T01:03:20.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.439+0000 7f419a62b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01d7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.439+0000 7f419a62b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c2b40 0x5572d01e37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.439+0000 7f419a62b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.439+0000 7f419a62b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41901b0d30 con 0x5572d01c15d0 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.439+0000 7f419a62b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f41901b2870 con 0x5572d01c2b40 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.439+0000 7f419a62b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f41901b1400 con 0x5572d01cc370 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f4195fee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01d7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f4195fee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01d7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46994/0 (socket says 172.21.15.12:46994) 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f4195fee640 1 -- 172.21.15.12:0/3139530023 learned_addr learned my addr 172.21.15.12:0/3139530023 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f41957ed640 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c2b40 0x5572d01e37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f41967ef640 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f4195fee640 1 -- 172.21.15.12:0/3139530023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 msgr2=0x5572d01e3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f4195fee640 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01e3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f4195fee640 1 -- 172.21.15.12:0/3139530023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c2b40 msgr2=0x5572d01e37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f4195fee640 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c2b40 0x5572d01e37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f4195fee640 1 -- 172.21.15.12:0/3139530023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d01c9b70 con 0x5572d01c15d0 2024-09-16T01:03:20.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f41957ed640 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c2b40 0x5572d01e37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f41967ef640 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f4195fee640 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01d7b20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x5572d01de760 tx=0x7f418c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faea97a6936fea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f417b7fe640 1 -- 172.21.15.12:0/3139530023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c011d40 con 0x5572d01c15d0 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.440+0000 7f417b7fe640 1 -- 172.21.15.12:0/3139530023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f418c021e30 con 0x5572d01c15d0 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.441+0000 7f417b7fe640 1 -- 172.21.15.12:0/3139530023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c0055f0 con 0x5572d01c15d0 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 -- 172.21.15.12:0/3139530023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 msgr2=0x5572d01d7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01d7b20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x5572d01de760 tx=0x7f418c013000 comp rx=0 tx=0).stop 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 -- 172.21.15.12:0/3139530023 shutdown_connections 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c2b40 0x5572d01e37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 --2- 172.21.15.12:0/3139530023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c15d0 0x5572d01d7b20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 -- 172.21.15.12:0/3139530023 >> 172.21.15.12:0/3139530023 conn(0x5572d018a310 msgr2=0x5572d01c3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 -- 172.21.15.12:0/3139530023 shutdown_connections 2024-09-16T01:03:20.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 -- 172.21.15.12:0/3139530023 wait complete. 2024-09-16T01:03:20.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 -- start start 2024-09-16T01:03:20.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.442+0000 7f419a62b740 1 Processor -- start 2024-09-16T01:03:20.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f419a62b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c15d0 0x5572d01d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f419a62b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f419a62b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f419a62b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41901b21a0 con 0x5572d01c2b40 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f419a62b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f41901b1ad0 con 0x5572d01c15d0 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f419a62b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f41901aed10 con 0x5572d01cc370 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f41957ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f41957ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47008/0 (socket says 172.21.15.12:47008) 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f419a62b740 10 client.0 _ll_register_callbacks cb 0x7f41800b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f41957ed640 1 -- 172.21.15.12:0/506409397 learned_addr learned my addr 172.21.15.12:0/506409397 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f4195fee640 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c15d0 0x5572d01d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.443+0000 7f41967ef640 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41957ed640 1 -- 172.21.15.12:0/506409397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 msgr2=0x5572d01d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41957ed640 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41957ed640 1 -- 172.21.15.12:0/506409397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c15d0 msgr2=0x5572d01d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41957ed640 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c15d0 0x5572d01d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41957ed640 1 -- 172.21.15.12:0/506409397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572d02459e0 con 0x5572d01c2b40 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41957ed640 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01d0990 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4180098770 tx=0x7f41800056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f9bfe5a76547a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41797fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41797fa640 1 -- 172.21.15.12:0/506409397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800ba040 con 0x5572d01c2b40 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41797fa640 1 -- 172.21.15.12:0/506409397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f41800b0400 con 0x5572d01c2b40 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f419a62b740 1 -- 172.21.15.12:0/506409397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f418c021e30 con 0x5572d01c2b40 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41797fa640 1 -- 172.21.15.12:0/506409397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f41800b5040 con 0x5572d01c2b40 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f419a62b740 10 client.16089 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f419a62b740 1 -- 172.21.15.12:0/506409397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5572d0246ce0 con 0x5572d01c2b40 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.444+0000 7f41797fa640 1 -- 172.21.15.12:0/506409397 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f418c021e30 con 0x5572d01c2b40 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.445+0000 7f41797fa640 1 -- 172.21.15.12:0/506409397 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f418008d020 con 0x5572d01c2b40 2024-09-16T01:03:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.445+0000 7f419a62b740 10 client.16089 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.445+0000 7f419a62b740 10 client.16089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.445+0000 7f419a62b740 20 client.16089 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.445+0000 7f419a62b740 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5572d02471c0 0x5572d02495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.445+0000 7f419a62b740 4 client.16089 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.445+0000 7f419a62b740 1 -- 172.21.15.12:0/506409397 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5572d012ed70 con 0x5572d02471c0 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.445+0000 7f4195fee640 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5572d02471c0 0x5572d02495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.445+0000 7f4195fee640 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5572d02471c0 0x5572d02495b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0a35fd9494915d0 server_cookie=dc88de6449612941 in_seq=0 out_seq=0 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.445+0000 7f41797fa640 10 client.16089 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f41797fa640 1 -- 172.21.15.12:0/506409397 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5572d012ed70 con 0x5572d02471c0 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f41797fa640 10 client.16089 handle_command_reply: tid=0 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 client.16089 shutdown 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 -- 172.21.15.12:0/506409397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 msgr2=0x5572d01d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01d0990 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4180098770 tx=0x7f41800056b0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 -- 172.21.15.12:0/506409397 shutdown_connections 2024-09-16T01:03:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5572d02471c0 0x5572d02495b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5572d01cc370 0x5572d01d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d01c2b40 0x5572d01d0990 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 --2- 172.21.15.12:0/506409397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5572d01c15d0 0x5572d01d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f41797fa640 0 client.16089 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 -- 172.21.15.12:0/506409397 >> 172.21.15.12:0/506409397 conn(0x5572d018a310 msgr2=0x5572d01d7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 -- 172.21.15.12:0/506409397 shutdown_connections 2024-09-16T01:03:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 1 -- 172.21.15.12:0/506409397 wait complete. 2024-09-16T01:03:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.446+0000 7f419a62b740 20 client.16089 trim_cache size 0 max 16384 2024-09-16T01:03:20.452 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:03:20.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 -- 172.21.15.12:0/2230705604 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f417c0a3240 msgr2=0x7f417c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:20.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f417c0a3240 0x7f417c0a5700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f418c00bbe0 tx=0x7f418c00b390 comp rx=0 tx=0).stop 2024-09-16T01:03:20.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 -- 172.21.15.12:0/2230705604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102570 msgr2=0x7f419019abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:20.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102570 0x7f419019abe0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f418000e9f0 tx=0x7f418000edf0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 -- 172.21.15.12:0/2230705604 shutdown_connections 2024-09-16T01:03:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f417c0a3240 0x7f417c0a5700 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4190102ef0 0x7f419019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4190102570 0x7f419019abe0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 --2- 172.21.15.12:0/2230705604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4190100e20 0x7f419019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 -- 172.21.15.12:0/2230705604 >> 172.21.15.12:0/2230705604 conn(0x7f41900fc7d0 msgr2=0x7f419006a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 -- 172.21.15.12:0/2230705604 shutdown_connections 2024-09-16T01:03:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:20.447+0000 7f4198252640 1 -- 172.21.15.12:0/2230705604 wait complete. 2024-09-16T01:03:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:20 smithi098 ceph-mon[35346]: pgmap v427: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 15 op/s 2024-09-16T01:03:21.051 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:20 smithi012 ceph-mon[31197]: pgmap v427: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 15 op/s 2024-09-16T01:03:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:20 smithi119 ceph-mon[35049]: pgmap v427: 129 pgs: 129 active+clean; 258 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 15 op/s 2024-09-16T01:03:21.769 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-16T01:03:21.769 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.55 2024-09-16T01:03:21.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:03:22.045 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:22.438 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-16T01:03:22.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-16T01:03:22.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.530+0000 7fd238971640 1 -- 172.21.15.12:0/1639457773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd234102d30 msgr2=0x7fd234103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:22.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.530+0000 7fd238971640 1 --2- 172.21.15.12:0/1639457773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd234102d30 0x7fd234103110 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd224009930 tx=0x7fd22402a420 comp rx=0 tx=0).stop 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.530+0000 7fd238971640 1 -- 172.21.15.12:0/1639457773 shutdown_connections 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.530+0000 7fd238971640 1 --2- 172.21.15.12:0/1639457773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2341082a0 0x7fd23410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.530+0000 7fd238971640 1 --2- 172.21.15.12:0/1639457773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2341036e0 0x7fd234107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.530+0000 7fd238971640 1 --2- 172.21.15.12:0/1639457773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd234102d30 0x7fd234103110 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.530+0000 7fd238971640 1 -- 172.21.15.12:0/1639457773 >> 172.21.15.12:0/1639457773 conn(0x7fd2340fc7d0 msgr2=0x7fd2340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.530+0000 7fd238971640 1 -- 172.21.15.12:0/1639457773 shutdown_connections 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.530+0000 7fd238971640 1 -- 172.21.15.12:0/1639457773 wait complete. 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.531+0000 7fd238971640 1 Processor -- start 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.531+0000 7fd238971640 1 -- start start 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.531+0000 7fd238971640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd234102d30 0x7fd2341985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.531+0000 7fd238971640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2341036e0 0x7fd234198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:22.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.531+0000 7fd238971640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2341082a0 0x7fd23419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.531+0000 7fd238971640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2341120a0 con 0x7fd2341036e0 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.531+0000 7fd238971640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd234111f20 con 0x7fd2341082a0 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.531+0000 7fd238971640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd234112220 con 0x7fd234102d30 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd231d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2341036e0 0x7fd234198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd231d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2341036e0 0x7fd234198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47026/0 (socket says 172.21.15.12:47026) 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd231d9b640 1 -- 172.21.15.12:0/2607779880 learned_addr learned my addr 172.21.15.12:0/2607779880 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd232d9d640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2341082a0 0x7fd23419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd23259c640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd234102d30 0x7fd2341985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd231d9b640 1 -- 172.21.15.12:0/2607779880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd234102d30 msgr2=0x7fd2341985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd231d9b640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd234102d30 0x7fd2341985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd231d9b640 1 -- 172.21.15.12:0/2607779880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2341082a0 msgr2=0x7fd23419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:22.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd231d9b640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2341082a0 0x7fd23419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd231d9b640 1 -- 172.21.15.12:0/2607779880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23419d570 con 0x7fd2341036e0 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd232d9d640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2341082a0 0x7fd23419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.532+0000 7fd231d9b640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2341036e0 0x7fd234198b00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd22800d950 tx=0x7fd22800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.533+0000 7fd2237fe640 1 -- 172.21.15.12:0/2607779880 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228017070 con 0x7fd2341036e0 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.533+0000 7fd2237fe640 1 -- 172.21.15.12:0/2607779880 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd228009c30 con 0x7fd2341036e0 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.533+0000 7fd2237fe640 1 -- 172.21.15.12:0/2607779880 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2280047a0 con 0x7fd2341036e0 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.533+0000 7fd238971640 1 -- 172.21.15.12:0/2607779880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23419d860 con 0x7fd2341036e0 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.533+0000 7fd238971640 1 -- 172.21.15.12:0/2607779880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2341a5140 con 0x7fd2341036e0 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.534+0000 7fd238971640 1 -- 172.21.15.12:0/2607779880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23406a850 con 0x7fd2341036e0 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.535+0000 7fd2237fe640 1 -- 172.21.15.12:0/2607779880 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd228004020 con 0x7fd2341036e0 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.536+0000 7fd2237fe640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd21c0a32c0 0x7fd21c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.537+0000 7fd2237fe640 1 -- 172.21.15.12:0/2607779880 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fd2280cfa20 con 0x7fd2341036e0 2024-09-16T01:03:22.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.537+0000 7fd23259c640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd21c0a32c0 0x7fd21c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:22.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.537+0000 7fd23259c640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd21c0a32c0 0x7fd21c0a5780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd224009900 tx=0x7fd2240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:22.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.540+0000 7fd2237fe640 1 -- 172.21.15.12:0/2607779880 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd228020030 con 0x7fd2341036e0 2024-09-16T01:03:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:22.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.780+0000 7fd238971640 1 -- 172.21.15.12:0/2607779880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd23410a2b0 con 0x7fd2341036e0 2024-09-16T01:03:22.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:22 smithi012 ceph-mon[31197]: pgmap v428: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 15 op/s 2024-09-16T01:03:22.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.781+0000 7fd2237fe640 1 -- 172.21.15.12:0/2607779880 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7fd22809c400 con 0x7fd2341036e0 2024-09-16T01:03:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:03:22.783 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:03:22.783 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:03:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 -- 172.21.15.12:0/2607779880 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd21c0a32c0 msgr2=0x7fd21c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd21c0a32c0 0x7fd21c0a5780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd224009900 tx=0x7fd2240058d0 comp rx=0 tx=0).stop 2024-09-16T01:03:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 -- 172.21.15.12:0/2607779880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2341036e0 msgr2=0x7fd234198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2341036e0 0x7fd234198b00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd22800d950 tx=0x7fd22800de10 comp rx=0 tx=0).stop 2024-09-16T01:03:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 -- 172.21.15.12:0/2607779880 shutdown_connections 2024-09-16T01:03:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fd21c0a32c0 0x7fd21c0a5780 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2341082a0 0x7fd23419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2341036e0 0x7fd234198b00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:22.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 --2- 172.21.15.12:0/2607779880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd234102d30 0x7fd2341985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:22.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 -- 172.21.15.12:0/2607779880 >> 172.21.15.12:0/2607779880 conn(0x7fd2340fc7d0 msgr2=0x7fd234105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:22.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 -- 172.21.15.12:0/2607779880 shutdown_connections 2024-09-16T01:03:22.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:22.783+0000 7fd238971640 1 -- 172.21.15.12:0/2607779880 wait complete. 2024-09-16T01:03:22.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:22 smithi098 ceph-mon[35346]: pgmap v428: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 15 op/s 2024-09-16T01:03:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:22 smithi119 ceph-mon[35049]: pgmap v428: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 15 op/s 2024-09-16T01:03:23.802 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0' 2024-09-16T01:03:23.802 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24518 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0 2024-09-16T01:03:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:23 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2607779880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:23.977 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:23 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2607779880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:23.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.976+0000 7f863a30d640 1 -- 172.21.15.12:0/996595802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86341027a0 msgr2=0x7f86341067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:23.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.976+0000 7f863a30d640 1 --2- 172.21.15.12:0/996595802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86341027a0 0x7f86341067f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8628009900 tx=0x7f862802a410 comp rx=0 tx=0).stop 2024-09-16T01:03:23.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.976+0000 7f863a30d640 1 -- 172.21.15.12:0/996595802 shutdown_connections 2024-09-16T01:03:23.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.976+0000 7f863a30d640 1 --2- 172.21.15.12:0/996595802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8634106f20 0x7f863410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.976+0000 7f863a30d640 1 --2- 172.21.15.12:0/996595802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86341027a0 0x7f86341067f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.976+0000 7f863a30d640 1 --2- 172.21.15.12:0/996595802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8634101df0 0x7f86341021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.976+0000 7f863a30d640 1 -- 172.21.15.12:0/996595802 >> 172.21.15.12:0/996595802 conn(0x7f86340fd8b0 msgr2=0x7f86340ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.976+0000 7f863a30d640 1 -- 172.21.15.12:0/996595802 shutdown_connections 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.976+0000 7f863a30d640 1 -- 172.21.15.12:0/996595802 wait complete. 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f863a30d640 1 Processor -- start 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f863a30d640 1 -- start start 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f863a30d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8634101df0 0x7f86340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f863a30d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86341027a0 0x7f8634074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f863a30d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8634106f20 0x7f8634074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f863a30d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8634111f80 con 0x7f8634106f20 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f863a30d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8634111e00 con 0x7f8634101df0 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f863a30d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8634112100 con 0x7f86341027a0 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f86388aa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8634106f20 0x7f8634074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f86388aa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8634106f20 0x7f8634074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47034/0 (socket says 172.21.15.12:47034) 2024-09-16T01:03:23.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f86388aa640 1 -- 172.21.15.12:0/3724483342 learned_addr learned my addr 172.21.15.12:0/3724483342 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f8633fff640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8634101df0 0x7f86340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.977+0000 7f86337fe640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86341027a0 0x7f8634074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f86388aa640 1 -- 172.21.15.12:0/3724483342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86341027a0 msgr2=0x7f8634074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f86388aa640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86341027a0 0x7f8634074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f86388aa640 1 -- 172.21.15.12:0/3724483342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8634101df0 msgr2=0x7f86340744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f86388aa640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8634101df0 0x7f86340744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f86388aa640 1 -- 172.21.15.12:0/3724483342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86341a6900 con 0x7f8634106f20 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f86337fe640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86341027a0 0x7f8634074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f86388aa640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8634106f20 0x7f8634074f70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f862c00eaa0 tx=0x7f862c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f86317fa640 1 -- 172.21.15.12:0/3724483342 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c00cdb0 con 0x7f8634106f20 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f863a30d640 1 -- 172.21.15.12:0/3724483342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86341a6bf0 con 0x7f8634106f20 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f86317fa640 1 -- 172.21.15.12:0/3724483342 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f862c005020 con 0x7f8634106f20 2024-09-16T01:03:23.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f86317fa640 1 -- 172.21.15.12:0/3724483342 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0116b0 con 0x7f8634106f20 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.978+0000 7f863a30d640 1 -- 172.21.15.12:0/3724483342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86341a70e0 con 0x7f8634106f20 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f86317fa640 1 -- 172.21.15.12:0/3724483342 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f862c005560 con 0x7f8634106f20 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f863c6e6740 1 Processor -- start 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f863c6e6740 1 -- start start 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac73bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73c480 0x5582ac746800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac746d40 0x5582ac749130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f863c6e6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5582ac6a1280 con 0x5582ac73bb60 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f863c6e6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5582ac648b10 con 0x5582ac746d40 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f863c6e6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5582ac69d240 con 0x5582ac73c480 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f86337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac73bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f86337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac73bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47038/0 (socket says 172.21.15.12:47038) 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f86337fe640 1 -- 172.21.15.12:0/95997038 learned_addr learned my addr 172.21.15.12:0/95997038 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.982+0000 7f8633fff640 1 --2- 172.21.15.12:0/95997038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73c480 0x5582ac746800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f86337fe640 1 --2- 172.21.15.12:0/95997038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac746d40 0x5582ac749130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f8633fff640 1 -- 172.21.15.12:0/95997038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac746d40 msgr2=0x5582ac749130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f8633fff640 1 --2- 172.21.15.12:0/95997038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac746d40 0x5582ac749130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f8633fff640 1 -- 172.21.15.12:0/95997038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 msgr2=0x5582ac73bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f8633fff640 1 --2- 172.21.15.12:0/95997038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac73bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f8633fff640 1 -- 172.21.15.12:0/95997038 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ac6551f0 con 0x5582ac73c480 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f86337fe640 1 --2- 172.21.15.12:0/95997038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac73bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f86317fa640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f861c0a3240 0x7f861c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f8633fff640 1 --2- 172.21.15.12:0/95997038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73c480 0x5582ac746800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f862400bbf0 tx=0x7f86240107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4921504f2fbaf572 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f86337fe640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f861c0a3240 0x7f861c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f86317fa640 1 -- 172.21.15.12:0/3724483342 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f862c0cfe80 con 0x7f8634106f20 2024-09-16T01:03:23.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f861a7fc640 1 -- 172.21.15.12:0/95997038 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624004030 con 0x5582ac73c480 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f861a7fc640 1 -- 172.21.15.12:0/95997038 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86240041d0 con 0x5582ac73c480 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.983+0000 7f861a7fc640 1 -- 172.21.15.12:0/95997038 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86240117b0 con 0x5582ac73c480 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f863c6e6740 1 -- 172.21.15.12:0/95997038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73c480 msgr2=0x5582ac746800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f86337fe640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f861c0a3240 0x7f861c0a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8628005ec0 tx=0x7f862803f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f863c6e6740 1 --2- 172.21.15.12:0/95997038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73c480 0x5582ac746800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f862400bbf0 tx=0x7f86240107a0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f863c6e6740 1 -- 172.21.15.12:0/95997038 shutdown_connections 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f863c6e6740 1 --2- 172.21.15.12:0/95997038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac746d40 0x5582ac749130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f863c6e6740 1 --2- 172.21.15.12:0/95997038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73c480 0x5582ac746800 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f863c6e6740 1 --2- 172.21.15.12:0/95997038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac73bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f863c6e6740 1 -- 172.21.15.12:0/95997038 >> 172.21.15.12:0/95997038 conn(0x5582ac7380f0 msgr2=0x5582ac7384d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f863c6e6740 1 -- 172.21.15.12:0/95997038 shutdown_connections 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f863c6e6740 1 -- 172.21.15.12:0/95997038 wait complete. 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.985+0000 7f863c6e6740 1 -- start start 2024-09-16T01:03:23.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f863c6e6740 1 Processor -- start 2024-09-16T01:03:23.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac743b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac7440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 0x5582ac744600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f863c6e6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5582ac749910 con 0x5582ac73bb60 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f863c6e6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5582ac65bf10 con 0x5582ac73c480 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f863c6e6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5582ac749a90 con 0x5582ac746d40 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f863c6e6740 10 client.0 _ll_register_callbacks cb 0x5582ac624a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f86388aa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 0x5582ac744600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f8633fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac743b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f8633fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac743b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47046/0 (socket says 172.21.15.12:47046) 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.986+0000 7f8633fff640 1 -- 172.21.15.12:0/58649825 learned_addr learned my addr 172.21.15.12:0/58649825 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f8633fff640 1 -- 172.21.15.12:0/58649825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 msgr2=0x5582ac744600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f8633fff640 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 0x5582ac744600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f8633fff640 1 -- 172.21.15.12:0/58649825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 msgr2=0x5582ac7440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f86337fe640 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac7440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f8633fff640 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac7440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f8633fff640 1 -- 172.21.15.12:0/58649825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582ac4126a0 con 0x5582ac73bb60 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f86388aa640 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 0x5582ac744600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f8633fff640 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac743b80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8624000c00 tx=0x7f862400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafac69c60235251 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f86137fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f86137fe640 1 -- 172.21.15.12:0/58649825 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862402a060 con 0x5582ac73bb60 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f86137fe640 1 -- 172.21.15.12:0/58649825 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f8624004380 con 0x5582ac73bb60 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.987+0000 7f863c6e6740 1 -- 172.21.15.12:0/58649825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86240041d0 con 0x5582ac73bb60 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f86137fe640 1 -- 172.21.15.12:0/58649825 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8624031050 con 0x5582ac73bb60 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f863c6e6740 10 client.16107 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f863c6e6740 1 -- 172.21.15.12:0/58649825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5582ac7554b0 con 0x5582ac73bb60 2024-09-16T01:03:23.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f86137fe640 1 -- 172.21.15.12:0/58649825 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86240041d0 con 0x5582ac73bb60 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f86137fe640 1 -- 172.21.15.12:0/58649825 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f86240046c0 con 0x5582ac73bb60 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f863c6e6740 10 client.16107 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f863c6e6740 10 client.16107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f863c6e6740 20 client.16107 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f863c6e6740 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5582ac756970 0x5582ac758d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f863c6e6740 4 client.16107 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.988+0000 7f863c6e6740 1 -- 172.21.15.12:0/58649825 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582ac6ae7f0 con 0x5582ac756970 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.989+0000 7f86337fe640 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5582ac756970 0x5582ac758d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.989+0000 7f86337fe640 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5582ac756970 0x5582ac758d60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ce8b2aaeeb28c54 server_cookie=198105b8e539ae4a in_seq=0 out_seq=0 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.989+0000 7f86137fe640 10 client.16107 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.990+0000 7f86137fe640 1 -- 172.21.15.12:0/58649825 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582ac6ae7f0 con 0x5582ac756970 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.990+0000 7f86137fe640 10 client.16107 handle_command_reply: tid=0 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.990+0000 7f863c6e6740 1 client.16107 shutdown 2024-09-16T01:03:23.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.990+0000 7f863c6e6740 1 -- 172.21.15.12:0/58649825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 msgr2=0x5582ac743b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.990+0000 7f863c6e6740 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac743b80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8624000c00 tx=0x7f862400bfd0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.991+0000 7f863c6e6740 1 -- 172.21.15.12:0/58649825 shutdown_connections 2024-09-16T01:03:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.991+0000 7f863c6e6740 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5582ac756970 0x5582ac758d60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.991+0000 7f863c6e6740 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 0x5582ac744600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.991+0000 7f863c6e6740 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac7440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.991+0000 7f863c6e6740 1 --2- 172.21.15.12:0/58649825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac743b80 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.991+0000 7f863c6e6740 1 -- 172.21.15.12:0/58649825 >> 172.21.15.12:0/58649825 conn(0x5582ac7380f0 msgr2=0x5582ac73de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.991+0000 7f86137fe640 0 client.16107 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.991+0000 7f863c6e6740 1 -- 172.21.15.12:0/58649825 shutdown_connections 2024-09-16T01:03:23.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.991+0000 7f863c6e6740 1 -- 172.21.15.12:0/58649825 wait complete. 2024-09-16T01:03:23.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:23.991+0000 7f863c6e6740 20 client.16107 trim_cache size 0 max 16384 2024-09-16T01:03:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f863c6e6740 1 Processor -- start 2024-09-16T01:03:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f863c6e6740 1 -- start start 2024-09-16T01:03:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac740de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac741320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f8633fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac740de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 0x5582ac742320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:24.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f8633fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac740de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47056/0 (socket says 172.21.15.12:47056) 2024-09-16T01:03:24.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f863c6e6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f86341b0e50 con 0x5582ac73bb60 2024-09-16T01:03:24.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f863c6e6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f86341b2990 con 0x5582ac73c480 2024-09-16T01:03:24.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f8633fff640 1 -- 172.21.15.12:0/2920049680 learned_addr learned my addr 172.21.15.12:0/2920049680 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:24.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f863c6e6740 1 -- 172.21.15.12:0/2920049680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f86341b1520 con 0x5582ac746d40 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.030+0000 7f86337fe640 1 --2- 172.21.15.12:0/2920049680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac741320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f86388aa640 1 --2- 172.21.15.12:0/2920049680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 0x5582ac742320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f8633fff640 1 -- 172.21.15.12:0/2920049680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 msgr2=0x5582ac742320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f8633fff640 1 --2- 172.21.15.12:0/2920049680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 0x5582ac742320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f8633fff640 1 -- 172.21.15.12:0/2920049680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 msgr2=0x5582ac741320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f8633fff640 1 --2- 172.21.15.12:0/2920049680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac741320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f8633fff640 1 -- 172.21.15.12:0/2920049680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ac733830 con 0x5582ac73bb60 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f86337fe640 1 --2- 172.21.15.12:0/2920049680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac741320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f8633fff640 1 --2- 172.21.15.12:0/2920049680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac740de0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f86240107e0 tx=0x7f8624011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d16ebece367cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f8619ffb640 1 -- 172.21.15.12:0/2920049680 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624005850 con 0x5582ac73bb60 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f8619ffb640 1 -- 172.21.15.12:0/2920049680 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8624004f20 con 0x5582ac73bb60 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.031+0000 7f8619ffb640 1 -- 172.21.15.12:0/2920049680 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624004380 con 0x5582ac73bb60 2024-09-16T01:03:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.032+0000 7f863c6e6740 1 -- 172.21.15.12:0/2920049680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 msgr2=0x5582ac740de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.032+0000 7f863c6e6740 1 --2- 172.21.15.12:0/2920049680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac740de0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f86240107e0 tx=0x7f8624011440 comp rx=0 tx=0).stop 2024-09-16T01:03:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.033+0000 7f863c6e6740 1 -- 172.21.15.12:0/2920049680 shutdown_connections 2024-09-16T01:03:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.033+0000 7f863c6e6740 1 --2- 172.21.15.12:0/2920049680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac746d40 0x5582ac742320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.033+0000 7f863c6e6740 1 --2- 172.21.15.12:0/2920049680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac741320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.033+0000 7f863c6e6740 1 --2- 172.21.15.12:0/2920049680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac73bb60 0x5582ac740de0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.033+0000 7f863c6e6740 1 -- 172.21.15.12:0/2920049680 >> 172.21.15.12:0/2920049680 conn(0x5582ac7380f0 msgr2=0x5582ac745af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.033+0000 7f863c6e6740 1 -- 172.21.15.12:0/2920049680 shutdown_connections 2024-09-16T01:03:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.033+0000 7f863c6e6740 1 -- 172.21.15.12:0/2920049680 wait complete. 2024-09-16T01:03:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.033+0000 7f863c6e6740 1 -- start start 2024-09-16T01:03:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f863c6e6740 1 Processor -- start 2024-09-16T01:03:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73bb60 0x5582ac75bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac7572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f863c6e6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac746d40 0x5582ac757830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f863c6e6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f86341b22c0 con 0x5582ac746d40 2024-09-16T01:03:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f863c6e6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f86341b1bf0 con 0x5582ac73c480 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f863c6e6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f86341aee30 con 0x5582ac73bb60 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f863c6e6740 10 client.0 _ll_register_callbacks cb 0x7f8628009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f86337fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac7572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f86337fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac7572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:50134/0 (socket says 172.21.15.12:50134) 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f86337fe640 1 -- 172.21.15.12:0/3802534334 learned_addr learned my addr 172.21.15.12:0/3802534334 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f86388aa640 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac746d40 0x5582ac757830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.034+0000 7f8633fff640 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73bb60 0x5582ac75bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.035+0000 7f86388aa640 1 -- 172.21.15.12:0/3802534334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73bb60 msgr2=0x5582ac75bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.035+0000 7f86388aa640 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73bb60 0x5582ac75bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.035+0000 7f86388aa640 1 -- 172.21.15.12:0/3802534334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 msgr2=0x5582ac7572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.035+0000 7f86388aa640 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac7572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.035+0000 7f86388aa640 1 -- 172.21.15.12:0/3802534334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582ac757f20 con 0x5582ac746d40 2024-09-16T01:03:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.035+0000 7f86388aa640 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac746d40 0x5582ac757830 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f862c00efd0 tx=0x7f862c09c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2247e88ab879b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:24.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.035+0000 7f86137fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.036+0000 7f86137fe640 1 -- 172.21.15.12:0/3802534334 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0b4070 con 0x5582ac746d40 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.036+0000 7f86137fe640 1 -- 172.21.15.12:0/3802534334 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f862c0a0150 con 0x5582ac746d40 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.036+0000 7f863c6e6740 1 -- 172.21.15.12:0/3802534334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8624004f20 con 0x5582ac746d40 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.036+0000 7f86137fe640 1 -- 172.21.15.12:0/3802534334 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f862c01f040 con 0x5582ac746d40 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.036+0000 7f863c6e6740 10 client.16113 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.036+0000 7f863c6e6740 1 -- 172.21.15.12:0/3802534334 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5582ac7c1200 con 0x5582ac746d40 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.036+0000 7f86137fe640 1 -- 172.21.15.12:0/3802534334 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f862c09b590 con 0x5582ac746d40 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.036+0000 7f86137fe640 1 -- 172.21.15.12:0/3802534334 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f862c00f040 con 0x5582ac746d40 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.037+0000 7f863c6e6740 10 client.16113 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.037+0000 7f863c6e6740 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.037+0000 7f863c6e6740 20 client.16113 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:24.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.037+0000 7f863c6e6740 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5582ac7c1970 0x5582ac7c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:24.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.037+0000 7f863c6e6740 4 client.16113 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-16T01:03:24.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.037+0000 7f863c6e6740 1 -- 172.21.15.12:0/3802534334 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f8624004f20 con 0x5582ac7c1970 2024-09-16T01:03:24.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.037+0000 7f8633fff640 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5582ac7c1970 0x5582ac7c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:24.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.038+0000 7f86137fe640 10 client.16113 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:24.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.038+0000 7f8633fff640 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5582ac7c1970 0x5582ac7c3d90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a6d36e7e6d1191 server_cookie=8916596b1039f217 in_seq=0 out_seq=0 2024-09-16T01:03:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.038+0000 7f86137fe640 1 -- 172.21.15.12:0/3802534334 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f8624004f20 con 0x5582ac7c1970 2024-09-16T01:03:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.038+0000 7f86137fe640 10 client.16113 handle_command_reply: tid=0 2024-09-16T01:03:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 client.16113 shutdown 2024-09-16T01:03:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 -- 172.21.15.12:0/3802534334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac746d40 msgr2=0x5582ac757830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac746d40 0x5582ac757830 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f862c00efd0 tx=0x7f862c09c140 comp rx=0 tx=0).stop 2024-09-16T01:03:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 -- 172.21.15.12:0/3802534334 shutdown_connections 2024-09-16T01:03:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5582ac7c1970 0x5582ac7c3d90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582ac746d40 0x5582ac757830 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5582ac73c480 0x5582ac7572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 --2- 172.21.15.12:0/3802534334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5582ac73bb60 0x5582ac75bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 -- 172.21.15.12:0/3802534334 >> 172.21.15.12:0/3802534334 conn(0x5582ac7380f0 msgr2=0x5582ac736a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:24.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f86137fe640 0 client.16113 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:24.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 -- 172.21.15.12:0/3802534334 shutdown_connections 2024-09-16T01:03:24.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.039+0000 7f863c6e6740 1 -- 172.21.15.12:0/3802534334 wait complete. 2024-09-16T01:03:24.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.040+0000 7f863c6e6740 20 client.16113 trim_cache size 0 max 16384 2024-09-16T01:03:24.042 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:03:24.042 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-16T01:03:24.042 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "d1a90aa1-498b-4a36-a3c4-32728da0285d", 2024-09-16T01:03:24.043 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-16T01:03:24.043 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:03:24.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.040+0000 7f863a30d640 1 -- 172.21.15.12:0/3724483342 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f861c0a3240 msgr2=0x7f861c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.040+0000 7f863a30d640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f861c0a3240 0x7f861c0a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8628005ec0 tx=0x7f862803f040 comp rx=0 tx=0).stop 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.040+0000 7f863a30d640 1 -- 172.21.15.12:0/3724483342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8634106f20 msgr2=0x7f8634074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.040+0000 7f863a30d640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8634106f20 0x7f8634074f70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f862c00eaa0 tx=0x7f862c00ef60 comp rx=0 tx=0).stop 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.041+0000 7f863a30d640 1 -- 172.21.15.12:0/3724483342 shutdown_connections 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.041+0000 7f863a30d640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f861c0a3240 0x7f861c0a5700 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.041+0000 7f863a30d640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8634106f20 0x7f8634074f70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.041+0000 7f863a30d640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86341027a0 0x7f8634074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.041+0000 7f863a30d640 1 --2- 172.21.15.12:0/3724483342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8634101df0 0x7f86340744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.041+0000 7f863a30d640 1 -- 172.21.15.12:0/3724483342 >> 172.21.15.12:0/3724483342 conn(0x7f86340fd8b0 msgr2=0x7f86340febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.041+0000 7f863a30d640 1 -- 172.21.15.12:0/3724483342 shutdown_connections 2024-09-16T01:03:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:24.041+0000 7f863a30d640 1 -- 172.21.15.12:0/3724483342 wait complete. 2024-09-16T01:03:24.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:23 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2607779880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:24.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:24 smithi012 ceph-mon[31197]: pgmap v429: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2024-09-16T01:03:24.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:24 smithi012 ceph-mon[31197]: scrub queued for path: / 2024-09-16T01:03:24.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:24 smithi012 ceph-mon[31197]: scrub summary: idle+waiting paths [/] 2024-09-16T01:03:24.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:24 smithi012 ceph-mon[31197]: scrub summary: active paths [/] 2024-09-16T01:03:24.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:24 smithi012 ceph-mon[31197]: scrub summary: idle+waiting paths [/] 2024-09-16T01:03:24.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:03:24.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:24 smithi098 ceph-mon[35346]: pgmap v429: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2024-09-16T01:03:24.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:24 smithi098 ceph-mon[35346]: scrub queued for path: / 2024-09-16T01:03:24.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:24 smithi098 ceph-mon[35346]: scrub summary: idle+waiting paths [/] 2024-09-16T01:03:24.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:24 smithi098 ceph-mon[35346]: scrub summary: active paths [/] 2024-09-16T01:03:24.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:24 smithi098 ceph-mon[35346]: scrub summary: idle+waiting paths [/] 2024-09-16T01:03:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:24 smithi119 ceph-mon[35049]: pgmap v429: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2024-09-16T01:03:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:24 smithi119 ceph-mon[35049]: scrub queued for path: / 2024-09-16T01:03:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:24 smithi119 ceph-mon[35049]: scrub summary: idle+waiting paths [/] 2024-09-16T01:03:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:24 smithi119 ceph-mon[35049]: scrub summary: active paths [/] 2024-09-16T01:03:25.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:24 smithi119 ceph-mon[35049]: scrub summary: idle+waiting paths [/] 2024-09-16T01:03:25.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.342+0000 7f2d094ad640 1 -- 172.21.15.12:0/1968527871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d04102ef0 msgr2=0x7f2d0410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:25.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.342+0000 7f2d094ad640 1 --2- 172.21.15.12:0/1968527871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d04102ef0 0x7f2d0410da40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc009ca0 tx=0x7f2cfc02a950 comp rx=0 tx=0).stop 2024-09-16T01:03:25.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.343+0000 7f2d094ad640 1 -- 172.21.15.12:0/1968527871 shutdown_connections 2024-09-16T01:03:25.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.343+0000 7f2d094ad640 1 --2- 172.21.15.12:0/1968527871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d04102ef0 0x7f2d0410da40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.343+0000 7f2d094ad640 1 --2- 172.21.15.12:0/1968527871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d04102570 0x7f2d041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.343+0000 7f2d094ad640 1 --2- 172.21.15.12:0/1968527871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d04100e20 0x7f2d04101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.343+0000 7f2d094ad640 1 -- 172.21.15.12:0/1968527871 >> 172.21.15.12:0/1968527871 conn(0x7f2d040fc7d0 msgr2=0x7f2d040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:25.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.343+0000 7f2d094ad640 1 -- 172.21.15.12:0/1968527871 shutdown_connections 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.343+0000 7f2d094ad640 1 -- 172.21.15.12:0/1968527871 wait complete. 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.343+0000 7f2d094ad640 1 Processor -- start 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d094ad640 1 -- start start 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d094ad640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d04100e20 0x7f2d04199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d094ad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d04102570 0x7f2d04199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d094ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d04102ef0 0x7f2d041a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d094ad640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2d04110fd0 con 0x7f2d04100e20 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d094ad640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2d04110e50 con 0x7f2d04102ef0 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d094ad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2d04111150 con 0x7f2d04102570 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d04100e20 0x7f2d04199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d04100e20 0x7f2d04199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47082/0 (socket says 172.21.15.12:47082) 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d02ffd640 1 -- 172.21.15.12:0/4043234922 learned_addr learned my addr 172.21.15.12:0/4043234922 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d04102570 0x7f2d04199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d037fe640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d04102ef0 0x7f2d041a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d02ffd640 1 -- 172.21.15.12:0/4043234922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d04102570 msgr2=0x7f2d04199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d04102570 0x7f2d04199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d02ffd640 1 -- 172.21.15.12:0/4043234922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d04102ef0 msgr2=0x7f2d041a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d04102ef0 0x7f2d041a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d02ffd640 1 -- 172.21.15.12:0/4043234922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d041a4900 con 0x7f2d04100e20 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d04102570 0x7f2d04199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.344+0000 7f2d037fe640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d04102ef0 0x7f2d041a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.345+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d04100e20 0x7f2d04199340 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400d950 tx=0x7f2cf400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.345+0000 7f2d00ff9640 1 -- 172.21.15.12:0/4043234922 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4017070 con 0x7f2d04100e20 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.345+0000 7f2d00ff9640 1 -- 172.21.15.12:0/4043234922 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cf4009c30 con 0x7f2d04100e20 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.345+0000 7f2d094ad640 1 -- 172.21.15.12:0/4043234922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d041a4ad0 con 0x7f2d04100e20 2024-09-16T01:03:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.345+0000 7f2d00ff9640 1 -- 172.21.15.12:0/4043234922 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400f6b0 con 0x7f2d04100e20 2024-09-16T01:03:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.345+0000 7f2d094ad640 1 -- 172.21.15.12:0/4043234922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d041a5010 con 0x7f2d04100e20 2024-09-16T01:03:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.348+0000 7f2d00ff9640 1 -- 172.21.15.12:0/4043234922 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2cf40109d0 con 0x7f2d04100e20 2024-09-16T01:03:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.348+0000 7f2d0b886740 1 Processor -- start 2024-09-16T01:03:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.349+0000 7f2d0b886740 1 -- start start 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.349+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dad3850 0x55ce0dad3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.349+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dade4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.349+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dadea30 0x55ce0dae0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.349+0000 7f2d0b886740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce0da38160 con 0x55ce0dad4170 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.349+0000 7f2d0b886740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce0d9df720 con 0x55ce0dad3850 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.349+0000 7f2d0b886740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ce0da34120 con 0x55ce0dadea30 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.349+0000 7f2d02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dade4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.349+0000 7f2d037fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dad3850 0x55ce0dad3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2d037fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dad3850 0x55ce0dad3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:50166/0 (socket says 172.21.15.12:50166) 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2d037fe640 1 -- 172.21.15.12:0/2861858999 learned_addr learned my addr 172.21.15.12:0/2861858999 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/2861858999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dadea30 0x55ce0dae0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2d00ff9640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2cf00a32c0 0x7f2cf00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2d02ffd640 1 -- 172.21.15.12:0/2861858999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dadea30 msgr2=0x55ce0dae0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/2861858999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dadea30 0x55ce0dae0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2d02ffd640 1 -- 172.21.15.12:0/2861858999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dad3850 msgr2=0x55ce0dad3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/2861858999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dad3850 0x55ce0dad3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2d02ffd640 1 -- 172.21.15.12:0/2861858999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0d7a9ba0 con 0x55ce0dad4170 2024-09-16T01:03:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2d037fe640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2cf00a32c0 0x7f2cf00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.350+0000 7f2d00ff9640 1 -- 172.21.15.12:0/4043234922 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f2cf40cf8b0 con 0x7f2d04100e20 2024-09-16T01:03:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.351+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/2861858999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dadea30 0x55ce0dae0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.351+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/2861858999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dade4f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40ccff0 tx=0x7f2cf4066500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7de357e7bd9491 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.351+0000 7f2d037fe640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2cf00a32c0 0x7f2cf00a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc02ae70 tx=0x7f2cfc02a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.351+0000 7f2cf97fa640 1 -- 172.21.15.12:0/2861858999 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf409b6b0 con 0x55ce0dad4170 2024-09-16T01:03:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.351+0000 7f2cf97fa640 1 -- 172.21.15.12:0/2861858999 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cf4066a10 con 0x55ce0dad4170 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.351+0000 7f2cf97fa640 1 -- 172.21.15.12:0/2861858999 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf409b4d0 con 0x55ce0dad4170 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.352+0000 7f2d0b886740 1 -- 172.21.15.12:0/2861858999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 msgr2=0x55ce0dade4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.352+0000 7f2d0b886740 1 --2- 172.21.15.12:0/2861858999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dade4f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40ccff0 tx=0x7f2cf4066500 comp rx=0 tx=0).stop 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.352+0000 7f2d0b886740 1 -- 172.21.15.12:0/2861858999 shutdown_connections 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.352+0000 7f2d0b886740 1 --2- 172.21.15.12:0/2861858999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dadea30 0x55ce0dae0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.352+0000 7f2d0b886740 1 --2- 172.21.15.12:0/2861858999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dade4f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.352+0000 7f2d0b886740 1 --2- 172.21.15.12:0/2861858999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dad3850 0x55ce0dad3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.352+0000 7f2d0b886740 1 -- 172.21.15.12:0/2861858999 >> 172.21.15.12:0/2861858999 conn(0x55ce0dacfde0 msgr2=0x55ce0dad01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.352+0000 7f2d0b886740 1 -- 172.21.15.12:0/2861858999 shutdown_connections 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.352+0000 7f2d0b886740 1 -- 172.21.15.12:0/2861858999 wait complete. 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.352+0000 7f2d0b886740 1 -- start start 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d0b886740 1 Processor -- start 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dadb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad4170 0x55ce0dadbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dadc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d0b886740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce0dae5a10 con 0x55ce0dad3850 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d0b886740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce0d9c0900 con 0x55ce0dadea30 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d0b886740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ce0dae5b90 con 0x55ce0dad4170 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d0b886740 10 client.0 _ll_register_callbacks cb 0x55ce0d9be780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dadb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dadb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47104/0 (socket says 172.21.15.12:47104) 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d02ffd640 1 -- 172.21.15.12:0/3612218777 learned_addr learned my addr 172.21.15.12:0/3612218777 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad4170 0x55ce0dadbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.353+0000 7f2d037fe640 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dadc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2d02ffd640 1 -- 172.21.15.12:0/3612218777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad4170 msgr2=0x55ce0dadbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad4170 0x55ce0dadbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2d02ffd640 1 -- 172.21.15.12:0/3612218777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 msgr2=0x55ce0dadc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dadc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2d02ffd640 1 -- 172.21.15.12:0/3612218777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce0da00c50 con 0x55ce0dad3850 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dadb880 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40058c0 tx=0x7f2cf400dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b714f3caa4ee580 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2cea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2cea7fc640 1 -- 172.21.15.12:0/3612218777 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4020040 con 0x55ce0dad3850 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2d0b886740 1 -- 172.21.15.12:0/3612218777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cf4066a10 con 0x55ce0dad3850 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2cea7fc640 1 -- 172.21.15.12:0/3612218777 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f2cf4099e70 con 0x55ce0dad3850 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2cea7fc640 1 -- 172.21.15.12:0/3612218777 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2cf409c270 con 0x55ce0dad3850 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2d0b886740 10 client.16125 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.354+0000 7f2d0b886740 1 -- 172.21.15.12:0/3612218777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ce0dae5a10 con 0x55ce0dad3850 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.355+0000 7f2cea7fc640 1 -- 172.21.15.12:0/3612218777 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cf4066a10 con 0x55ce0dad3850 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.355+0000 7f2cea7fc640 1 -- 172.21.15.12:0/3612218777 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2cf40981e0 con 0x55ce0dad3850 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.355+0000 7f2d0b886740 10 client.16125 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:25.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.355+0000 7f2d0b886740 10 client.16125 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:03:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.355+0000 7f2d0b886740 20 client.16125 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.355+0000 7f2d0b886740 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ce0daf2a70 0x55ce0daf4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.355+0000 7f2d0b886740 4 client.16125 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.355+0000 7f2d0b886740 1 -- 172.21.15.12:0/3612218777 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce0da45890 con 0x55ce0daf2a70 2024-09-16T01:03:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.355+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ce0daf2a70 0x55ce0daf4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.356+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ce0daf2a70 0x55ce0daf4eb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18cc2580a2343561 server_cookie=bd9b06caa34ca75c in_seq=0 out_seq=0 2024-09-16T01:03:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.356+0000 7f2cea7fc640 10 client.16125 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:25.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.356+0000 7f2cea7fc640 1 -- 172.21.15.12:0/3612218777 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce0da45890 con 0x55ce0daf2a70 2024-09-16T01:03:25.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.356+0000 7f2cea7fc640 10 client.16125 handle_command_reply: tid=0 2024-09-16T01:03:25.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 client.16125 shutdown 2024-09-16T01:03:25.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 -- 172.21.15.12:0/3612218777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 msgr2=0x55ce0dadb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:25.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dadb880 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40058c0 tx=0x7f2cf400dfa0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 -- 172.21.15.12:0/3612218777 shutdown_connections 2024-09-16T01:03:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ce0daf2a70 0x55ce0daf4eb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dadc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad4170 0x55ce0dadbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 --2- 172.21.15.12:0/3612218777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dadb880 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2cea7fc640 0 client.16125 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 -- 172.21.15.12:0/3612218777 >> 172.21.15.12:0/3612218777 conn(0x55ce0dacfde0 msgr2=0x55ce0dad5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 -- 172.21.15.12:0/3612218777 shutdown_connections 2024-09-16T01:03:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 1 -- 172.21.15.12:0/3612218777 wait complete. 2024-09-16T01:03:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.357+0000 7f2d0b886740 20 client.16125 trim_cache size 0 max 16384 2024-09-16T01:03:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d0b886740 1 Processor -- start 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d0b886740 1 -- start start 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dada7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad4170 0x55ce0dad62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dacad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d0b886740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2d041acac0 con 0x55ce0dad3850 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d0b886740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2d041ae600 con 0x55ce0dadea30 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d0b886740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2d041ad190 con 0x55ce0dad4170 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dada7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d02ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dada7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47110/0 (socket says 172.21.15.12:47110) 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.395+0000 7f2d02ffd640 1 -- 172.21.15.12:0/1121792491 learned_addr learned my addr 172.21.15.12:0/1121792491 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/1121792491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad4170 0x55ce0dad62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2d037fe640 1 --2- 172.21.15.12:0/1121792491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dacad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2d02ffd640 1 -- 172.21.15.12:0/1121792491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad4170 msgr2=0x55ce0dad62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/1121792491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad4170 0x55ce0dad62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2d02ffd640 1 -- 172.21.15.12:0/1121792491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 msgr2=0x55ce0dacad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/1121792491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dacad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2d02ffd640 1 -- 172.21.15.12:0/1121792491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0dad7480 con 0x55ce0dad3850 2024-09-16T01:03:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/1121792491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dada7c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40d5330 tx=0x7f2cf40cfcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d06018f1699bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2cf8ff9640 1 -- 172.21.15.12:0/1121792491 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4020070 con 0x55ce0dad3850 2024-09-16T01:03:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2cf8ff9640 1 -- 172.21.15.12:0/1121792491 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cf4009de0 con 0x55ce0dad3850 2024-09-16T01:03:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.396+0000 7f2cf8ff9640 1 -- 172.21.15.12:0/1121792491 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40d53b0 con 0x55ce0dad3850 2024-09-16T01:03:25.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.397+0000 7f2d0b886740 1 -- 172.21.15.12:0/1121792491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 msgr2=0x55ce0dada7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:25.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.397+0000 7f2d0b886740 1 --2- 172.21.15.12:0/1121792491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dada7c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40d5330 tx=0x7f2cf40cfcb0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.397+0000 7f2d0b886740 1 -- 172.21.15.12:0/1121792491 shutdown_connections 2024-09-16T01:03:25.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.397+0000 7f2d0b886740 1 --2- 172.21.15.12:0/1121792491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dacad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.397+0000 7f2d0b886740 1 --2- 172.21.15.12:0/1121792491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad4170 0x55ce0dad62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.397+0000 7f2d0b886740 1 --2- 172.21.15.12:0/1121792491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad3850 0x55ce0dada7c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.397+0000 7f2d0b886740 1 -- 172.21.15.12:0/1121792491 >> 172.21.15.12:0/1121792491 conn(0x55ce0dacfde0 msgr2=0x55ce0dadd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 1 -- 172.21.15.12:0/1121792491 shutdown_connections 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 1 -- 172.21.15.12:0/1121792491 wait complete. 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 1 -- start start 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 1 Processor -- start 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad3850 0x55ce0daeb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dad8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dad8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2d041adf30 con 0x55ce0dad4170 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2d041ad860 con 0x55ce0dadea30 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2d041aaaa0 con 0x55ce0dad3850 2024-09-16T01:03:25.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.398+0000 7f2d0b886740 10 client.0 _ll_register_callbacks cb 0x7f2cfc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2cfbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dad8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2cfbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dad8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47120/0 (socket says 172.21.15.12:47120) 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2cfbfff640 1 -- 172.21.15.12:0/1809080159 learned_addr learned my addr 172.21.15.12:0/1809080159 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2d037fe640 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dad8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad3850 0x55ce0daeb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2cfbfff640 1 -- 172.21.15.12:0/1809080159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad3850 msgr2=0x55ce0daeb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad3850 0x55ce0daeb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2cfbfff640 1 -- 172.21.15.12:0/1809080159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 msgr2=0x55ce0dad8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dad8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2cfbfff640 1 -- 172.21.15.12:0/1809080159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce0dad8cd0 con 0x55ce0dad4170 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2cfbfff640 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dad8250 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55ce0dad1160 tx=0x7f2cec012b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4155d47dcec4942 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.399+0000 7f2cea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2cea7fc640 1 -- 172.21.15.12:0/1809080159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec004220 con 0x55ce0dad4170 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2cea7fc640 1 -- 172.21.15.12:0/1809080159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f2cec0043c0 con 0x55ce0dad4170 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2d0b886740 1 -- 172.21.15.12:0/1809080159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cf4009de0 con 0x55ce0dad4170 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2cea7fc640 1 -- 172.21.15.12:0/1809080159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2cec00f7f0 con 0x55ce0dad4170 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2d0b886740 10 client.16131 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2d0b886740 1 -- 172.21.15.12:0/1809080159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ce0db5d490 con 0x55ce0dad4170 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2cea7fc640 1 -- 172.21.15.12:0/1809080159 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cec02c070 con 0x55ce0dad4170 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2cea7fc640 1 -- 172.21.15.12:0/1809080159 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2cec003c90 con 0x55ce0dad4170 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2d0b886740 10 client.16131 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2d0b886740 10 client.16131 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2d0b886740 20 client.16131 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2d0b886740 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ce0db5dcb0 0x55ce0db600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2d0b886740 4 client.16131 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}] 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.400+0000 7f2d0b886740 1 -- 172.21.15.12:0/1809080159 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}) -- 0x55ce0da3fbe0 con 0x55ce0db5dcb0 2024-09-16T01:03:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.401+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ce0db5dcb0 0x55ce0db600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.401+0000 7f2cea7fc640 10 client.16131 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.401+0000 7f2d02ffd640 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ce0db5dcb0 0x55ce0db600d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b1aa889b9f415d1 server_cookie=6e39323da13fb795 in_seq=0 out_seq=0 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.415+0000 7f2cea7fc640 1 -- 172.21.15.12:0/1809080159 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ce0da3fbe0 con 0x55ce0db5dcb0 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.415+0000 7f2cea7fc640 10 client.16131 handle_command_reply: tid=0 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.415+0000 7f2d0b886740 1 client.16131 shutdown 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.415+0000 7f2d0b886740 1 -- 172.21.15.12:0/1809080159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 msgr2=0x55ce0dad8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.415+0000 7f2d0b886740 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dad8250 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55ce0dad1160 tx=0x7f2cec012b10 comp rx=0 tx=0).stop 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.416+0000 7f2d0b886740 1 -- 172.21.15.12:0/1809080159 shutdown_connections 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.416+0000 7f2d0b886740 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55ce0db5dcb0 0x55ce0db600d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.416+0000 7f2d0b886740 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce0dadea30 0x55ce0dad8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.416+0000 7f2d0b886740 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0dad4170 0x55ce0dad8250 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.416+0000 7f2d0b886740 1 --2- 172.21.15.12:0/1809080159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ce0dad3850 0x55ce0daeb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.416+0000 7f2d0b886740 1 -- 172.21.15.12:0/1809080159 >> 172.21.15.12:0/1809080159 conn(0x55ce0dacfde0 msgr2=0x55ce0dace6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:25.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.416+0000 7f2cea7fc640 0 client.16131 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.416+0000 7f2d0b886740 1 -- 172.21.15.12:0/1809080159 shutdown_connections 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.416+0000 7f2d0b886740 1 -- 172.21.15.12:0/1809080159 wait complete. 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.416+0000 7f2d0b886740 20 client.16131 trim_cache size 0 max 16384 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 29, 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24518, 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 6, 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stdout: "77ad929a": { 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 6, 2024-09-16T01:03:25.418 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 139.6, 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:25.419 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:25.420 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:25.420 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:25.420 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:25.420 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:03:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 -- 172.21.15.12:0/4043234922 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2cf00a32c0 msgr2=0x7f2cf00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2cf00a32c0 0x7f2cf00a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc02ae70 tx=0x7f2cfc02a950 comp rx=0 tx=0).stop 2024-09-16T01:03:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 -- 172.21.15.12:0/4043234922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d04100e20 msgr2=0x7f2d04199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d04100e20 0x7f2d04199340 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400d950 tx=0x7f2cf400de10 comp rx=0 tx=0).stop 2024-09-16T01:03:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 -- 172.21.15.12:0/4043234922 shutdown_connections 2024-09-16T01:03:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f2cf00a32c0 0x7f2cf00a5780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d04102ef0 0x7f2d041a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d04102570 0x7f2d04199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 --2- 172.21.15.12:0/4043234922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d04100e20 0x7f2d04199340 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 -- 172.21.15.12:0/4043234922 >> 172.21.15.12:0/4043234922 conn(0x7f2d040fc7d0 msgr2=0x7f2d04106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 -- 172.21.15.12:0/4043234922 shutdown_connections 2024-09-16T01:03:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:25.417+0000 7f2d094ad640 1 -- 172.21.15.12:0/4043234922 wait complete. 2024-09-16T01:03:26.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.044+0000 7efd2a6e6640 1 -- 172.21.15.12:0/3465314618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd24106f10 msgr2=0x7efd2410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:26.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.044+0000 7efd2a6e6640 1 --2- 172.21.15.12:0/3465314618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd24106f10 0x7efd2410ea90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009be0 tx=0x7efd1c02a6c0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.045+0000 7efd2a6e6640 1 -- 172.21.15.12:0/3465314618 shutdown_connections 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.045+0000 7efd2a6e6640 1 --2- 172.21.15.12:0/3465314618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd24106f10 0x7efd2410ea90 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.045+0000 7efd2a6e6640 1 --2- 172.21.15.12:0/3465314618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd24102790 0x7efd241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.045+0000 7efd2a6e6640 1 --2- 172.21.15.12:0/3465314618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd24101de0 0x7efd241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.045+0000 7efd2a6e6640 1 -- 172.21.15.12:0/3465314618 >> 172.21.15.12:0/3465314618 conn(0x7efd240fd8c0 msgr2=0x7efd240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.045+0000 7efd2a6e6640 1 -- 172.21.15.12:0/3465314618 shutdown_connections 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.045+0000 7efd2a6e6640 1 -- 172.21.15.12:0/3465314618 wait complete. 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.045+0000 7efd2a6e6640 1 Processor -- start 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.045+0000 7efd2a6e6640 1 -- start start 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd2a6e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd24101de0 0x7efd24198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd2a6e6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd24102790 0x7efd241989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd2a6e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd24106f10 0x7efd2419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd2a6e6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd24111f20 con 0x7efd24101de0 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd2a6e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd24111da0 con 0x7efd24106f10 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd2a6e6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd241120a0 con 0x7efd24102790 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd23fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd24101de0 0x7efd24198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd23fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd24101de0 0x7efd24198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47134/0 (socket says 172.21.15.12:47134) 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd23fff640 1 -- 172.21.15.12:0/4144295225 learned_addr learned my addr 172.21.15.12:0/4144295225 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd237fe640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd24102790 0x7efd241989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd28c83640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd24106f10 0x7efd2419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd23fff640 1 -- 172.21.15.12:0/4144295225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd24102790 msgr2=0x7efd241989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd23fff640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd24102790 0x7efd241989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd23fff640 1 -- 172.21.15.12:0/4144295225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd24106f10 msgr2=0x7efd2419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd23fff640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd24106f10 0x7efd2419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd23fff640 1 -- 172.21.15.12:0/4144295225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2419d410 con 0x7efd24101de0 2024-09-16T01:03:26.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.046+0000 7efd28c83640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd24106f10 0x7efd2419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.047+0000 7efd23fff640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd24101de0 0x7efd24198460 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efd1400e9f0 tx=0x7efd1400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.047+0000 7efd217fa640 1 -- 172.21.15.12:0/4144295225 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1400cd80 con 0x7efd24101de0 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.047+0000 7efd217fa640 1 -- 172.21.15.12:0/4144295225 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd14005500 con 0x7efd24101de0 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.047+0000 7efd2a6e6640 1 -- 172.21.15.12:0/4144295225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2419d700 con 0x7efd24101de0 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.047+0000 7efd217fa640 1 -- 172.21.15.12:0/4144295225 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14010690 con 0x7efd24101de0 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.047+0000 7efd2a6e6640 1 -- 172.21.15.12:0/4144295225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd241a4fe0 con 0x7efd24101de0 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd217fa640 1 -- 172.21.15.12:0/4144295225 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efd140046c0 con 0x7efd24101de0 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd2cabf740 1 Processor -- start 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd2cabf740 1 -- start start 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a564a0 0x562133a56880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a61140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a61680 0x562133a63a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd2cabf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5621339bc2e0 con 0x562133a56dc0 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd2cabf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562133963ce0 con 0x562133a61680 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd2cabf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5621339b82a0 con 0x562133a564a0 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd23fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a61140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.050+0000 7efd23fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a61140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47142/0 (socket says 172.21.15.12:47142) 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd23fff640 1 -- 172.21.15.12:0/1575216363 learned_addr learned my addr 172.21.15.12:0/1575216363 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd28c83640 1 --2- 172.21.15.12:0/1575216363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a564a0 0x562133a56880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd237fe640 1 --2- 172.21.15.12:0/1575216363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a61680 0x562133a63a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd23fff640 1 -- 172.21.15.12:0/1575216363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a564a0 msgr2=0x562133a56880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd23fff640 1 --2- 172.21.15.12:0/1575216363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a564a0 0x562133a56880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd23fff640 1 -- 172.21.15.12:0/1575216363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a61680 msgr2=0x562133a63a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd23fff640 1 --2- 172.21.15.12:0/1575216363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a61680 0x562133a63a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd23fff640 1 -- 172.21.15.12:0/1575216363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562133948440 con 0x562133a56dc0 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd217fa640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd0c0a3240 0x7efd0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd23fff640 1 --2- 172.21.15.12:0/1575216363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a61140 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efd140d8160 tx=0x7efd140d8250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1556db741d682312 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd28c83640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd0c0a3240 0x7efd0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd217fa640 1 -- 172.21.15.12:0/4144295225 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7efd140d00f0 con 0x7efd24101de0 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd0a7fc640 1 -- 172.21.15.12:0/1575216363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14098650 con 0x562133a56dc0 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd0a7fc640 1 -- 172.21.15.12:0/1575216363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd1409cab0 con 0x562133a56dc0 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.051+0000 7efd0a7fc640 1 -- 172.21.15.12:0/1575216363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1409bd10 con 0x562133a56dc0 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd2cabf740 1 -- 172.21.15.12:0/1575216363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 msgr2=0x562133a61140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd2cabf740 1 --2- 172.21.15.12:0/1575216363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a61140 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efd140d8160 tx=0x7efd140d8250 comp rx=0 tx=0).stop 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd28c83640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd0c0a3240 0x7efd0c0a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd1c02abe0 tx=0x7efd1c009880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd2cabf740 1 -- 172.21.15.12:0/1575216363 shutdown_connections 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd2cabf740 1 --2- 172.21.15.12:0/1575216363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a61680 0x562133a63a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd2cabf740 1 --2- 172.21.15.12:0/1575216363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a61140 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd2cabf740 1 --2- 172.21.15.12:0/1575216363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a564a0 0x562133a56880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd2cabf740 1 -- 172.21.15.12:0/1575216363 >> 172.21.15.12:0/1575216363 conn(0x562133a52a30 msgr2=0x562133a52e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd2cabf740 1 -- 172.21.15.12:0/1575216363 shutdown_connections 2024-09-16T01:03:26.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd2cabf740 1 -- 172.21.15.12:0/1575216363 wait complete. 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.052+0000 7efd2cabf740 1 -- start start 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd2cabf740 1 Processor -- start 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a60f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a56dc0 0x562133a5e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a61680 0x562133a5e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd2cabf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562133a64250 con 0x562133a61680 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd2cabf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562133977050 con 0x562133a564a0 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd2cabf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562133a643d0 con 0x562133a56dc0 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd2cabf740 10 client.0 _ll_register_callbacks cb 0x5621339b7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd28c83640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a61680 0x562133a5e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd28c83640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a61680 0x562133a5e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47146/0 (socket says 172.21.15.12:47146) 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd28c83640 1 -- 172.21.15.12:0/4204496998 learned_addr learned my addr 172.21.15.12:0/4204496998 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd23fff640 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a60f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.053+0000 7efd237fe640 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a56dc0 0x562133a5e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd28c83640 1 -- 172.21.15.12:0/4204496998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a56dc0 msgr2=0x562133a5e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd28c83640 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a56dc0 0x562133a5e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd28c83640 1 -- 172.21.15.12:0/4204496998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 msgr2=0x562133a60f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd28c83640 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a60f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd28c83640 1 -- 172.21.15.12:0/4204496998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56213372d3c0 con 0x562133a61680 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd23fff640 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a60f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd28c83640 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a61680 0x562133a5e720 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efd1c033000 tx=0x7efd1c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61f85b6c68d1a7f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd037fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd037fe640 1 -- 172.21.15.12:0/4204496998 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c04f070 con 0x562133a61680 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd037fe640 1 -- 172.21.15.12:0/4204496998 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7efd1c003970 con 0x562133a61680 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd2cabf740 1 -- 172.21.15.12:0/4204496998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd1409cab0 con 0x562133a61680 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd037fe640 1 -- 172.21.15.12:0/4204496998 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd1c05b050 con 0x562133a61680 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd2cabf740 10 client.16143 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd2cabf740 1 -- 172.21.15.12:0/4204496998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562133a6fb70 con 0x562133a61680 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd037fe640 1 -- 172.21.15.12:0/4204496998 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd1409cab0 con 0x562133a61680 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.054+0000 7efd037fe640 1 -- 172.21.15.12:0/4204496998 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7efd1c031440 con 0x562133a61680 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.055+0000 7efd2cabf740 10 client.16143 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.055+0000 7efd2cabf740 10 client.16143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.055+0000 7efd2cabf740 20 client.16143 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.055+0000 7efd2cabf740 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x562133a71040 0x562133a734c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.055+0000 7efd2cabf740 4 client.16143 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.055+0000 7efd2cabf740 1 -- 172.21.15.12:0/4204496998 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621339c9850 con 0x562133a71040 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.055+0000 7efd23fff640 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x562133a71040 0x562133a734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.055+0000 7efd037fe640 10 client.16143 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.055+0000 7efd23fff640 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x562133a71040 0x562133a734c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca23cc8ac0075f5e server_cookie=1b47a88d8df77f09 in_seq=0 out_seq=0 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd037fe640 1 -- 172.21.15.12:0/4204496998 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621339c9850 con 0x562133a71040 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd037fe640 10 client.16143 handle_command_reply: tid=0 2024-09-16T01:03:26.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 client.16143 shutdown 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 -- 172.21.15.12:0/4204496998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a61680 msgr2=0x562133a5e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a61680 0x562133a5e720 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efd1c033000 tx=0x7efd1c02a6c0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 -- 172.21.15.12:0/4204496998 shutdown_connections 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x562133a71040 0x562133a734c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a61680 0x562133a5e720 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a56dc0 0x562133a5e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd037fe640 0 client.16143 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 --2- 172.21.15.12:0/4204496998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a60f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 -- 172.21.15.12:0/4204496998 >> 172.21.15.12:0/4204496998 conn(0x562133a52a30 msgr2=0x562133a58710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 -- 172.21.15.12:0/4204496998 shutdown_connections 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 1 -- 172.21.15.12:0/4204496998 wait complete. 2024-09-16T01:03:26.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.056+0000 7efd2cabf740 20 client.16143 trim_cache size 0 max 16384 2024-09-16T01:03:26.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd2cabf740 1 Processor -- start 2024-09-16T01:03:26.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd2cabf740 1 -- start start 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a6d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a78d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 0x562133a792d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd2cabf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd241aec70 con 0x562133a56dc0 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd2cabf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd241b07b0 con 0x562133a564a0 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd2cabf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd241af340 con 0x562133a61680 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a78d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a78d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47158/0 (socket says 172.21.15.12:47158) 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd237fe640 1 -- 172.21.15.12:0/431965978 learned_addr learned my addr 172.21.15.12:0/431965978 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd23fff640 1 --2- 172.21.15.12:0/431965978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a6d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd28c83640 1 --2- 172.21.15.12:0/431965978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 0x562133a792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd237fe640 1 -- 172.21.15.12:0/431965978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 msgr2=0x562133a792d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:26.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd237fe640 1 --2- 172.21.15.12:0/431965978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 0x562133a792d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd237fe640 1 -- 172.21.15.12:0/431965978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 msgr2=0x562133a6d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:26.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd237fe640 1 --2- 172.21.15.12:0/431965978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a6d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd237fe640 1 -- 172.21.15.12:0/431965978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562133a56bf0 con 0x562133a56dc0 2024-09-16T01:03:26.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.074+0000 7efd28c83640 1 --2- 172.21.15.12:0/431965978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 0x562133a792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:26.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.075+0000 7efd237fe640 1 --2- 172.21.15.12:0/431965978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a78d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efd18005fd0 tx=0x7efd18009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3854295e59800de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:26.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.075+0000 7efd09ffb640 1 -- 172.21.15.12:0/431965978 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18004020 con 0x562133a56dc0 2024-09-16T01:03:26.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.075+0000 7efd09ffb640 1 -- 172.21.15.12:0/431965978 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd18005500 con 0x562133a56dc0 2024-09-16T01:03:26.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.075+0000 7efd09ffb640 1 -- 172.21.15.12:0/431965978 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd180035f0 con 0x562133a56dc0 2024-09-16T01:03:26.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.076+0000 7efd2cabf740 1 -- 172.21.15.12:0/431965978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 msgr2=0x562133a78d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.076+0000 7efd2cabf740 1 --2- 172.21.15.12:0/431965978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a78d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efd18005fd0 tx=0x7efd18009260 comp rx=0 tx=0).stop 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.076+0000 7efd2cabf740 1 -- 172.21.15.12:0/431965978 shutdown_connections 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.076+0000 7efd2cabf740 1 --2- 172.21.15.12:0/431965978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 0x562133a792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.076+0000 7efd2cabf740 1 --2- 172.21.15.12:0/431965978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a78d90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.076+0000 7efd2cabf740 1 --2- 172.21.15.12:0/431965978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a6d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.076+0000 7efd2cabf740 1 -- 172.21.15.12:0/431965978 >> 172.21.15.12:0/431965978 conn(0x562133a52a30 msgr2=0x562133a59850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.076+0000 7efd2cabf740 1 -- 172.21.15.12:0/431965978 shutdown_connections 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.076+0000 7efd2cabf740 1 -- 172.21.15.12:0/431965978 wait complete. 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.076+0000 7efd2cabf740 1 -- start start 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd2cabf740 1 Processor -- start 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a64d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a652a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd2cabf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 0x562133ad8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd2cabf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd241b00e0 con 0x562133a56dc0 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd2cabf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd241afa10 con 0x562133a564a0 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd2cabf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd241acc50 con 0x562133a61680 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a652a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47160/0 (socket says 172.21.15.12:47160) 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd237fe640 1 -- 172.21.15.12:0/870822068 learned_addr learned my addr 172.21.15.12:0/870822068 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd2cabf740 10 client.0 _ll_register_callbacks cb 0x7efd1c042070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd23fff640 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a64d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.077+0000 7efd28c83640 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 0x562133ad8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd237fe640 1 -- 172.21.15.12:0/870822068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 msgr2=0x562133ad8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd237fe640 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 0x562133ad8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd237fe640 1 -- 172.21.15.12:0/870822068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 msgr2=0x562133a64d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd237fe640 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a64d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd237fe640 1 -- 172.21.15.12:0/870822068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562133ad87d0 con 0x562133a56dc0 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd28c83640 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 0x562133ad8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd23fff640 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a64d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd237fe640 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a652a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efd18011ca0 tx=0x7efd18004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38e12dafabb3fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd037fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd037fe640 1 -- 172.21.15.12:0/870822068 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18004c90 con 0x562133a56dc0 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd037fe640 1 -- 172.21.15.12:0/870822068 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7efd18027440 con 0x562133a56dc0 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.078+0000 7efd2cabf740 1 -- 172.21.15.12:0/870822068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd18005500 con 0x562133a56dc0 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd037fe640 1 -- 172.21.15.12:0/870822068 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd18036050 con 0x562133a56dc0 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd2cabf740 10 client.16149 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd2cabf740 1 -- 172.21.15.12:0/870822068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562133adfb00 con 0x562133a56dc0 2024-09-16T01:03:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd037fe640 1 -- 172.21.15.12:0/870822068 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd18005500 con 0x562133a56dc0 2024-09-16T01:03:26.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd037fe640 1 -- 172.21.15.12:0/870822068 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7efd1801c630 con 0x562133a56dc0 2024-09-16T01:03:26.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd2cabf740 10 client.16149 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:26.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd2cabf740 10 client.16149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:26.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd2cabf740 20 client.16149 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:26.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd2cabf740 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x562133ae0250 0x562133ae2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:26.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd2cabf740 4 client.16149 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:03:26.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.079+0000 7efd2cabf740 1 -- 172.21.15.12:0/870822068 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5621339c3d60 con 0x562133ae0250 2024-09-16T01:03:26.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.080+0000 7efd23fff640 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x562133ae0250 0x562133ae2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:26.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.080+0000 7efd23fff640 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x562133ae0250 0x562133ae2670 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c4d432397b1e7a0 server_cookie=640386f1b7144524 in_seq=0 out_seq=0 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.080+0000 7efd037fe640 10 client.16149 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.080+0000 7efd037fe640 1 -- 172.21.15.12:0/870822068 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5621339c3d60 con 0x562133ae0250 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.080+0000 7efd037fe640 10 client.16149 handle_command_reply: tid=0 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.080+0000 7efd2cabf740 1 client.16149 shutdown 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 1 -- 172.21.15.12:0/870822068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 msgr2=0x562133a652a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a652a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efd18011ca0 tx=0x7efd18004740 comp rx=0 tx=0).stop 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 1 -- 172.21.15.12:0/870822068 shutdown_connections 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x562133ae0250 0x562133ae2670 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562133a61680 0x562133ad8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562133a56dc0 0x562133a652a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 1 --2- 172.21.15.12:0/870822068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562133a564a0 0x562133a64d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 1 -- 172.21.15.12:0/870822068 >> 172.21.15.12:0/870822068 conn(0x562133a52a30 msgr2=0x562133a5fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:26.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd037fe640 0 client.16149 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 1 -- 172.21.15.12:0/870822068 shutdown_connections 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 1 -- 172.21.15.12:0/870822068 wait complete. 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2cabf740 20 client.16149 trim_cache size 0 max 16384 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stdout: "d1a90aa1-498b-4a36-a3c4-32728da0285d": { 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "d1a90aa1-498b-4a36-a3c4-32728da0285d", 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-16T01:03:26.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:26.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:26.087 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:03:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2a6e6640 1 -- 172.21.15.12:0/4144295225 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd0c0a3240 msgr2=0x7efd0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2a6e6640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd0c0a3240 0x7efd0c0a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd1c02abe0 tx=0x7efd1c009880 comp rx=0 tx=0).stop 2024-09-16T01:03:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.081+0000 7efd2a6e6640 1 -- 172.21.15.12:0/4144295225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd24101de0 msgr2=0x7efd24198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.082+0000 7efd2a6e6640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd24101de0 0x7efd24198460 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efd1400e9f0 tx=0x7efd1400edf0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.082+0000 7efd2a6e6640 1 -- 172.21.15.12:0/4144295225 shutdown_connections 2024-09-16T01:03:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.082+0000 7efd2a6e6640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7efd0c0a3240 0x7efd0c0a5700 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.082+0000 7efd2a6e6640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd24106f10 0x7efd2419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.082+0000 7efd2a6e6640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd24102790 0x7efd241989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.082+0000 7efd2a6e6640 1 --2- 172.21.15.12:0/4144295225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd24101de0 0x7efd24198460 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.082+0000 7efd2a6e6640 1 -- 172.21.15.12:0/4144295225 >> 172.21.15.12:0/4144295225 conn(0x7efd240fd8c0 msgr2=0x7efd240feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.082+0000 7efd2a6e6640 1 -- 172.21.15.12:0/4144295225 shutdown_connections 2024-09-16T01:03:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:26.082+0000 7efd2a6e6640 1 -- 172.21.15.12:0/4144295225 wait complete. 2024-09-16T01:03:26.586 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '77ad929a', quiesce took 4.8 seconds. Will release after: 14.75 2024-09-16T01:03:26.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:26 smithi012 ceph-mon[31197]: pgmap v430: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-16T01:03:26.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:26 smithi012 ceph-mon[31197]: scrub summary: idle 2024-09-16T01:03:26.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:26 smithi098 ceph-mon[35346]: pgmap v430: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-16T01:03:26.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:26 smithi098 ceph-mon[35346]: scrub summary: idle 2024-09-16T01:03:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:26 smithi119 ceph-mon[35049]: pgmap v430: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 862 KiB/s wr, 14 op/s 2024-09-16T01:03:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:26 smithi119 ceph-mon[35049]: scrub summary: idle 2024-09-16T01:03:27.287 INFO:tasks.cephfs.filesystem:scrub status for tag:d1a90aa1-498b-4a36-a3c4-32728da0285d - {'path': '/', 'tag': 'd1a90aa1-498b-4a36-a3c4-32728da0285d', 'options': 'recursive,force'} 2024-09-16T01:03:28.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:28 smithi098 ceph-mon[35346]: pgmap v431: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 859 KiB/s wr, 12 op/s 2024-09-16T01:03:29.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:28 smithi119 ceph-mon[35049]: pgmap v431: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 859 KiB/s wr, 12 op/s 2024-09-16T01:03:29.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:28 smithi012 ceph-mon[31197]: pgmap v431: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 859 KiB/s wr, 12 op/s 2024-09-16T01:03:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:30 smithi098 ceph-mon[35346]: pgmap v432: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2024-09-16T01:03:31.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:30 smithi119 ceph-mon[35049]: pgmap v432: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2024-09-16T01:03:31.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:30 smithi012 ceph-mon[31197]: pgmap v432: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2024-09-16T01:03:32.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:32 smithi098 ceph-mon[35346]: pgmap v433: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 690 KiB/s wr, 14 op/s 2024-09-16T01:03:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:32 smithi119 ceph-mon[35049]: pgmap v433: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 690 KiB/s wr, 14 op/s 2024-09-16T01:03:33.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:32 smithi012 ceph-mon[31197]: pgmap v433: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 690 KiB/s wr, 14 op/s 2024-09-16T01:03:34.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:34 smithi098 ceph-mon[35346]: pgmap v434: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 687 KiB/s wr, 12 op/s 2024-09-16T01:03:35.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:34 smithi119 ceph-mon[35049]: pgmap v434: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 687 KiB/s wr, 12 op/s 2024-09-16T01:03:35.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:34 smithi012 ceph-mon[31197]: pgmap v434: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 687 KiB/s wr, 12 op/s 2024-09-16T01:03:36.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:36 smithi098 ceph-mon[35346]: pgmap v435: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 261 KiB/s wr, 13 op/s 2024-09-16T01:03:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:36 smithi119 ceph-mon[35049]: pgmap v435: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 261 KiB/s wr, 13 op/s 2024-09-16T01:03:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:36 smithi012 ceph-mon[31197]: pgmap v435: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 261 KiB/s wr, 13 op/s 2024-09-16T01:03:38.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:38 smithi098 ceph-mon[35346]: pgmap v436: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 258 KiB/s wr, 10 op/s 2024-09-16T01:03:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:38 smithi119 ceph-mon[35049]: pgmap v436: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 258 KiB/s wr, 10 op/s 2024-09-16T01:03:39.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:38 smithi012 ceph-mon[31197]: pgmap v436: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 258 KiB/s wr, 10 op/s 2024-09-16T01:03:40.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:40 smithi098 ceph-mon[35346]: pgmap v437: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.6 MiB/s wr, 12 op/s 2024-09-16T01:03:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:40 smithi119 ceph-mon[35049]: pgmap v437: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.6 MiB/s wr, 12 op/s 2024-09-16T01:03:41.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:40 smithi012 ceph-mon[31197]: pgmap v437: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.6 MiB/s wr, 12 op/s 2024-09-16T01:03:41.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:03:41.609 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:41.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:03:41.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:03:41.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:03:41.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:41 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:03:42.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:03:42.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:03:42.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:03:42.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:41 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:03:42.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:03:42.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:03:42.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:03:42.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:41 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:03:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.161+0000 7fb112db2640 1 -- 172.21.15.12:0/959202171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c10c170 msgr2=0x7fb10c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.161+0000 7fb112db2640 1 --2- 172.21.15.12:0/959202171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c10c170 0x7fb10c10e610 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb104009ca0 tx=0x7fb10402a950 comp rx=0 tx=0).stop 2024-09-16T01:03:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.161+0000 7fb112db2640 1 -- 172.21.15.12:0/959202171 shutdown_connections 2024-09-16T01:03:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.161+0000 7fb112db2640 1 --2- 172.21.15.12:0/959202171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c10c170 0x7fb10c10e610 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.161+0000 7fb112db2640 1 --2- 172.21.15.12:0/959202171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10c103660 0x7fb10c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.161+0000 7fb112db2640 1 --2- 172.21.15.12:0/959202171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb10c102d40 0x7fb10c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.161+0000 7fb112db2640 1 -- 172.21.15.12:0/959202171 >> 172.21.15.12:0/959202171 conn(0x7fb10c0fc7a0 msgr2=0x7fb10c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.161+0000 7fb112db2640 1 -- 172.21.15.12:0/959202171 shutdown_connections 2024-09-16T01:03:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.162+0000 7fb112db2640 1 -- 172.21.15.12:0/959202171 wait complete. 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.162+0000 7fb112db2640 1 Processor -- start 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.162+0000 7fb112db2640 1 -- start start 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.162+0000 7fb112db2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb10c102d40 0x7fb10c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.162+0000 7fb112db2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c103660 0x7fb10c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.162+0000 7fb112db2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10c10c170 0x7fb10c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.162+0000 7fb112db2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c111f70 con 0x7fb10c103660 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.162+0000 7fb112db2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c111df0 con 0x7fb10c10c170 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.162+0000 7fb112db2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c1120f0 con 0x7fb10c102d40 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb10bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c103660 0x7fb10c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb10bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c103660 0x7fb10c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56568/0 (socket says 172.21.15.12:56568) 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb10bfff640 1 -- 172.21.15.12:0/2056043187 learned_addr learned my addr 172.21.15.12:0/2056043187 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb110b4e640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb10c102d40 0x7fb10c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb11134f640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10c10c170 0x7fb10c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb10bfff640 1 -- 172.21.15.12:0/2056043187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb10c102d40 msgr2=0x7fb10c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb10bfff640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb10c102d40 0x7fb10c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb10bfff640 1 -- 172.21.15.12:0/2056043187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10c10c170 msgr2=0x7fb10c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb10bfff640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10c10c170 0x7fb10c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb10bfff640 1 -- 172.21.15.12:0/2056043187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c1a68d0 con 0x7fb10c103660 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb10bfff640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c103660 0x7fb10c100ee0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800e9f0 tx=0x7fb0f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb109ffb640 1 -- 172.21.15.12:0/2056043187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800ccc0 con 0x7fb10c103660 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb112db2640 1 -- 172.21.15.12:0/2056043187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10c1a6bc0 con 0x7fb10c103660 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb109ffb640 1 -- 172.21.15.12:0/2056043187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0f8010910 con 0x7fb10c103660 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.163+0000 7fb109ffb640 1 -- 172.21.15.12:0/2056043187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8018920 con 0x7fb10c103660 2024-09-16T01:03:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.164+0000 7fb112db2640 1 -- 172.21.15.12:0/2056043187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10c1a7150 con 0x7fb10c103660 2024-09-16T01:03:42.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.164+0000 7fb112db2640 1 -- 172.21.15.12:0/2056043187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10c103120 con 0x7fb10c103660 2024-09-16T01:03:42.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.166+0000 7fb109ffb640 1 -- 172.21.15.12:0/2056043187 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb0f8010430 con 0x7fb10c103660 2024-09-16T01:03:42.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.166+0000 7fb109ffb640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0fc0a3240 0x7fb0fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:42.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.167+0000 7fb109ffb640 1 -- 172.21.15.12:0/2056043187 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fb0f80d02b0 con 0x7fb10c103660 2024-09-16T01:03:42.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.167+0000 7fb110b4e640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0fc0a3240 0x7fb0fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:42.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.167+0000 7fb110b4e640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0fc0a3240 0x7fb0fc0a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb100005fd0 tx=0x7fb10000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.170+0000 7fb109ffb640 1 -- 172.21.15.12:0/2056043187 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb0f809c620 con 0x7fb10c103660 2024-09-16T01:03:42.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.382+0000 7fb112db2640 1 -- 172.21.15.12:0/2056043187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb10c1a7320 con 0x7fb10c103660 2024-09-16T01:03:42.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.383+0000 7fb109ffb640 1 -- 172.21.15.12:0/2056043187 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7fb0f80bc020 con 0x7fb10c103660 2024-09-16T01:03:42.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:03:42.385 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:03:42.385 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:03:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 -- 172.21.15.12:0/2056043187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0fc0a3240 msgr2=0x7fb0fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0fc0a3240 0x7fb0fc0a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb100005fd0 tx=0x7fb10000b390 comp rx=0 tx=0).stop 2024-09-16T01:03:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 -- 172.21.15.12:0/2056043187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c103660 msgr2=0x7fb10c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c103660 0x7fb10c100ee0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800e9f0 tx=0x7fb0f800eeb0 comp rx=0 tx=0).stop 2024-09-16T01:03:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 -- 172.21.15.12:0/2056043187 shutdown_connections 2024-09-16T01:03:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0fc0a3240 0x7fb0fc0a5700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10c10c170 0x7fb10c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb10c103660 0x7fb10c100ee0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 --2- 172.21.15.12:0/2056043187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb10c102d40 0x7fb10c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 -- 172.21.15.12:0/2056043187 >> 172.21.15.12:0/2056043187 conn(0x7fb10c0fc7a0 msgr2=0x7fb10c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:42.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 -- 172.21.15.12:0/2056043187 shutdown_connections 2024-09-16T01:03:42.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:42.385+0000 7fb112db2640 1 -- 172.21.15.12:0/2056043187 wait complete. 2024-09-16T01:03:42.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:42 smithi098 ceph-mon[35346]: pgmap v438: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 14 op/s 2024-09-16T01:03:42.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:42 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2056043187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:43.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:42 smithi119 ceph-mon[35049]: pgmap v438: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 14 op/s 2024-09-16T01:03:43.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:42 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2056043187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:43.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:42 smithi012 ceph-mon[31197]: pgmap v438: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 14 op/s 2024-09-16T01:03:43.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:42 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2056043187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:43.154 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db --set-id 77ad929a --release --await' 2024-09-16T01:03:43.154 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24518 quiesce db --set-id 77ad929a --release --await 2024-09-16T01:03:43.414 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:43.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.896+0000 7fb063695640 1 -- 172.21.15.12:0/3797447672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c101bc0 msgr2=0x7fb05c10d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:43.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.896+0000 7fb063695640 1 --2- 172.21.15.12:0/3797447672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c101bc0 0x7fb05c10d910 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb054009900 tx=0x7fb05402a410 comp rx=0 tx=0).stop 2024-09-16T01:03:43.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.896+0000 7fb063695640 1 -- 172.21.15.12:0/3797447672 shutdown_connections 2024-09-16T01:03:43.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.896+0000 7fb063695640 1 --2- 172.21.15.12:0/3797447672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c101bc0 0x7fb05c10d910 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.896+0000 7fb063695640 1 --2- 172.21.15.12:0/3797447672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05c101240 0x7fb05c101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.896+0000 7fb063695640 1 --2- 172.21.15.12:0/3797447672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb05c105a90 0x7fb05c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.896+0000 7fb063695640 1 -- 172.21.15.12:0/3797447672 >> 172.21.15.12:0/3797447672 conn(0x7fb05c077210 msgr2=0x7fb05c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.896+0000 7fb063695640 1 -- 172.21.15.12:0/3797447672 shutdown_connections 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.896+0000 7fb063695640 1 -- 172.21.15.12:0/3797447672 wait complete. 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb063695640 1 Processor -- start 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb063695640 1 -- start start 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb063695640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05c101240 0x7fb05c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb063695640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c101bc0 0x7fb05c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb063695640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb05c105a90 0x7fb05c1a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb063695640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c110f70 con 0x7fb05c101bc0 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb063695640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c110df0 con 0x7fb05c105a90 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb063695640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1110f0 con 0x7fb05c101240 2024-09-16T01:03:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb060c30640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c101bc0 0x7fb05c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb060c30640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c101bc0 0x7fb05c199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56586/0 (socket says 172.21.15.12:56586) 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb060c30640 1 -- 172.21.15.12:0/877634303 learned_addr learned my addr 172.21.15.12:0/877634303 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb061431640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05c101240 0x7fb05c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb061c32640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb05c105a90 0x7fb05c1a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb060c30640 1 -- 172.21.15.12:0/877634303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05c101240 msgr2=0x7fb05c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.897+0000 7fb060c30640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05c101240 0x7fb05c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.898+0000 7fb060c30640 1 -- 172.21.15.12:0/877634303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb05c105a90 msgr2=0x7fb05c1a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.898+0000 7fb060c30640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb05c105a90 0x7fb05c1a4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.898+0000 7fb060c30640 1 -- 172.21.15.12:0/877634303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05c1a4880 con 0x7fb05c101bc0 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.898+0000 7fb061c32640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb05c105a90 0x7fb05c1a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.898+0000 7fb060c30640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c101bc0 0x7fb05c199800 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb05000d950 tx=0x7fb05000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.898+0000 7fb05a7fc640 1 -- 172.21.15.12:0/877634303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb050017030 con 0x7fb05c101bc0 2024-09-16T01:03:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.898+0000 7fb05a7fc640 1 -- 172.21.15.12:0/877634303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb050004020 con 0x7fb05c101bc0 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.898+0000 7fb05a7fc640 1 -- 172.21.15.12:0/877634303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0500047a0 con 0x7fb05c101bc0 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.898+0000 7fb063695640 1 -- 172.21.15.12:0/877634303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05c1a4a50 con 0x7fb05c101bc0 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.898+0000 7fb063695640 1 -- 172.21.15.12:0/877634303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb05c1a4f60 con 0x7fb05c101bc0 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.900+0000 7fb05a7fc640 1 -- 172.21.15.12:0/877634303 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb0500041d0 con 0x7fb05c101bc0 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb065a6e740 1 Processor -- start 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb065a6e740 1 -- start start 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1060 0x5571f63d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63dbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63de630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb065a6e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5571f6336620 con 0x5571f63dc240 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb065a6e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5571f62dde50 con 0x5571f63d1980 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb065a6e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5571f63325e0 con 0x5571f63d1060 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb060c30640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63de630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb05a7fc640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0440a3240 0x7fb0440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb060c30640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63de630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56600/0 (socket says 172.21.15.12:56600) 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb060c30640 1 -- 172.21.15.12:0/1358387483 learned_addr learned my addr 172.21.15.12:0/1358387483 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.901+0000 7fb061431640 1 --2- 172.21.15.12:0/1358387483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63dbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb061c32640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0440a3240 0x7fb0440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb061c32640 1 --2- 172.21.15.12:0/1358387483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1060 0x5571f63d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb05a7fc640 1 -- 172.21.15.12:0/877634303 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fb0500cf6c0 con 0x7fb05c101bc0 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb060c30640 1 -- 172.21.15.12:0/1358387483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1060 msgr2=0x5571f63d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb060c30640 1 --2- 172.21.15.12:0/1358387483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1060 0x5571f63d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb060c30640 1 -- 172.21.15.12:0/1358387483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 msgr2=0x5571f63dbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb060c30640 1 --2- 172.21.15.12:0/1358387483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63dbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb060c30640 1 -- 172.21.15.12:0/1358387483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f62ced40 con 0x5571f63dc240 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb060c30640 1 --2- 172.21.15.12:0/1358387483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63de630 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb0500a4060 tx=0x7fb0500bbb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20b1c8e66d694a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb061c32640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0440a3240 0x7fb0440a5700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb0540096c0 tx=0x7fb054009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb0437fe640 1 -- 172.21.15.12:0/1358387483 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05009b920 con 0x5571f63dc240 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb0437fe640 1 -- 172.21.15.12:0/1358387483 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb05009cc50 con 0x5571f63dc240 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.902+0000 7fb0437fe640 1 -- 172.21.15.12:0/1358387483 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0500ccfc0 con 0x5571f63dc240 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 -- 172.21.15.12:0/1358387483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 msgr2=0x5571f63de630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 --2- 172.21.15.12:0/1358387483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63de630 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb0500a4060 tx=0x7fb0500bbb50 comp rx=0 tx=0).stop 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 -- 172.21.15.12:0/1358387483 shutdown_connections 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 --2- 172.21.15.12:0/1358387483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63de630 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 --2- 172.21.15.12:0/1358387483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63dbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 --2- 172.21.15.12:0/1358387483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1060 0x5571f63d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 -- 172.21.15.12:0/1358387483 >> 172.21.15.12:0/1358387483 conn(0x5571f63cd5f0 msgr2=0x5571f63cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 -- 172.21.15.12:0/1358387483 shutdown_connections 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 -- 172.21.15.12:0/1358387483 wait complete. 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 -- start start 2024-09-16T01:03:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.903+0000 7fb065a6e740 1 Processor -- start 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1060 0x5571f63d90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63d9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63d9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb065a6e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5571f63dedb0 con 0x5571f63dc240 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb065a6e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5571f62bef10 con 0x5571f63d1980 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb065a6e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5571f63def30 con 0x5571f63d1060 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb065a6e740 10 client.0 _ll_register_callbacks cb 0x5571f62e2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb061c32640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63d9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb061c32640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63d9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56602/0 (socket says 172.21.15.12:56602) 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb061c32640 1 -- 172.21.15.12:0/910179575 learned_addr learned my addr 172.21.15.12:0/910179575 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb060c30640 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63d9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb061431640 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1060 0x5571f63d90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb061c32640 1 -- 172.21.15.12:0/910179575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1060 msgr2=0x5571f63d90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb061c32640 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1060 0x5571f63d90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb061c32640 1 -- 172.21.15.12:0/910179575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 msgr2=0x5571f63d9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb061c32640 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63d9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.904+0000 7fb061c32640 1 -- 172.21.15.12:0/910179575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571f6045580 con 0x5571f63dc240 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb061c32640 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63d9b50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb054003db0 tx=0x7fb054009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ab2b6a7ab5ca01 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb040ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb040ff9640 1 -- 172.21.15.12:0/910179575 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05404d070 con 0x5571f63dc240 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb040ff9640 1 -- 172.21.15.12:0/910179575 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fb054005220 con 0x5571f63dc240 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb065a6e740 1 -- 172.21.15.12:0/910179575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5571f6343b90 con 0x5571f63dc240 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb040ff9640 1 -- 172.21.15.12:0/910179575 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb054035040 con 0x5571f63dc240 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb065a6e740 10 client.16167 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb065a6e740 1 -- 172.21.15.12:0/910179575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5571f610f960 con 0x5571f63dc240 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb040ff9640 1 -- 172.21.15.12:0/910179575 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5571f6343b90 con 0x5571f63dc240 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb040ff9640 1 -- 172.21.15.12:0/910179575 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb054048070 con 0x5571f63dc240 2024-09-16T01:03:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb065a6e740 10 client.16167 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:43.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb065a6e740 10 client.16167 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:03:43.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb065a6e740 20 client.16167 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:43.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb065a6e740 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5571f63ebc60 0x5571f63ee0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb065a6e740 4 client.16167 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:43.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.905+0000 7fb065a6e740 1 -- 172.21.15.12:0/910179575 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571f633e0a0 con 0x5571f63ebc60 2024-09-16T01:03:43.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.906+0000 7fb061431640 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5571f63ebc60 0x5571f63ee0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.906+0000 7fb061431640 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5571f63ebc60 0x5571f63ee0a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6410a55d71a7b88 server_cookie=69a77e21bff74ecd in_seq=0 out_seq=0 2024-09-16T01:03:43.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.906+0000 7fb040ff9640 10 client.16167 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb040ff9640 1 -- 172.21.15.12:0/910179575 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571f633e0a0 con 0x5571f63ebc60 2024-09-16T01:03:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb040ff9640 10 client.16167 handle_command_reply: tid=0 2024-09-16T01:03:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 client.16167 shutdown 2024-09-16T01:03:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 -- 172.21.15.12:0/910179575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 msgr2=0x5571f63d9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63d9b50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb054003db0 tx=0x7fb054009260 comp rx=0 tx=0).stop 2024-09-16T01:03:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 -- 172.21.15.12:0/910179575 shutdown_connections 2024-09-16T01:03:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5571f63ebc60 0x5571f63ee0a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb040ff9640 0 client.16167 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63dc240 0x5571f63d9b50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63d9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 --2- 172.21.15.12:0/910179575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1060 0x5571f63d90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 -- 172.21.15.12:0/910179575 >> 172.21.15.12:0/910179575 conn(0x5571f63cd5f0 msgr2=0x5571f63d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 -- 172.21.15.12:0/910179575 shutdown_connections 2024-09-16T01:03:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 1 -- 172.21.15.12:0/910179575 wait complete. 2024-09-16T01:03:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.907+0000 7fb065a6e740 20 client.16167 trim_cache size 0 max 16384 2024-09-16T01:03:43.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.924+0000 7fb065a6e740 1 Processor -- start 2024-09-16T01:03:43.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb065a6e740 1 -- start start 2024-09-16T01:03:43.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63e4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63e4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63dc240 0x5571f63f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb065a6e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1aec50 con 0x5571f63d1060 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb065a6e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1b0790 con 0x5571f63d1980 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb065a6e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1af320 con 0x5571f63dc240 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb061431640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb061431640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63e4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56612/0 (socket says 172.21.15.12:56612) 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb061431640 1 -- 172.21.15.12:0/3675536099 learned_addr learned my addr 172.21.15.12:0/3675536099 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb060c30640 1 --2- 172.21.15.12:0/3675536099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63e4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb061431640 1 -- 172.21.15.12:0/3675536099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63dc240 msgr2=0x5571f63f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb061c32640 1 --2- 172.21.15.12:0/3675536099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63dc240 0x5571f63f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb061431640 1 --2- 172.21.15.12:0/3675536099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63dc240 0x5571f63f39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb061431640 1 -- 172.21.15.12:0/3675536099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 msgr2=0x5571f63e4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb061431640 1 --2- 172.21.15.12:0/3675536099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63e4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb061431640 1 -- 172.21.15.12:0/3675536099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f63cd420 con 0x5571f63d1060 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.925+0000 7fb061431640 1 --2- 172.21.15.12:0/3675536099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63e4590 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb04c000f80 tx=0x7fb04c015af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba0d80c0b106bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb042ffd640 1 -- 172.21.15.12:0/3675536099 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0153d0 con 0x5571f63d1060 2024-09-16T01:03:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb042ffd640 1 -- 172.21.15.12:0/3675536099 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb04c022070 con 0x5571f63d1060 2024-09-16T01:03:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb042ffd640 1 -- 172.21.15.12:0/3675536099 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c004050 con 0x5571f63d1060 2024-09-16T01:03:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb065a6e740 1 -- 172.21.15.12:0/3675536099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 msgr2=0x5571f63e4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb065a6e740 1 --2- 172.21.15.12:0/3675536099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63e4590 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb04c000f80 tx=0x7fb04c015af0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb065a6e740 1 -- 172.21.15.12:0/3675536099 shutdown_connections 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb065a6e740 1 --2- 172.21.15.12:0/3675536099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63dc240 0x5571f63f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb065a6e740 1 --2- 172.21.15.12:0/3675536099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63d1980 0x5571f63e4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb065a6e740 1 --2- 172.21.15.12:0/3675536099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63e4590 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb065a6e740 1 -- 172.21.15.12:0/3675536099 >> 172.21.15.12:0/3675536099 conn(0x5571f63cd5f0 msgr2=0x5571f63d79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb065a6e740 1 -- 172.21.15.12:0/3675536099 shutdown_connections 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.926+0000 7fb065a6e740 1 -- 172.21.15.12:0/3675536099 wait complete. 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb065a6e740 1 -- start start 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb065a6e740 1 Processor -- start 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63d68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1980 0x5571f63d6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb065a6e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63dc240 0x5571f63d55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb065a6e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1b00c0 con 0x5571f63d1060 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb065a6e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1af9f0 con 0x5571f63dc240 2024-09-16T01:03:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb065a6e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1acc30 con 0x5571f63d1980 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb061431640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63d68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb061431640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63d68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56614/0 (socket says 172.21.15.12:56614) 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb061431640 1 -- 172.21.15.12:0/1601799545 learned_addr learned my addr 172.21.15.12:0/1601799545 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.927+0000 7fb065a6e740 10 client.0 _ll_register_callbacks cb 0x7fb054003a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb060c30640 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1980 0x5571f63d6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb061c32640 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63dc240 0x5571f63d55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb061431640 1 -- 172.21.15.12:0/1601799545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1980 msgr2=0x5571f63d6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb061431640 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1980 0x5571f63d6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb061431640 1 -- 172.21.15.12:0/1601799545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63dc240 msgr2=0x5571f63d55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb061431640 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63dc240 0x5571f63d55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb061431640 1 -- 172.21.15.12:0/1601799545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571f63d3ed0 con 0x5571f63d1060 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb061c32640 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63dc240 0x5571f63d55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb061431640 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63d68b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009f40 tx=0x7fb04c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f295d8fecd67fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb040ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb040ff9640 1 -- 172.21.15.12:0/1601799545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c004a80 con 0x5571f63d1060 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb065a6e740 1 -- 172.21.15.12:0/1601799545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb04c022070 con 0x5571f63d1060 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb040ff9640 1 -- 172.21.15.12:0/1601799545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fb04c004c20 con 0x5571f63d1060 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb040ff9640 1 -- 172.21.15.12:0/1601799545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb04c004e20 con 0x5571f63d1060 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb065a6e740 10 client.16173 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.928+0000 7fb065a6e740 1 -- 172.21.15.12:0/1601799545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5571f645b4d0 con 0x5571f63d1060 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.929+0000 7fb040ff9640 1 -- 172.21.15.12:0/1601799545 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb04c022070 con 0x5571f63d1060 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.929+0000 7fb040ff9640 1 -- 172.21.15.12:0/1601799545 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb04c00f040 con 0x5571f63d1060 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.929+0000 7fb065a6e740 10 client.16173 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.929+0000 7fb065a6e740 10 client.16173 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.929+0000 7fb065a6e740 20 client.16173 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.929+0000 7fb065a6e740 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5571f63ebc60 0x5571f645dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.929+0000 7fb065a6e740 4 client.16173 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "77ad929a", "release": true, "await": true}] 2024-09-16T01:03:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.929+0000 7fb065a6e740 1 -- 172.21.15.12:0/1601799545 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "quiesce db", "set_id": "77ad929a", "release": true, "await": true}) -- 0x5571f62ba5a0 con 0x5571f63ebc60 2024-09-16T01:03:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.929+0000 7fb060c30640 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5571f63ebc60 0x5571f645dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.930+0000 7fb060c30640 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5571f63ebc60 0x5571f645dc30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63eea77782b03dcb server_cookie=d34b573ba16e12ec in_seq=0 out_seq=0 2024-09-16T01:03:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.930+0000 7fb040ff9640 10 client.16173 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb040ff9640 1 -- 172.21.15.12:0/1601799545 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5571f62ba5a0 con 0x5571f63ebc60 2024-09-16T01:03:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb040ff9640 10 client.16173 handle_command_reply: tid=0 2024-09-16T01:03:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 client.16173 shutdown 2024-09-16T01:03:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 -- 172.21.15.12:0/1601799545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 msgr2=0x5571f63d68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63d68b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009f40 tx=0x7fb04c009f70 comp rx=0 tx=0).stop 2024-09-16T01:03:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 -- 172.21.15.12:0/1601799545 shutdown_connections 2024-09-16T01:03:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5571f63ebc60 0x5571f645dc30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571f63dc240 0x5571f63d55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5571f63d1980 0x5571f63d6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 --2- 172.21.15.12:0/1601799545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f63d1060 0x5571f63d68b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 -- 172.21.15.12:0/1601799545 >> 172.21.15.12:0/1601799545 conn(0x5571f63cd5f0 msgr2=0x5571f63cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb040ff9640 0 client.16173 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 -- 172.21.15.12:0/1601799545 shutdown_connections 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 1 -- 172.21.15.12:0/1601799545 wait complete. 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.932+0000 7fb065a6e740 20 client.16173 trim_cache size 0 max 16384 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 29, 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24518, 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 8, 2024-09-16T01:03:43.937 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "77ad929a": { 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 8, 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 139.6, 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-16T01:03:43.938 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-16T01:03:43.939 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:43.939 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:43.939 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:43.939 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:43.939 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:43.939 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 -- 172.21.15.12:0/877634303 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0440a3240 msgr2=0x7fb0440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0440a3240 0x7fb0440a5700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb0540096c0 tx=0x7fb054009560 comp rx=0 tx=0).stop 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 -- 172.21.15.12:0/877634303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c101bc0 msgr2=0x7fb05c199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c101bc0 0x7fb05c199800 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb05000d950 tx=0x7fb05000de10 comp rx=0 tx=0).stop 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 -- 172.21.15.12:0/877634303 shutdown_connections 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fb0440a3240 0x7fb0440a5700 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb05c105a90 0x7fb05c1a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c101bc0 0x7fb05c199800 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 --2- 172.21.15.12:0/877634303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb05c101240 0x7fb05c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 -- 172.21.15.12:0/877634303 >> 172.21.15.12:0/877634303 conn(0x7fb05c077210 msgr2=0x7fb05c103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 -- 172.21.15.12:0/877634303 shutdown_connections 2024-09-16T01:03:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:43.933+0000 7fb063695640 1 -- 172.21.15.12:0/877634303 wait complete. 2024-09-16T01:03:43.941 INFO:tasks.workunit.client.0.smithi012.stdout:setting up random write file 2024-09-16T01:03:43.941 INFO:tasks.workunit.client.0.smithi012.stdout:done setting up random write file 2024-09-16T01:03:43.941 INFO:tasks.workunit.client.0.smithi012.stdout:starting fsync run 2024-09-16T01:03:43.941 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0091s 2024-09-16T01:03:43.941 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0062s 2024-09-16T01:03:43.941 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0064s 2024-09-16T01:03:43.941 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0058s 2024-09-16T01:03:43.941 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0209s 2024-09-16T01:03:43.941 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-16T01:03:43.941 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0064s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0068s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0073s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0068s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0056s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0062s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0064s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-16T01:03:43.942 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0055s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0060s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0073s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0053s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0051s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0051s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0056s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0060s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0064s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-16T01:03:43.943 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0056s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0073s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0063s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0056s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-16T01:03:43.944 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0060s 2024-09-16T01:03:43.945 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0054s 2024-09-16T01:03:43.945 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0003s fsync time: 0.0069s 2024-09-16T01:03:43.945 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0062s 2024-09-16T01:03:43.945 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-16T01:03:43.945 INFO:tasks.workunit.client.0.smithi012.stdout:write time: 17.8996s fsync time: 0.0063s 2024-09-16T01:03:43.945 INFO:tasks.workunit.client.0.smithi012.stdout:run done 56 fsyncs total, killing random writer 2024-09-16T01:03:43.945 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-16T01:03:43.945 INFO:tasks.workunit.client.0.smithi012.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-16T01:03:43.946 INFO:tasks.workunit.client.0.smithi012.stderr:+ whereis lsof 2024-09-16T01:03:44.017 INFO:tasks.workunit.client.0.smithi012.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-16T01:03:44.018 INFO:tasks.workunit.client.0.smithi012.stderr:+ lsof 2024-09-16T01:03:44.079 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/30aa27a66e64349d6c79d03d1b46edcdbd4882bf9306b46554c88000c8d9a04d/merged 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/e02b69b019cf3a07a506caf56dc2e44344e8a4caba83bfa457219bba32edb6c0/merged 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/3ae3198606a2ac0b593ea14c55bee84e9114eb77bf53d03b7adfeef886072024/merged 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/b7861865a0e4a9ebe0a4d37bda46ac5879c1979df68beecd62de789af865dc5b/merged 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/a83c24379fc0f3d7c1a45b7e08716adc14541a968e778115d3fa8521ac8b19fd/merged 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/49e80330a48341993c86ccbabdb795680e728d68c02199b977bea1f22880bc07/merged 2024-09-16T01:03:44.080 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.081 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d84335987e878dc8a6ee6e5cc1e5acacb83b1434f05ae7d39111af750b1029ea/merged 2024-09-16T01:03:44.081 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.081 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/59254901b4481e62b1f426695eb9144a33c168dc8d44c866f00b631bf1d7cccb/merged 2024-09-16T01:03:44.081 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.081 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d9e6b4138c1e6ceb61cd36ff26531253d62a53c2123a0ba33d39477fdc7edd66/merged 2024-09-16T01:03:44.081 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.081 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/96bf600d4e1ebfdc6a2b147b8cf6d7652f9a249954eefeb2af49e4f65a577004/merged 2024-09-16T01:03:44.081 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.081 INFO:tasks.workunit.client.0.smithi012.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/7ea6d4e1bd5c09cf9f585562d92745a1faf04ed62aa6c23da7cd688bc493864d/merged 2024-09-16T01:03:44.081 INFO:tasks.workunit.client.0.smithi012.stderr: Output information may be incomplete. 2024-09-16T01:03:44.140 INFO:tasks.workunit.client.0.smithi012.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-16T01:03:44.140 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-16T01:03:44.140 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-16T01:03:44.140 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-16T01:03:44.140 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-16T01:03:44.140 INFO:tasks.workunit.client.0.smithi012.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-16T01:03:44.140 INFO:tasks.workunit.client.0.smithi012.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-16T01:03:44.140 INFO:tasks.workunit.client.0.smithi012.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-16T01:03:44.140 INFO:tasks.workunit.client.0.smithi012.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-16T01:03:44.140 INFO:tasks.workunit.client.0.smithi012.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-16T01:03:44.141 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-16T01:03:44.142 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-16T01:03:44.143 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:pr/ttyS1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:pr/ttyS1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:pr/ttyS1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_preem 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_preem 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_preem 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-16T01:03:44.144 INFO:tasks.workunit.client.0.smithi012.stdout:rcu_preem 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/0 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/0 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/0 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/0 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-16T01:03:44.145 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-16T01:03:44.146 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-09-16T01:03:44.147 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-16T01:03:44.148 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-16T01:03:44.149 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-16T01:03:44.150 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-16T01:03:44.151 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-16T01:03:44.152 INFO:tasks.workunit.client.0.smithi012.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-16T01:03:44.153 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-16T01:03:44.154 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:cpuhp/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:idle_inje 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:migration 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:migration 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:migration 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:migration 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2024-09-16T01:03:44.155 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:ksoftirqd 62 root NOFD /proc/62/fd (opendir: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 64 root cwd unknown /proc/64/cwd (readlink: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 64 root rtd unknown /proc/64/root (readlink: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 64 root txt unknown /proc/64/exe (readlink: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 64 root NOFD /proc/64/fd (opendir: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 67 root cwd unknown /proc/67/cwd (readlink: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 67 root rtd unknown /proc/67/root (readlink: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 67 root txt unknown /proc/67/exe (readlink: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 67 root NOFD /proc/67/fd (opendir: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2024-09-16T01:03:44.156 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 68 root NOFD /proc/68/fd (opendir: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kdevtmpfs 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kdevtmpfs 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kdevtmpfs 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kdevtmpfs 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-09-16T01:03:44.157 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:kauditd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:kauditd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:kauditd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:kauditd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:khungtask 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:khungtask 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:khungtask 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:khungtask 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:oom_reape 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:oom_reape 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:oom_reape 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:oom_reape 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-09-16T01:03:44.158 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:kcompactd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:kcompactd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:kcompactd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:kcompactd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:ksmd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:ksmd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:ksmd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:ksmd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:khugepage 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:khugepage 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:khugepage 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-09-16T01:03:44.159 INFO:tasks.workunit.client.0.smithi012.stdout:khugepage 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-16T01:03:44.160 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 86 root cwd unknown /proc/86/cwd (readlink: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 86 root rtd unknown /proc/86/root (readlink: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 86 root txt unknown /proc/86/exe (readlink: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 86 root NOFD /proc/86/fd (opendir: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-09-16T01:03:44.161 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:watchdogd 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:watchdogd 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:watchdogd 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:watchdogd 91 root NOFD /proc/91/fd (opendir: Permission denied) 2024-09-16T01:03:44.162 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 93 root cwd unknown /proc/93/cwd (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 93 root rtd unknown /proc/93/root (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 93 root txt unknown /proc/93/exe (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 93 root NOFD /proc/93/fd (opendir: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kswapd0 96 root cwd unknown /proc/96/cwd (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kswapd0 96 root rtd unknown /proc/96/root (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kswapd0 96 root txt unknown /proc/96/exe (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kswapd0 96 root NOFD /proc/96/fd (opendir: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 103 root cwd unknown /proc/103/cwd (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 103 root rtd unknown /proc/103/root (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 103 root txt unknown /proc/103/exe (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 103 root NOFD /proc/103/fd (opendir: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 109 root cwd unknown /proc/109/cwd (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 109 root rtd unknown /proc/109/root (readlink: Permission denied) 2024-09-16T01:03:44.163 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 109 root txt unknown /proc/109/exe (readlink: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 109 root NOFD /proc/109/fd (opendir: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-09-16T01:03:44.164 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 114 root cwd unknown /proc/114/cwd (readlink: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 114 root rtd unknown /proc/114/root (readlink: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 114 root txt unknown /proc/114/exe (readlink: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 114 root NOFD /proc/114/fd (opendir: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 115 root cwd unknown /proc/115/cwd (readlink: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 115 root rtd unknown /proc/115/root (readlink: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 115 root txt unknown /proc/115/exe (readlink: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 115 root NOFD /proc/115/fd (opendir: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 116 root cwd unknown /proc/116/cwd (readlink: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 116 root rtd unknown /proc/116/root (readlink: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 116 root txt unknown /proc/116/exe (readlink: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 116 root NOFD /proc/116/fd (opendir: Permission denied) 2024-09-16T01:03:44.165 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 125 root cwd unknown /proc/125/cwd (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 125 root rtd unknown /proc/125/root (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 125 root txt unknown /proc/125/exe (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 125 root NOFD /proc/125/fd (opendir: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 131 root cwd unknown /proc/131/cwd (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 131 root rtd unknown /proc/131/root (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 131 root txt unknown /proc/131/exe (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 131 root NOFD /proc/131/fd (opendir: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 238 root cwd unknown /proc/238/cwd (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 238 root rtd unknown /proc/238/root (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 238 root txt unknown /proc/238/exe (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 238 root NOFD /proc/238/fd (opendir: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 239 root cwd unknown /proc/239/cwd (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 239 root rtd unknown /proc/239/root (readlink: Permission denied) 2024-09-16T01:03:44.166 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 239 root txt unknown /proc/239/exe (readlink: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 239 root NOFD /proc/239/fd (opendir: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 241 root cwd unknown /proc/241/cwd (readlink: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 241 root rtd unknown /proc/241/root (readlink: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 241 root txt unknown /proc/241/exe (readlink: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 241 root NOFD /proc/241/fd (opendir: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 280 root cwd unknown /proc/280/cwd (readlink: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 280 root rtd unknown /proc/280/root (readlink: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 280 root txt unknown /proc/280/exe (readlink: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 280 root NOFD /proc/280/fd (opendir: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 282 root cwd unknown /proc/282/cwd (readlink: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 282 root rtd unknown /proc/282/root (readlink: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 282 root txt unknown /proc/282/exe (readlink: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 282 root NOFD /proc/282/fd (opendir: Permission denied) 2024-09-16T01:03:44.167 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 284 root cwd unknown /proc/284/cwd (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 284 root rtd unknown /proc/284/root (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 284 root txt unknown /proc/284/exe (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 284 root NOFD /proc/284/fd (opendir: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 286 root cwd unknown /proc/286/cwd (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 286 root rtd unknown /proc/286/root (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 286 root txt unknown /proc/286/exe (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 286 root NOFD /proc/286/fd (opendir: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 429 root cwd unknown /proc/429/cwd (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 429 root rtd unknown /proc/429/root (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 429 root txt unknown /proc/429/exe (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 429 root NOFD /proc/429/fd (opendir: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 430 root cwd unknown /proc/430/cwd (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 430 root rtd unknown /proc/430/root (readlink: Permission denied) 2024-09-16T01:03:44.168 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 430 root txt unknown /proc/430/exe (readlink: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 430 root NOFD /proc/430/fd (opendir: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 431 root cwd unknown /proc/431/cwd (readlink: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 431 root rtd unknown /proc/431/root (readlink: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 431 root txt unknown /proc/431/exe (readlink: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 431 root NOFD /proc/431/fd (opendir: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 432 root cwd unknown /proc/432/cwd (readlink: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 432 root rtd unknown /proc/432/root (readlink: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 432 root txt unknown /proc/432/exe (readlink: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 432 root NOFD /proc/432/fd (opendir: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 433 root cwd unknown /proc/433/cwd (readlink: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 433 root rtd unknown /proc/433/root (readlink: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 433 root txt unknown /proc/433/exe (readlink: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 433 root NOFD /proc/433/fd (opendir: Permission denied) 2024-09-16T01:03:44.169 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 434 root cwd unknown /proc/434/cwd (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 434 root rtd unknown /proc/434/root (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 434 root txt unknown /proc/434/exe (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 434 root NOFD /proc/434/fd (opendir: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_0 448 root cwd unknown /proc/448/cwd (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_0 448 root rtd unknown /proc/448/root (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_0 448 root txt unknown /proc/448/exe (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_0 448 root NOFD /proc/448/fd (opendir: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 449 root cwd unknown /proc/449/cwd (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 449 root rtd unknown /proc/449/root (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 449 root txt unknown /proc/449/exe (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 449 root NOFD /proc/449/fd (opendir: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_1 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_1 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-09-16T01:03:44.170 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_1 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_1 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_2 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_2 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_2 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_2 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-09-16T01:03:44.171 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_3 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_3 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_3 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_3 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 455 root cwd unknown /proc/455/cwd (readlink: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 455 root rtd unknown /proc/455/root (readlink: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 455 root txt unknown /proc/455/exe (readlink: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 455 root NOFD /proc/455/fd (opendir: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_4 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_4 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_4 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_4 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 457 root cwd unknown /proc/457/cwd (readlink: Permission denied) 2024-09-16T01:03:44.172 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 457 root rtd unknown /proc/457/root (readlink: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 457 root txt unknown /proc/457/exe (readlink: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 457 root NOFD /proc/457/fd (opendir: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_5 458 root cwd unknown /proc/458/cwd (readlink: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_5 458 root rtd unknown /proc/458/root (readlink: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_5 458 root txt unknown /proc/458/exe (readlink: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_5 458 root NOFD /proc/458/fd (opendir: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 459 root cwd unknown /proc/459/cwd (readlink: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 459 root rtd unknown /proc/459/root (readlink: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 459 root txt unknown /proc/459/exe (readlink: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 459 root NOFD /proc/459/fd (opendir: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_6 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_6 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-09-16T01:03:44.173 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_6 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_6 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_7 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_7 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_7 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_7 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 463 root cwd unknown /proc/463/cwd (readlink: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 463 root rtd unknown /proc/463/root (readlink: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 463 root txt unknown /proc/463/exe (readlink: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 463 root NOFD /proc/463/fd (opendir: Permission denied) 2024-09-16T01:03:44.174 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_8 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_8 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_8 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_8 464 root NOFD /proc/464/fd (opendir: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_9 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_9 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_9 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:scsi_eh_9 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 467 root cwd unknown /proc/467/cwd (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 467 root rtd unknown /proc/467/root (readlink: Permission denied) 2024-09-16T01:03:44.175 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 467 root txt unknown /proc/467/exe (readlink: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 467 root NOFD /proc/467/fd (opendir: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 468 root cwd unknown /proc/468/cwd (readlink: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 468 root rtd unknown /proc/468/root (readlink: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 468 root txt unknown /proc/468/exe (readlink: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 468 root NOFD /proc/468/fd (opendir: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 499 root cwd unknown /proc/499/cwd (readlink: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 499 root rtd unknown /proc/499/root (readlink: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 499 root txt unknown /proc/499/exe (readlink: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 499 root NOFD /proc/499/fd (opendir: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:jbd2/sda1 500 root cwd unknown /proc/500/cwd (readlink: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:jbd2/sda1 500 root rtd unknown /proc/500/root (readlink: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:jbd2/sda1 500 root txt unknown /proc/500/exe (readlink: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:jbd2/sda1 500 root NOFD /proc/500/fd (opendir: Permission denied) 2024-09-16T01:03:44.176 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 501 root cwd unknown /proc/501/cwd (readlink: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 501 root rtd unknown /proc/501/root (readlink: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 501 root txt unknown /proc/501/exe (readlink: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 501 root NOFD /proc/501/fd (opendir: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 563 root cwd unknown /proc/563/cwd (readlink: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 563 root rtd unknown /proc/563/root (readlink: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 563 root txt unknown /proc/563/exe (readlink: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 563 root NOFD /proc/563/fd (opendir: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-j 578 root cwd unknown /proc/578/cwd (readlink: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-j 578 root rtd unknown /proc/578/root (readlink: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-j 578 root txt unknown /proc/578/exe (readlink: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-j 578 root NOFD /proc/578/fd (opendir: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:ext4lazyi 589 root cwd unknown /proc/589/cwd (readlink: Permission denied) 2024-09-16T01:03:44.177 INFO:tasks.workunit.client.0.smithi012.stdout:ext4lazyi 589 root rtd unknown /proc/589/root (readlink: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:ext4lazyi 589 root txt unknown /proc/589/exe (readlink: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:ext4lazyi 589 root NOFD /proc/589/fd (opendir: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 590 root cwd unknown /proc/590/cwd (readlink: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 590 root rtd unknown /proc/590/root (readlink: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 590 root txt unknown /proc/590/exe (readlink: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 590 root NOFD /proc/590/fd (opendir: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-u 595 root cwd unknown /proc/595/cwd (readlink: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-u 595 root rtd unknown /proc/595/root (readlink: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-u 595 root txt unknown /proc/595/exe (readlink: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-u 595 root NOFD /proc/595/fd (opendir: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 637 root cwd unknown /proc/637/cwd (readlink: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 637 root rtd unknown /proc/637/root (readlink: Permission denied) 2024-09-16T01:03:44.178 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 637 root txt unknown /proc/637/exe (readlink: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 637 root NOFD /proc/637/fd (opendir: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:kipmi0 644 root cwd unknown /proc/644/cwd (readlink: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:kipmi0 644 root rtd unknown /proc/644/root (readlink: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:kipmi0 644 root txt unknown /proc/644/exe (readlink: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:kipmi0 644 root NOFD /proc/644/fd (opendir: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:rpcbind 662 rpc cwd unknown /proc/662/cwd (readlink: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:rpcbind 662 rpc rtd unknown /proc/662/root (readlink: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:rpcbind 662 rpc txt unknown /proc/662/exe (readlink: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:rpcbind 662 rpc NOFD /proc/662/fd (opendir: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 674 root cwd unknown /proc/674/cwd (readlink: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 674 root rtd unknown /proc/674/root (readlink: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 674 root txt unknown /proc/674/exe (readlink: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 674 root NOFD /proc/674/fd (opendir: Permission denied) 2024-09-16T01:03:44.179 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 675 root cwd unknown /proc/675/cwd (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 675 root rtd unknown /proc/675/root (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 675 root txt unknown /proc/675/exe (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 675 root NOFD /proc/675/fd (opendir: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 root cwd unknown /proc/676/cwd (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 root rtd unknown /proc/676/root (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 root txt unknown /proc/676/exe (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 root NOFD /proc/676/fd (opendir: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 677 auditd root cwd unknown /proc/676/task/677/cwd (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 677 auditd root rtd unknown /proc/676/task/677/root (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 677 auditd root txt unknown /proc/676/task/677/exe (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 677 auditd root NOFD /proc/676/task/677/fd (opendir: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 679 auditd root cwd unknown /proc/676/task/679/cwd (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 679 auditd root rtd unknown /proc/676/task/679/root (readlink: Permission denied) 2024-09-16T01:03:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 679 auditd root txt unknown /proc/676/task/679/exe (readlink: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:auditd 676 679 auditd root NOFD /proc/676/task/679/fd (opendir: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:sedispatc 678 root cwd unknown /proc/678/cwd (readlink: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:sedispatc 678 root rtd unknown /proc/678/root (readlink: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:sedispatc 678 root txt unknown /proc/678/exe (readlink: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:sedispatc 678 root NOFD /proc/678/fd (opendir: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:dbus-brok 720 dbus cwd unknown /proc/720/cwd (readlink: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:dbus-brok 720 dbus rtd unknown /proc/720/root (readlink: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:dbus-brok 720 dbus txt unknown /proc/720/exe (readlink: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:dbus-brok 720 dbus NOFD /proc/720/fd (opendir: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:dbus-brok 721 dbus cwd unknown /proc/721/cwd (readlink: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:dbus-brok 721 dbus rtd unknown /proc/721/root (readlink: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:dbus-brok 721 dbus txt unknown /proc/721/exe (readlink: Permission denied) 2024-09-16T01:03:44.181 INFO:tasks.workunit.client.0.smithi012.stdout:dbus-brok 721 dbus NOFD /proc/721/fd (opendir: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 root cwd unknown /proc/722/cwd (readlink: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 root rtd unknown /proc/722/root (readlink: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 root txt unknown /proc/722/exe (readlink: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 root NOFD /proc/722/fd (opendir: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 739 gmain root cwd unknown /proc/722/task/739/cwd (readlink: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 739 gmain root rtd unknown /proc/722/task/739/root (readlink: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 739 gmain root txt unknown /proc/722/task/739/exe (readlink: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 739 gmain root NOFD /proc/722/task/739/fd (opendir: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 740 gdbus root cwd unknown /proc/722/task/740/cwd (readlink: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 740 gdbus root rtd unknown /proc/722/task/740/root (readlink: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 740 gdbus root txt unknown /proc/722/task/740/exe (readlink: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:NetworkMa 722 740 gdbus root NOFD /proc/722/task/740/fd (opendir: Permission denied) 2024-09-16T01:03:44.182 INFO:tasks.workunit.client.0.smithi012.stdout:irqbalanc 725 root cwd unknown /proc/725/cwd (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:irqbalanc 725 root rtd unknown /proc/725/root (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:irqbalanc 725 root txt unknown /proc/725/exe (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:irqbalanc 725 root NOFD /proc/725/fd (opendir: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:irqbalanc 725 732 gmain root cwd unknown /proc/725/task/732/cwd (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:irqbalanc 725 732 gmain root rtd unknown /proc/725/task/732/root (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:irqbalanc 725 732 gmain root txt unknown /proc/725/task/732/exe (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:irqbalanc 725 732 gmain root NOFD /proc/725/task/732/fd (opendir: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:lsmd 726 libstoragemgmt cwd unknown /proc/726/cwd (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:lsmd 726 libstoragemgmt rtd unknown /proc/726/root (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:lsmd 726 libstoragemgmt txt unknown /proc/726/exe (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:lsmd 726 libstoragemgmt NOFD /proc/726/fd (opendir: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:mcelog 727 root cwd unknown /proc/727/cwd (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:mcelog 727 root rtd unknown /proc/727/root (readlink: Permission denied) 2024-09-16T01:03:44.183 INFO:tasks.workunit.client.0.smithi012.stdout:mcelog 727 root txt unknown /proc/727/exe (readlink: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:mcelog 727 root NOFD /proc/727/fd (opendir: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:smartd 728 root cwd unknown /proc/728/cwd (readlink: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:smartd 728 root rtd unknown /proc/728/root (readlink: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:smartd 728 root txt unknown /proc/728/exe (readlink: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:smartd 728 root NOFD /proc/728/fd (opendir: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-l 730 root cwd unknown /proc/730/cwd (readlink: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-l 730 root rtd unknown /proc/730/root (readlink: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-l 730 root txt unknown /proc/730/exe (readlink: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:systemd-l 730 root NOFD /proc/730/fd (opendir: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 774 root cwd unknown /proc/774/cwd (readlink: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 774 root rtd unknown /proc/774/root (readlink: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 774 root txt unknown /proc/774/exe (readlink: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 774 root NOFD /proc/774/fd (opendir: Permission denied) 2024-09-16T01:03:44.184 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 root cwd unknown /proc/778/cwd (readlink: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 root rtd unknown /proc/778/root (readlink: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 root txt unknown /proc/778/exe (readlink: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 root NOFD /proc/778/fd (opendir: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 779 gssproxy root cwd unknown /proc/778/task/779/cwd (readlink: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 779 gssproxy root rtd unknown /proc/778/task/779/root (readlink: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 779 gssproxy root txt unknown /proc/778/task/779/exe (readlink: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 779 gssproxy root NOFD /proc/778/task/779/fd (opendir: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 780 gssproxy root cwd unknown /proc/778/task/780/cwd (readlink: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 780 gssproxy root rtd unknown /proc/778/task/780/root (readlink: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 780 gssproxy root txt unknown /proc/778/task/780/exe (readlink: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 780 gssproxy root NOFD /proc/778/task/780/fd (opendir: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 781 gssproxy root cwd unknown /proc/778/task/781/cwd (readlink: Permission denied) 2024-09-16T01:03:44.185 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 781 gssproxy root rtd unknown /proc/778/task/781/root (readlink: Permission denied) 2024-09-16T01:03:44.186 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 781 gssproxy root txt unknown /proc/778/task/781/exe (readlink: Permission denied) 2024-09-16T01:03:44.186 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 781 gssproxy root NOFD /proc/778/task/781/fd (opendir: Permission denied) 2024-09-16T01:03:44.186 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 782 gssproxy root cwd unknown /proc/778/task/782/cwd (readlink: Permission denied) 2024-09-16T01:03:44.186 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 782 gssproxy root rtd unknown /proc/778/task/782/root (readlink: Permission denied) 2024-09-16T01:03:44.186 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 782 gssproxy root txt unknown /proc/778/task/782/exe (readlink: Permission denied) 2024-09-16T01:03:44.186 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 782 gssproxy root NOFD /proc/778/task/782/fd (opendir: Permission denied) 2024-09-16T01:03:44.186 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 783 gssproxy root cwd unknown /proc/778/task/783/cwd (readlink: Permission denied) 2024-09-16T01:03:44.186 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 783 gssproxy root rtd unknown /proc/778/task/783/root (readlink: Permission denied) 2024-09-16T01:03:44.186 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 783 gssproxy root txt unknown /proc/778/task/783/exe (readlink: Permission denied) 2024-09-16T01:03:44.186 INFO:tasks.workunit.client.0.smithi012.stdout:gssproxy 778 783 gssproxy root NOFD /proc/778/task/783/fd (opendir: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:atd 785 root cwd unknown /proc/785/cwd (readlink: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:atd 785 root rtd unknown /proc/785/root (readlink: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:atd 785 root txt unknown /proc/785/exe (readlink: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:atd 785 root NOFD /proc/785/fd (opendir: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:crond 786 root cwd unknown /proc/786/cwd (readlink: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:crond 786 root rtd unknown /proc/786/root (readlink: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:crond 786 root txt unknown /proc/786/exe (readlink: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:crond 786 root NOFD /proc/786/fd (opendir: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:nrpe 812 nrpe cwd unknown /proc/812/cwd (readlink: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:nrpe 812 nrpe rtd unknown /proc/812/root (readlink: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:nrpe 812 nrpe txt unknown /proc/812/exe (readlink: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:nrpe 812 nrpe NOFD /proc/812/fd (opendir: Permission denied) 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu cwd DIR 8,1 4096 2 / 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu rtd DIR 8,1 4096 2 / 2024-09-16T01:03:44.187 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 600667 655 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 21219 2231 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-16T01:03:44.188 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-16T01:03:44.189 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 1u unix 0x0000000000000000 0t0 17040 type=STREAM (CONNECTED) 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 2u unix 0x0000000000000000 0t0 17040 type=STREAM (CONNECTED) 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 3u unix 0x0000000000000000 0t0 17068 type=DGRAM (CONNECTED) 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 4u a_inode 0,14 0 2074 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 5u a_inode 0,14 0 2074 [signalfd] 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 6r a_inode 0,14 0 2074 inotify 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 7r DIR 0,25 0 3232 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-16T01:03:44.190 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 8u a_inode 0,14 0 2074 [timerfd] 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 9u a_inode 0,14 0 2074 [eventpoll:10,13] 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 10r REG 0,20 0 17057 /proc/1111/mountinfo 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 11r a_inode 0,14 0 2074 inotify 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 12u unix 0x0000000000000000 0t0 17094 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 13r a_inode 0,14 0 2074 inotify 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 14r REG 0,20 0 4026532068 /proc/swaps 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 15u netlink 0t0 17076 KOBJECT_UEVENT 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 16u unix 0x0000000000000000 0t0 17081 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 17u unix 0x0000000000000000 0t0 17082 type=DGRAM (CONNECTED) 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 18u unix 0x0000000000000000 0t0 17083 type=DGRAM (CONNECTED) 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 19u unix 0x0000000000000000 0t0 17084 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 20u unix 0x0000000000000000 0t0 17086 type=STREAM (CONNECTED) 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 1111 ubuntu 21u a_inode 0,14 0 2074 [timerfd] 2024-09-16T01:03:44.191 INFO:tasks.workunit.client.0.smithi012.stdout:(sd-pam) 1114 ubuntu cwd unknown /proc/1114/cwd (readlink: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:(sd-pam) 1114 ubuntu rtd unknown /proc/1114/root (readlink: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:(sd-pam) 1114 ubuntu txt unknown /proc/1114/exe (readlink: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:(sd-pam) 1114 ubuntu NOFD /proc/1114/fd (opendir: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:agetty 1243 root cwd unknown /proc/1243/cwd (readlink: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:agetty 1243 root rtd unknown /proc/1243/root (readlink: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:agetty 1243 root txt unknown /proc/1243/exe (readlink: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:agetty 1243 root NOFD /proc/1243/fd (opendir: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 1244 root cwd unknown /proc/1244/cwd (readlink: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 1244 root rtd unknown /proc/1244/root (readlink: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 1244 root txt unknown /proc/1244/exe (readlink: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 1244 root NOFD /proc/1244/fd (opendir: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:agetty 1245 root cwd unknown /proc/1245/cwd (readlink: Permission denied) 2024-09-16T01:03:44.192 INFO:tasks.workunit.client.0.smithi012.stdout:agetty 1245 root rtd unknown /proc/1245/root (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:agetty 1245 root txt unknown /proc/1245/exe (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:agetty 1245 root NOFD /proc/1245/fd (opendir: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 root cwd unknown /proc/2974/cwd (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 root rtd unknown /proc/2974/root (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 root txt unknown /proc/2974/exe (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 root NOFD /proc/2974/fd (opendir: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 2987 in:imjour root cwd unknown /proc/2974/task/2987/cwd (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 2987 in:imjour root rtd unknown /proc/2974/task/2987/root (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 2987 in:imjour root txt unknown /proc/2974/task/2987/exe (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 2987 in:imjour root NOFD /proc/2974/task/2987/fd (opendir: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 2988 rs:main root cwd unknown /proc/2974/task/2988/cwd (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 2988 rs:main root rtd unknown /proc/2974/task/2988/root (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 2988 rs:main root txt unknown /proc/2974/task/2988/exe (readlink: Permission denied) 2024-09-16T01:03:44.193 INFO:tasks.workunit.client.0.smithi012.stdout:rsyslogd 2974 2988 rs:main root NOFD /proc/2974/task/2988/fd (opendir: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 18664 root cwd unknown /proc/18664/cwd (readlink: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 18664 root rtd unknown /proc/18664/root (readlink: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 18664 root txt unknown /proc/18664/exe (readlink: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 18664 root NOFD /proc/18664/fd (opendir: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 polkitd cwd unknown /proc/19227/cwd (readlink: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 polkitd rtd unknown /proc/19227/root (readlink: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 polkitd txt unknown /proc/19227/exe (readlink: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 polkitd NOFD /proc/19227/fd (opendir: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19229 gmain polkitd cwd unknown /proc/19227/task/19229/cwd (readlink: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19229 gmain polkitd rtd unknown /proc/19227/task/19229/root (readlink: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19229 gmain polkitd txt unknown /proc/19227/task/19229/exe (readlink: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19229 gmain polkitd NOFD /proc/19227/task/19229/fd (opendir: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19230 gdbus polkitd cwd unknown /proc/19227/task/19230/cwd (readlink: Permission denied) 2024-09-16T01:03:44.194 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19230 gdbus polkitd rtd unknown /proc/19227/task/19230/root (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19230 gdbus polkitd txt unknown /proc/19227/task/19230/exe (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19230 gdbus polkitd NOFD /proc/19227/task/19230/fd (opendir: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19231 JS\x20Hel polkitd cwd unknown /proc/19227/task/19231/cwd (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19231 JS\x20Hel polkitd rtd unknown /proc/19227/task/19231/root (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19231 JS\x20Hel polkitd txt unknown /proc/19227/task/19231/exe (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19231 JS\x20Hel polkitd NOFD /proc/19227/task/19231/fd (opendir: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19232 JS\x20Hel polkitd cwd unknown /proc/19227/task/19232/cwd (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19232 JS\x20Hel polkitd rtd unknown /proc/19227/task/19232/root (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19232 JS\x20Hel polkitd txt unknown /proc/19227/task/19232/exe (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19232 JS\x20Hel polkitd NOFD /proc/19227/task/19232/fd (opendir: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19233 JS\x20Hel polkitd cwd unknown /proc/19227/task/19233/cwd (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19233 JS\x20Hel polkitd rtd unknown /proc/19227/task/19233/root (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19233 JS\x20Hel polkitd txt unknown /proc/19227/task/19233/exe (readlink: Permission denied) 2024-09-16T01:03:44.195 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19233 JS\x20Hel polkitd NOFD /proc/19227/task/19233/fd (opendir: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19234 JS\x20Hel polkitd cwd unknown /proc/19227/task/19234/cwd (readlink: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19234 JS\x20Hel polkitd rtd unknown /proc/19227/task/19234/root (readlink: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19234 JS\x20Hel polkitd txt unknown /proc/19227/task/19234/exe (readlink: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19234 JS\x20Hel polkitd NOFD /proc/19227/task/19234/fd (opendir: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19235 JS\x20Hel polkitd cwd unknown /proc/19227/task/19235/cwd (readlink: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19235 JS\x20Hel polkitd rtd unknown /proc/19227/task/19235/root (readlink: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19235 JS\x20Hel polkitd txt unknown /proc/19227/task/19235/exe (readlink: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19235 JS\x20Hel polkitd NOFD /proc/19227/task/19235/fd (opendir: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19236 JS\x20Hel polkitd cwd unknown /proc/19227/task/19236/cwd (readlink: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19236 JS\x20Hel polkitd rtd unknown /proc/19227/task/19236/root (readlink: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19236 JS\x20Hel polkitd txt unknown /proc/19227/task/19236/exe (readlink: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19236 JS\x20Hel polkitd NOFD /proc/19227/task/19236/fd (opendir: Permission denied) 2024-09-16T01:03:44.196 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19237 JS\x20Hel polkitd cwd unknown /proc/19227/task/19237/cwd (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19237 JS\x20Hel polkitd rtd unknown /proc/19227/task/19237/root (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19237 JS\x20Hel polkitd txt unknown /proc/19227/task/19237/exe (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19237 JS\x20Hel polkitd NOFD /proc/19227/task/19237/fd (opendir: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19238 JS\x20Hel polkitd cwd unknown /proc/19227/task/19238/cwd (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19238 JS\x20Hel polkitd rtd unknown /proc/19227/task/19238/root (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19238 JS\x20Hel polkitd txt unknown /proc/19227/task/19238/exe (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19238 JS\x20Hel polkitd NOFD /proc/19227/task/19238/fd (opendir: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19239 polkitd polkitd cwd unknown /proc/19227/task/19239/cwd (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19239 polkitd polkitd rtd unknown /proc/19227/task/19239/root (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19239 polkitd polkitd txt unknown /proc/19227/task/19239/exe (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:polkitd 19227 19239 polkitd polkitd NOFD /proc/19227/task/19239/fd (opendir: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21134 root cwd unknown /proc/21134/cwd (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21134 root rtd unknown /proc/21134/root (readlink: Permission denied) 2024-09-16T01:03:44.197 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21134 root txt unknown /proc/21134/exe (readlink: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21134 root NOFD /proc/21134/fd (opendir: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21163 root cwd unknown /proc/21163/cwd (readlink: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21163 root rtd unknown /proc/21163/root (readlink: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21163 root txt unknown /proc/21163/exe (readlink: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21163 root NOFD /proc/21163/fd (opendir: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21192 root cwd unknown /proc/21192/cwd (readlink: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21192 root rtd unknown /proc/21192/root (readlink: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21192 root txt unknown /proc/21192/exe (readlink: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21192 root NOFD /proc/21192/fd (opendir: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21221 root cwd unknown /proc/21221/cwd (readlink: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21221 root rtd unknown /proc/21221/root (readlink: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21221 root txt unknown /proc/21221/exe (readlink: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21221 root NOFD /proc/21221/fd (opendir: Permission denied) 2024-09-16T01:03:44.198 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21250 root cwd unknown /proc/21250/cwd (readlink: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21250 root rtd unknown /proc/21250/root (readlink: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21250 root txt unknown /proc/21250/exe (readlink: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21250 root NOFD /proc/21250/fd (opendir: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21414 root cwd unknown /proc/21414/cwd (readlink: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21414 root rtd unknown /proc/21414/root (readlink: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21414 root txt unknown /proc/21414/exe (readlink: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21414 root NOFD /proc/21414/fd (opendir: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21415 root cwd unknown /proc/21415/cwd (readlink: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21415 root rtd unknown /proc/21415/root (readlink: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21415 root txt unknown /proc/21415/exe (readlink: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21415 root NOFD /proc/21415/fd (opendir: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21416 root cwd unknown /proc/21416/cwd (readlink: Permission denied) 2024-09-16T01:03:44.199 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21416 root rtd unknown /proc/21416/root (readlink: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21416 root txt unknown /proc/21416/exe (readlink: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21416 root NOFD /proc/21416/fd (opendir: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21417 root cwd unknown /proc/21417/cwd (readlink: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21417 root rtd unknown /proc/21417/root (readlink: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21417 root txt unknown /proc/21417/exe (readlink: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21417 root NOFD /proc/21417/fd (opendir: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21418 root cwd unknown /proc/21418/cwd (readlink: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21418 root rtd unknown /proc/21418/root (readlink: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21418 root txt unknown /proc/21418/exe (readlink: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21418 root NOFD /proc/21418/fd (opendir: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21419 root cwd unknown /proc/21419/cwd (readlink: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21419 root rtd unknown /proc/21419/root (readlink: Permission denied) 2024-09-16T01:03:44.200 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21419 root txt unknown /proc/21419/exe (readlink: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21419 root NOFD /proc/21419/fd (opendir: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21420 root cwd unknown /proc/21420/cwd (readlink: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21420 root rtd unknown /proc/21420/root (readlink: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21420 root txt unknown /proc/21420/exe (readlink: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21420 root NOFD /proc/21420/fd (opendir: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21421 root cwd unknown /proc/21421/cwd (readlink: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21421 root rtd unknown /proc/21421/root (readlink: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21421 root txt unknown /proc/21421/exe (readlink: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21421 root NOFD /proc/21421/fd (opendir: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21422 root cwd unknown /proc/21422/cwd (readlink: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21422 root rtd unknown /proc/21422/root (readlink: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21422 root txt unknown /proc/21422/exe (readlink: Permission denied) 2024-09-16T01:03:44.201 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 21422 root NOFD /proc/21422/fd (opendir: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:xfsaild/d 21423 root cwd unknown /proc/21423/cwd (readlink: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:xfsaild/d 21423 root rtd unknown /proc/21423/root (readlink: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:xfsaild/d 21423 root txt unknown /proc/21423/exe (readlink: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:xfsaild/d 21423 root NOFD /proc/21423/fd (opendir: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 22343 root cwd unknown /proc/22343/cwd (readlink: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 22343 root rtd unknown /proc/22343/root (readlink: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 22343 root txt unknown /proc/22343/exe (readlink: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 22343 root NOFD /proc/22343/fd (opendir: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 22346 ubuntu cwd unknown /proc/22346/cwd (readlink: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 22346 ubuntu rtd unknown /proc/22346/root (readlink: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 22346 ubuntu txt unknown /proc/22346/exe (readlink: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 22346 ubuntu NOFD /proc/22346/fd (opendir: Permission denied) 2024-09-16T01:03:44.202 INFO:tasks.workunit.client.0.smithi012.stdout:chronyd 22406 chrony cwd unknown /proc/22406/cwd (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:chronyd 22406 chrony rtd unknown /proc/22406/root (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:chronyd 22406 chrony txt unknown /proc/22406/exe (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:chronyd 22406 chrony NOFD /proc/22406/fd (opendir: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-cras 22723 ceph cwd unknown /proc/22723/cwd (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-cras 22723 ceph rtd unknown /proc/22723/root (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-cras 22723 ceph txt unknown /proc/22723/exe (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-cras 22723 ceph NOFD /proc/22723/fd (opendir: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 24417 root cwd unknown /proc/24417/cwd (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 24417 root rtd unknown /proc/24417/root (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 24417 root txt unknown /proc/24417/exe (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 24417 root NOFD /proc/24417/fd (opendir: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 25780 root cwd unknown /proc/25780/cwd (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 25780 root rtd unknown /proc/25780/root (readlink: Permission denied) 2024-09-16T01:03:44.203 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 25780 root txt unknown /proc/25780/exe (readlink: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 25780 root NOFD /proc/25780/fd (opendir: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 25781 root cwd unknown /proc/25781/cwd (readlink: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 25781 root rtd unknown /proc/25781/root (readlink: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 25781 root txt unknown /proc/25781/exe (readlink: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 25781 root NOFD /proc/25781/fd (opendir: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 30137 root cwd unknown /proc/30137/cwd (readlink: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 30137 root rtd unknown /proc/30137/root (readlink: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 30137 root txt unknown /proc/30137/exe (readlink: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 30137 root NOFD /proc/30137/fd (opendir: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 30190 root cwd unknown /proc/30190/cwd (readlink: Permission denied) 2024-09-16T01:03:44.204 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 30190 root rtd unknown /proc/30190/root (readlink: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 30190 root txt unknown /proc/30190/exe (readlink: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 30190 root NOFD /proc/30190/fd (opendir: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 30207 root cwd unknown /proc/30207/cwd (readlink: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 30207 root rtd unknown /proc/30207/root (readlink: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 30207 root txt unknown /proc/30207/exe (readlink: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 30207 root NOFD /proc/30207/fd (opendir: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 30208 root cwd unknown /proc/30208/cwd (readlink: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 30208 root rtd unknown /proc/30208/root (readlink: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 30208 root txt unknown /proc/30208/exe (readlink: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 30208 root NOFD /proc/30208/fd (opendir: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 30225 root cwd unknown /proc/30225/cwd (readlink: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 30225 root rtd unknown /proc/30225/root (readlink: Permission denied) 2024-09-16T01:03:44.205 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 30225 root txt unknown /proc/30225/exe (readlink: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 30225 root NOFD /proc/30225/fd (opendir: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 30594 root cwd unknown /proc/30594/cwd (readlink: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 30594 root rtd unknown /proc/30594/root (readlink: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 30594 root txt unknown /proc/30594/exe (readlink: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 30594 root NOFD /proc/30594/fd (opendir: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 31149 root cwd unknown /proc/31149/cwd (readlink: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 31149 root rtd unknown /proc/31149/root (readlink: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 31149 root txt unknown /proc/31149/exe (readlink: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 31149 root NOFD /proc/31149/fd (opendir: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 31193 root cwd unknown /proc/31193/cwd (readlink: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 31193 root rtd unknown /proc/31193/root (readlink: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 31193 root txt unknown /proc/31193/exe (readlink: Permission denied) 2024-09-16T01:03:44.206 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 31193 root NOFD /proc/31193/fd (opendir: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 31195 root cwd unknown /proc/31195/cwd (readlink: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 31195 root rtd unknown /proc/31195/root (readlink: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 31195 root txt unknown /proc/31195/exe (readlink: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 31195 root NOFD /proc/31195/fd (opendir: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 ceph cwd unknown /proc/31197/cwd (readlink: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 ceph rtd unknown /proc/31197/root (readlink: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 ceph txt unknown /proc/31197/exe (readlink: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 ceph NOFD /proc/31197/fd (opendir: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31198 log ceph cwd unknown /proc/31197/task/31198/cwd (readlink: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31198 log ceph rtd unknown /proc/31197/task/31198/root (readlink: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31198 log ceph txt unknown /proc/31197/task/31198/exe (readlink: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31198 log ceph NOFD /proc/31197/task/31198/fd (opendir: Permission denied) 2024-09-16T01:03:44.207 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31199 service ceph cwd unknown /proc/31197/task/31199/cwd (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31199 service ceph rtd unknown /proc/31197/task/31199/root (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31199 service ceph txt unknown /proc/31197/task/31199/exe (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31199 service ceph NOFD /proc/31197/task/31199/fd (opendir: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31200 admin_soc ceph cwd unknown /proc/31197/task/31200/cwd (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31200 admin_soc ceph rtd unknown /proc/31197/task/31200/root (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31200 admin_soc ceph txt unknown /proc/31197/task/31200/exe (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31200 admin_soc ceph NOFD /proc/31197/task/31200/fd (opendir: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31201 signal_ha ceph cwd unknown /proc/31197/task/31201/cwd (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31201 signal_ha ceph rtd unknown /proc/31197/task/31201/root (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31201 signal_ha ceph txt unknown /proc/31197/task/31201/exe (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31201 signal_ha ceph NOFD /proc/31197/task/31201/fd (opendir: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31202 rocksdb:l ceph cwd unknown /proc/31197/task/31202/cwd (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31202 rocksdb:l ceph rtd unknown /proc/31197/task/31202/root (readlink: Permission denied) 2024-09-16T01:03:44.208 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31202 rocksdb:l ceph txt unknown /proc/31197/task/31202/exe (readlink: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31202 rocksdb:l ceph NOFD /proc/31197/task/31202/fd (opendir: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31203 rocksdb:h ceph cwd unknown /proc/31197/task/31203/cwd (readlink: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31203 rocksdb:h ceph rtd unknown /proc/31197/task/31203/root (readlink: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31203 rocksdb:h ceph txt unknown /proc/31197/task/31203/exe (readlink: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31203 rocksdb:h ceph NOFD /proc/31197/task/31203/fd (opendir: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31219 ceph-mon ceph cwd unknown /proc/31197/task/31219/cwd (readlink: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31219 ceph-mon ceph rtd unknown /proc/31197/task/31219/root (readlink: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31219 ceph-mon ceph txt unknown /proc/31197/task/31219/exe (readlink: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31219 ceph-mon ceph NOFD /proc/31197/task/31219/fd (opendir: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31220 fn_monsto ceph cwd unknown /proc/31197/task/31220/cwd (readlink: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31220 fn_monsto ceph rtd unknown /proc/31197/task/31220/root (readlink: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31220 fn_monsto ceph txt unknown /proc/31197/task/31220/exe (readlink: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31220 fn_monsto ceph NOFD /proc/31197/task/31220/fd (opendir: Permission denied) 2024-09-16T01:03:44.209 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31221 msgr-work ceph cwd unknown /proc/31197/task/31221/cwd (readlink: Permission denied) 2024-09-16T01:03:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31221 msgr-work ceph rtd unknown /proc/31197/task/31221/root (readlink: Permission denied) 2024-09-16T01:03:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31221 msgr-work ceph txt unknown /proc/31197/task/31221/exe (readlink: Permission denied) 2024-09-16T01:03:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31221 msgr-work ceph NOFD /proc/31197/task/31221/fd (opendir: Permission denied) 2024-09-16T01:03:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31222 msgr-work ceph cwd unknown /proc/31197/task/31222/cwd (readlink: Permission denied) 2024-09-16T01:03:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31222 msgr-work ceph rtd unknown /proc/31197/task/31222/root (readlink: Permission denied) 2024-09-16T01:03:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31222 msgr-work ceph txt unknown /proc/31197/task/31222/exe (readlink: Permission denied) 2024-09-16T01:03:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31222 msgr-work ceph NOFD /proc/31197/task/31222/fd (opendir: Permission denied) 2024-09-16T01:03:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31223 msgr-work ceph cwd unknown /proc/31197/task/31223/cwd (readlink: Permission denied) 2024-09-16T01:03:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31223 msgr-work ceph rtd unknown /proc/31197/task/31223/root (readlink: Permission denied) 2024-09-16T01:03:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31223 msgr-work ceph txt unknown /proc/31197/task/31223/exe (readlink: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31223 msgr-work ceph NOFD /proc/31197/task/31223/fd (opendir: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31224 OpHistory ceph cwd unknown /proc/31197/task/31224/cwd (readlink: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31224 OpHistory ceph rtd unknown /proc/31197/task/31224/root (readlink: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31224 OpHistory ceph txt unknown /proc/31197/task/31224/exe (readlink: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31224 OpHistory ceph NOFD /proc/31197/task/31224/fd (opendir: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31225 fin ceph cwd unknown /proc/31197/task/31225/cwd (readlink: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31225 fin ceph rtd unknown /proc/31197/task/31225/root (readlink: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31225 fin ceph txt unknown /proc/31197/task/31225/exe (readlink: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31225 fin ceph NOFD /proc/31197/task/31225/fd (opendir: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31226 safe_time ceph cwd unknown /proc/31197/task/31226/cwd (readlink: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31226 safe_time ceph rtd unknown /proc/31197/task/31226/root (readlink: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31226 safe_time ceph txt unknown /proc/31197/task/31226/exe (readlink: Permission denied) 2024-09-16T01:03:44.211 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31226 safe_time ceph NOFD /proc/31197/task/31226/fd (opendir: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31227 cpu_tp ceph cwd unknown /proc/31197/task/31227/cwd (readlink: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31227 cpu_tp ceph rtd unknown /proc/31197/task/31227/root (readlink: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31227 cpu_tp ceph txt unknown /proc/31197/task/31227/exe (readlink: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31227 cpu_tp ceph NOFD /proc/31197/task/31227/fd (opendir: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31228 cpu_tp ceph cwd unknown /proc/31197/task/31228/cwd (readlink: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31228 cpu_tp ceph rtd unknown /proc/31197/task/31228/root (readlink: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31228 cpu_tp ceph txt unknown /proc/31197/task/31228/exe (readlink: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31228 cpu_tp ceph NOFD /proc/31197/task/31228/fd (opendir: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31229 cpu_tp ceph cwd unknown /proc/31197/task/31229/cwd (readlink: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31229 cpu_tp ceph rtd unknown /proc/31197/task/31229/root (readlink: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31229 cpu_tp ceph txt unknown /proc/31197/task/31229/exe (readlink: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31229 cpu_tp ceph NOFD /proc/31197/task/31229/fd (opendir: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31230 cpu_tp ceph cwd unknown /proc/31197/task/31230/cwd (readlink: Permission denied) 2024-09-16T01:03:44.212 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31230 cpu_tp ceph rtd unknown /proc/31197/task/31230/root (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31230 cpu_tp ceph txt unknown /proc/31197/task/31230/exe (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31230 cpu_tp ceph NOFD /proc/31197/task/31230/fd (opendir: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31231 ms_dispat ceph cwd unknown /proc/31197/task/31231/cwd (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31231 ms_dispat ceph rtd unknown /proc/31197/task/31231/root (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31231 ms_dispat ceph txt unknown /proc/31197/task/31231/exe (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31231 ms_dispat ceph NOFD /proc/31197/task/31231/fd (opendir: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31232 ms_local ceph cwd unknown /proc/31197/task/31232/cwd (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31232 ms_local ceph rtd unknown /proc/31197/task/31232/root (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31232 ms_local ceph txt unknown /proc/31197/task/31232/exe (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31232 ms_local ceph NOFD /proc/31197/task/31232/fd (opendir: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31233 safe_time ceph cwd unknown /proc/31197/task/31233/cwd (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31233 safe_time ceph rtd unknown /proc/31197/task/31233/root (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31233 safe_time ceph txt unknown /proc/31197/task/31233/exe (readlink: Permission denied) 2024-09-16T01:03:44.213 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31233 safe_time ceph NOFD /proc/31197/task/31233/fd (opendir: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31234 ms_dispat ceph cwd unknown /proc/31197/task/31234/cwd (readlink: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31234 ms_dispat ceph rtd unknown /proc/31197/task/31234/root (readlink: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31234 ms_dispat ceph txt unknown /proc/31197/task/31234/exe (readlink: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31234 ms_dispat ceph NOFD /proc/31197/task/31234/fd (opendir: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31235 ms_local ceph cwd unknown /proc/31197/task/31235/cwd (readlink: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31235 ms_local ceph rtd unknown /proc/31197/task/31235/root (readlink: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31235 ms_local ceph txt unknown /proc/31197/task/31235/exe (readlink: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 31235 ms_local ceph NOFD /proc/31197/task/31235/fd (opendir: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 66807 rstore_co ceph cwd unknown /proc/31197/task/66807/cwd (readlink: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 66807 rstore_co ceph rtd unknown /proc/31197/task/66807/root (readlink: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 66807 rstore_co ceph txt unknown /proc/31197/task/66807/exe (readlink: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mon 31197 66807 rstore_co ceph NOFD /proc/31197/task/66807/fd (opendir: Permission denied) 2024-09-16T01:03:44.214 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 31424 root cwd unknown /proc/31424/cwd (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 31424 root rtd unknown /proc/31424/root (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 31424 root txt unknown /proc/31424/exe (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 31424 root NOFD /proc/31424/fd (opendir: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 31426 root cwd unknown /proc/31426/cwd (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 31426 root rtd unknown /proc/31426/root (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 31426 root txt unknown /proc/31426/exe (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 31426 root NOFD /proc/31426/fd (opendir: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 ceph cwd unknown /proc/31428/cwd (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 ceph rtd unknown /proc/31428/root (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 ceph txt unknown /proc/31428/exe (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 ceph NOFD /proc/31428/fd (opendir: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33520 log ceph cwd unknown /proc/31428/task/33520/cwd (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33520 log ceph rtd unknown /proc/31428/task/33520/root (readlink: Permission denied) 2024-09-16T01:03:44.215 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33520 log ceph txt unknown /proc/31428/task/33520/exe (readlink: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33520 log ceph NOFD /proc/31428/task/33520/fd (opendir: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33522 msgr-work ceph cwd unknown /proc/31428/task/33522/cwd (readlink: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33522 msgr-work ceph rtd unknown /proc/31428/task/33522/root (readlink: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33522 msgr-work ceph txt unknown /proc/31428/task/33522/exe (readlink: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33522 msgr-work ceph NOFD /proc/31428/task/33522/fd (opendir: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33523 msgr-work ceph cwd unknown /proc/31428/task/33523/cwd (readlink: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33523 msgr-work ceph rtd unknown /proc/31428/task/33523/root (readlink: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33523 msgr-work ceph txt unknown /proc/31428/task/33523/exe (readlink: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33523 msgr-work ceph NOFD /proc/31428/task/33523/fd (opendir: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33524 msgr-work ceph cwd unknown /proc/31428/task/33524/cwd (readlink: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33524 msgr-work ceph rtd unknown /proc/31428/task/33524/root (readlink: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33524 msgr-work ceph txt unknown /proc/31428/task/33524/exe (readlink: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33524 msgr-work ceph NOFD /proc/31428/task/33524/fd (opendir: Permission denied) 2024-09-16T01:03:44.216 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33528 service ceph cwd unknown /proc/31428/task/33528/cwd (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33528 service ceph rtd unknown /proc/31428/task/33528/root (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33528 service ceph txt unknown /proc/31428/task/33528/exe (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33528 service ceph NOFD /proc/31428/task/33528/fd (opendir: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33529 admin_soc ceph cwd unknown /proc/31428/task/33529/cwd (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33529 admin_soc ceph rtd unknown /proc/31428/task/33529/root (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33529 admin_soc ceph txt unknown /proc/31428/task/33529/exe (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33529 admin_soc ceph NOFD /proc/31428/task/33529/fd (opendir: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33530 ceph_time ceph cwd unknown /proc/31428/task/33530/cwd (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33530 ceph_time ceph rtd unknown /proc/31428/task/33530/root (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33530 ceph_time ceph txt unknown /proc/31428/task/33530/exe (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33530 ceph_time ceph NOFD /proc/31428/task/33530/fd (opendir: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33531 fn_anonym ceph cwd unknown /proc/31428/task/33531/cwd (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33531 fn_anonym ceph rtd unknown /proc/31428/task/33531/root (readlink: Permission denied) 2024-09-16T01:03:44.217 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33531 fn_anonym ceph txt unknown /proc/31428/task/33531/exe (readlink: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33531 fn_anonym ceph NOFD /proc/31428/task/33531/fd (opendir: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33532 signal_ha ceph cwd unknown /proc/31428/task/33532/cwd (readlink: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33532 signal_ha ceph rtd unknown /proc/31428/task/33532/root (readlink: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33532 signal_ha ceph txt unknown /proc/31428/task/33532/exe (readlink: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33532 signal_ha ceph NOFD /proc/31428/task/33532/fd (opendir: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33533 mgrsb-fin ceph cwd unknown /proc/31428/task/33533/cwd (readlink: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33533 mgrsb-fin ceph rtd unknown /proc/31428/task/33533/root (readlink: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33533 mgrsb-fin ceph txt unknown /proc/31428/task/33533/exe (readlink: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33533 mgrsb-fin ceph NOFD /proc/31428/task/33533/fd (opendir: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33534 ms_dispat ceph cwd unknown /proc/31428/task/33534/cwd (readlink: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33534 ms_dispat ceph rtd unknown /proc/31428/task/33534/root (readlink: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33534 ms_dispat ceph txt unknown /proc/31428/task/33534/exe (readlink: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33534 ms_dispat ceph NOFD /proc/31428/task/33534/fd (opendir: Permission denied) 2024-09-16T01:03:44.218 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33535 ms_local ceph cwd unknown /proc/31428/task/33535/cwd (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33535 ms_local ceph rtd unknown /proc/31428/task/33535/root (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33535 ms_local ceph txt unknown /proc/31428/task/33535/exe (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33535 ms_local ceph NOFD /proc/31428/task/33535/fd (opendir: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33536 io_contex ceph cwd unknown /proc/31428/task/33536/cwd (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33536 io_contex ceph rtd unknown /proc/31428/task/33536/root (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33536 io_contex ceph txt unknown /proc/31428/task/33536/exe (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33536 io_contex ceph NOFD /proc/31428/task/33536/fd (opendir: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33537 io_contex ceph cwd unknown /proc/31428/task/33537/cwd (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33537 io_contex ceph rtd unknown /proc/31428/task/33537/root (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33537 io_contex ceph txt unknown /proc/31428/task/33537/exe (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33537 io_contex ceph NOFD /proc/31428/task/33537/fd (opendir: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33538 safe_time ceph cwd unknown /proc/31428/task/33538/cwd (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33538 safe_time ceph rtd unknown /proc/31428/task/33538/root (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33538 safe_time ceph txt unknown /proc/31428/task/33538/exe (readlink: Permission denied) 2024-09-16T01:03:44.219 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33538 safe_time ceph NOFD /proc/31428/task/33538/fd (opendir: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33539 safe_time ceph cwd unknown /proc/31428/task/33539/cwd (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33539 safe_time ceph rtd unknown /proc/31428/task/33539/root (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33539 safe_time ceph txt unknown /proc/31428/task/33539/exe (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33539 safe_time ceph NOFD /proc/31428/task/33539/fd (opendir: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33540 safe_time ceph cwd unknown /proc/31428/task/33540/cwd (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33540 safe_time ceph rtd unknown /proc/31428/task/33540/root (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33540 safe_time ceph txt unknown /proc/31428/task/33540/exe (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33540 safe_time ceph NOFD /proc/31428/task/33540/fd (opendir: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33541 fn_anonym ceph cwd unknown /proc/31428/task/33541/cwd (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33541 fn_anonym ceph rtd unknown /proc/31428/task/33541/root (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33541 fn_anonym ceph txt unknown /proc/31428/task/33541/exe (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33541 fn_anonym ceph NOFD /proc/31428/task/33541/fd (opendir: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33542 flusher ceph cwd unknown /proc/31428/task/33542/cwd (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33542 flusher ceph rtd unknown /proc/31428/task/33542/root (readlink: Permission denied) 2024-09-16T01:03:44.220 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33542 flusher ceph txt unknown /proc/31428/task/33542/exe (readlink: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33542 flusher ceph NOFD /proc/31428/task/33542/fd (opendir: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33543 safe_time ceph cwd unknown /proc/31428/task/33543/cwd (readlink: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33543 safe_time ceph rtd unknown /proc/31428/task/33543/root (readlink: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33543 safe_time ceph txt unknown /proc/31428/task/33543/exe (readlink: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33543 safe_time ceph NOFD /proc/31428/task/33543/fd (opendir: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33677 OpHistory ceph cwd unknown /proc/31428/task/33677/cwd (readlink: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33677 OpHistory ceph rtd unknown /proc/31428/task/33677/root (readlink: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33677 OpHistory ceph txt unknown /proc/31428/task/33677/exe (readlink: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33677 OpHistory ceph NOFD /proc/31428/task/33677/fd (opendir: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33678 mgr-fin ceph cwd unknown /proc/31428/task/33678/cwd (readlink: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33678 mgr-fin ceph rtd unknown /proc/31428/task/33678/root (readlink: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33678 mgr-fin ceph txt unknown /proc/31428/task/33678/exe (readlink: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33678 mgr-fin ceph NOFD /proc/31428/task/33678/fd (opendir: Permission denied) 2024-09-16T01:03:44.221 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33679 ms_dispat ceph cwd unknown /proc/31428/task/33679/cwd (readlink: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33679 ms_dispat ceph rtd unknown /proc/31428/task/33679/root (readlink: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33679 ms_dispat ceph txt unknown /proc/31428/task/33679/exe (readlink: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33679 ms_dispat ceph NOFD /proc/31428/task/33679/fd (opendir: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33680 ms_local ceph cwd unknown /proc/31428/task/33680/cwd (readlink: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33680 ms_local ceph rtd unknown /proc/31428/task/33680/root (readlink: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33680 ms_local ceph txt unknown /proc/31428/task/33680/exe (readlink: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33680 ms_local ceph NOFD /proc/31428/task/33680/fd (opendir: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33681 safe_time ceph cwd unknown /proc/31428/task/33681/cwd (readlink: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33681 safe_time ceph rtd unknown /proc/31428/task/33681/root (readlink: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33681 safe_time ceph txt unknown /proc/31428/task/33681/exe (readlink: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33681 safe_time ceph NOFD /proc/31428/task/33681/fd (opendir: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33682 cmdfin ceph cwd unknown /proc/31428/task/33682/cwd (readlink: Permission denied) 2024-09-16T01:03:44.222 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33682 cmdfin ceph rtd unknown /proc/31428/task/33682/root (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33682 cmdfin ceph txt unknown /proc/31428/task/33682/exe (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33682 cmdfin ceph NOFD /proc/31428/task/33682/fd (opendir: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33686 io_contex ceph cwd unknown /proc/31428/task/33686/cwd (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33686 io_contex ceph rtd unknown /proc/31428/task/33686/root (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33686 io_contex ceph txt unknown /proc/31428/task/33686/exe (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33686 io_contex ceph NOFD /proc/31428/task/33686/fd (opendir: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33687 io_contex ceph cwd unknown /proc/31428/task/33687/cwd (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33687 io_contex ceph rtd unknown /proc/31428/task/33687/root (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33687 io_contex ceph txt unknown /proc/31428/task/33687/exe (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33687 io_contex ceph NOFD /proc/31428/task/33687/fd (opendir: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33688 ceph_time ceph cwd unknown /proc/31428/task/33688/cwd (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33688 ceph_time ceph rtd unknown /proc/31428/task/33688/root (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33688 ceph_time ceph txt unknown /proc/31428/task/33688/exe (readlink: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33688 ceph_time ceph NOFD /proc/31428/task/33688/fd (opendir: Permission denied) 2024-09-16T01:03:44.223 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33689 ms_dispat ceph cwd unknown /proc/31428/task/33689/cwd (readlink: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33689 ms_dispat ceph rtd unknown /proc/31428/task/33689/root (readlink: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33689 ms_dispat ceph txt unknown /proc/31428/task/33689/exe (readlink: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33689 ms_dispat ceph NOFD /proc/31428/task/33689/fd (opendir: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33690 ms_local ceph cwd unknown /proc/31428/task/33690/cwd (readlink: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33690 ms_local ceph rtd unknown /proc/31428/task/33690/root (readlink: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33690 ms_local ceph txt unknown /proc/31428/task/33690/exe (readlink: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33690 ms_local ceph NOFD /proc/31428/task/33690/fd (opendir: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33691 safe_time ceph cwd unknown /proc/31428/task/33691/cwd (readlink: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33691 safe_time ceph rtd unknown /proc/31428/task/33691/root (readlink: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33691 safe_time ceph txt unknown /proc/31428/task/33691/exe (readlink: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33691 safe_time ceph NOFD /proc/31428/task/33691/fd (opendir: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33692 safe_time ceph cwd unknown /proc/31428/task/33692/cwd (readlink: Permission denied) 2024-09-16T01:03:44.224 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33692 safe_time ceph rtd unknown /proc/31428/task/33692/root (readlink: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33692 safe_time ceph txt unknown /proc/31428/task/33692/exe (readlink: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33692 safe_time ceph NOFD /proc/31428/task/33692/fd (opendir: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33693 balancer ceph cwd unknown /proc/31428/task/33693/cwd (readlink: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33693 balancer ceph rtd unknown /proc/31428/task/33693/root (readlink: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33693 balancer ceph txt unknown /proc/31428/task/33693/exe (readlink: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33693 balancer ceph NOFD /proc/31428/task/33693/fd (opendir: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33694 m-fin-bal ceph cwd unknown /proc/31428/task/33694/cwd (readlink: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33694 m-fin-bal ceph rtd unknown /proc/31428/task/33694/root (readlink: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33694 m-fin-bal ceph txt unknown /proc/31428/task/33694/exe (readlink: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33694 m-fin-bal ceph NOFD /proc/31428/task/33694/fd (opendir: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33695 mgr-fin ceph cwd unknown /proc/31428/task/33695/cwd (readlink: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33695 mgr-fin ceph rtd unknown /proc/31428/task/33695/root (readlink: Permission denied) 2024-09-16T01:03:44.225 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33695 mgr-fin ceph txt unknown /proc/31428/task/33695/exe (readlink: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33695 mgr-fin ceph NOFD /proc/31428/task/33695/fd (opendir: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33696 mgr-fin ceph cwd unknown /proc/31428/task/33696/cwd (readlink: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33696 mgr-fin ceph rtd unknown /proc/31428/task/33696/root (readlink: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33696 mgr-fin ceph txt unknown /proc/31428/task/33696/exe (readlink: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33696 mgr-fin ceph NOFD /proc/31428/task/33696/fd (opendir: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33697 mgr-fin ceph cwd unknown /proc/31428/task/33697/cwd (readlink: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33697 mgr-fin ceph rtd unknown /proc/31428/task/33697/root (readlink: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33697 mgr-fin ceph txt unknown /proc/31428/task/33697/exe (readlink: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33697 mgr-fin ceph NOFD /proc/31428/task/33697/fd (opendir: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33698 mgr-fin ceph cwd unknown /proc/31428/task/33698/cwd (readlink: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33698 mgr-fin ceph rtd unknown /proc/31428/task/33698/root (readlink: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33698 mgr-fin ceph txt unknown /proc/31428/task/33698/exe (readlink: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33698 mgr-fin ceph NOFD /proc/31428/task/33698/fd (opendir: Permission denied) 2024-09-16T01:03:44.226 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33699 mgr-fin ceph cwd unknown /proc/31428/task/33699/cwd (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33699 mgr-fin ceph rtd unknown /proc/31428/task/33699/root (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33699 mgr-fin ceph txt unknown /proc/31428/task/33699/exe (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33699 mgr-fin ceph NOFD /proc/31428/task/33699/fd (opendir: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33700 mgr-fin ceph cwd unknown /proc/31428/task/33700/cwd (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33700 mgr-fin ceph rtd unknown /proc/31428/task/33700/root (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33700 mgr-fin ceph txt unknown /proc/31428/task/33700/exe (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33700 mgr-fin ceph NOFD /proc/31428/task/33700/fd (opendir: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33701 mgr-fin ceph cwd unknown /proc/31428/task/33701/cwd (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33701 mgr-fin ceph rtd unknown /proc/31428/task/33701/root (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33701 mgr-fin ceph txt unknown /proc/31428/task/33701/exe (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33701 mgr-fin ceph NOFD /proc/31428/task/33701/fd (opendir: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33702 mgr-fin ceph cwd unknown /proc/31428/task/33702/cwd (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33702 mgr-fin ceph rtd unknown /proc/31428/task/33702/root (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33702 mgr-fin ceph txt unknown /proc/31428/task/33702/exe (readlink: Permission denied) 2024-09-16T01:03:44.227 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33702 mgr-fin ceph NOFD /proc/31428/task/33702/fd (opendir: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33703 mgr-fin ceph cwd unknown /proc/31428/task/33703/cwd (readlink: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33703 mgr-fin ceph rtd unknown /proc/31428/task/33703/root (readlink: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33703 mgr-fin ceph txt unknown /proc/31428/task/33703/exe (readlink: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33703 mgr-fin ceph NOFD /proc/31428/task/33703/fd (opendir: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33704 mgr-fin ceph cwd unknown /proc/31428/task/33704/cwd (readlink: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33704 mgr-fin ceph rtd unknown /proc/31428/task/33704/root (readlink: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33704 mgr-fin ceph txt unknown /proc/31428/task/33704/exe (readlink: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33704 mgr-fin ceph NOFD /proc/31428/task/33704/fd (opendir: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33705 mgr-fin ceph cwd unknown /proc/31428/task/33705/cwd (readlink: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33705 mgr-fin ceph rtd unknown /proc/31428/task/33705/root (readlink: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33705 mgr-fin ceph txt unknown /proc/31428/task/33705/exe (readlink: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33705 mgr-fin ceph NOFD /proc/31428/task/33705/fd (opendir: Permission denied) 2024-09-16T01:03:44.228 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33706 mgr-fin ceph cwd unknown /proc/31428/task/33706/cwd (readlink: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33706 mgr-fin ceph rtd unknown /proc/31428/task/33706/root (readlink: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33706 mgr-fin ceph txt unknown /proc/31428/task/33706/exe (readlink: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33706 mgr-fin ceph NOFD /proc/31428/task/33706/fd (opendir: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33707 mgr-fin ceph cwd unknown /proc/31428/task/33707/cwd (readlink: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33707 mgr-fin ceph rtd unknown /proc/31428/task/33707/root (readlink: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33707 mgr-fin ceph txt unknown /proc/31428/task/33707/exe (readlink: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33707 mgr-fin ceph NOFD /proc/31428/task/33707/fd (opendir: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33708 mgr-fin ceph cwd unknown /proc/31428/task/33708/cwd (readlink: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33708 mgr-fin ceph rtd unknown /proc/31428/task/33708/root (readlink: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33708 mgr-fin ceph txt unknown /proc/31428/task/33708/exe (readlink: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33708 mgr-fin ceph NOFD /proc/31428/task/33708/fd (opendir: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33709 mgr-fin ceph cwd unknown /proc/31428/task/33709/cwd (readlink: Permission denied) 2024-09-16T01:03:44.229 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33709 mgr-fin ceph rtd unknown /proc/31428/task/33709/root (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33709 mgr-fin ceph txt unknown /proc/31428/task/33709/exe (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33709 mgr-fin ceph NOFD /proc/31428/task/33709/fd (opendir: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33710 cephadm ceph cwd unknown /proc/31428/task/33710/cwd (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33710 cephadm ceph rtd unknown /proc/31428/task/33710/root (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33710 cephadm ceph txt unknown /proc/31428/task/33710/exe (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33710 cephadm ceph NOFD /proc/31428/task/33710/fd (opendir: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33711 m-fin-cep ceph cwd unknown /proc/31428/task/33711/cwd (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33711 m-fin-cep ceph rtd unknown /proc/31428/task/33711/root (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33711 m-fin-cep ceph txt unknown /proc/31428/task/33711/exe (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33711 m-fin-cep ceph NOFD /proc/31428/task/33711/fd (opendir: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33712 mgr-fin ceph cwd unknown /proc/31428/task/33712/cwd (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33712 mgr-fin ceph rtd unknown /proc/31428/task/33712/root (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33712 mgr-fin ceph txt unknown /proc/31428/task/33712/exe (readlink: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33712 mgr-fin ceph NOFD /proc/31428/task/33712/fd (opendir: Permission denied) 2024-09-16T01:03:44.230 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33713 mgr-fin ceph cwd unknown /proc/31428/task/33713/cwd (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33713 mgr-fin ceph rtd unknown /proc/31428/task/33713/root (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33713 mgr-fin ceph txt unknown /proc/31428/task/33713/exe (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33713 mgr-fin ceph NOFD /proc/31428/task/33713/fd (opendir: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33714 mgr-fin ceph cwd unknown /proc/31428/task/33714/cwd (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33714 mgr-fin ceph rtd unknown /proc/31428/task/33714/root (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33714 mgr-fin ceph txt unknown /proc/31428/task/33714/exe (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33714 mgr-fin ceph NOFD /proc/31428/task/33714/fd (opendir: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33715 mgr-fin ceph cwd unknown /proc/31428/task/33715/cwd (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33715 mgr-fin ceph rtd unknown /proc/31428/task/33715/root (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33715 mgr-fin ceph txt unknown /proc/31428/task/33715/exe (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33715 mgr-fin ceph NOFD /proc/31428/task/33715/fd (opendir: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33716 cephadm ceph cwd unknown /proc/31428/task/33716/cwd (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33716 cephadm ceph rtd unknown /proc/31428/task/33716/root (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33716 cephadm ceph txt unknown /proc/31428/task/33716/exe (readlink: Permission denied) 2024-09-16T01:03:44.231 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33716 cephadm ceph NOFD /proc/31428/task/33716/fd (opendir: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33717 crash ceph cwd unknown /proc/31428/task/33717/cwd (readlink: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33717 crash ceph rtd unknown /proc/31428/task/33717/root (readlink: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33717 crash ceph txt unknown /proc/31428/task/33717/exe (readlink: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33717 crash ceph NOFD /proc/31428/task/33717/fd (opendir: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33718 m-fin-cra ceph cwd unknown /proc/31428/task/33718/cwd (readlink: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33718 m-fin-cra ceph rtd unknown /proc/31428/task/33718/root (readlink: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33718 m-fin-cra ceph txt unknown /proc/31428/task/33718/exe (readlink: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33718 m-fin-cra ceph NOFD /proc/31428/task/33718/fd (opendir: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33719 mgr-fin ceph cwd unknown /proc/31428/task/33719/cwd (readlink: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33719 mgr-fin ceph rtd unknown /proc/31428/task/33719/root (readlink: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33719 mgr-fin ceph txt unknown /proc/31428/task/33719/exe (readlink: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33719 mgr-fin ceph NOFD /proc/31428/task/33719/fd (opendir: Permission denied) 2024-09-16T01:03:44.232 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33720 mgr-fin ceph cwd unknown /proc/31428/task/33720/cwd (readlink: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33720 mgr-fin ceph rtd unknown /proc/31428/task/33720/root (readlink: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33720 mgr-fin ceph txt unknown /proc/31428/task/33720/exe (readlink: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33720 mgr-fin ceph NOFD /proc/31428/task/33720/fd (opendir: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33721 mgr-fin ceph cwd unknown /proc/31428/task/33721/cwd (readlink: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33721 mgr-fin ceph rtd unknown /proc/31428/task/33721/root (readlink: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33721 mgr-fin ceph txt unknown /proc/31428/task/33721/exe (readlink: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33721 mgr-fin ceph NOFD /proc/31428/task/33721/fd (opendir: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33722 dashboard ceph cwd unknown /proc/31428/task/33722/cwd (readlink: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33722 dashboard ceph rtd unknown /proc/31428/task/33722/root (readlink: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33722 dashboard ceph txt unknown /proc/31428/task/33722/exe (readlink: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33722 dashboard ceph NOFD /proc/31428/task/33722/fd (opendir: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33723 m-fin-das ceph cwd unknown /proc/31428/task/33723/cwd (readlink: Permission denied) 2024-09-16T01:03:44.233 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33723 m-fin-das ceph rtd unknown /proc/31428/task/33723/root (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33723 m-fin-das ceph txt unknown /proc/31428/task/33723/exe (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33723 m-fin-das ceph NOFD /proc/31428/task/33723/fd (opendir: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33724 mgr-fin ceph cwd unknown /proc/31428/task/33724/cwd (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33724 mgr-fin ceph rtd unknown /proc/31428/task/33724/root (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33724 mgr-fin ceph txt unknown /proc/31428/task/33724/exe (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33724 mgr-fin ceph NOFD /proc/31428/task/33724/fd (opendir: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33725 mgr-fin ceph cwd unknown /proc/31428/task/33725/cwd (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33725 mgr-fin ceph rtd unknown /proc/31428/task/33725/root (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33725 mgr-fin ceph txt unknown /proc/31428/task/33725/exe (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33725 mgr-fin ceph NOFD /proc/31428/task/33725/fd (opendir: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33726 devicehea ceph cwd unknown /proc/31428/task/33726/cwd (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33726 devicehea ceph rtd unknown /proc/31428/task/33726/root (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33726 devicehea ceph txt unknown /proc/31428/task/33726/exe (readlink: Permission denied) 2024-09-16T01:03:44.234 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33726 devicehea ceph NOFD /proc/31428/task/33726/fd (opendir: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33727 mgr-fin ceph cwd unknown /proc/31428/task/33727/cwd (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33727 mgr-fin ceph rtd unknown /proc/31428/task/33727/root (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33727 mgr-fin ceph txt unknown /proc/31428/task/33727/exe (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33727 mgr-fin ceph NOFD /proc/31428/task/33727/fd (opendir: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33728 m-fin-dev ceph cwd unknown /proc/31428/task/33728/cwd (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33728 m-fin-dev ceph rtd unknown /proc/31428/task/33728/root (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33728 m-fin-dev ceph txt unknown /proc/31428/task/33728/exe (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33728 m-fin-dev ceph NOFD /proc/31428/task/33728/fd (opendir: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33729 mgr-fin ceph cwd unknown /proc/31428/task/33729/cwd (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33729 mgr-fin ceph rtd unknown /proc/31428/task/33729/root (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33729 mgr-fin ceph txt unknown /proc/31428/task/33729/exe (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33729 mgr-fin ceph NOFD /proc/31428/task/33729/fd (opendir: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33730 mgr-fin ceph cwd unknown /proc/31428/task/33730/cwd (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33730 mgr-fin ceph rtd unknown /proc/31428/task/33730/root (readlink: Permission denied) 2024-09-16T01:03:44.235 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33730 mgr-fin ceph txt unknown /proc/31428/task/33730/exe (readlink: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33730 mgr-fin ceph NOFD /proc/31428/task/33730/fd (opendir: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33732 mgr-fin ceph cwd unknown /proc/31428/task/33732/cwd (readlink: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33732 mgr-fin ceph rtd unknown /proc/31428/task/33732/root (readlink: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33732 mgr-fin ceph txt unknown /proc/31428/task/33732/exe (readlink: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33732 mgr-fin ceph NOFD /proc/31428/task/33732/fd (opendir: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33733 m-fin-ios ceph cwd unknown /proc/31428/task/33733/cwd (readlink: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33733 m-fin-ios ceph rtd unknown /proc/31428/task/33733/root (readlink: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33733 m-fin-ios ceph txt unknown /proc/31428/task/33733/exe (readlink: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33733 m-fin-ios ceph NOFD /proc/31428/task/33733/fd (opendir: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33735 m-fin-nfs ceph cwd unknown /proc/31428/task/33735/cwd (readlink: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33735 m-fin-nfs ceph rtd unknown /proc/31428/task/33735/root (readlink: Permission denied) 2024-09-16T01:03:44.236 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33735 m-fin-nfs ceph txt unknown /proc/31428/task/33735/exe (readlink: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33735 m-fin-nfs ceph NOFD /proc/31428/task/33735/fd (opendir: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33737 m-fin-orc ceph cwd unknown /proc/31428/task/33737/cwd (readlink: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33737 m-fin-orc ceph rtd unknown /proc/31428/task/33737/root (readlink: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33737 m-fin-orc ceph txt unknown /proc/31428/task/33737/exe (readlink: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33737 m-fin-orc ceph NOFD /proc/31428/task/33737/fd (opendir: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33738 cephadm ceph cwd unknown /proc/31428/task/33738/cwd (readlink: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33738 cephadm ceph rtd unknown /proc/31428/task/33738/root (readlink: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33738 cephadm ceph txt unknown /proc/31428/task/33738/exe (readlink: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33738 cephadm ceph NOFD /proc/31428/task/33738/fd (opendir: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33739 pg_autosc ceph cwd unknown /proc/31428/task/33739/cwd (readlink: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33739 pg_autosc ceph rtd unknown /proc/31428/task/33739/root (readlink: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33739 pg_autosc ceph txt unknown /proc/31428/task/33739/exe (readlink: Permission denied) 2024-09-16T01:03:44.237 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33739 pg_autosc ceph NOFD /proc/31428/task/33739/fd (opendir: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33740 m-fin-pg_ ceph cwd unknown /proc/31428/task/33740/cwd (readlink: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33740 m-fin-pg_ ceph rtd unknown /proc/31428/task/33740/root (readlink: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33740 m-fin-pg_ ceph txt unknown /proc/31428/task/33740/exe (readlink: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33740 m-fin-pg_ ceph NOFD /proc/31428/task/33740/fd (opendir: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33741 progress ceph cwd unknown /proc/31428/task/33741/cwd (readlink: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33741 progress ceph rtd unknown /proc/31428/task/33741/root (readlink: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33741 progress ceph txt unknown /proc/31428/task/33741/exe (readlink: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33741 progress ceph NOFD /proc/31428/task/33741/fd (opendir: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33742 m-fin-pro ceph cwd unknown /proc/31428/task/33742/cwd (readlink: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33742 m-fin-pro ceph rtd unknown /proc/31428/task/33742/root (readlink: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33742 m-fin-pro ceph txt unknown /proc/31428/task/33742/exe (readlink: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33742 m-fin-pro ceph NOFD /proc/31428/task/33742/fd (opendir: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33746 io_contex ceph cwd unknown /proc/31428/task/33746/cwd (readlink: Permission denied) 2024-09-16T01:03:44.238 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33746 io_contex ceph rtd unknown /proc/31428/task/33746/root (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33746 io_contex ceph txt unknown /proc/31428/task/33746/exe (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33746 io_contex ceph NOFD /proc/31428/task/33746/fd (opendir: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33747 io_contex ceph cwd unknown /proc/31428/task/33747/cwd (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33747 io_contex ceph rtd unknown /proc/31428/task/33747/root (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33747 io_contex ceph txt unknown /proc/31428/task/33747/exe (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33747 io_contex ceph NOFD /proc/31428/task/33747/fd (opendir: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33748 ceph_time ceph cwd unknown /proc/31428/task/33748/cwd (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33748 ceph_time ceph rtd unknown /proc/31428/task/33748/root (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33748 ceph_time ceph txt unknown /proc/31428/task/33748/exe (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33748 ceph_time ceph NOFD /proc/31428/task/33748/fd (opendir: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33749 ms_dispat ceph cwd unknown /proc/31428/task/33749/cwd (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33749 ms_dispat ceph rtd unknown /proc/31428/task/33749/root (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33749 ms_dispat ceph txt unknown /proc/31428/task/33749/exe (readlink: Permission denied) 2024-09-16T01:03:44.239 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33749 ms_dispat ceph NOFD /proc/31428/task/33749/fd (opendir: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33750 ms_local ceph cwd unknown /proc/31428/task/33750/cwd (readlink: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33750 ms_local ceph rtd unknown /proc/31428/task/33750/root (readlink: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33750 ms_local ceph txt unknown /proc/31428/task/33750/exe (readlink: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33750 ms_local ceph NOFD /proc/31428/task/33750/fd (opendir: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33751 safe_time ceph cwd unknown /proc/31428/task/33751/cwd (readlink: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33751 safe_time ceph rtd unknown /proc/31428/task/33751/root (readlink: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33751 safe_time ceph txt unknown /proc/31428/task/33751/exe (readlink: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33751 safe_time ceph NOFD /proc/31428/task/33751/fd (opendir: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33752 safe_time ceph cwd unknown /proc/31428/task/33752/cwd (readlink: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33752 safe_time ceph rtd unknown /proc/31428/task/33752/root (readlink: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33752 safe_time ceph txt unknown /proc/31428/task/33752/exe (readlink: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33752 safe_time ceph NOFD /proc/31428/task/33752/fd (opendir: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33753 mgr-fin ceph cwd unknown /proc/31428/task/33753/cwd (readlink: Permission denied) 2024-09-16T01:03:44.240 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33753 mgr-fin ceph rtd unknown /proc/31428/task/33753/root (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33753 mgr-fin ceph txt unknown /proc/31428/task/33753/exe (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33753 mgr-fin ceph NOFD /proc/31428/task/33753/fd (opendir: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33755 m-fin-rbd ceph cwd unknown /proc/31428/task/33755/cwd (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33755 m-fin-rbd ceph rtd unknown /proc/31428/task/33755/root (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33755 m-fin-rbd ceph txt unknown /proc/31428/task/33755/exe (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33755 m-fin-rbd ceph NOFD /proc/31428/task/33755/fd (opendir: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33756 restful ceph cwd unknown /proc/31428/task/33756/cwd (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33756 restful ceph rtd unknown /proc/31428/task/33756/root (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33756 restful ceph txt unknown /proc/31428/task/33756/exe (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33756 restful ceph NOFD /proc/31428/task/33756/fd (opendir: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33757 m-fin-res ceph cwd unknown /proc/31428/task/33757/cwd (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33757 m-fin-res ceph rtd unknown /proc/31428/task/33757/root (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33757 m-fin-res ceph txt unknown /proc/31428/task/33757/exe (readlink: Permission denied) 2024-09-16T01:03:44.241 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33757 m-fin-res ceph NOFD /proc/31428/task/33757/fd (opendir: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33759 m-fin-sta ceph cwd unknown /proc/31428/task/33759/cwd (readlink: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33759 m-fin-sta ceph rtd unknown /proc/31428/task/33759/root (readlink: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33759 m-fin-sta ceph txt unknown /proc/31428/task/33759/exe (readlink: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33759 m-fin-sta ceph NOFD /proc/31428/task/33759/fd (opendir: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33760 telemetry ceph cwd unknown /proc/31428/task/33760/cwd (readlink: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33760 telemetry ceph rtd unknown /proc/31428/task/33760/root (readlink: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33760 telemetry ceph txt unknown /proc/31428/task/33760/exe (readlink: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33760 telemetry ceph NOFD /proc/31428/task/33760/fd (opendir: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33761 m-fin-tel ceph cwd unknown /proc/31428/task/33761/cwd (readlink: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33761 m-fin-tel ceph rtd unknown /proc/31428/task/33761/root (readlink: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33761 m-fin-tel ceph txt unknown /proc/31428/task/33761/exe (readlink: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33761 m-fin-tel ceph NOFD /proc/31428/task/33761/fd (opendir: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33762 mgr-fin ceph cwd unknown /proc/31428/task/33762/cwd (readlink: Permission denied) 2024-09-16T01:03:44.242 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33762 mgr-fin ceph rtd unknown /proc/31428/task/33762/root (readlink: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33762 mgr-fin ceph txt unknown /proc/31428/task/33762/exe (readlink: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33762 mgr-fin ceph NOFD /proc/31428/task/33762/fd (opendir: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33763 mgr-fin ceph cwd unknown /proc/31428/task/33763/cwd (readlink: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33763 mgr-fin ceph rtd unknown /proc/31428/task/33763/root (readlink: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33763 mgr-fin ceph txt unknown /proc/31428/task/33763/exe (readlink: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33763 mgr-fin ceph NOFD /proc/31428/task/33763/fd (opendir: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33764 mgr-fin ceph cwd unknown /proc/31428/task/33764/cwd (readlink: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33764 mgr-fin ceph rtd unknown /proc/31428/task/33764/root (readlink: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33764 mgr-fin ceph txt unknown /proc/31428/task/33764/exe (readlink: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33764 mgr-fin ceph NOFD /proc/31428/task/33764/fd (opendir: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33765 mgr-fin ceph cwd unknown /proc/31428/task/33765/cwd (readlink: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33765 mgr-fin ceph rtd unknown /proc/31428/task/33765/root (readlink: Permission denied) 2024-09-16T01:03:44.243 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33765 mgr-fin ceph txt unknown /proc/31428/task/33765/exe (readlink: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33765 mgr-fin ceph NOFD /proc/31428/task/33765/fd (opendir: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33769 mgr-fin ceph cwd unknown /proc/31428/task/33769/cwd (readlink: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33769 mgr-fin ceph rtd unknown /proc/31428/task/33769/root (readlink: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33769 mgr-fin ceph txt unknown /proc/31428/task/33769/exe (readlink: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33769 mgr-fin ceph NOFD /proc/31428/task/33769/fd (opendir: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33770 io_contex ceph cwd unknown /proc/31428/task/33770/cwd (readlink: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33770 io_contex ceph rtd unknown /proc/31428/task/33770/root (readlink: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33770 io_contex ceph txt unknown /proc/31428/task/33770/exe (readlink: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33770 io_contex ceph NOFD /proc/31428/task/33770/fd (opendir: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33771 io_contex ceph cwd unknown /proc/31428/task/33771/cwd (readlink: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33771 io_contex ceph rtd unknown /proc/31428/task/33771/root (readlink: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33771 io_contex ceph txt unknown /proc/31428/task/33771/exe (readlink: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33771 io_contex ceph NOFD /proc/31428/task/33771/fd (opendir: Permission denied) 2024-09-16T01:03:44.244 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33772 ceph_time ceph cwd unknown /proc/31428/task/33772/cwd (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33772 ceph_time ceph rtd unknown /proc/31428/task/33772/root (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33772 ceph_time ceph txt unknown /proc/31428/task/33772/exe (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33772 ceph_time ceph NOFD /proc/31428/task/33772/fd (opendir: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33773 ms_dispat ceph cwd unknown /proc/31428/task/33773/cwd (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33773 ms_dispat ceph rtd unknown /proc/31428/task/33773/root (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33773 ms_dispat ceph txt unknown /proc/31428/task/33773/exe (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33773 ms_dispat ceph NOFD /proc/31428/task/33773/fd (opendir: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33774 ms_local ceph cwd unknown /proc/31428/task/33774/cwd (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33774 ms_local ceph rtd unknown /proc/31428/task/33774/root (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33774 ms_local ceph txt unknown /proc/31428/task/33774/exe (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33774 ms_local ceph NOFD /proc/31428/task/33774/fd (opendir: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33775 safe_time ceph cwd unknown /proc/31428/task/33775/cwd (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33775 safe_time ceph rtd unknown /proc/31428/task/33775/root (readlink: Permission denied) 2024-09-16T01:03:44.245 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33775 safe_time ceph txt unknown /proc/31428/task/33775/exe (readlink: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33775 safe_time ceph NOFD /proc/31428/task/33775/fd (opendir: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33776 safe_time ceph cwd unknown /proc/31428/task/33776/cwd (readlink: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33776 safe_time ceph rtd unknown /proc/31428/task/33776/root (readlink: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33776 safe_time ceph txt unknown /proc/31428/task/33776/exe (readlink: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33776 safe_time ceph NOFD /proc/31428/task/33776/fd (opendir: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33777 mgr-fin ceph cwd unknown /proc/31428/task/33777/cwd (readlink: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33777 mgr-fin ceph rtd unknown /proc/31428/task/33777/root (readlink: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33777 mgr-fin ceph txt unknown /proc/31428/task/33777/exe (readlink: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33777 mgr-fin ceph NOFD /proc/31428/task/33777/fd (opendir: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33778 mgr-fin ceph cwd unknown /proc/31428/task/33778/cwd (readlink: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33778 mgr-fin ceph rtd unknown /proc/31428/task/33778/root (readlink: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33778 mgr-fin ceph txt unknown /proc/31428/task/33778/exe (readlink: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33778 mgr-fin ceph NOFD /proc/31428/task/33778/fd (opendir: Permission denied) 2024-09-16T01:03:44.246 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33779 mgr-fin ceph cwd unknown /proc/31428/task/33779/cwd (readlink: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33779 mgr-fin ceph rtd unknown /proc/31428/task/33779/root (readlink: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33779 mgr-fin ceph txt unknown /proc/31428/task/33779/exe (readlink: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33779 mgr-fin ceph NOFD /proc/31428/task/33779/fd (opendir: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33780 mgr-fin ceph cwd unknown /proc/31428/task/33780/cwd (readlink: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33780 mgr-fin ceph rtd unknown /proc/31428/task/33780/root (readlink: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33780 mgr-fin ceph txt unknown /proc/31428/task/33780/exe (readlink: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33780 mgr-fin ceph NOFD /proc/31428/task/33780/fd (opendir: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33781 mgr-fin ceph cwd unknown /proc/31428/task/33781/cwd (readlink: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33781 mgr-fin ceph rtd unknown /proc/31428/task/33781/root (readlink: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33781 mgr-fin ceph txt unknown /proc/31428/task/33781/exe (readlink: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33781 mgr-fin ceph NOFD /proc/31428/task/33781/fd (opendir: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33782 mgr-fin ceph cwd unknown /proc/31428/task/33782/cwd (readlink: Permission denied) 2024-09-16T01:03:44.247 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33782 mgr-fin ceph rtd unknown /proc/31428/task/33782/root (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33782 mgr-fin ceph txt unknown /proc/31428/task/33782/exe (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33782 mgr-fin ceph NOFD /proc/31428/task/33782/fd (opendir: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33783 mgr-fin ceph cwd unknown /proc/31428/task/33783/cwd (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33783 mgr-fin ceph rtd unknown /proc/31428/task/33783/root (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33783 mgr-fin ceph txt unknown /proc/31428/task/33783/exe (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33783 mgr-fin ceph NOFD /proc/31428/task/33783/fd (opendir: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33784 mgr-fin ceph cwd unknown /proc/31428/task/33784/cwd (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33784 mgr-fin ceph rtd unknown /proc/31428/task/33784/root (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33784 mgr-fin ceph txt unknown /proc/31428/task/33784/exe (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33784 mgr-fin ceph NOFD /proc/31428/task/33784/fd (opendir: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33785 mgr-fin ceph cwd unknown /proc/31428/task/33785/cwd (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33785 mgr-fin ceph rtd unknown /proc/31428/task/33785/root (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33785 mgr-fin ceph txt unknown /proc/31428/task/33785/exe (readlink: Permission denied) 2024-09-16T01:03:44.248 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33785 mgr-fin ceph NOFD /proc/31428/task/33785/fd (opendir: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33786 mgr-fin ceph cwd unknown /proc/31428/task/33786/cwd (readlink: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33786 mgr-fin ceph rtd unknown /proc/31428/task/33786/root (readlink: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33786 mgr-fin ceph txt unknown /proc/31428/task/33786/exe (readlink: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33786 mgr-fin ceph NOFD /proc/31428/task/33786/fd (opendir: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33787 mgr-fin ceph cwd unknown /proc/31428/task/33787/cwd (readlink: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33787 mgr-fin ceph rtd unknown /proc/31428/task/33787/root (readlink: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33787 mgr-fin ceph txt unknown /proc/31428/task/33787/exe (readlink: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33787 mgr-fin ceph NOFD /proc/31428/task/33787/fd (opendir: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33788 mgr-fin ceph cwd unknown /proc/31428/task/33788/cwd (readlink: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33788 mgr-fin ceph rtd unknown /proc/31428/task/33788/root (readlink: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33788 mgr-fin ceph txt unknown /proc/31428/task/33788/exe (readlink: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33788 mgr-fin ceph NOFD /proc/31428/task/33788/fd (opendir: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33790 m-fin-vol ceph cwd unknown /proc/31428/task/33790/cwd (readlink: Permission denied) 2024-09-16T01:03:44.249 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33790 m-fin-vol ceph rtd unknown /proc/31428/task/33790/root (readlink: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33790 m-fin-vol ceph txt unknown /proc/31428/task/33790/exe (readlink: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 33790 m-fin-vol ceph NOFD /proc/31428/task/33790/fd (opendir: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34013 mgr-fin ceph cwd unknown /proc/31428/task/34013/cwd (readlink: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34013 mgr-fin ceph rtd unknown /proc/31428/task/34013/root (readlink: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34013 mgr-fin ceph txt unknown /proc/31428/task/34013/exe (readlink: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34013 mgr-fin ceph NOFD /proc/31428/task/34013/fd (opendir: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34014 mgr-fin ceph cwd unknown /proc/31428/task/34014/cwd (readlink: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34014 mgr-fin ceph rtd unknown /proc/31428/task/34014/root (readlink: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34014 mgr-fin ceph txt unknown /proc/31428/task/34014/exe (readlink: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34014 mgr-fin ceph NOFD /proc/31428/task/34014/fd (opendir: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34015 mgr-fin ceph cwd unknown /proc/31428/task/34015/cwd (readlink: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34015 mgr-fin ceph rtd unknown /proc/31428/task/34015/root (readlink: Permission denied) 2024-09-16T01:03:44.250 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34015 mgr-fin ceph txt unknown /proc/31428/task/34015/exe (readlink: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34015 mgr-fin ceph NOFD /proc/31428/task/34015/fd (opendir: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34016 mgr-fin ceph cwd unknown /proc/31428/task/34016/cwd (readlink: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34016 mgr-fin ceph rtd unknown /proc/31428/task/34016/root (readlink: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34016 mgr-fin ceph txt unknown /proc/31428/task/34016/exe (readlink: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34016 mgr-fin ceph NOFD /proc/31428/task/34016/fd (opendir: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34017 mgr-fin ceph cwd unknown /proc/31428/task/34017/cwd (readlink: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34017 mgr-fin ceph rtd unknown /proc/31428/task/34017/root (readlink: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34017 mgr-fin ceph txt unknown /proc/31428/task/34017/exe (readlink: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34017 mgr-fin ceph NOFD /proc/31428/task/34017/fd (opendir: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34018 mgr-fin ceph cwd unknown /proc/31428/task/34018/cwd (readlink: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34018 mgr-fin ceph rtd unknown /proc/31428/task/34018/root (readlink: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34018 mgr-fin ceph txt unknown /proc/31428/task/34018/exe (readlink: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34018 mgr-fin ceph NOFD /proc/31428/task/34018/fd (opendir: Permission denied) 2024-09-16T01:03:44.251 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34019 mgr-fin ceph cwd unknown /proc/31428/task/34019/cwd (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34019 mgr-fin ceph rtd unknown /proc/31428/task/34019/root (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34019 mgr-fin ceph txt unknown /proc/31428/task/34019/exe (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34019 mgr-fin ceph NOFD /proc/31428/task/34019/fd (opendir: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34020 mgr-fin ceph cwd unknown /proc/31428/task/34020/cwd (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34020 mgr-fin ceph rtd unknown /proc/31428/task/34020/root (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34020 mgr-fin ceph txt unknown /proc/31428/task/34020/exe (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34020 mgr-fin ceph NOFD /proc/31428/task/34020/fd (opendir: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34021 mgr-fin ceph cwd unknown /proc/31428/task/34021/cwd (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34021 mgr-fin ceph rtd unknown /proc/31428/task/34021/root (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34021 mgr-fin ceph txt unknown /proc/31428/task/34021/exe (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34021 mgr-fin ceph NOFD /proc/31428/task/34021/fd (opendir: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34022 mgr-fin ceph cwd unknown /proc/31428/task/34022/cwd (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34022 mgr-fin ceph rtd unknown /proc/31428/task/34022/root (readlink: Permission denied) 2024-09-16T01:03:44.252 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34022 mgr-fin ceph txt unknown /proc/31428/task/34022/exe (readlink: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34022 mgr-fin ceph NOFD /proc/31428/task/34022/fd (opendir: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34023 mgr-fin ceph cwd unknown /proc/31428/task/34023/cwd (readlink: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34023 mgr-fin ceph rtd unknown /proc/31428/task/34023/root (readlink: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34023 mgr-fin ceph txt unknown /proc/31428/task/34023/exe (readlink: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34023 mgr-fin ceph NOFD /proc/31428/task/34023/fd (opendir: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34029 mgr-fin ceph cwd unknown /proc/31428/task/34029/cwd (readlink: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34029 mgr-fin ceph rtd unknown /proc/31428/task/34029/root (readlink: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34029 mgr-fin ceph txt unknown /proc/31428/task/34029/exe (readlink: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34029 mgr-fin ceph NOFD /proc/31428/task/34029/fd (opendir: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34030 mgr-fin ceph cwd unknown /proc/31428/task/34030/cwd (readlink: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34030 mgr-fin ceph rtd unknown /proc/31428/task/34030/root (readlink: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34030 mgr-fin ceph txt unknown /proc/31428/task/34030/exe (readlink: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34030 mgr-fin ceph NOFD /proc/31428/task/34030/fd (opendir: Permission denied) 2024-09-16T01:03:44.253 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34031 mgr-fin ceph cwd unknown /proc/31428/task/34031/cwd (readlink: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34031 mgr-fin ceph rtd unknown /proc/31428/task/34031/root (readlink: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34031 mgr-fin ceph txt unknown /proc/31428/task/34031/exe (readlink: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34031 mgr-fin ceph NOFD /proc/31428/task/34031/fd (opendir: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34032 mgr-fin ceph cwd unknown /proc/31428/task/34032/cwd (readlink: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34032 mgr-fin ceph rtd unknown /proc/31428/task/34032/root (readlink: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34032 mgr-fin ceph txt unknown /proc/31428/task/34032/exe (readlink: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34032 mgr-fin ceph NOFD /proc/31428/task/34032/fd (opendir: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34033 mgr-fin ceph cwd unknown /proc/31428/task/34033/cwd (readlink: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34033 mgr-fin ceph rtd unknown /proc/31428/task/34033/root (readlink: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34033 mgr-fin ceph txt unknown /proc/31428/task/34033/exe (readlink: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34033 mgr-fin ceph NOFD /proc/31428/task/34033/fd (opendir: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34034 mgr-fin ceph cwd unknown /proc/31428/task/34034/cwd (readlink: Permission denied) 2024-09-16T01:03:44.254 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34034 mgr-fin ceph rtd unknown /proc/31428/task/34034/root (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34034 mgr-fin ceph txt unknown /proc/31428/task/34034/exe (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34034 mgr-fin ceph NOFD /proc/31428/task/34034/fd (opendir: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34035 mgr-fin ceph cwd unknown /proc/31428/task/34035/cwd (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34035 mgr-fin ceph rtd unknown /proc/31428/task/34035/root (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34035 mgr-fin ceph txt unknown /proc/31428/task/34035/exe (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34035 mgr-fin ceph NOFD /proc/31428/task/34035/fd (opendir: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34036 mgr-fin ceph cwd unknown /proc/31428/task/34036/cwd (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34036 mgr-fin ceph rtd unknown /proc/31428/task/34036/root (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34036 mgr-fin ceph txt unknown /proc/31428/task/34036/exe (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34036 mgr-fin ceph NOFD /proc/31428/task/34036/fd (opendir: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34037 mgr-fin ceph cwd unknown /proc/31428/task/34037/cwd (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34037 mgr-fin ceph rtd unknown /proc/31428/task/34037/root (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34037 mgr-fin ceph txt unknown /proc/31428/task/34037/exe (readlink: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34037 mgr-fin ceph NOFD /proc/31428/task/34037/fd (opendir: Permission denied) 2024-09-16T01:03:44.255 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34038 mgr-fin ceph cwd unknown /proc/31428/task/34038/cwd (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34038 mgr-fin ceph rtd unknown /proc/31428/task/34038/root (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34038 mgr-fin ceph txt unknown /proc/31428/task/34038/exe (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34038 mgr-fin ceph NOFD /proc/31428/task/34038/fd (opendir: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34039 mgr-fin ceph cwd unknown /proc/31428/task/34039/cwd (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34039 mgr-fin ceph rtd unknown /proc/31428/task/34039/root (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34039 mgr-fin ceph txt unknown /proc/31428/task/34039/exe (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34039 mgr-fin ceph NOFD /proc/31428/task/34039/fd (opendir: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34511 dashboard ceph cwd unknown /proc/31428/task/34511/cwd (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34511 dashboard ceph rtd unknown /proc/31428/task/34511/root (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34511 dashboard ceph txt unknown /proc/31428/task/34511/exe (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34511 dashboard ceph NOFD /proc/31428/task/34511/fd (opendir: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34512 dashboard ceph cwd unknown /proc/31428/task/34512/cwd (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34512 dashboard ceph rtd unknown /proc/31428/task/34512/root (readlink: Permission denied) 2024-09-16T01:03:44.256 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34512 dashboard ceph txt unknown /proc/31428/task/34512/exe (readlink: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34512 dashboard ceph NOFD /proc/31428/task/34512/fd (opendir: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34513 dashboard ceph cwd unknown /proc/31428/task/34513/cwd (readlink: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34513 dashboard ceph rtd unknown /proc/31428/task/34513/root (readlink: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34513 dashboard ceph txt unknown /proc/31428/task/34513/exe (readlink: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34513 dashboard ceph NOFD /proc/31428/task/34513/fd (opendir: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34514 dashboard ceph cwd unknown /proc/31428/task/34514/cwd (readlink: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34514 dashboard ceph rtd unknown /proc/31428/task/34514/root (readlink: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34514 dashboard ceph txt unknown /proc/31428/task/34514/exe (readlink: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34514 dashboard ceph NOFD /proc/31428/task/34514/fd (opendir: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34515 dashboard ceph cwd unknown /proc/31428/task/34515/cwd (readlink: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34515 dashboard ceph rtd unknown /proc/31428/task/34515/root (readlink: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34515 dashboard ceph txt unknown /proc/31428/task/34515/exe (readlink: Permission denied) 2024-09-16T01:03:44.257 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34515 dashboard ceph NOFD /proc/31428/task/34515/fd (opendir: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34516 dashboard ceph cwd unknown /proc/31428/task/34516/cwd (readlink: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34516 dashboard ceph rtd unknown /proc/31428/task/34516/root (readlink: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34516 dashboard ceph txt unknown /proc/31428/task/34516/exe (readlink: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34516 dashboard ceph NOFD /proc/31428/task/34516/fd (opendir: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34517 dashboard ceph cwd unknown /proc/31428/task/34517/cwd (readlink: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34517 dashboard ceph rtd unknown /proc/31428/task/34517/root (readlink: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34517 dashboard ceph txt unknown /proc/31428/task/34517/exe (readlink: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34517 dashboard ceph NOFD /proc/31428/task/34517/fd (opendir: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34518 dashboard ceph cwd unknown /proc/31428/task/34518/cwd (readlink: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34518 dashboard ceph rtd unknown /proc/31428/task/34518/root (readlink: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34518 dashboard ceph txt unknown /proc/31428/task/34518/exe (readlink: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34518 dashboard ceph NOFD /proc/31428/task/34518/fd (opendir: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34519 dashboard ceph cwd unknown /proc/31428/task/34519/cwd (readlink: Permission denied) 2024-09-16T01:03:44.258 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34519 dashboard ceph rtd unknown /proc/31428/task/34519/root (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34519 dashboard ceph txt unknown /proc/31428/task/34519/exe (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34519 dashboard ceph NOFD /proc/31428/task/34519/fd (opendir: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34520 dashboard ceph cwd unknown /proc/31428/task/34520/cwd (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34520 dashboard ceph rtd unknown /proc/31428/task/34520/root (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34520 dashboard ceph txt unknown /proc/31428/task/34520/exe (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34520 dashboard ceph NOFD /proc/31428/task/34520/fd (opendir: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34521 dashboard ceph cwd unknown /proc/31428/task/34521/cwd (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34521 dashboard ceph rtd unknown /proc/31428/task/34521/root (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34521 dashboard ceph txt unknown /proc/31428/task/34521/exe (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34521 dashboard ceph NOFD /proc/31428/task/34521/fd (opendir: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34522 dashboard ceph cwd unknown /proc/31428/task/34522/cwd (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34522 dashboard ceph rtd unknown /proc/31428/task/34522/root (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34522 dashboard ceph txt unknown /proc/31428/task/34522/exe (readlink: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 34522 dashboard ceph NOFD /proc/31428/task/34522/fd (opendir: Permission denied) 2024-09-16T01:03:44.259 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47483 devicehea ceph cwd unknown /proc/31428/task/47483/cwd (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47483 devicehea ceph rtd unknown /proc/31428/task/47483/root (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47483 devicehea ceph txt unknown /proc/31428/task/47483/exe (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47483 devicehea ceph NOFD /proc/31428/task/47483/fd (opendir: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47491 io_contex ceph cwd unknown /proc/31428/task/47491/cwd (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47491 io_contex ceph rtd unknown /proc/31428/task/47491/root (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47491 io_contex ceph txt unknown /proc/31428/task/47491/exe (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47491 io_contex ceph NOFD /proc/31428/task/47491/fd (opendir: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47492 io_contex ceph cwd unknown /proc/31428/task/47492/cwd (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47492 io_contex ceph rtd unknown /proc/31428/task/47492/root (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47492 io_contex ceph txt unknown /proc/31428/task/47492/exe (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47492 io_contex ceph NOFD /proc/31428/task/47492/fd (opendir: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47493 ceph_time ceph cwd unknown /proc/31428/task/47493/cwd (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47493 ceph_time ceph rtd unknown /proc/31428/task/47493/root (readlink: Permission denied) 2024-09-16T01:03:44.260 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47493 ceph_time ceph txt unknown /proc/31428/task/47493/exe (readlink: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47493 ceph_time ceph NOFD /proc/31428/task/47493/fd (opendir: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47494 ms_dispat ceph cwd unknown /proc/31428/task/47494/cwd (readlink: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47494 ms_dispat ceph rtd unknown /proc/31428/task/47494/root (readlink: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47494 ms_dispat ceph txt unknown /proc/31428/task/47494/exe (readlink: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47494 ms_dispat ceph NOFD /proc/31428/task/47494/fd (opendir: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47495 ms_local ceph cwd unknown /proc/31428/task/47495/cwd (readlink: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47495 ms_local ceph rtd unknown /proc/31428/task/47495/root (readlink: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47495 ms_local ceph txt unknown /proc/31428/task/47495/exe (readlink: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47495 ms_local ceph NOFD /proc/31428/task/47495/fd (opendir: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47496 safe_time ceph cwd unknown /proc/31428/task/47496/cwd (readlink: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47496 safe_time ceph rtd unknown /proc/31428/task/47496/root (readlink: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47496 safe_time ceph txt unknown /proc/31428/task/47496/exe (readlink: Permission denied) 2024-09-16T01:03:44.261 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47496 safe_time ceph NOFD /proc/31428/task/47496/fd (opendir: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47497 safe_time ceph cwd unknown /proc/31428/task/47497/cwd (readlink: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47497 safe_time ceph rtd unknown /proc/31428/task/47497/root (readlink: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47497 safe_time ceph txt unknown /proc/31428/task/47497/exe (readlink: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mgr 31428 47497 safe_time ceph NOFD /proc/31428/task/47497/fd (opendir: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 32394 root cwd unknown /proc/32394/cwd (readlink: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 32394 root rtd unknown /proc/32394/root (readlink: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 32394 root txt unknown /proc/32394/exe (readlink: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:systemd 32394 root NOFD /proc/32394/fd (opendir: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:(sd-pam) 32396 root cwd unknown /proc/32396/cwd (readlink: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:(sd-pam) 32396 root rtd unknown /proc/32396/root (readlink: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:(sd-pam) 32396 root txt unknown /proc/32396/exe (readlink: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:(sd-pam) 32396 root NOFD /proc/32396/fd (opendir: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 33791 root cwd unknown /proc/33791/cwd (readlink: Permission denied) 2024-09-16T01:03:44.262 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 33791 root rtd unknown /proc/33791/root (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 33791 root txt unknown /proc/33791/exe (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 33791 root NOFD /proc/33791/fd (opendir: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 33795 root cwd unknown /proc/33795/cwd (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 33795 root rtd unknown /proc/33795/root (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 33795 root txt unknown /proc/33795/exe (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:sshd 33795 root NOFD /proc/33795/fd (opendir: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 40599 root cwd unknown /proc/40599/cwd (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 40599 root rtd unknown /proc/40599/root (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 40599 root txt unknown /proc/40599/exe (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 40599 root NOFD /proc/40599/fd (opendir: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 42817 root cwd unknown /proc/42817/cwd (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 42817 root rtd unknown /proc/42817/root (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 42817 root txt unknown /proc/42817/exe (readlink: Permission denied) 2024-09-16T01:03:44.263 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 42817 root NOFD /proc/42817/fd (opendir: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 42819 root cwd unknown /proc/42819/cwd (readlink: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 42819 root rtd unknown /proc/42819/root (readlink: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 42819 root txt unknown /proc/42819/exe (readlink: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 42819 root NOFD /proc/42819/fd (opendir: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 ceph cwd unknown /proc/42821/cwd (readlink: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 ceph rtd unknown /proc/42821/root (readlink: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 ceph txt unknown /proc/42821/exe (readlink: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 ceph NOFD /proc/42821/fd (opendir: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42822 log ceph cwd unknown /proc/42821/task/42822/cwd (readlink: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42822 log ceph rtd unknown /proc/42821/task/42822/root (readlink: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42822 log ceph txt unknown /proc/42821/task/42822/exe (readlink: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42822 log ceph NOFD /proc/42821/task/42822/fd (opendir: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42824 msgr-work ceph cwd unknown /proc/42821/task/42824/cwd (readlink: Permission denied) 2024-09-16T01:03:44.264 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42824 msgr-work ceph rtd unknown /proc/42821/task/42824/root (readlink: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42824 msgr-work ceph txt unknown /proc/42821/task/42824/exe (readlink: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42824 msgr-work ceph NOFD /proc/42821/task/42824/fd (opendir: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42825 msgr-work ceph cwd unknown /proc/42821/task/42825/cwd (readlink: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42825 msgr-work ceph rtd unknown /proc/42821/task/42825/root (readlink: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42825 msgr-work ceph txt unknown /proc/42821/task/42825/exe (readlink: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42825 msgr-work ceph NOFD /proc/42821/task/42825/fd (opendir: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42826 msgr-work ceph cwd unknown /proc/42821/task/42826/cwd (readlink: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42826 msgr-work ceph rtd unknown /proc/42821/task/42826/root (readlink: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42826 msgr-work ceph txt unknown /proc/42821/task/42826/exe (readlink: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42826 msgr-work ceph NOFD /proc/42821/task/42826/fd (opendir: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42830 service ceph cwd unknown /proc/42821/task/42830/cwd (readlink: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42830 service ceph rtd unknown /proc/42821/task/42830/root (readlink: Permission denied) 2024-09-16T01:03:44.265 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42830 service ceph txt unknown /proc/42821/task/42830/exe (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42830 service ceph NOFD /proc/42821/task/42830/fd (opendir: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42831 admin_soc ceph cwd unknown /proc/42821/task/42831/cwd (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42831 admin_soc ceph rtd unknown /proc/42821/task/42831/root (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42831 admin_soc ceph txt unknown /proc/42821/task/42831/exe (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 42831 admin_soc ceph NOFD /proc/42821/task/42831/fd (opendir: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43169 signal_ha ceph cwd unknown /proc/42821/task/43169/cwd (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43169 signal_ha ceph rtd unknown /proc/42821/task/43169/root (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43169 signal_ha ceph txt unknown /proc/42821/task/43169/exe (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43169 signal_ha ceph NOFD /proc/42821/task/43169/fd (opendir: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43170 io_contex ceph cwd unknown /proc/42821/task/43170/cwd (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43170 io_contex ceph rtd unknown /proc/42821/task/43170/root (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43170 io_contex ceph txt unknown /proc/42821/task/43170/exe (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43170 io_contex ceph NOFD /proc/42821/task/43170/fd (opendir: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43171 io_contex ceph cwd unknown /proc/42821/task/43171/cwd (readlink: Permission denied) 2024-09-16T01:03:44.266 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43171 io_contex ceph rtd unknown /proc/42821/task/43171/root (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43171 io_contex ceph txt unknown /proc/42821/task/43171/exe (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43171 io_contex ceph NOFD /proc/42821/task/43171/fd (opendir: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43200 OpHistory ceph cwd unknown /proc/42821/task/43200/cwd (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43200 OpHistory ceph rtd unknown /proc/42821/task/43200/root (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43200 OpHistory ceph txt unknown /proc/42821/task/43200/exe (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43200 OpHistory ceph NOFD /proc/42821/task/43200/fd (opendir: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43201 ceph_time ceph cwd unknown /proc/42821/task/43201/cwd (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43201 ceph_time ceph rtd unknown /proc/42821/task/43201/root (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43201 ceph_time ceph txt unknown /proc/42821/task/43201/exe (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43201 ceph_time ceph NOFD /proc/42821/task/43201/fd (opendir: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43222 ceph-osd ceph cwd unknown /proc/42821/task/43222/cwd (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43222 ceph-osd ceph rtd unknown /proc/42821/task/43222/root (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43222 ceph-osd ceph txt unknown /proc/42821/task/43222/exe (readlink: Permission denied) 2024-09-16T01:03:44.267 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43222 ceph-osd ceph NOFD /proc/42821/task/43222/fd (opendir: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43265 ceph-osd ceph cwd unknown /proc/42821/task/43265/cwd (readlink: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43265 ceph-osd ceph rtd unknown /proc/42821/task/43265/root (readlink: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43265 ceph-osd ceph txt unknown /proc/42821/task/43265/exe (readlink: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43265 ceph-osd ceph NOFD /proc/42821/task/43265/fd (opendir: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43279 ceph-osd ceph cwd unknown /proc/42821/task/43279/cwd (readlink: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43279 ceph-osd ceph rtd unknown /proc/42821/task/43279/root (readlink: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43279 ceph-osd ceph txt unknown /proc/42821/task/43279/exe (readlink: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43279 ceph-osd ceph NOFD /proc/42821/task/43279/fd (opendir: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43287 ceph-osd ceph cwd unknown /proc/42821/task/43287/cwd (readlink: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43287 ceph-osd ceph rtd unknown /proc/42821/task/43287/root (readlink: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43287 ceph-osd ceph txt unknown /proc/42821/task/43287/exe (readlink: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43287 ceph-osd ceph NOFD /proc/42821/task/43287/fd (opendir: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43295 ceph-osd ceph cwd unknown /proc/42821/task/43295/cwd (readlink: Permission denied) 2024-09-16T01:03:44.268 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43295 ceph-osd ceph rtd unknown /proc/42821/task/43295/root (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43295 ceph-osd ceph txt unknown /proc/42821/task/43295/exe (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43295 ceph-osd ceph NOFD /proc/42821/task/43295/fd (opendir: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43316 ceph-osd ceph cwd unknown /proc/42821/task/43316/cwd (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43316 ceph-osd ceph rtd unknown /proc/42821/task/43316/root (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43316 ceph-osd ceph txt unknown /proc/42821/task/43316/exe (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43316 ceph-osd ceph NOFD /proc/42821/task/43316/fd (opendir: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43320 ceph-osd ceph cwd unknown /proc/42821/task/43320/cwd (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43320 ceph-osd ceph rtd unknown /proc/42821/task/43320/root (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43320 ceph-osd ceph txt unknown /proc/42821/task/43320/exe (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43320 ceph-osd ceph NOFD /proc/42821/task/43320/fd (opendir: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43404 ceph-osd ceph cwd unknown /proc/42821/task/43404/cwd (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43404 ceph-osd ceph rtd unknown /proc/42821/task/43404/root (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43404 ceph-osd ceph txt unknown /proc/42821/task/43404/exe (readlink: Permission denied) 2024-09-16T01:03:44.269 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43404 ceph-osd ceph NOFD /proc/42821/task/43404/fd (opendir: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43405 ceph-osd ceph cwd unknown /proc/42821/task/43405/cwd (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43405 ceph-osd ceph rtd unknown /proc/42821/task/43405/root (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43405 ceph-osd ceph txt unknown /proc/42821/task/43405/exe (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43405 ceph-osd ceph NOFD /proc/42821/task/43405/fd (opendir: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43406 safe_time ceph cwd unknown /proc/42821/task/43406/cwd (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43406 safe_time ceph rtd unknown /proc/42821/task/43406/root (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43406 safe_time ceph txt unknown /proc/42821/task/43406/exe (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43406 safe_time ceph NOFD /proc/42821/task/43406/fd (opendir: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43408 safe_time ceph cwd unknown /proc/42821/task/43408/cwd (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43408 safe_time ceph rtd unknown /proc/42821/task/43408/root (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43408 safe_time ceph txt unknown /proc/42821/task/43408/exe (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43408 safe_time ceph NOFD /proc/42821/task/43408/fd (opendir: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43409 safe_time ceph cwd unknown /proc/42821/task/43409/cwd (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43409 safe_time ceph rtd unknown /proc/42821/task/43409/root (readlink: Permission denied) 2024-09-16T01:03:44.270 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43409 safe_time ceph txt unknown /proc/42821/task/43409/exe (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43409 safe_time ceph NOFD /proc/42821/task/43409/fd (opendir: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43410 safe_time ceph cwd unknown /proc/42821/task/43410/cwd (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43410 safe_time ceph rtd unknown /proc/42821/task/43410/root (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43410 safe_time ceph txt unknown /proc/42821/task/43410/exe (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43410 safe_time ceph NOFD /proc/42821/task/43410/fd (opendir: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43411 fn_anonym ceph cwd unknown /proc/42821/task/43411/cwd (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43411 fn_anonym ceph rtd unknown /proc/42821/task/43411/root (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43411 fn_anonym ceph txt unknown /proc/42821/task/43411/exe (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43411 fn_anonym ceph NOFD /proc/42821/task/43411/fd (opendir: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43485 rocksdb:l ceph cwd unknown /proc/42821/task/43485/cwd (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43485 rocksdb:l ceph rtd unknown /proc/42821/task/43485/root (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43485 rocksdb:l ceph txt unknown /proc/42821/task/43485/exe (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43485 rocksdb:l ceph NOFD /proc/42821/task/43485/fd (opendir: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43486 rocksdb:l ceph cwd unknown /proc/42821/task/43486/cwd (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43486 rocksdb:l ceph rtd unknown /proc/42821/task/43486/root (readlink: Permission denied) 2024-09-16T01:03:44.271 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43486 rocksdb:l ceph txt unknown /proc/42821/task/43486/exe (readlink: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43486 rocksdb:l ceph NOFD /proc/42821/task/43486/fd (opendir: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43487 rocksdb:l ceph cwd unknown /proc/42821/task/43487/cwd (readlink: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43487 rocksdb:l ceph rtd unknown /proc/42821/task/43487/root (readlink: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43487 rocksdb:l ceph txt unknown /proc/42821/task/43487/exe (readlink: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43487 rocksdb:l ceph NOFD /proc/42821/task/43487/fd (opendir: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43488 rocksdb:h ceph cwd unknown /proc/42821/task/43488/cwd (readlink: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43488 rocksdb:h ceph rtd unknown /proc/42821/task/43488/root (readlink: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43488 rocksdb:h ceph txt unknown /proc/42821/task/43488/exe (readlink: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43488 rocksdb:h ceph NOFD /proc/42821/task/43488/fd (opendir: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43883 bstore_ai ceph cwd unknown /proc/42821/task/43883/cwd (readlink: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43883 bstore_ai ceph rtd unknown /proc/42821/task/43883/root (readlink: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43883 bstore_ai ceph txt unknown /proc/42821/task/43883/exe (readlink: Permission denied) 2024-09-16T01:03:44.272 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 43883 bstore_ai ceph NOFD /proc/42821/task/43883/fd (opendir: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44090 bstore_ai ceph cwd unknown /proc/42821/task/44090/cwd (readlink: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44090 bstore_ai ceph rtd unknown /proc/42821/task/44090/root (readlink: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44090 bstore_ai ceph txt unknown /proc/42821/task/44090/exe (readlink: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44090 bstore_ai ceph NOFD /proc/42821/task/44090/fd (opendir: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44273 ceph-osd ceph cwd unknown /proc/42821/task/44273/cwd (readlink: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44273 ceph-osd ceph rtd unknown /proc/42821/task/44273/root (readlink: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44273 ceph-osd ceph txt unknown /proc/42821/task/44273/exe (readlink: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44273 ceph-osd ceph NOFD /proc/42821/task/44273/fd (opendir: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44274 cfin ceph cwd unknown /proc/42821/task/44274/cwd (readlink: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44274 cfin ceph rtd unknown /proc/42821/task/44274/root (readlink: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44274 cfin ceph txt unknown /proc/42821/task/44274/exe (readlink: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44274 cfin ceph NOFD /proc/42821/task/44274/fd (opendir: Permission denied) 2024-09-16T01:03:44.273 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44275 bstore_kv ceph cwd unknown /proc/42821/task/44275/cwd (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44275 bstore_kv ceph rtd unknown /proc/42821/task/44275/root (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44275 bstore_kv ceph txt unknown /proc/42821/task/44275/exe (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44275 bstore_kv ceph NOFD /proc/42821/task/44275/fd (opendir: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44276 bstore_kv ceph cwd unknown /proc/42821/task/44276/cwd (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44276 bstore_kv ceph rtd unknown /proc/42821/task/44276/root (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44276 bstore_kv ceph txt unknown /proc/42821/task/44276/exe (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44276 bstore_kv ceph NOFD /proc/42821/task/44276/fd (opendir: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44277 bstore_me ceph cwd unknown /proc/42821/task/44277/cwd (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44277 bstore_me ceph rtd unknown /proc/42821/task/44277/root (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44277 bstore_me ceph txt unknown /proc/42821/task/44277/exe (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44277 bstore_me ceph NOFD /proc/42821/task/44277/fd (opendir: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44278 ms_dispat ceph cwd unknown /proc/42821/task/44278/cwd (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44278 ms_dispat ceph rtd unknown /proc/42821/task/44278/root (readlink: Permission denied) 2024-09-16T01:03:44.274 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44278 ms_dispat ceph txt unknown /proc/42821/task/44278/exe (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44278 ms_dispat ceph NOFD /proc/42821/task/44278/fd (opendir: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44279 ms_local ceph cwd unknown /proc/42821/task/44279/cwd (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44279 ms_local ceph rtd unknown /proc/42821/task/44279/root (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44279 ms_local ceph txt unknown /proc/42821/task/44279/exe (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44279 ms_local ceph NOFD /proc/42821/task/44279/fd (opendir: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44280 safe_time ceph cwd unknown /proc/42821/task/44280/cwd (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44280 safe_time ceph rtd unknown /proc/42821/task/44280/root (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44280 safe_time ceph txt unknown /proc/42821/task/44280/exe (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44280 safe_time ceph NOFD /proc/42821/task/44280/fd (opendir: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44281 safe_time ceph cwd unknown /proc/42821/task/44281/cwd (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44281 safe_time ceph rtd unknown /proc/42821/task/44281/root (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44281 safe_time ceph txt unknown /proc/42821/task/44281/exe (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44281 safe_time ceph NOFD /proc/42821/task/44281/fd (opendir: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44282 ms_dispat ceph cwd unknown /proc/42821/task/44282/cwd (readlink: Permission denied) 2024-09-16T01:03:44.275 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44282 ms_dispat ceph rtd unknown /proc/42821/task/44282/root (readlink: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44282 ms_dispat ceph txt unknown /proc/42821/task/44282/exe (readlink: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44282 ms_dispat ceph NOFD /proc/42821/task/44282/fd (opendir: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44283 ms_local ceph cwd unknown /proc/42821/task/44283/cwd (readlink: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44283 ms_local ceph rtd unknown /proc/42821/task/44283/root (readlink: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44283 ms_local ceph txt unknown /proc/42821/task/44283/exe (readlink: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44283 ms_local ceph NOFD /proc/42821/task/44283/fd (opendir: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44284 ms_dispat ceph cwd unknown /proc/42821/task/44284/cwd (readlink: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44284 ms_dispat ceph rtd unknown /proc/42821/task/44284/root (readlink: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44284 ms_dispat ceph txt unknown /proc/42821/task/44284/exe (readlink: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44284 ms_dispat ceph NOFD /proc/42821/task/44284/fd (opendir: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44285 ms_local ceph cwd unknown /proc/42821/task/44285/cwd (readlink: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44285 ms_local ceph rtd unknown /proc/42821/task/44285/root (readlink: Permission denied) 2024-09-16T01:03:44.276 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44285 ms_local ceph txt unknown /proc/42821/task/44285/exe (readlink: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44285 ms_local ceph NOFD /proc/42821/task/44285/fd (opendir: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44286 ms_dispat ceph cwd unknown /proc/42821/task/44286/cwd (readlink: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44286 ms_dispat ceph rtd unknown /proc/42821/task/44286/root (readlink: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44286 ms_dispat ceph txt unknown /proc/42821/task/44286/exe (readlink: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44286 ms_dispat ceph NOFD /proc/42821/task/44286/fd (opendir: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44287 ms_local ceph cwd unknown /proc/42821/task/44287/cwd (readlink: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44287 ms_local ceph rtd unknown /proc/42821/task/44287/root (readlink: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44287 ms_local ceph txt unknown /proc/42821/task/44287/exe (readlink: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44287 ms_local ceph NOFD /proc/42821/task/44287/fd (opendir: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44288 ms_dispat ceph cwd unknown /proc/42821/task/44288/cwd (readlink: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44288 ms_dispat ceph rtd unknown /proc/42821/task/44288/root (readlink: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44288 ms_dispat ceph txt unknown /proc/42821/task/44288/exe (readlink: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44288 ms_dispat ceph NOFD /proc/42821/task/44288/fd (opendir: Permission denied) 2024-09-16T01:03:44.277 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44289 ms_local ceph cwd unknown /proc/42821/task/44289/cwd (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44289 ms_local ceph rtd unknown /proc/42821/task/44289/root (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44289 ms_local ceph txt unknown /proc/42821/task/44289/exe (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44289 ms_local ceph NOFD /proc/42821/task/44289/fd (opendir: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44290 ms_dispat ceph cwd unknown /proc/42821/task/44290/cwd (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44290 ms_dispat ceph rtd unknown /proc/42821/task/44290/root (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44290 ms_dispat ceph txt unknown /proc/42821/task/44290/exe (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44290 ms_dispat ceph NOFD /proc/42821/task/44290/fd (opendir: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44291 ms_local ceph cwd unknown /proc/42821/task/44291/cwd (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44291 ms_local ceph rtd unknown /proc/42821/task/44291/root (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44291 ms_local ceph txt unknown /proc/42821/task/44291/exe (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44291 ms_local ceph NOFD /proc/42821/task/44291/fd (opendir: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44292 ms_dispat ceph cwd unknown /proc/42821/task/44292/cwd (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44292 ms_dispat ceph rtd unknown /proc/42821/task/44292/root (readlink: Permission denied) 2024-09-16T01:03:44.278 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44292 ms_dispat ceph txt unknown /proc/42821/task/44292/exe (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44292 ms_dispat ceph NOFD /proc/42821/task/44292/fd (opendir: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44293 ms_local ceph cwd unknown /proc/42821/task/44293/cwd (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44293 ms_local ceph rtd unknown /proc/42821/task/44293/root (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44293 ms_local ceph txt unknown /proc/42821/task/44293/exe (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44293 ms_local ceph NOFD /proc/42821/task/44293/fd (opendir: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44294 fn_anonym ceph cwd unknown /proc/42821/task/44294/cwd (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44294 fn_anonym ceph rtd unknown /proc/42821/task/44294/root (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44294 fn_anonym ceph txt unknown /proc/42821/task/44294/exe (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44294 fn_anonym ceph NOFD /proc/42821/task/44294/fd (opendir: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44295 finisher ceph cwd unknown /proc/42821/task/44295/cwd (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44295 finisher ceph rtd unknown /proc/42821/task/44295/root (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44295 finisher ceph txt unknown /proc/42821/task/44295/exe (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44295 finisher ceph NOFD /proc/42821/task/44295/fd (opendir: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44296 safe_time ceph cwd unknown /proc/42821/task/44296/cwd (readlink: Permission denied) 2024-09-16T01:03:44.279 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44296 safe_time ceph rtd unknown /proc/42821/task/44296/root (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44296 safe_time ceph txt unknown /proc/42821/task/44296/exe (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44296 safe_time ceph NOFD /proc/42821/task/44296/fd (opendir: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44297 safe_time ceph cwd unknown /proc/42821/task/44297/cwd (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44297 safe_time ceph rtd unknown /proc/42821/task/44297/root (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44297 safe_time ceph txt unknown /proc/42821/task/44297/exe (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44297 safe_time ceph NOFD /proc/42821/task/44297/fd (opendir: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44298 ceph-osd ceph cwd unknown /proc/42821/task/44298/cwd (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44298 ceph-osd ceph rtd unknown /proc/42821/task/44298/root (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44298 ceph-osd ceph txt unknown /proc/42821/task/44298/exe (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44298 ceph-osd ceph NOFD /proc/42821/task/44298/fd (opendir: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44299 osd_srv_a ceph cwd unknown /proc/42821/task/44299/cwd (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44299 osd_srv_a ceph rtd unknown /proc/42821/task/44299/root (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44299 osd_srv_a ceph txt unknown /proc/42821/task/44299/exe (readlink: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44299 osd_srv_a ceph NOFD /proc/42821/task/44299/fd (opendir: Permission denied) 2024-09-16T01:03:44.280 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44300 tp_osd_tp ceph cwd unknown /proc/42821/task/44300/cwd (readlink: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44300 tp_osd_tp ceph rtd unknown /proc/42821/task/44300/root (readlink: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44300 tp_osd_tp ceph txt unknown /proc/42821/task/44300/exe (readlink: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44300 tp_osd_tp ceph NOFD /proc/42821/task/44300/fd (opendir: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44301 tp_osd_tp ceph cwd unknown /proc/42821/task/44301/cwd (readlink: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44301 tp_osd_tp ceph rtd unknown /proc/42821/task/44301/root (readlink: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44301 tp_osd_tp ceph txt unknown /proc/42821/task/44301/exe (readlink: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44301 tp_osd_tp ceph NOFD /proc/42821/task/44301/fd (opendir: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44302 tp_osd_tp ceph cwd unknown /proc/42821/task/44302/cwd (readlink: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44302 tp_osd_tp ceph rtd unknown /proc/42821/task/44302/root (readlink: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44302 tp_osd_tp ceph txt unknown /proc/42821/task/44302/exe (readlink: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44302 tp_osd_tp ceph NOFD /proc/42821/task/44302/fd (opendir: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44303 tp_osd_tp ceph cwd unknown /proc/42821/task/44303/cwd (readlink: Permission denied) 2024-09-16T01:03:44.281 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44303 tp_osd_tp ceph rtd unknown /proc/42821/task/44303/root (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44303 tp_osd_tp ceph txt unknown /proc/42821/task/44303/exe (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44303 tp_osd_tp ceph NOFD /proc/42821/task/44303/fd (opendir: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44304 tp_osd_tp ceph cwd unknown /proc/42821/task/44304/cwd (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44304 tp_osd_tp ceph rtd unknown /proc/42821/task/44304/root (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44304 tp_osd_tp ceph txt unknown /proc/42821/task/44304/exe (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44304 tp_osd_tp ceph NOFD /proc/42821/task/44304/fd (opendir: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44305 tp_osd_tp ceph cwd unknown /proc/42821/task/44305/cwd (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44305 tp_osd_tp ceph rtd unknown /proc/42821/task/44305/root (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44305 tp_osd_tp ceph txt unknown /proc/42821/task/44305/exe (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44305 tp_osd_tp ceph NOFD /proc/42821/task/44305/fd (opendir: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44306 tp_osd_tp ceph cwd unknown /proc/42821/task/44306/cwd (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44306 tp_osd_tp ceph rtd unknown /proc/42821/task/44306/root (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44306 tp_osd_tp ceph txt unknown /proc/42821/task/44306/exe (readlink: Permission denied) 2024-09-16T01:03:44.282 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44306 tp_osd_tp ceph NOFD /proc/42821/task/44306/fd (opendir: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44307 tp_osd_tp ceph cwd unknown /proc/42821/task/44307/cwd (readlink: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44307 tp_osd_tp ceph rtd unknown /proc/42821/task/44307/root (readlink: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44307 tp_osd_tp ceph txt unknown /proc/42821/task/44307/exe (readlink: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44307 tp_osd_tp ceph NOFD /proc/42821/task/44307/fd (opendir: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44308 tp_osd_tp ceph cwd unknown /proc/42821/task/44308/cwd (readlink: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44308 tp_osd_tp ceph rtd unknown /proc/42821/task/44308/root (readlink: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44308 tp_osd_tp ceph txt unknown /proc/42821/task/44308/exe (readlink: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44308 tp_osd_tp ceph NOFD /proc/42821/task/44308/fd (opendir: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44309 tp_osd_tp ceph cwd unknown /proc/42821/task/44309/cwd (readlink: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44309 tp_osd_tp ceph rtd unknown /proc/42821/task/44309/root (readlink: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44309 tp_osd_tp ceph txt unknown /proc/42821/task/44309/exe (readlink: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44309 tp_osd_tp ceph NOFD /proc/42821/task/44309/fd (opendir: Permission denied) 2024-09-16T01:03:44.283 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44310 tp_osd_tp ceph cwd unknown /proc/42821/task/44310/cwd (readlink: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44310 tp_osd_tp ceph rtd unknown /proc/42821/task/44310/root (readlink: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44310 tp_osd_tp ceph txt unknown /proc/42821/task/44310/exe (readlink: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44310 tp_osd_tp ceph NOFD /proc/42821/task/44310/fd (opendir: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44311 tp_osd_tp ceph cwd unknown /proc/42821/task/44311/cwd (readlink: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44311 tp_osd_tp ceph rtd unknown /proc/42821/task/44311/root (readlink: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44311 tp_osd_tp ceph txt unknown /proc/42821/task/44311/exe (readlink: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44311 tp_osd_tp ceph NOFD /proc/42821/task/44311/fd (opendir: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44312 tp_osd_tp ceph cwd unknown /proc/42821/task/44312/cwd (readlink: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44312 tp_osd_tp ceph rtd unknown /proc/42821/task/44312/root (readlink: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44312 tp_osd_tp ceph txt unknown /proc/42821/task/44312/exe (readlink: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44312 tp_osd_tp ceph NOFD /proc/42821/task/44312/fd (opendir: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44313 tp_osd_tp ceph cwd unknown /proc/42821/task/44313/cwd (readlink: Permission denied) 2024-09-16T01:03:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44313 tp_osd_tp ceph rtd unknown /proc/42821/task/44313/root (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44313 tp_osd_tp ceph txt unknown /proc/42821/task/44313/exe (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44313 tp_osd_tp ceph NOFD /proc/42821/task/44313/fd (opendir: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44314 tp_osd_tp ceph cwd unknown /proc/42821/task/44314/cwd (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44314 tp_osd_tp ceph rtd unknown /proc/42821/task/44314/root (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44314 tp_osd_tp ceph txt unknown /proc/42821/task/44314/exe (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44314 tp_osd_tp ceph NOFD /proc/42821/task/44314/fd (opendir: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44315 tp_osd_tp ceph cwd unknown /proc/42821/task/44315/cwd (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44315 tp_osd_tp ceph rtd unknown /proc/42821/task/44315/root (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44315 tp_osd_tp ceph txt unknown /proc/42821/task/44315/exe (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44315 tp_osd_tp ceph NOFD /proc/42821/task/44315/fd (opendir: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44316 osd_srv_h ceph cwd unknown /proc/42821/task/44316/cwd (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44316 osd_srv_h ceph rtd unknown /proc/42821/task/44316/root (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44316 osd_srv_h ceph txt unknown /proc/42821/task/44316/exe (readlink: Permission denied) 2024-09-16T01:03:44.285 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 42821 44316 osd_srv_h ceph NOFD /proc/42821/task/44316/fd (opendir: Permission denied) 2024-09-16T01:03:44.286 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 43438 root cwd unknown /proc/43438/cwd (readlink: Permission denied) 2024-09-16T01:03:44.286 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 43438 root rtd unknown /proc/43438/root (readlink: Permission denied) 2024-09-16T01:03:44.286 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 43438 root txt unknown /proc/43438/exe (readlink: Permission denied) 2024-09-16T01:03:44.286 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 43438 root NOFD /proc/43438/fd (opendir: Permission denied) 2024-09-16T01:03:44.286 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 43463 root cwd unknown /proc/43463/cwd (readlink: Permission denied) 2024-09-16T01:03:44.286 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 43463 root rtd unknown /proc/43463/root (readlink: Permission denied) 2024-09-16T01:03:44.286 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 43463 root txt unknown /proc/43463/exe (readlink: Permission denied) 2024-09-16T01:03:44.286 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 43463 root NOFD /proc/43463/fd (opendir: Permission denied) 2024-09-16T01:03:44.286 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 48965 root cwd unknown /proc/48965/cwd (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 48965 root rtd unknown /proc/48965/root (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 48965 root txt unknown /proc/48965/exe (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 48965 root NOFD /proc/48965/fd (opendir: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 49543 root cwd unknown /proc/49543/cwd (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 49543 root rtd unknown /proc/49543/root (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 49543 root txt unknown /proc/49543/exe (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 49543 root NOFD /proc/49543/fd (opendir: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 49545 root cwd unknown /proc/49545/cwd (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 49545 root rtd unknown /proc/49545/root (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 49545 root txt unknown /proc/49545/exe (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 49545 root NOFD /proc/49545/fd (opendir: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 ceph cwd unknown /proc/49547/cwd (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 ceph rtd unknown /proc/49547/root (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 ceph txt unknown /proc/49547/exe (readlink: Permission denied) 2024-09-16T01:03:44.287 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 ceph NOFD /proc/49547/fd (opendir: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49548 log ceph cwd unknown /proc/49547/task/49548/cwd (readlink: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49548 log ceph rtd unknown /proc/49547/task/49548/root (readlink: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49548 log ceph txt unknown /proc/49547/task/49548/exe (readlink: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49548 log ceph NOFD /proc/49547/task/49548/fd (opendir: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49550 msgr-work ceph cwd unknown /proc/49547/task/49550/cwd (readlink: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49550 msgr-work ceph rtd unknown /proc/49547/task/49550/root (readlink: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49550 msgr-work ceph txt unknown /proc/49547/task/49550/exe (readlink: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49550 msgr-work ceph NOFD /proc/49547/task/49550/fd (opendir: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49551 msgr-work ceph cwd unknown /proc/49547/task/49551/cwd (readlink: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49551 msgr-work ceph rtd unknown /proc/49547/task/49551/root (readlink: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49551 msgr-work ceph txt unknown /proc/49547/task/49551/exe (readlink: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49551 msgr-work ceph NOFD /proc/49547/task/49551/fd (opendir: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49552 msgr-work ceph cwd unknown /proc/49547/task/49552/cwd (readlink: Permission denied) 2024-09-16T01:03:44.288 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49552 msgr-work ceph rtd unknown /proc/49547/task/49552/root (readlink: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49552 msgr-work ceph txt unknown /proc/49547/task/49552/exe (readlink: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49552 msgr-work ceph NOFD /proc/49547/task/49552/fd (opendir: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49556 service ceph cwd unknown /proc/49547/task/49556/cwd (readlink: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49556 service ceph rtd unknown /proc/49547/task/49556/root (readlink: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49556 service ceph txt unknown /proc/49547/task/49556/exe (readlink: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49556 service ceph NOFD /proc/49547/task/49556/fd (opendir: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49557 admin_soc ceph cwd unknown /proc/49547/task/49557/cwd (readlink: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49557 admin_soc ceph rtd unknown /proc/49547/task/49557/root (readlink: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49557 admin_soc ceph txt unknown /proc/49547/task/49557/exe (readlink: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49557 admin_soc ceph NOFD /proc/49547/task/49557/fd (opendir: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49898 signal_ha ceph cwd unknown /proc/49547/task/49898/cwd (readlink: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49898 signal_ha ceph rtd unknown /proc/49547/task/49898/root (readlink: Permission denied) 2024-09-16T01:03:44.289 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49898 signal_ha ceph txt unknown /proc/49547/task/49898/exe (readlink: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49898 signal_ha ceph NOFD /proc/49547/task/49898/fd (opendir: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49899 io_contex ceph cwd unknown /proc/49547/task/49899/cwd (readlink: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49899 io_contex ceph rtd unknown /proc/49547/task/49899/root (readlink: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49899 io_contex ceph txt unknown /proc/49547/task/49899/exe (readlink: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49899 io_contex ceph NOFD /proc/49547/task/49899/fd (opendir: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49900 io_contex ceph cwd unknown /proc/49547/task/49900/cwd (readlink: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49900 io_contex ceph rtd unknown /proc/49547/task/49900/root (readlink: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49900 io_contex ceph txt unknown /proc/49547/task/49900/exe (readlink: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49900 io_contex ceph NOFD /proc/49547/task/49900/fd (opendir: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49912 OpHistory ceph cwd unknown /proc/49547/task/49912/cwd (readlink: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49912 OpHistory ceph rtd unknown /proc/49547/task/49912/root (readlink: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49912 OpHistory ceph txt unknown /proc/49547/task/49912/exe (readlink: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49912 OpHistory ceph NOFD /proc/49547/task/49912/fd (opendir: Permission denied) 2024-09-16T01:03:44.290 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49913 ceph_time ceph cwd unknown /proc/49547/task/49913/cwd (readlink: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49913 ceph_time ceph rtd unknown /proc/49547/task/49913/root (readlink: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49913 ceph_time ceph txt unknown /proc/49547/task/49913/exe (readlink: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 49913 ceph_time ceph NOFD /proc/49547/task/49913/fd (opendir: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50088 ceph-osd ceph cwd unknown /proc/49547/task/50088/cwd (readlink: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50088 ceph-osd ceph rtd unknown /proc/49547/task/50088/root (readlink: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50088 ceph-osd ceph txt unknown /proc/49547/task/50088/exe (readlink: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50088 ceph-osd ceph NOFD /proc/49547/task/50088/fd (opendir: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50089 safe_time ceph cwd unknown /proc/49547/task/50089/cwd (readlink: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50089 safe_time ceph rtd unknown /proc/49547/task/50089/root (readlink: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50089 safe_time ceph txt unknown /proc/49547/task/50089/exe (readlink: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50089 safe_time ceph NOFD /proc/49547/task/50089/fd (opendir: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50091 safe_time ceph cwd unknown /proc/49547/task/50091/cwd (readlink: Permission denied) 2024-09-16T01:03:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50091 safe_time ceph rtd unknown /proc/49547/task/50091/root (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50091 safe_time ceph txt unknown /proc/49547/task/50091/exe (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50091 safe_time ceph NOFD /proc/49547/task/50091/fd (opendir: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50092 safe_time ceph cwd unknown /proc/49547/task/50092/cwd (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50092 safe_time ceph rtd unknown /proc/49547/task/50092/root (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50092 safe_time ceph txt unknown /proc/49547/task/50092/exe (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50092 safe_time ceph NOFD /proc/49547/task/50092/fd (opendir: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50093 safe_time ceph cwd unknown /proc/49547/task/50093/cwd (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50093 safe_time ceph rtd unknown /proc/49547/task/50093/root (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50093 safe_time ceph txt unknown /proc/49547/task/50093/exe (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50093 safe_time ceph NOFD /proc/49547/task/50093/fd (opendir: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50094 fn_anonym ceph cwd unknown /proc/49547/task/50094/cwd (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50094 fn_anonym ceph rtd unknown /proc/49547/task/50094/root (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50094 fn_anonym ceph txt unknown /proc/49547/task/50094/exe (readlink: Permission denied) 2024-09-16T01:03:44.292 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50094 fn_anonym ceph NOFD /proc/49547/task/50094/fd (opendir: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50210 rocksdb:l ceph cwd unknown /proc/49547/task/50210/cwd (readlink: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50210 rocksdb:l ceph rtd unknown /proc/49547/task/50210/root (readlink: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50210 rocksdb:l ceph txt unknown /proc/49547/task/50210/exe (readlink: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50210 rocksdb:l ceph NOFD /proc/49547/task/50210/fd (opendir: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50211 rocksdb:l ceph cwd unknown /proc/49547/task/50211/cwd (readlink: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50211 rocksdb:l ceph rtd unknown /proc/49547/task/50211/root (readlink: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50211 rocksdb:l ceph txt unknown /proc/49547/task/50211/exe (readlink: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50211 rocksdb:l ceph NOFD /proc/49547/task/50211/fd (opendir: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50212 rocksdb:l ceph cwd unknown /proc/49547/task/50212/cwd (readlink: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50212 rocksdb:l ceph rtd unknown /proc/49547/task/50212/root (readlink: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50212 rocksdb:l ceph txt unknown /proc/49547/task/50212/exe (readlink: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50212 rocksdb:l ceph NOFD /proc/49547/task/50212/fd (opendir: Permission denied) 2024-09-16T01:03:44.293 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50213 rocksdb:h ceph cwd unknown /proc/49547/task/50213/cwd (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50213 rocksdb:h ceph rtd unknown /proc/49547/task/50213/root (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50213 rocksdb:h ceph txt unknown /proc/49547/task/50213/exe (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50213 rocksdb:h ceph NOFD /proc/49547/task/50213/fd (opendir: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50648 bstore_ai ceph cwd unknown /proc/49547/task/50648/cwd (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50648 bstore_ai ceph rtd unknown /proc/49547/task/50648/root (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50648 bstore_ai ceph txt unknown /proc/49547/task/50648/exe (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50648 bstore_ai ceph NOFD /proc/49547/task/50648/fd (opendir: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50852 bstore_ai ceph cwd unknown /proc/49547/task/50852/cwd (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50852 bstore_ai ceph rtd unknown /proc/49547/task/50852/root (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50852 bstore_ai ceph txt unknown /proc/49547/task/50852/exe (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 50852 bstore_ai ceph NOFD /proc/49547/task/50852/fd (opendir: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51034 ceph-osd ceph cwd unknown /proc/49547/task/51034/cwd (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51034 ceph-osd ceph rtd unknown /proc/49547/task/51034/root (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51034 ceph-osd ceph txt unknown /proc/49547/task/51034/exe (readlink: Permission denied) 2024-09-16T01:03:44.294 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51034 ceph-osd ceph NOFD /proc/49547/task/51034/fd (opendir: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51035 cfin ceph cwd unknown /proc/49547/task/51035/cwd (readlink: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51035 cfin ceph rtd unknown /proc/49547/task/51035/root (readlink: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51035 cfin ceph txt unknown /proc/49547/task/51035/exe (readlink: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51035 cfin ceph NOFD /proc/49547/task/51035/fd (opendir: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51036 bstore_kv ceph cwd unknown /proc/49547/task/51036/cwd (readlink: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51036 bstore_kv ceph rtd unknown /proc/49547/task/51036/root (readlink: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51036 bstore_kv ceph txt unknown /proc/49547/task/51036/exe (readlink: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51036 bstore_kv ceph NOFD /proc/49547/task/51036/fd (opendir: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51037 bstore_kv ceph cwd unknown /proc/49547/task/51037/cwd (readlink: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51037 bstore_kv ceph rtd unknown /proc/49547/task/51037/root (readlink: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51037 bstore_kv ceph txt unknown /proc/49547/task/51037/exe (readlink: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51037 bstore_kv ceph NOFD /proc/49547/task/51037/fd (opendir: Permission denied) 2024-09-16T01:03:44.295 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51038 bstore_me ceph cwd unknown /proc/49547/task/51038/cwd (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51038 bstore_me ceph rtd unknown /proc/49547/task/51038/root (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51038 bstore_me ceph txt unknown /proc/49547/task/51038/exe (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51038 bstore_me ceph NOFD /proc/49547/task/51038/fd (opendir: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51039 ms_dispat ceph cwd unknown /proc/49547/task/51039/cwd (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51039 ms_dispat ceph rtd unknown /proc/49547/task/51039/root (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51039 ms_dispat ceph txt unknown /proc/49547/task/51039/exe (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51039 ms_dispat ceph NOFD /proc/49547/task/51039/fd (opendir: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51040 ms_local ceph cwd unknown /proc/49547/task/51040/cwd (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51040 ms_local ceph rtd unknown /proc/49547/task/51040/root (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51040 ms_local ceph txt unknown /proc/49547/task/51040/exe (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51040 ms_local ceph NOFD /proc/49547/task/51040/fd (opendir: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51041 safe_time ceph cwd unknown /proc/49547/task/51041/cwd (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51041 safe_time ceph rtd unknown /proc/49547/task/51041/root (readlink: Permission denied) 2024-09-16T01:03:44.296 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51041 safe_time ceph txt unknown /proc/49547/task/51041/exe (readlink: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51041 safe_time ceph NOFD /proc/49547/task/51041/fd (opendir: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51042 safe_time ceph cwd unknown /proc/49547/task/51042/cwd (readlink: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51042 safe_time ceph rtd unknown /proc/49547/task/51042/root (readlink: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51042 safe_time ceph txt unknown /proc/49547/task/51042/exe (readlink: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51042 safe_time ceph NOFD /proc/49547/task/51042/fd (opendir: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51043 ms_dispat ceph cwd unknown /proc/49547/task/51043/cwd (readlink: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51043 ms_dispat ceph rtd unknown /proc/49547/task/51043/root (readlink: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51043 ms_dispat ceph txt unknown /proc/49547/task/51043/exe (readlink: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51043 ms_dispat ceph NOFD /proc/49547/task/51043/fd (opendir: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51044 ms_local ceph cwd unknown /proc/49547/task/51044/cwd (readlink: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51044 ms_local ceph rtd unknown /proc/49547/task/51044/root (readlink: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51044 ms_local ceph txt unknown /proc/49547/task/51044/exe (readlink: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51044 ms_local ceph NOFD /proc/49547/task/51044/fd (opendir: Permission denied) 2024-09-16T01:03:44.297 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51045 ms_dispat ceph cwd unknown /proc/49547/task/51045/cwd (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51045 ms_dispat ceph rtd unknown /proc/49547/task/51045/root (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51045 ms_dispat ceph txt unknown /proc/49547/task/51045/exe (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51045 ms_dispat ceph NOFD /proc/49547/task/51045/fd (opendir: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51046 ms_local ceph cwd unknown /proc/49547/task/51046/cwd (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51046 ms_local ceph rtd unknown /proc/49547/task/51046/root (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51046 ms_local ceph txt unknown /proc/49547/task/51046/exe (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51046 ms_local ceph NOFD /proc/49547/task/51046/fd (opendir: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51047 ms_dispat ceph cwd unknown /proc/49547/task/51047/cwd (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51047 ms_dispat ceph rtd unknown /proc/49547/task/51047/root (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51047 ms_dispat ceph txt unknown /proc/49547/task/51047/exe (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51047 ms_dispat ceph NOFD /proc/49547/task/51047/fd (opendir: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51048 ms_local ceph cwd unknown /proc/49547/task/51048/cwd (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51048 ms_local ceph rtd unknown /proc/49547/task/51048/root (readlink: Permission denied) 2024-09-16T01:03:44.298 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51048 ms_local ceph txt unknown /proc/49547/task/51048/exe (readlink: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51048 ms_local ceph NOFD /proc/49547/task/51048/fd (opendir: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51049 ms_dispat ceph cwd unknown /proc/49547/task/51049/cwd (readlink: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51049 ms_dispat ceph rtd unknown /proc/49547/task/51049/root (readlink: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51049 ms_dispat ceph txt unknown /proc/49547/task/51049/exe (readlink: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51049 ms_dispat ceph NOFD /proc/49547/task/51049/fd (opendir: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51050 ms_local ceph cwd unknown /proc/49547/task/51050/cwd (readlink: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51050 ms_local ceph rtd unknown /proc/49547/task/51050/root (readlink: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51050 ms_local ceph txt unknown /proc/49547/task/51050/exe (readlink: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51050 ms_local ceph NOFD /proc/49547/task/51050/fd (opendir: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51051 ms_dispat ceph cwd unknown /proc/49547/task/51051/cwd (readlink: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51051 ms_dispat ceph rtd unknown /proc/49547/task/51051/root (readlink: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51051 ms_dispat ceph txt unknown /proc/49547/task/51051/exe (readlink: Permission denied) 2024-09-16T01:03:44.299 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51051 ms_dispat ceph NOFD /proc/49547/task/51051/fd (opendir: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51052 ms_local ceph cwd unknown /proc/49547/task/51052/cwd (readlink: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51052 ms_local ceph rtd unknown /proc/49547/task/51052/root (readlink: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51052 ms_local ceph txt unknown /proc/49547/task/51052/exe (readlink: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51052 ms_local ceph NOFD /proc/49547/task/51052/fd (opendir: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51053 ms_dispat ceph cwd unknown /proc/49547/task/51053/cwd (readlink: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51053 ms_dispat ceph rtd unknown /proc/49547/task/51053/root (readlink: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51053 ms_dispat ceph txt unknown /proc/49547/task/51053/exe (readlink: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51053 ms_dispat ceph NOFD /proc/49547/task/51053/fd (opendir: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51054 ms_local ceph cwd unknown /proc/49547/task/51054/cwd (readlink: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51054 ms_local ceph rtd unknown /proc/49547/task/51054/root (readlink: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51054 ms_local ceph txt unknown /proc/49547/task/51054/exe (readlink: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51054 ms_local ceph NOFD /proc/49547/task/51054/fd (opendir: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51055 fn_anonym ceph cwd unknown /proc/49547/task/51055/cwd (readlink: Permission denied) 2024-09-16T01:03:44.300 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51055 fn_anonym ceph rtd unknown /proc/49547/task/51055/root (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51055 fn_anonym ceph txt unknown /proc/49547/task/51055/exe (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51055 fn_anonym ceph NOFD /proc/49547/task/51055/fd (opendir: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51056 finisher ceph cwd unknown /proc/49547/task/51056/cwd (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51056 finisher ceph rtd unknown /proc/49547/task/51056/root (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51056 finisher ceph txt unknown /proc/49547/task/51056/exe (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51056 finisher ceph NOFD /proc/49547/task/51056/fd (opendir: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51057 safe_time ceph cwd unknown /proc/49547/task/51057/cwd (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51057 safe_time ceph rtd unknown /proc/49547/task/51057/root (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51057 safe_time ceph txt unknown /proc/49547/task/51057/exe (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51057 safe_time ceph NOFD /proc/49547/task/51057/fd (opendir: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51058 safe_time ceph cwd unknown /proc/49547/task/51058/cwd (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51058 safe_time ceph rtd unknown /proc/49547/task/51058/root (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51058 safe_time ceph txt unknown /proc/49547/task/51058/exe (readlink: Permission denied) 2024-09-16T01:03:44.301 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51058 safe_time ceph NOFD /proc/49547/task/51058/fd (opendir: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51059 ceph-osd ceph cwd unknown /proc/49547/task/51059/cwd (readlink: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51059 ceph-osd ceph rtd unknown /proc/49547/task/51059/root (readlink: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51059 ceph-osd ceph txt unknown /proc/49547/task/51059/exe (readlink: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51059 ceph-osd ceph NOFD /proc/49547/task/51059/fd (opendir: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51060 osd_srv_a ceph cwd unknown /proc/49547/task/51060/cwd (readlink: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51060 osd_srv_a ceph rtd unknown /proc/49547/task/51060/root (readlink: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51060 osd_srv_a ceph txt unknown /proc/49547/task/51060/exe (readlink: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51060 osd_srv_a ceph NOFD /proc/49547/task/51060/fd (opendir: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51061 tp_osd_tp ceph cwd unknown /proc/49547/task/51061/cwd (readlink: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51061 tp_osd_tp ceph rtd unknown /proc/49547/task/51061/root (readlink: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51061 tp_osd_tp ceph txt unknown /proc/49547/task/51061/exe (readlink: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51061 tp_osd_tp ceph NOFD /proc/49547/task/51061/fd (opendir: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51062 tp_osd_tp ceph cwd unknown /proc/49547/task/51062/cwd (readlink: Permission denied) 2024-09-16T01:03:44.302 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51062 tp_osd_tp ceph rtd unknown /proc/49547/task/51062/root (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51062 tp_osd_tp ceph txt unknown /proc/49547/task/51062/exe (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51062 tp_osd_tp ceph NOFD /proc/49547/task/51062/fd (opendir: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51063 tp_osd_tp ceph cwd unknown /proc/49547/task/51063/cwd (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51063 tp_osd_tp ceph rtd unknown /proc/49547/task/51063/root (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51063 tp_osd_tp ceph txt unknown /proc/49547/task/51063/exe (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51063 tp_osd_tp ceph NOFD /proc/49547/task/51063/fd (opendir: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51064 tp_osd_tp ceph cwd unknown /proc/49547/task/51064/cwd (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51064 tp_osd_tp ceph rtd unknown /proc/49547/task/51064/root (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51064 tp_osd_tp ceph txt unknown /proc/49547/task/51064/exe (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51064 tp_osd_tp ceph NOFD /proc/49547/task/51064/fd (opendir: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51065 tp_osd_tp ceph cwd unknown /proc/49547/task/51065/cwd (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51065 tp_osd_tp ceph rtd unknown /proc/49547/task/51065/root (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51065 tp_osd_tp ceph txt unknown /proc/49547/task/51065/exe (readlink: Permission denied) 2024-09-16T01:03:44.303 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51065 tp_osd_tp ceph NOFD /proc/49547/task/51065/fd (opendir: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51066 tp_osd_tp ceph cwd unknown /proc/49547/task/51066/cwd (readlink: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51066 tp_osd_tp ceph rtd unknown /proc/49547/task/51066/root (readlink: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51066 tp_osd_tp ceph txt unknown /proc/49547/task/51066/exe (readlink: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51066 tp_osd_tp ceph NOFD /proc/49547/task/51066/fd (opendir: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51067 tp_osd_tp ceph cwd unknown /proc/49547/task/51067/cwd (readlink: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51067 tp_osd_tp ceph rtd unknown /proc/49547/task/51067/root (readlink: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51067 tp_osd_tp ceph txt unknown /proc/49547/task/51067/exe (readlink: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51067 tp_osd_tp ceph NOFD /proc/49547/task/51067/fd (opendir: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51068 tp_osd_tp ceph cwd unknown /proc/49547/task/51068/cwd (readlink: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51068 tp_osd_tp ceph rtd unknown /proc/49547/task/51068/root (readlink: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51068 tp_osd_tp ceph txt unknown /proc/49547/task/51068/exe (readlink: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51068 tp_osd_tp ceph NOFD /proc/49547/task/51068/fd (opendir: Permission denied) 2024-09-16T01:03:44.304 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51069 tp_osd_tp ceph cwd unknown /proc/49547/task/51069/cwd (readlink: Permission denied) 2024-09-16T01:03:44.305 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51069 tp_osd_tp ceph rtd unknown /proc/49547/task/51069/root (readlink: Permission denied) 2024-09-16T01:03:44.305 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51069 tp_osd_tp ceph txt unknown /proc/49547/task/51069/exe (readlink: Permission denied) 2024-09-16T01:03:44.305 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51069 tp_osd_tp ceph NOFD /proc/49547/task/51069/fd (opendir: Permission denied) 2024-09-16T01:03:44.305 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51070 tp_osd_tp ceph cwd unknown /proc/49547/task/51070/cwd (readlink: Permission denied) 2024-09-16T01:03:44.305 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51070 tp_osd_tp ceph rtd unknown /proc/49547/task/51070/root (readlink: Permission denied) 2024-09-16T01:03:44.305 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51070 tp_osd_tp ceph txt unknown /proc/49547/task/51070/exe (readlink: Permission denied) 2024-09-16T01:03:44.305 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51070 tp_osd_tp ceph NOFD /proc/49547/task/51070/fd (opendir: Permission denied) 2024-09-16T01:03:44.305 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51071 tp_osd_tp ceph cwd unknown /proc/49547/task/51071/cwd (readlink: Permission denied) 2024-09-16T01:03:44.305 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51071 tp_osd_tp ceph rtd unknown /proc/49547/task/51071/root (readlink: Permission denied) 2024-09-16T01:03:44.305 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51071 tp_osd_tp ceph txt unknown /proc/49547/task/51071/exe (readlink: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51071 tp_osd_tp ceph NOFD /proc/49547/task/51071/fd (opendir: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51072 tp_osd_tp ceph cwd unknown /proc/49547/task/51072/cwd (readlink: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51072 tp_osd_tp ceph rtd unknown /proc/49547/task/51072/root (readlink: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51072 tp_osd_tp ceph txt unknown /proc/49547/task/51072/exe (readlink: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51072 tp_osd_tp ceph NOFD /proc/49547/task/51072/fd (opendir: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51073 tp_osd_tp ceph cwd unknown /proc/49547/task/51073/cwd (readlink: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51073 tp_osd_tp ceph rtd unknown /proc/49547/task/51073/root (readlink: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51073 tp_osd_tp ceph txt unknown /proc/49547/task/51073/exe (readlink: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51073 tp_osd_tp ceph NOFD /proc/49547/task/51073/fd (opendir: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51074 tp_osd_tp ceph cwd unknown /proc/49547/task/51074/cwd (readlink: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51074 tp_osd_tp ceph rtd unknown /proc/49547/task/51074/root (readlink: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51074 tp_osd_tp ceph txt unknown /proc/49547/task/51074/exe (readlink: Permission denied) 2024-09-16T01:03:44.306 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51074 tp_osd_tp ceph NOFD /proc/49547/task/51074/fd (opendir: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51075 tp_osd_tp ceph cwd unknown /proc/49547/task/51075/cwd (readlink: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51075 tp_osd_tp ceph rtd unknown /proc/49547/task/51075/root (readlink: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51075 tp_osd_tp ceph txt unknown /proc/49547/task/51075/exe (readlink: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51075 tp_osd_tp ceph NOFD /proc/49547/task/51075/fd (opendir: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51076 tp_osd_tp ceph cwd unknown /proc/49547/task/51076/cwd (readlink: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51076 tp_osd_tp ceph rtd unknown /proc/49547/task/51076/root (readlink: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51076 tp_osd_tp ceph txt unknown /proc/49547/task/51076/exe (readlink: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51076 tp_osd_tp ceph NOFD /proc/49547/task/51076/fd (opendir: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51077 osd_srv_h ceph cwd unknown /proc/49547/task/51077/cwd (readlink: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51077 osd_srv_h ceph rtd unknown /proc/49547/task/51077/root (readlink: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51077 osd_srv_h ceph txt unknown /proc/49547/task/51077/exe (readlink: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 49547 51077 osd_srv_h ceph NOFD /proc/49547/task/51077/fd (opendir: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 50407 root cwd unknown /proc/50407/cwd (readlink: Permission denied) 2024-09-16T01:03:44.307 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 50407 root rtd unknown /proc/50407/root (readlink: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 50407 root txt unknown /proc/50407/exe (readlink: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 50407 root NOFD /proc/50407/fd (opendir: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 50437 root cwd unknown /proc/50437/cwd (readlink: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 50437 root rtd unknown /proc/50437/root (readlink: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 50437 root txt unknown /proc/50437/exe (readlink: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 50437 root NOFD /proc/50437/fd (opendir: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 53906 root cwd unknown /proc/53906/cwd (readlink: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 53906 root rtd unknown /proc/53906/root (readlink: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 53906 root txt unknown /proc/53906/exe (readlink: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 53906 root NOFD /proc/53906/fd (opendir: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 55937 root cwd unknown /proc/55937/cwd (readlink: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 55937 root rtd unknown /proc/55937/root (readlink: Permission denied) 2024-09-16T01:03:44.308 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 55937 root txt unknown /proc/55937/exe (readlink: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 55937 root NOFD /proc/55937/fd (opendir: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 56306 root cwd unknown /proc/56306/cwd (readlink: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 56306 root rtd unknown /proc/56306/root (readlink: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 56306 root txt unknown /proc/56306/exe (readlink: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 56306 root NOFD /proc/56306/fd (opendir: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 56308 root cwd unknown /proc/56308/cwd (readlink: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 56308 root rtd unknown /proc/56308/root (readlink: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 56308 root txt unknown /proc/56308/exe (readlink: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 56308 root NOFD /proc/56308/fd (opendir: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 ceph cwd unknown /proc/56310/cwd (readlink: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 ceph rtd unknown /proc/56310/root (readlink: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 ceph txt unknown /proc/56310/exe (readlink: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 ceph NOFD /proc/56310/fd (opendir: Permission denied) 2024-09-16T01:03:44.309 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56311 log ceph cwd unknown /proc/56310/task/56311/cwd (readlink: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56311 log ceph rtd unknown /proc/56310/task/56311/root (readlink: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56311 log ceph txt unknown /proc/56310/task/56311/exe (readlink: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56311 log ceph NOFD /proc/56310/task/56311/fd (opendir: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56313 msgr-work ceph cwd unknown /proc/56310/task/56313/cwd (readlink: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56313 msgr-work ceph rtd unknown /proc/56310/task/56313/root (readlink: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56313 msgr-work ceph txt unknown /proc/56310/task/56313/exe (readlink: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56313 msgr-work ceph NOFD /proc/56310/task/56313/fd (opendir: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56314 msgr-work ceph cwd unknown /proc/56310/task/56314/cwd (readlink: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56314 msgr-work ceph rtd unknown /proc/56310/task/56314/root (readlink: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56314 msgr-work ceph txt unknown /proc/56310/task/56314/exe (readlink: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56314 msgr-work ceph NOFD /proc/56310/task/56314/fd (opendir: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56315 msgr-work ceph cwd unknown /proc/56310/task/56315/cwd (readlink: Permission denied) 2024-09-16T01:03:44.310 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56315 msgr-work ceph rtd unknown /proc/56310/task/56315/root (readlink: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56315 msgr-work ceph txt unknown /proc/56310/task/56315/exe (readlink: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56315 msgr-work ceph NOFD /proc/56310/task/56315/fd (opendir: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56319 service ceph cwd unknown /proc/56310/task/56319/cwd (readlink: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56319 service ceph rtd unknown /proc/56310/task/56319/root (readlink: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56319 service ceph txt unknown /proc/56310/task/56319/exe (readlink: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56319 service ceph NOFD /proc/56310/task/56319/fd (opendir: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56320 admin_soc ceph cwd unknown /proc/56310/task/56320/cwd (readlink: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56320 admin_soc ceph rtd unknown /proc/56310/task/56320/root (readlink: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56320 admin_soc ceph txt unknown /proc/56310/task/56320/exe (readlink: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56320 admin_soc ceph NOFD /proc/56310/task/56320/fd (opendir: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56630 signal_ha ceph cwd unknown /proc/56310/task/56630/cwd (readlink: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56630 signal_ha ceph rtd unknown /proc/56310/task/56630/root (readlink: Permission denied) 2024-09-16T01:03:44.311 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56630 signal_ha ceph txt unknown /proc/56310/task/56630/exe (readlink: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56630 signal_ha ceph NOFD /proc/56310/task/56630/fd (opendir: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56631 io_contex ceph cwd unknown /proc/56310/task/56631/cwd (readlink: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56631 io_contex ceph rtd unknown /proc/56310/task/56631/root (readlink: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56631 io_contex ceph txt unknown /proc/56310/task/56631/exe (readlink: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56631 io_contex ceph NOFD /proc/56310/task/56631/fd (opendir: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56632 io_contex ceph cwd unknown /proc/56310/task/56632/cwd (readlink: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56632 io_contex ceph rtd unknown /proc/56310/task/56632/root (readlink: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56632 io_contex ceph txt unknown /proc/56310/task/56632/exe (readlink: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56632 io_contex ceph NOFD /proc/56310/task/56632/fd (opendir: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56657 OpHistory ceph cwd unknown /proc/56310/task/56657/cwd (readlink: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56657 OpHistory ceph rtd unknown /proc/56310/task/56657/root (readlink: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56657 OpHistory ceph txt unknown /proc/56310/task/56657/exe (readlink: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56657 OpHistory ceph NOFD /proc/56310/task/56657/fd (opendir: Permission denied) 2024-09-16T01:03:44.312 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56658 ceph_time ceph cwd unknown /proc/56310/task/56658/cwd (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56658 ceph_time ceph rtd unknown /proc/56310/task/56658/root (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56658 ceph_time ceph txt unknown /proc/56310/task/56658/exe (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56658 ceph_time ceph NOFD /proc/56310/task/56658/fd (opendir: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56940 ceph-osd ceph cwd unknown /proc/56310/task/56940/cwd (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56940 ceph-osd ceph rtd unknown /proc/56310/task/56940/root (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56940 ceph-osd ceph txt unknown /proc/56310/task/56940/exe (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56940 ceph-osd ceph NOFD /proc/56310/task/56940/fd (opendir: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56941 safe_time ceph cwd unknown /proc/56310/task/56941/cwd (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56941 safe_time ceph rtd unknown /proc/56310/task/56941/root (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56941 safe_time ceph txt unknown /proc/56310/task/56941/exe (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56941 safe_time ceph NOFD /proc/56310/task/56941/fd (opendir: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56943 safe_time ceph cwd unknown /proc/56310/task/56943/cwd (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56943 safe_time ceph rtd unknown /proc/56310/task/56943/root (readlink: Permission denied) 2024-09-16T01:03:44.313 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56943 safe_time ceph txt unknown /proc/56310/task/56943/exe (readlink: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56943 safe_time ceph NOFD /proc/56310/task/56943/fd (opendir: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56944 safe_time ceph cwd unknown /proc/56310/task/56944/cwd (readlink: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56944 safe_time ceph rtd unknown /proc/56310/task/56944/root (readlink: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56944 safe_time ceph txt unknown /proc/56310/task/56944/exe (readlink: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56944 safe_time ceph NOFD /proc/56310/task/56944/fd (opendir: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56945 safe_time ceph cwd unknown /proc/56310/task/56945/cwd (readlink: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56945 safe_time ceph rtd unknown /proc/56310/task/56945/root (readlink: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56945 safe_time ceph txt unknown /proc/56310/task/56945/exe (readlink: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56945 safe_time ceph NOFD /proc/56310/task/56945/fd (opendir: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56946 fn_anonym ceph cwd unknown /proc/56310/task/56946/cwd (readlink: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56946 fn_anonym ceph rtd unknown /proc/56310/task/56946/root (readlink: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56946 fn_anonym ceph txt unknown /proc/56310/task/56946/exe (readlink: Permission denied) 2024-09-16T01:03:44.314 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 56946 fn_anonym ceph NOFD /proc/56310/task/56946/fd (opendir: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57037 rocksdb:l ceph cwd unknown /proc/56310/task/57037/cwd (readlink: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57037 rocksdb:l ceph rtd unknown /proc/56310/task/57037/root (readlink: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57037 rocksdb:l ceph txt unknown /proc/56310/task/57037/exe (readlink: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57037 rocksdb:l ceph NOFD /proc/56310/task/57037/fd (opendir: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57038 rocksdb:l ceph cwd unknown /proc/56310/task/57038/cwd (readlink: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57038 rocksdb:l ceph rtd unknown /proc/56310/task/57038/root (readlink: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57038 rocksdb:l ceph txt unknown /proc/56310/task/57038/exe (readlink: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57038 rocksdb:l ceph NOFD /proc/56310/task/57038/fd (opendir: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57039 rocksdb:l ceph cwd unknown /proc/56310/task/57039/cwd (readlink: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57039 rocksdb:l ceph rtd unknown /proc/56310/task/57039/root (readlink: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57039 rocksdb:l ceph txt unknown /proc/56310/task/57039/exe (readlink: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57039 rocksdb:l ceph NOFD /proc/56310/task/57039/fd (opendir: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57040 rocksdb:h ceph cwd unknown /proc/56310/task/57040/cwd (readlink: Permission denied) 2024-09-16T01:03:44.315 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57040 rocksdb:h ceph rtd unknown /proc/56310/task/57040/root (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57040 rocksdb:h ceph txt unknown /proc/56310/task/57040/exe (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57040 rocksdb:h ceph NOFD /proc/56310/task/57040/fd (opendir: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57432 bstore_ai ceph cwd unknown /proc/56310/task/57432/cwd (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57432 bstore_ai ceph rtd unknown /proc/56310/task/57432/root (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57432 bstore_ai ceph txt unknown /proc/56310/task/57432/exe (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57432 bstore_ai ceph NOFD /proc/56310/task/57432/fd (opendir: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57622 bstore_ai ceph cwd unknown /proc/56310/task/57622/cwd (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57622 bstore_ai ceph rtd unknown /proc/56310/task/57622/root (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57622 bstore_ai ceph txt unknown /proc/56310/task/57622/exe (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57622 bstore_ai ceph NOFD /proc/56310/task/57622/fd (opendir: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57804 ceph-osd ceph cwd unknown /proc/56310/task/57804/cwd (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57804 ceph-osd ceph rtd unknown /proc/56310/task/57804/root (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57804 ceph-osd ceph txt unknown /proc/56310/task/57804/exe (readlink: Permission denied) 2024-09-16T01:03:44.316 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57804 ceph-osd ceph NOFD /proc/56310/task/57804/fd (opendir: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57805 cfin ceph cwd unknown /proc/56310/task/57805/cwd (readlink: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57805 cfin ceph rtd unknown /proc/56310/task/57805/root (readlink: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57805 cfin ceph txt unknown /proc/56310/task/57805/exe (readlink: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57805 cfin ceph NOFD /proc/56310/task/57805/fd (opendir: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57806 bstore_kv ceph cwd unknown /proc/56310/task/57806/cwd (readlink: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57806 bstore_kv ceph rtd unknown /proc/56310/task/57806/root (readlink: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57806 bstore_kv ceph txt unknown /proc/56310/task/57806/exe (readlink: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57806 bstore_kv ceph NOFD /proc/56310/task/57806/fd (opendir: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57807 bstore_kv ceph cwd unknown /proc/56310/task/57807/cwd (readlink: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57807 bstore_kv ceph rtd unknown /proc/56310/task/57807/root (readlink: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57807 bstore_kv ceph txt unknown /proc/56310/task/57807/exe (readlink: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57807 bstore_kv ceph NOFD /proc/56310/task/57807/fd (opendir: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57808 bstore_me ceph cwd unknown /proc/56310/task/57808/cwd (readlink: Permission denied) 2024-09-16T01:03:44.317 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57808 bstore_me ceph rtd unknown /proc/56310/task/57808/root (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57808 bstore_me ceph txt unknown /proc/56310/task/57808/exe (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57808 bstore_me ceph NOFD /proc/56310/task/57808/fd (opendir: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57811 ms_dispat ceph cwd unknown /proc/56310/task/57811/cwd (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57811 ms_dispat ceph rtd unknown /proc/56310/task/57811/root (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57811 ms_dispat ceph txt unknown /proc/56310/task/57811/exe (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57811 ms_dispat ceph NOFD /proc/56310/task/57811/fd (opendir: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57812 ms_local ceph cwd unknown /proc/56310/task/57812/cwd (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57812 ms_local ceph rtd unknown /proc/56310/task/57812/root (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57812 ms_local ceph txt unknown /proc/56310/task/57812/exe (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57812 ms_local ceph NOFD /proc/56310/task/57812/fd (opendir: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57813 safe_time ceph cwd unknown /proc/56310/task/57813/cwd (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57813 safe_time ceph rtd unknown /proc/56310/task/57813/root (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57813 safe_time ceph txt unknown /proc/56310/task/57813/exe (readlink: Permission denied) 2024-09-16T01:03:44.318 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57813 safe_time ceph NOFD /proc/56310/task/57813/fd (opendir: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57814 safe_time ceph cwd unknown /proc/56310/task/57814/cwd (readlink: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57814 safe_time ceph rtd unknown /proc/56310/task/57814/root (readlink: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57814 safe_time ceph txt unknown /proc/56310/task/57814/exe (readlink: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57814 safe_time ceph NOFD /proc/56310/task/57814/fd (opendir: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57815 ms_dispat ceph cwd unknown /proc/56310/task/57815/cwd (readlink: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57815 ms_dispat ceph rtd unknown /proc/56310/task/57815/root (readlink: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57815 ms_dispat ceph txt unknown /proc/56310/task/57815/exe (readlink: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57815 ms_dispat ceph NOFD /proc/56310/task/57815/fd (opendir: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57816 ms_local ceph cwd unknown /proc/56310/task/57816/cwd (readlink: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57816 ms_local ceph rtd unknown /proc/56310/task/57816/root (readlink: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57816 ms_local ceph txt unknown /proc/56310/task/57816/exe (readlink: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57816 ms_local ceph NOFD /proc/56310/task/57816/fd (opendir: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57817 ms_dispat ceph cwd unknown /proc/56310/task/57817/cwd (readlink: Permission denied) 2024-09-16T01:03:44.319 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57817 ms_dispat ceph rtd unknown /proc/56310/task/57817/root (readlink: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57817 ms_dispat ceph txt unknown /proc/56310/task/57817/exe (readlink: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57817 ms_dispat ceph NOFD /proc/56310/task/57817/fd (opendir: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57818 ms_local ceph cwd unknown /proc/56310/task/57818/cwd (readlink: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57818 ms_local ceph rtd unknown /proc/56310/task/57818/root (readlink: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57818 ms_local ceph txt unknown /proc/56310/task/57818/exe (readlink: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57818 ms_local ceph NOFD /proc/56310/task/57818/fd (opendir: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57819 ms_dispat ceph cwd unknown /proc/56310/task/57819/cwd (readlink: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57819 ms_dispat ceph rtd unknown /proc/56310/task/57819/root (readlink: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57819 ms_dispat ceph txt unknown /proc/56310/task/57819/exe (readlink: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57819 ms_dispat ceph NOFD /proc/56310/task/57819/fd (opendir: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57820 ms_local ceph cwd unknown /proc/56310/task/57820/cwd (readlink: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57820 ms_local ceph rtd unknown /proc/56310/task/57820/root (readlink: Permission denied) 2024-09-16T01:03:44.320 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57820 ms_local ceph txt unknown /proc/56310/task/57820/exe (readlink: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57820 ms_local ceph NOFD /proc/56310/task/57820/fd (opendir: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57821 ms_dispat ceph cwd unknown /proc/56310/task/57821/cwd (readlink: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57821 ms_dispat ceph rtd unknown /proc/56310/task/57821/root (readlink: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57821 ms_dispat ceph txt unknown /proc/56310/task/57821/exe (readlink: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57821 ms_dispat ceph NOFD /proc/56310/task/57821/fd (opendir: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57822 ms_local ceph cwd unknown /proc/56310/task/57822/cwd (readlink: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57822 ms_local ceph rtd unknown /proc/56310/task/57822/root (readlink: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57822 ms_local ceph txt unknown /proc/56310/task/57822/exe (readlink: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57822 ms_local ceph NOFD /proc/56310/task/57822/fd (opendir: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57823 ms_dispat ceph cwd unknown /proc/56310/task/57823/cwd (readlink: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57823 ms_dispat ceph rtd unknown /proc/56310/task/57823/root (readlink: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57823 ms_dispat ceph txt unknown /proc/56310/task/57823/exe (readlink: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57823 ms_dispat ceph NOFD /proc/56310/task/57823/fd (opendir: Permission denied) 2024-09-16T01:03:44.321 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57824 ms_local ceph cwd unknown /proc/56310/task/57824/cwd (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57824 ms_local ceph rtd unknown /proc/56310/task/57824/root (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57824 ms_local ceph txt unknown /proc/56310/task/57824/exe (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57824 ms_local ceph NOFD /proc/56310/task/57824/fd (opendir: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57825 ms_dispat ceph cwd unknown /proc/56310/task/57825/cwd (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57825 ms_dispat ceph rtd unknown /proc/56310/task/57825/root (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57825 ms_dispat ceph txt unknown /proc/56310/task/57825/exe (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57825 ms_dispat ceph NOFD /proc/56310/task/57825/fd (opendir: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57826 ms_local ceph cwd unknown /proc/56310/task/57826/cwd (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57826 ms_local ceph rtd unknown /proc/56310/task/57826/root (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57826 ms_local ceph txt unknown /proc/56310/task/57826/exe (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57826 ms_local ceph NOFD /proc/56310/task/57826/fd (opendir: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57827 fn_anonym ceph cwd unknown /proc/56310/task/57827/cwd (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57827 fn_anonym ceph rtd unknown /proc/56310/task/57827/root (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57827 fn_anonym ceph txt unknown /proc/56310/task/57827/exe (readlink: Permission denied) 2024-09-16T01:03:44.322 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57827 fn_anonym ceph NOFD /proc/56310/task/57827/fd (opendir: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57828 finisher ceph cwd unknown /proc/56310/task/57828/cwd (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57828 finisher ceph rtd unknown /proc/56310/task/57828/root (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57828 finisher ceph txt unknown /proc/56310/task/57828/exe (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57828 finisher ceph NOFD /proc/56310/task/57828/fd (opendir: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57829 safe_time ceph cwd unknown /proc/56310/task/57829/cwd (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57829 safe_time ceph rtd unknown /proc/56310/task/57829/root (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57829 safe_time ceph txt unknown /proc/56310/task/57829/exe (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57829 safe_time ceph NOFD /proc/56310/task/57829/fd (opendir: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57830 safe_time ceph cwd unknown /proc/56310/task/57830/cwd (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57830 safe_time ceph rtd unknown /proc/56310/task/57830/root (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57830 safe_time ceph txt unknown /proc/56310/task/57830/exe (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57830 safe_time ceph NOFD /proc/56310/task/57830/fd (opendir: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57831 ceph-osd ceph cwd unknown /proc/56310/task/57831/cwd (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57831 ceph-osd ceph rtd unknown /proc/56310/task/57831/root (readlink: Permission denied) 2024-09-16T01:03:44.323 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57831 ceph-osd ceph txt unknown /proc/56310/task/57831/exe (readlink: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57831 ceph-osd ceph NOFD /proc/56310/task/57831/fd (opendir: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57832 osd_srv_a ceph cwd unknown /proc/56310/task/57832/cwd (readlink: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57832 osd_srv_a ceph rtd unknown /proc/56310/task/57832/root (readlink: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57832 osd_srv_a ceph txt unknown /proc/56310/task/57832/exe (readlink: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57832 osd_srv_a ceph NOFD /proc/56310/task/57832/fd (opendir: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57833 tp_osd_tp ceph cwd unknown /proc/56310/task/57833/cwd (readlink: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57833 tp_osd_tp ceph rtd unknown /proc/56310/task/57833/root (readlink: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57833 tp_osd_tp ceph txt unknown /proc/56310/task/57833/exe (readlink: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57833 tp_osd_tp ceph NOFD /proc/56310/task/57833/fd (opendir: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57834 tp_osd_tp ceph cwd unknown /proc/56310/task/57834/cwd (readlink: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57834 tp_osd_tp ceph rtd unknown /proc/56310/task/57834/root (readlink: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57834 tp_osd_tp ceph txt unknown /proc/56310/task/57834/exe (readlink: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57834 tp_osd_tp ceph NOFD /proc/56310/task/57834/fd (opendir: Permission denied) 2024-09-16T01:03:44.324 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57835 tp_osd_tp ceph cwd unknown /proc/56310/task/57835/cwd (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57835 tp_osd_tp ceph rtd unknown /proc/56310/task/57835/root (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57835 tp_osd_tp ceph txt unknown /proc/56310/task/57835/exe (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57835 tp_osd_tp ceph NOFD /proc/56310/task/57835/fd (opendir: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57836 tp_osd_tp ceph cwd unknown /proc/56310/task/57836/cwd (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57836 tp_osd_tp ceph rtd unknown /proc/56310/task/57836/root (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57836 tp_osd_tp ceph txt unknown /proc/56310/task/57836/exe (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57836 tp_osd_tp ceph NOFD /proc/56310/task/57836/fd (opendir: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57837 tp_osd_tp ceph cwd unknown /proc/56310/task/57837/cwd (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57837 tp_osd_tp ceph rtd unknown /proc/56310/task/57837/root (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57837 tp_osd_tp ceph txt unknown /proc/56310/task/57837/exe (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57837 tp_osd_tp ceph NOFD /proc/56310/task/57837/fd (opendir: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57838 tp_osd_tp ceph cwd unknown /proc/56310/task/57838/cwd (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57838 tp_osd_tp ceph rtd unknown /proc/56310/task/57838/root (readlink: Permission denied) 2024-09-16T01:03:44.325 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57838 tp_osd_tp ceph txt unknown /proc/56310/task/57838/exe (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57838 tp_osd_tp ceph NOFD /proc/56310/task/57838/fd (opendir: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57839 tp_osd_tp ceph cwd unknown /proc/56310/task/57839/cwd (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57839 tp_osd_tp ceph rtd unknown /proc/56310/task/57839/root (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57839 tp_osd_tp ceph txt unknown /proc/56310/task/57839/exe (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57839 tp_osd_tp ceph NOFD /proc/56310/task/57839/fd (opendir: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57840 tp_osd_tp ceph cwd unknown /proc/56310/task/57840/cwd (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57840 tp_osd_tp ceph rtd unknown /proc/56310/task/57840/root (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57840 tp_osd_tp ceph txt unknown /proc/56310/task/57840/exe (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57840 tp_osd_tp ceph NOFD /proc/56310/task/57840/fd (opendir: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57841 tp_osd_tp ceph cwd unknown /proc/56310/task/57841/cwd (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57841 tp_osd_tp ceph rtd unknown /proc/56310/task/57841/root (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57841 tp_osd_tp ceph txt unknown /proc/56310/task/57841/exe (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57841 tp_osd_tp ceph NOFD /proc/56310/task/57841/fd (opendir: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57842 tp_osd_tp ceph cwd unknown /proc/56310/task/57842/cwd (readlink: Permission denied) 2024-09-16T01:03:44.326 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57842 tp_osd_tp ceph rtd unknown /proc/56310/task/57842/root (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57842 tp_osd_tp ceph txt unknown /proc/56310/task/57842/exe (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57842 tp_osd_tp ceph NOFD /proc/56310/task/57842/fd (opendir: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57843 tp_osd_tp ceph cwd unknown /proc/56310/task/57843/cwd (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57843 tp_osd_tp ceph rtd unknown /proc/56310/task/57843/root (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57843 tp_osd_tp ceph txt unknown /proc/56310/task/57843/exe (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57843 tp_osd_tp ceph NOFD /proc/56310/task/57843/fd (opendir: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57844 tp_osd_tp ceph cwd unknown /proc/56310/task/57844/cwd (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57844 tp_osd_tp ceph rtd unknown /proc/56310/task/57844/root (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57844 tp_osd_tp ceph txt unknown /proc/56310/task/57844/exe (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57844 tp_osd_tp ceph NOFD /proc/56310/task/57844/fd (opendir: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57845 tp_osd_tp ceph cwd unknown /proc/56310/task/57845/cwd (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57845 tp_osd_tp ceph rtd unknown /proc/56310/task/57845/root (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57845 tp_osd_tp ceph txt unknown /proc/56310/task/57845/exe (readlink: Permission denied) 2024-09-16T01:03:44.327 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57845 tp_osd_tp ceph NOFD /proc/56310/task/57845/fd (opendir: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57846 tp_osd_tp ceph cwd unknown /proc/56310/task/57846/cwd (readlink: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57846 tp_osd_tp ceph rtd unknown /proc/56310/task/57846/root (readlink: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57846 tp_osd_tp ceph txt unknown /proc/56310/task/57846/exe (readlink: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57846 tp_osd_tp ceph NOFD /proc/56310/task/57846/fd (opendir: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57847 tp_osd_tp ceph cwd unknown /proc/56310/task/57847/cwd (readlink: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57847 tp_osd_tp ceph rtd unknown /proc/56310/task/57847/root (readlink: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57847 tp_osd_tp ceph txt unknown /proc/56310/task/57847/exe (readlink: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57847 tp_osd_tp ceph NOFD /proc/56310/task/57847/fd (opendir: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57848 tp_osd_tp ceph cwd unknown /proc/56310/task/57848/cwd (readlink: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57848 tp_osd_tp ceph rtd unknown /proc/56310/task/57848/root (readlink: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57848 tp_osd_tp ceph txt unknown /proc/56310/task/57848/exe (readlink: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57848 tp_osd_tp ceph NOFD /proc/56310/task/57848/fd (opendir: Permission denied) 2024-09-16T01:03:44.328 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57849 osd_srv_h ceph cwd unknown /proc/56310/task/57849/cwd (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57849 osd_srv_h ceph rtd unknown /proc/56310/task/57849/root (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57849 osd_srv_h ceph txt unknown /proc/56310/task/57849/exe (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 56310 57849 osd_srv_h ceph NOFD /proc/56310/task/57849/fd (opendir: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 56954 root cwd unknown /proc/56954/cwd (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 56954 root rtd unknown /proc/56954/root (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 56954 root txt unknown /proc/56954/exe (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 56954 root NOFD /proc/56954/fd (opendir: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 56978 root cwd unknown /proc/56978/cwd (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 56978 root rtd unknown /proc/56978/root (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 56978 root txt unknown /proc/56978/exe (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 56978 root NOFD /proc/56978/fd (opendir: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 62820 root cwd unknown /proc/62820/cwd (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 62820 root rtd unknown /proc/62820/root (readlink: Permission denied) 2024-09-16T01:03:44.329 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 62820 root txt unknown /proc/62820/exe (readlink: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 62820 root NOFD /proc/62820/fd (opendir: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 62822 root cwd unknown /proc/62822/cwd (readlink: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 62822 root rtd unknown /proc/62822/root (readlink: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 62822 root txt unknown /proc/62822/exe (readlink: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 62822 root NOFD /proc/62822/fd (opendir: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 ceph cwd unknown /proc/62825/cwd (readlink: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 ceph rtd unknown /proc/62825/root (readlink: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 ceph txt unknown /proc/62825/exe (readlink: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 ceph NOFD /proc/62825/fd (opendir: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62826 log ceph cwd unknown /proc/62825/task/62826/cwd (readlink: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62826 log ceph rtd unknown /proc/62825/task/62826/root (readlink: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62826 log ceph txt unknown /proc/62825/task/62826/exe (readlink: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62826 log ceph NOFD /proc/62825/task/62826/fd (opendir: Permission denied) 2024-09-16T01:03:44.330 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62828 msgr-work ceph cwd unknown /proc/62825/task/62828/cwd (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62828 msgr-work ceph rtd unknown /proc/62825/task/62828/root (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62828 msgr-work ceph txt unknown /proc/62825/task/62828/exe (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62828 msgr-work ceph NOFD /proc/62825/task/62828/fd (opendir: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62829 msgr-work ceph cwd unknown /proc/62825/task/62829/cwd (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62829 msgr-work ceph rtd unknown /proc/62825/task/62829/root (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62829 msgr-work ceph txt unknown /proc/62825/task/62829/exe (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62829 msgr-work ceph NOFD /proc/62825/task/62829/fd (opendir: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62830 msgr-work ceph cwd unknown /proc/62825/task/62830/cwd (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62830 msgr-work ceph rtd unknown /proc/62825/task/62830/root (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62830 msgr-work ceph txt unknown /proc/62825/task/62830/exe (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62830 msgr-work ceph NOFD /proc/62825/task/62830/fd (opendir: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62834 service ceph cwd unknown /proc/62825/task/62834/cwd (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62834 service ceph rtd unknown /proc/62825/task/62834/root (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62834 service ceph txt unknown /proc/62825/task/62834/exe (readlink: Permission denied) 2024-09-16T01:03:44.331 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62834 service ceph NOFD /proc/62825/task/62834/fd (opendir: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62835 admin_soc ceph cwd unknown /proc/62825/task/62835/cwd (readlink: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62835 admin_soc ceph rtd unknown /proc/62825/task/62835/root (readlink: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62835 admin_soc ceph txt unknown /proc/62825/task/62835/exe (readlink: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 62835 admin_soc ceph NOFD /proc/62825/task/62835/fd (opendir: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63165 signal_ha ceph cwd unknown /proc/62825/task/63165/cwd (readlink: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63165 signal_ha ceph rtd unknown /proc/62825/task/63165/root (readlink: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63165 signal_ha ceph txt unknown /proc/62825/task/63165/exe (readlink: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63165 signal_ha ceph NOFD /proc/62825/task/63165/fd (opendir: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63166 io_contex ceph cwd unknown /proc/62825/task/63166/cwd (readlink: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63166 io_contex ceph rtd unknown /proc/62825/task/63166/root (readlink: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63166 io_contex ceph txt unknown /proc/62825/task/63166/exe (readlink: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63166 io_contex ceph NOFD /proc/62825/task/63166/fd (opendir: Permission denied) 2024-09-16T01:03:44.332 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63167 io_contex ceph cwd unknown /proc/62825/task/63167/cwd (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63167 io_contex ceph rtd unknown /proc/62825/task/63167/root (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63167 io_contex ceph txt unknown /proc/62825/task/63167/exe (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63167 io_contex ceph NOFD /proc/62825/task/63167/fd (opendir: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63187 OpHistory ceph cwd unknown /proc/62825/task/63187/cwd (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63187 OpHistory ceph rtd unknown /proc/62825/task/63187/root (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63187 OpHistory ceph txt unknown /proc/62825/task/63187/exe (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63187 OpHistory ceph NOFD /proc/62825/task/63187/fd (opendir: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63188 ceph_time ceph cwd unknown /proc/62825/task/63188/cwd (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63188 ceph_time ceph rtd unknown /proc/62825/task/63188/root (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63188 ceph_time ceph txt unknown /proc/62825/task/63188/exe (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63188 ceph_time ceph NOFD /proc/62825/task/63188/fd (opendir: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63198 ceph-osd ceph cwd unknown /proc/62825/task/63198/cwd (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63198 ceph-osd ceph rtd unknown /proc/62825/task/63198/root (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63198 ceph-osd ceph txt unknown /proc/62825/task/63198/exe (readlink: Permission denied) 2024-09-16T01:03:44.333 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63198 ceph-osd ceph NOFD /proc/62825/task/63198/fd (opendir: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63239 ceph-osd ceph cwd unknown /proc/62825/task/63239/cwd (readlink: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63239 ceph-osd ceph rtd unknown /proc/62825/task/63239/root (readlink: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63239 ceph-osd ceph txt unknown /proc/62825/task/63239/exe (readlink: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63239 ceph-osd ceph NOFD /proc/62825/task/63239/fd (opendir: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63319 ceph-osd ceph cwd unknown /proc/62825/task/63319/cwd (readlink: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63319 ceph-osd ceph rtd unknown /proc/62825/task/63319/root (readlink: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63319 ceph-osd ceph txt unknown /proc/62825/task/63319/exe (readlink: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63319 ceph-osd ceph NOFD /proc/62825/task/63319/fd (opendir: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63375 ceph-osd ceph cwd unknown /proc/62825/task/63375/cwd (readlink: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63375 ceph-osd ceph rtd unknown /proc/62825/task/63375/root (readlink: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63375 ceph-osd ceph txt unknown /proc/62825/task/63375/exe (readlink: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63375 ceph-osd ceph NOFD /proc/62825/task/63375/fd (opendir: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63381 ceph-osd ceph cwd unknown /proc/62825/task/63381/cwd (readlink: Permission denied) 2024-09-16T01:03:44.334 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63381 ceph-osd ceph rtd unknown /proc/62825/task/63381/root (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63381 ceph-osd ceph txt unknown /proc/62825/task/63381/exe (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63381 ceph-osd ceph NOFD /proc/62825/task/63381/fd (opendir: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63465 ceph-osd ceph cwd unknown /proc/62825/task/63465/cwd (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63465 ceph-osd ceph rtd unknown /proc/62825/task/63465/root (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63465 ceph-osd ceph txt unknown /proc/62825/task/63465/exe (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63465 ceph-osd ceph NOFD /proc/62825/task/63465/fd (opendir: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63508 ceph-osd ceph cwd unknown /proc/62825/task/63508/cwd (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63508 ceph-osd ceph rtd unknown /proc/62825/task/63508/root (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63508 ceph-osd ceph txt unknown /proc/62825/task/63508/exe (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63508 ceph-osd ceph NOFD /proc/62825/task/63508/fd (opendir: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63511 ceph-osd ceph cwd unknown /proc/62825/task/63511/cwd (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63511 ceph-osd ceph rtd unknown /proc/62825/task/63511/root (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63511 ceph-osd ceph txt unknown /proc/62825/task/63511/exe (readlink: Permission denied) 2024-09-16T01:03:44.335 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63511 ceph-osd ceph NOFD /proc/62825/task/63511/fd (opendir: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63513 ceph-osd ceph cwd unknown /proc/62825/task/63513/cwd (readlink: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63513 ceph-osd ceph rtd unknown /proc/62825/task/63513/root (readlink: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63513 ceph-osd ceph txt unknown /proc/62825/task/63513/exe (readlink: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63513 ceph-osd ceph NOFD /proc/62825/task/63513/fd (opendir: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63514 safe_time ceph cwd unknown /proc/62825/task/63514/cwd (readlink: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63514 safe_time ceph rtd unknown /proc/62825/task/63514/root (readlink: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63514 safe_time ceph txt unknown /proc/62825/task/63514/exe (readlink: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63514 safe_time ceph NOFD /proc/62825/task/63514/fd (opendir: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63515 safe_time ceph cwd unknown /proc/62825/task/63515/cwd (readlink: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63515 safe_time ceph rtd unknown /proc/62825/task/63515/root (readlink: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63515 safe_time ceph txt unknown /proc/62825/task/63515/exe (readlink: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63515 safe_time ceph NOFD /proc/62825/task/63515/fd (opendir: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63516 safe_time ceph cwd unknown /proc/62825/task/63516/cwd (readlink: Permission denied) 2024-09-16T01:03:44.336 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63516 safe_time ceph rtd unknown /proc/62825/task/63516/root (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63516 safe_time ceph txt unknown /proc/62825/task/63516/exe (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63516 safe_time ceph NOFD /proc/62825/task/63516/fd (opendir: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63517 safe_time ceph cwd unknown /proc/62825/task/63517/cwd (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63517 safe_time ceph rtd unknown /proc/62825/task/63517/root (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63517 safe_time ceph txt unknown /proc/62825/task/63517/exe (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63517 safe_time ceph NOFD /proc/62825/task/63517/fd (opendir: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63518 fn_anonym ceph cwd unknown /proc/62825/task/63518/cwd (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63518 fn_anonym ceph rtd unknown /proc/62825/task/63518/root (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63518 fn_anonym ceph txt unknown /proc/62825/task/63518/exe (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63518 fn_anonym ceph NOFD /proc/62825/task/63518/fd (opendir: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63563 rocksdb:l ceph cwd unknown /proc/62825/task/63563/cwd (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63563 rocksdb:l ceph rtd unknown /proc/62825/task/63563/root (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63563 rocksdb:l ceph txt unknown /proc/62825/task/63563/exe (readlink: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63563 rocksdb:l ceph NOFD /proc/62825/task/63563/fd (opendir: Permission denied) 2024-09-16T01:03:44.337 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63564 rocksdb:l ceph cwd unknown /proc/62825/task/63564/cwd (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63564 rocksdb:l ceph rtd unknown /proc/62825/task/63564/root (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63564 rocksdb:l ceph txt unknown /proc/62825/task/63564/exe (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63564 rocksdb:l ceph NOFD /proc/62825/task/63564/fd (opendir: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63565 rocksdb:l ceph cwd unknown /proc/62825/task/63565/cwd (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63565 rocksdb:l ceph rtd unknown /proc/62825/task/63565/root (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63565 rocksdb:l ceph txt unknown /proc/62825/task/63565/exe (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63565 rocksdb:l ceph NOFD /proc/62825/task/63565/fd (opendir: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63566 rocksdb:h ceph cwd unknown /proc/62825/task/63566/cwd (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63566 rocksdb:h ceph rtd unknown /proc/62825/task/63566/root (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63566 rocksdb:h ceph txt unknown /proc/62825/task/63566/exe (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63566 rocksdb:h ceph NOFD /proc/62825/task/63566/fd (opendir: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63975 bstore_ai ceph cwd unknown /proc/62825/task/63975/cwd (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63975 bstore_ai ceph rtd unknown /proc/62825/task/63975/root (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63975 bstore_ai ceph txt unknown /proc/62825/task/63975/exe (readlink: Permission denied) 2024-09-16T01:03:44.338 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 63975 bstore_ai ceph NOFD /proc/62825/task/63975/fd (opendir: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64167 bstore_ai ceph cwd unknown /proc/62825/task/64167/cwd (readlink: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64167 bstore_ai ceph rtd unknown /proc/62825/task/64167/root (readlink: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64167 bstore_ai ceph txt unknown /proc/62825/task/64167/exe (readlink: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64167 bstore_ai ceph NOFD /proc/62825/task/64167/fd (opendir: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64350 ceph-osd ceph cwd unknown /proc/62825/task/64350/cwd (readlink: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64350 ceph-osd ceph rtd unknown /proc/62825/task/64350/root (readlink: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64350 ceph-osd ceph txt unknown /proc/62825/task/64350/exe (readlink: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64350 ceph-osd ceph NOFD /proc/62825/task/64350/fd (opendir: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64351 cfin ceph cwd unknown /proc/62825/task/64351/cwd (readlink: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64351 cfin ceph rtd unknown /proc/62825/task/64351/root (readlink: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64351 cfin ceph txt unknown /proc/62825/task/64351/exe (readlink: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64351 cfin ceph NOFD /proc/62825/task/64351/fd (opendir: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64352 bstore_kv ceph cwd unknown /proc/62825/task/64352/cwd (readlink: Permission denied) 2024-09-16T01:03:44.339 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64352 bstore_kv ceph rtd unknown /proc/62825/task/64352/root (readlink: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64352 bstore_kv ceph txt unknown /proc/62825/task/64352/exe (readlink: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64352 bstore_kv ceph NOFD /proc/62825/task/64352/fd (opendir: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64353 bstore_kv ceph cwd unknown /proc/62825/task/64353/cwd (readlink: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64353 bstore_kv ceph rtd unknown /proc/62825/task/64353/root (readlink: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64353 bstore_kv ceph txt unknown /proc/62825/task/64353/exe (readlink: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64353 bstore_kv ceph NOFD /proc/62825/task/64353/fd (opendir: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64354 bstore_me ceph cwd unknown /proc/62825/task/64354/cwd (readlink: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64354 bstore_me ceph rtd unknown /proc/62825/task/64354/root (readlink: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64354 bstore_me ceph txt unknown /proc/62825/task/64354/exe (readlink: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64354 bstore_me ceph NOFD /proc/62825/task/64354/fd (opendir: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64355 ms_dispat ceph cwd unknown /proc/62825/task/64355/cwd (readlink: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64355 ms_dispat ceph rtd unknown /proc/62825/task/64355/root (readlink: Permission denied) 2024-09-16T01:03:44.340 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64355 ms_dispat ceph txt unknown /proc/62825/task/64355/exe (readlink: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64355 ms_dispat ceph NOFD /proc/62825/task/64355/fd (opendir: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64356 ms_local ceph cwd unknown /proc/62825/task/64356/cwd (readlink: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64356 ms_local ceph rtd unknown /proc/62825/task/64356/root (readlink: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64356 ms_local ceph txt unknown /proc/62825/task/64356/exe (readlink: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64356 ms_local ceph NOFD /proc/62825/task/64356/fd (opendir: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64357 safe_time ceph cwd unknown /proc/62825/task/64357/cwd (readlink: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64357 safe_time ceph rtd unknown /proc/62825/task/64357/root (readlink: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64357 safe_time ceph txt unknown /proc/62825/task/64357/exe (readlink: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64357 safe_time ceph NOFD /proc/62825/task/64357/fd (opendir: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64358 safe_time ceph cwd unknown /proc/62825/task/64358/cwd (readlink: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64358 safe_time ceph rtd unknown /proc/62825/task/64358/root (readlink: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64358 safe_time ceph txt unknown /proc/62825/task/64358/exe (readlink: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64358 safe_time ceph NOFD /proc/62825/task/64358/fd (opendir: Permission denied) 2024-09-16T01:03:44.341 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64359 ms_dispat ceph cwd unknown /proc/62825/task/64359/cwd (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64359 ms_dispat ceph rtd unknown /proc/62825/task/64359/root (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64359 ms_dispat ceph txt unknown /proc/62825/task/64359/exe (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64359 ms_dispat ceph NOFD /proc/62825/task/64359/fd (opendir: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64360 ms_local ceph cwd unknown /proc/62825/task/64360/cwd (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64360 ms_local ceph rtd unknown /proc/62825/task/64360/root (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64360 ms_local ceph txt unknown /proc/62825/task/64360/exe (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64360 ms_local ceph NOFD /proc/62825/task/64360/fd (opendir: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64361 ms_dispat ceph cwd unknown /proc/62825/task/64361/cwd (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64361 ms_dispat ceph rtd unknown /proc/62825/task/64361/root (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64361 ms_dispat ceph txt unknown /proc/62825/task/64361/exe (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64361 ms_dispat ceph NOFD /proc/62825/task/64361/fd (opendir: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64362 ms_local ceph cwd unknown /proc/62825/task/64362/cwd (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64362 ms_local ceph rtd unknown /proc/62825/task/64362/root (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64362 ms_local ceph txt unknown /proc/62825/task/64362/exe (readlink: Permission denied) 2024-09-16T01:03:44.342 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64362 ms_local ceph NOFD /proc/62825/task/64362/fd (opendir: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64363 ms_dispat ceph cwd unknown /proc/62825/task/64363/cwd (readlink: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64363 ms_dispat ceph rtd unknown /proc/62825/task/64363/root (readlink: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64363 ms_dispat ceph txt unknown /proc/62825/task/64363/exe (readlink: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64363 ms_dispat ceph NOFD /proc/62825/task/64363/fd (opendir: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64364 ms_local ceph cwd unknown /proc/62825/task/64364/cwd (readlink: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64364 ms_local ceph rtd unknown /proc/62825/task/64364/root (readlink: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64364 ms_local ceph txt unknown /proc/62825/task/64364/exe (readlink: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64364 ms_local ceph NOFD /proc/62825/task/64364/fd (opendir: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64365 ms_dispat ceph cwd unknown /proc/62825/task/64365/cwd (readlink: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64365 ms_dispat ceph rtd unknown /proc/62825/task/64365/root (readlink: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64365 ms_dispat ceph txt unknown /proc/62825/task/64365/exe (readlink: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64365 ms_dispat ceph NOFD /proc/62825/task/64365/fd (opendir: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64366 ms_local ceph cwd unknown /proc/62825/task/64366/cwd (readlink: Permission denied) 2024-09-16T01:03:44.343 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64366 ms_local ceph rtd unknown /proc/62825/task/64366/root (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64366 ms_local ceph txt unknown /proc/62825/task/64366/exe (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64366 ms_local ceph NOFD /proc/62825/task/64366/fd (opendir: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64367 ms_dispat ceph cwd unknown /proc/62825/task/64367/cwd (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64367 ms_dispat ceph rtd unknown /proc/62825/task/64367/root (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64367 ms_dispat ceph txt unknown /proc/62825/task/64367/exe (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64367 ms_dispat ceph NOFD /proc/62825/task/64367/fd (opendir: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64368 ms_local ceph cwd unknown /proc/62825/task/64368/cwd (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64368 ms_local ceph rtd unknown /proc/62825/task/64368/root (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64368 ms_local ceph txt unknown /proc/62825/task/64368/exe (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64368 ms_local ceph NOFD /proc/62825/task/64368/fd (opendir: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64369 ms_dispat ceph cwd unknown /proc/62825/task/64369/cwd (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64369 ms_dispat ceph rtd unknown /proc/62825/task/64369/root (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64369 ms_dispat ceph txt unknown /proc/62825/task/64369/exe (readlink: Permission denied) 2024-09-16T01:03:44.344 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64369 ms_dispat ceph NOFD /proc/62825/task/64369/fd (opendir: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64370 ms_local ceph cwd unknown /proc/62825/task/64370/cwd (readlink: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64370 ms_local ceph rtd unknown /proc/62825/task/64370/root (readlink: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64370 ms_local ceph txt unknown /proc/62825/task/64370/exe (readlink: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64370 ms_local ceph NOFD /proc/62825/task/64370/fd (opendir: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64371 fn_anonym ceph cwd unknown /proc/62825/task/64371/cwd (readlink: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64371 fn_anonym ceph rtd unknown /proc/62825/task/64371/root (readlink: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64371 fn_anonym ceph txt unknown /proc/62825/task/64371/exe (readlink: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64371 fn_anonym ceph NOFD /proc/62825/task/64371/fd (opendir: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64372 finisher ceph cwd unknown /proc/62825/task/64372/cwd (readlink: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64372 finisher ceph rtd unknown /proc/62825/task/64372/root (readlink: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64372 finisher ceph txt unknown /proc/62825/task/64372/exe (readlink: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64372 finisher ceph NOFD /proc/62825/task/64372/fd (opendir: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64373 safe_time ceph cwd unknown /proc/62825/task/64373/cwd (readlink: Permission denied) 2024-09-16T01:03:44.345 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64373 safe_time ceph rtd unknown /proc/62825/task/64373/root (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64373 safe_time ceph txt unknown /proc/62825/task/64373/exe (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64373 safe_time ceph NOFD /proc/62825/task/64373/fd (opendir: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64374 safe_time ceph cwd unknown /proc/62825/task/64374/cwd (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64374 safe_time ceph rtd unknown /proc/62825/task/64374/root (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64374 safe_time ceph txt unknown /proc/62825/task/64374/exe (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64374 safe_time ceph NOFD /proc/62825/task/64374/fd (opendir: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64375 ceph-osd ceph cwd unknown /proc/62825/task/64375/cwd (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64375 ceph-osd ceph rtd unknown /proc/62825/task/64375/root (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64375 ceph-osd ceph txt unknown /proc/62825/task/64375/exe (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64375 ceph-osd ceph NOFD /proc/62825/task/64375/fd (opendir: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64376 osd_srv_a ceph cwd unknown /proc/62825/task/64376/cwd (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64376 osd_srv_a ceph rtd unknown /proc/62825/task/64376/root (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64376 osd_srv_a ceph txt unknown /proc/62825/task/64376/exe (readlink: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64376 osd_srv_a ceph NOFD /proc/62825/task/64376/fd (opendir: Permission denied) 2024-09-16T01:03:44.346 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64377 tp_osd_tp ceph cwd unknown /proc/62825/task/64377/cwd (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64377 tp_osd_tp ceph rtd unknown /proc/62825/task/64377/root (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64377 tp_osd_tp ceph txt unknown /proc/62825/task/64377/exe (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64377 tp_osd_tp ceph NOFD /proc/62825/task/64377/fd (opendir: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64378 tp_osd_tp ceph cwd unknown /proc/62825/task/64378/cwd (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64378 tp_osd_tp ceph rtd unknown /proc/62825/task/64378/root (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64378 tp_osd_tp ceph txt unknown /proc/62825/task/64378/exe (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64378 tp_osd_tp ceph NOFD /proc/62825/task/64378/fd (opendir: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64379 tp_osd_tp ceph cwd unknown /proc/62825/task/64379/cwd (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64379 tp_osd_tp ceph rtd unknown /proc/62825/task/64379/root (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64379 tp_osd_tp ceph txt unknown /proc/62825/task/64379/exe (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64379 tp_osd_tp ceph NOFD /proc/62825/task/64379/fd (opendir: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64380 tp_osd_tp ceph cwd unknown /proc/62825/task/64380/cwd (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64380 tp_osd_tp ceph rtd unknown /proc/62825/task/64380/root (readlink: Permission denied) 2024-09-16T01:03:44.347 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64380 tp_osd_tp ceph txt unknown /proc/62825/task/64380/exe (readlink: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64380 tp_osd_tp ceph NOFD /proc/62825/task/64380/fd (opendir: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64381 tp_osd_tp ceph cwd unknown /proc/62825/task/64381/cwd (readlink: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64381 tp_osd_tp ceph rtd unknown /proc/62825/task/64381/root (readlink: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64381 tp_osd_tp ceph txt unknown /proc/62825/task/64381/exe (readlink: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64381 tp_osd_tp ceph NOFD /proc/62825/task/64381/fd (opendir: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64382 tp_osd_tp ceph cwd unknown /proc/62825/task/64382/cwd (readlink: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64382 tp_osd_tp ceph rtd unknown /proc/62825/task/64382/root (readlink: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64382 tp_osd_tp ceph txt unknown /proc/62825/task/64382/exe (readlink: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64382 tp_osd_tp ceph NOFD /proc/62825/task/64382/fd (opendir: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64383 tp_osd_tp ceph cwd unknown /proc/62825/task/64383/cwd (readlink: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64383 tp_osd_tp ceph rtd unknown /proc/62825/task/64383/root (readlink: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64383 tp_osd_tp ceph txt unknown /proc/62825/task/64383/exe (readlink: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64383 tp_osd_tp ceph NOFD /proc/62825/task/64383/fd (opendir: Permission denied) 2024-09-16T01:03:44.348 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64384 tp_osd_tp ceph cwd unknown /proc/62825/task/64384/cwd (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64384 tp_osd_tp ceph rtd unknown /proc/62825/task/64384/root (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64384 tp_osd_tp ceph txt unknown /proc/62825/task/64384/exe (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64384 tp_osd_tp ceph NOFD /proc/62825/task/64384/fd (opendir: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64385 tp_osd_tp ceph cwd unknown /proc/62825/task/64385/cwd (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64385 tp_osd_tp ceph rtd unknown /proc/62825/task/64385/root (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64385 tp_osd_tp ceph txt unknown /proc/62825/task/64385/exe (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64385 tp_osd_tp ceph NOFD /proc/62825/task/64385/fd (opendir: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64386 tp_osd_tp ceph cwd unknown /proc/62825/task/64386/cwd (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64386 tp_osd_tp ceph rtd unknown /proc/62825/task/64386/root (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64386 tp_osd_tp ceph txt unknown /proc/62825/task/64386/exe (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64386 tp_osd_tp ceph NOFD /proc/62825/task/64386/fd (opendir: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64387 tp_osd_tp ceph cwd unknown /proc/62825/task/64387/cwd (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64387 tp_osd_tp ceph rtd unknown /proc/62825/task/64387/root (readlink: Permission denied) 2024-09-16T01:03:44.349 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64387 tp_osd_tp ceph txt unknown /proc/62825/task/64387/exe (readlink: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64387 tp_osd_tp ceph NOFD /proc/62825/task/64387/fd (opendir: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64388 tp_osd_tp ceph cwd unknown /proc/62825/task/64388/cwd (readlink: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64388 tp_osd_tp ceph rtd unknown /proc/62825/task/64388/root (readlink: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64388 tp_osd_tp ceph txt unknown /proc/62825/task/64388/exe (readlink: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64388 tp_osd_tp ceph NOFD /proc/62825/task/64388/fd (opendir: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64389 tp_osd_tp ceph cwd unknown /proc/62825/task/64389/cwd (readlink: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64389 tp_osd_tp ceph rtd unknown /proc/62825/task/64389/root (readlink: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64389 tp_osd_tp ceph txt unknown /proc/62825/task/64389/exe (readlink: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64389 tp_osd_tp ceph NOFD /proc/62825/task/64389/fd (opendir: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64390 tp_osd_tp ceph cwd unknown /proc/62825/task/64390/cwd (readlink: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64390 tp_osd_tp ceph rtd unknown /proc/62825/task/64390/root (readlink: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64390 tp_osd_tp ceph txt unknown /proc/62825/task/64390/exe (readlink: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64390 tp_osd_tp ceph NOFD /proc/62825/task/64390/fd (opendir: Permission denied) 2024-09-16T01:03:44.350 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64391 tp_osd_tp ceph cwd unknown /proc/62825/task/64391/cwd (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64391 tp_osd_tp ceph rtd unknown /proc/62825/task/64391/root (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64391 tp_osd_tp ceph txt unknown /proc/62825/task/64391/exe (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64391 tp_osd_tp ceph NOFD /proc/62825/task/64391/fd (opendir: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64392 tp_osd_tp ceph cwd unknown /proc/62825/task/64392/cwd (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64392 tp_osd_tp ceph rtd unknown /proc/62825/task/64392/root (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64392 tp_osd_tp ceph txt unknown /proc/62825/task/64392/exe (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64392 tp_osd_tp ceph NOFD /proc/62825/task/64392/fd (opendir: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64393 osd_srv_h ceph cwd unknown /proc/62825/task/64393/cwd (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64393 osd_srv_h ceph rtd unknown /proc/62825/task/64393/root (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64393 osd_srv_h ceph txt unknown /proc/62825/task/64393/exe (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-osd 62825 64393 osd_srv_h ceph NOFD /proc/62825/task/64393/fd (opendir: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 63525 root cwd unknown /proc/63525/cwd (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 63525 root rtd unknown /proc/63525/root (readlink: Permission denied) 2024-09-16T01:03:44.351 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 63525 root txt unknown /proc/63525/exe (readlink: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 63525 root NOFD /proc/63525/fd (opendir: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 63543 root cwd unknown /proc/63543/cwd (readlink: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 63543 root rtd unknown /proc/63543/root (readlink: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 63543 root txt unknown /proc/63543/exe (readlink: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 63543 root NOFD /proc/63543/fd (opendir: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 66803 root cwd unknown /proc/66803/cwd (readlink: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 66803 root rtd unknown /proc/66803/root (readlink: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 66803 root txt unknown /proc/66803/exe (readlink: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 66803 root NOFD /proc/66803/fd (opendir: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 66804 root cwd unknown /proc/66804/cwd (readlink: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 66804 root rtd unknown /proc/66804/root (readlink: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 66804 root txt unknown /proc/66804/exe (readlink: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 66804 root NOFD /proc/66804/fd (opendir: Permission denied) 2024-09-16T01:03:44.352 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 66805 root cwd unknown /proc/66805/cwd (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 66805 root rtd unknown /proc/66805/root (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 66805 root txt unknown /proc/66805/exe (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 66805 root NOFD /proc/66805/fd (opendir: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 66905 root cwd unknown /proc/66905/cwd (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 66905 root rtd unknown /proc/66905/root (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 66905 root txt unknown /proc/66905/exe (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 66905 root NOFD /proc/66905/fd (opendir: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67550 root cwd unknown /proc/67550/cwd (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67550 root rtd unknown /proc/67550/root (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67550 root txt unknown /proc/67550/exe (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67550 root NOFD /proc/67550/fd (opendir: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67567 root cwd unknown /proc/67567/cwd (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67567 root rtd unknown /proc/67567/root (readlink: Permission denied) 2024-09-16T01:03:44.353 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67567 root txt unknown /proc/67567/exe (readlink: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67567 root NOFD /proc/67567/fd (opendir: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67568 root cwd unknown /proc/67568/cwd (readlink: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67568 root rtd unknown /proc/67568/root (readlink: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67568 root txt unknown /proc/67568/exe (readlink: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67568 root NOFD /proc/67568/fd (opendir: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67585 root cwd unknown /proc/67585/cwd (readlink: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67585 root rtd unknown /proc/67585/root (readlink: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67585 root txt unknown /proc/67585/exe (readlink: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67585 root NOFD /proc/67585/fd (opendir: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67586 root cwd unknown /proc/67586/cwd (readlink: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67586 root rtd unknown /proc/67586/root (readlink: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67586 root txt unknown /proc/67586/exe (readlink: Permission denied) 2024-09-16T01:03:44.354 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67586 root NOFD /proc/67586/fd (opendir: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67603 root cwd unknown /proc/67603/cwd (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67603 root rtd unknown /proc/67603/root (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67603 root txt unknown /proc/67603/exe (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67603 root NOFD /proc/67603/fd (opendir: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67604 root cwd unknown /proc/67604/cwd (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67604 root rtd unknown /proc/67604/root (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67604 root txt unknown /proc/67604/exe (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 67604 root NOFD /proc/67604/fd (opendir: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67621 root cwd unknown /proc/67621/cwd (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67621 root rtd unknown /proc/67621/root (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67621 root txt unknown /proc/67621/exe (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:journalct 67621 root NOFD /proc/67621/fd (opendir: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 67681 root cwd unknown /proc/67681/cwd (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 67681 root rtd unknown /proc/67681/root (readlink: Permission denied) 2024-09-16T01:03:44.355 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 67681 root txt unknown /proc/67681/exe (readlink: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 67681 root NOFD /proc/67681/fd (opendir: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 68141 root cwd unknown /proc/68141/cwd (readlink: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 68141 root rtd unknown /proc/68141/root (readlink: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 68141 root txt unknown /proc/68141/exe (readlink: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 68141 root NOFD /proc/68141/fd (opendir: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 68143 root cwd unknown /proc/68143/cwd (readlink: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 68143 root rtd unknown /proc/68143/root (readlink: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 68143 root txt unknown /proc/68143/exe (readlink: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 68143 root NOFD /proc/68143/fd (opendir: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 ceph cwd unknown /proc/68158/cwd (readlink: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 ceph rtd unknown /proc/68158/root (readlink: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 ceph txt unknown /proc/68158/exe (readlink: Permission denied) 2024-09-16T01:03:44.356 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 ceph NOFD /proc/68158/fd (opendir: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68159 log ceph cwd unknown /proc/68158/task/68159/cwd (readlink: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68159 log ceph rtd unknown /proc/68158/task/68159/root (readlink: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68159 log ceph txt unknown /proc/68158/task/68159/exe (readlink: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68159 log ceph NOFD /proc/68158/task/68159/fd (opendir: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68161 msgr-work ceph cwd unknown /proc/68158/task/68161/cwd (readlink: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68161 msgr-work ceph rtd unknown /proc/68158/task/68161/root (readlink: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68161 msgr-work ceph txt unknown /proc/68158/task/68161/exe (readlink: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68161 msgr-work ceph NOFD /proc/68158/task/68161/fd (opendir: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68162 msgr-work ceph cwd unknown /proc/68158/task/68162/cwd (readlink: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68162 msgr-work ceph rtd unknown /proc/68158/task/68162/root (readlink: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68162 msgr-work ceph txt unknown /proc/68158/task/68162/exe (readlink: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68162 msgr-work ceph NOFD /proc/68158/task/68162/fd (opendir: Permission denied) 2024-09-16T01:03:44.357 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68163 msgr-work ceph cwd unknown /proc/68158/task/68163/cwd (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68163 msgr-work ceph rtd unknown /proc/68158/task/68163/root (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68163 msgr-work ceph txt unknown /proc/68158/task/68163/exe (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68163 msgr-work ceph NOFD /proc/68158/task/68163/fd (opendir: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68167 service ceph cwd unknown /proc/68158/task/68167/cwd (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68167 service ceph rtd unknown /proc/68158/task/68167/root (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68167 service ceph txt unknown /proc/68158/task/68167/exe (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68167 service ceph NOFD /proc/68158/task/68167/fd (opendir: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68168 admin_soc ceph cwd unknown /proc/68158/task/68168/cwd (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68168 admin_soc ceph rtd unknown /proc/68158/task/68168/root (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68168 admin_soc ceph txt unknown /proc/68158/task/68168/exe (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68168 admin_soc ceph NOFD /proc/68158/task/68168/fd (opendir: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68169 signal_ha ceph cwd unknown /proc/68158/task/68169/cwd (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68169 signal_ha ceph rtd unknown /proc/68158/task/68169/root (readlink: Permission denied) 2024-09-16T01:03:44.358 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68169 signal_ha ceph txt unknown /proc/68158/task/68169/exe (readlink: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68169 signal_ha ceph NOFD /proc/68158/task/68169/fd (opendir: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68170 io_contex ceph cwd unknown /proc/68158/task/68170/cwd (readlink: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68170 io_contex ceph rtd unknown /proc/68158/task/68170/root (readlink: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68170 io_contex ceph txt unknown /proc/68158/task/68170/exe (readlink: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68170 io_contex ceph NOFD /proc/68158/task/68170/fd (opendir: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68171 io_contex ceph cwd unknown /proc/68158/task/68171/cwd (readlink: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68171 io_contex ceph rtd unknown /proc/68158/task/68171/root (readlink: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68171 io_contex ceph txt unknown /proc/68158/task/68171/exe (readlink: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68171 io_contex ceph NOFD /proc/68158/task/68171/fd (opendir: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68172 ms_dispat ceph cwd unknown /proc/68158/task/68172/cwd (readlink: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68172 ms_dispat ceph rtd unknown /proc/68158/task/68172/root (readlink: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68172 ms_dispat ceph txt unknown /proc/68158/task/68172/exe (readlink: Permission denied) 2024-09-16T01:03:44.359 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68172 ms_dispat ceph NOFD /proc/68158/task/68172/fd (opendir: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68173 ms_local ceph cwd unknown /proc/68158/task/68173/cwd (readlink: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68173 ms_local ceph rtd unknown /proc/68158/task/68173/root (readlink: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68173 ms_local ceph txt unknown /proc/68158/task/68173/exe (readlink: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68173 ms_local ceph NOFD /proc/68158/task/68173/fd (opendir: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68174 safe_time ceph cwd unknown /proc/68158/task/68174/cwd (readlink: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68174 safe_time ceph rtd unknown /proc/68158/task/68174/root (readlink: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68174 safe_time ceph txt unknown /proc/68158/task/68174/exe (readlink: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68174 safe_time ceph NOFD /proc/68158/task/68174/fd (opendir: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68175 safe_time ceph cwd unknown /proc/68158/task/68175/cwd (readlink: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68175 safe_time ceph rtd unknown /proc/68158/task/68175/root (readlink: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68175 safe_time ceph txt unknown /proc/68158/task/68175/exe (readlink: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68175 safe_time ceph NOFD /proc/68158/task/68175/fd (opendir: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68176 ceph-mds ceph cwd unknown /proc/68158/task/68176/cwd (readlink: Permission denied) 2024-09-16T01:03:44.360 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68176 ceph-mds ceph rtd unknown /proc/68158/task/68176/root (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68176 ceph-mds ceph txt unknown /proc/68158/task/68176/exe (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68176 ceph-mds ceph NOFD /proc/68158/task/68176/fd (opendir: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68307 safe_time ceph cwd unknown /proc/68158/task/68307/cwd (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68307 safe_time ceph rtd unknown /proc/68158/task/68307/root (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68307 safe_time ceph txt unknown /proc/68158/task/68307/exe (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68158 68307 safe_time ceph NOFD /proc/68158/task/68307/fd (opendir: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 68534 root cwd unknown /proc/68534/cwd (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 68534 root rtd unknown /proc/68534/root (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 68534 root txt unknown /proc/68534/exe (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 68534 root NOFD /proc/68534/fd (opendir: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 68536 root cwd unknown /proc/68536/cwd (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 68536 root rtd unknown /proc/68536/root (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 68536 root txt unknown /proc/68536/exe (readlink: Permission denied) 2024-09-16T01:03:44.361 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 68536 root NOFD /proc/68536/fd (opendir: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 ceph cwd unknown /proc/68556/cwd (readlink: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 ceph rtd unknown /proc/68556/root (readlink: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 ceph txt unknown /proc/68556/exe (readlink: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 ceph NOFD /proc/68556/fd (opendir: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68557 log ceph cwd unknown /proc/68556/task/68557/cwd (readlink: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68557 log ceph rtd unknown /proc/68556/task/68557/root (readlink: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68557 log ceph txt unknown /proc/68556/task/68557/exe (readlink: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68557 log ceph NOFD /proc/68556/task/68557/fd (opendir: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68559 msgr-work ceph cwd unknown /proc/68556/task/68559/cwd (readlink: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68559 msgr-work ceph rtd unknown /proc/68556/task/68559/root (readlink: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68559 msgr-work ceph txt unknown /proc/68556/task/68559/exe (readlink: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68559 msgr-work ceph NOFD /proc/68556/task/68559/fd (opendir: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68560 msgr-work ceph cwd unknown /proc/68556/task/68560/cwd (readlink: Permission denied) 2024-09-16T01:03:44.362 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68560 msgr-work ceph rtd unknown /proc/68556/task/68560/root (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68560 msgr-work ceph txt unknown /proc/68556/task/68560/exe (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68560 msgr-work ceph NOFD /proc/68556/task/68560/fd (opendir: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68561 msgr-work ceph cwd unknown /proc/68556/task/68561/cwd (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68561 msgr-work ceph rtd unknown /proc/68556/task/68561/root (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68561 msgr-work ceph txt unknown /proc/68556/task/68561/exe (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68561 msgr-work ceph NOFD /proc/68556/task/68561/fd (opendir: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68565 service ceph cwd unknown /proc/68556/task/68565/cwd (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68565 service ceph rtd unknown /proc/68556/task/68565/root (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68565 service ceph txt unknown /proc/68556/task/68565/exe (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68565 service ceph NOFD /proc/68556/task/68565/fd (opendir: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68566 admin_soc ceph cwd unknown /proc/68556/task/68566/cwd (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68566 admin_soc ceph rtd unknown /proc/68556/task/68566/root (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68566 admin_soc ceph txt unknown /proc/68556/task/68566/exe (readlink: Permission denied) 2024-09-16T01:03:44.363 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68566 admin_soc ceph NOFD /proc/68556/task/68566/fd (opendir: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68567 signal_ha ceph cwd unknown /proc/68556/task/68567/cwd (readlink: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68567 signal_ha ceph rtd unknown /proc/68556/task/68567/root (readlink: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68567 signal_ha ceph txt unknown /proc/68556/task/68567/exe (readlink: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68567 signal_ha ceph NOFD /proc/68556/task/68567/fd (opendir: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68568 io_contex ceph cwd unknown /proc/68556/task/68568/cwd (readlink: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68568 io_contex ceph rtd unknown /proc/68556/task/68568/root (readlink: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68568 io_contex ceph txt unknown /proc/68556/task/68568/exe (readlink: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68568 io_contex ceph NOFD /proc/68556/task/68568/fd (opendir: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68569 io_contex ceph cwd unknown /proc/68556/task/68569/cwd (readlink: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68569 io_contex ceph rtd unknown /proc/68556/task/68569/root (readlink: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68569 io_contex ceph txt unknown /proc/68556/task/68569/exe (readlink: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68569 io_contex ceph NOFD /proc/68556/task/68569/fd (opendir: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68570 ms_dispat ceph cwd unknown /proc/68556/task/68570/cwd (readlink: Permission denied) 2024-09-16T01:03:44.364 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68570 ms_dispat ceph rtd unknown /proc/68556/task/68570/root (readlink: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68570 ms_dispat ceph txt unknown /proc/68556/task/68570/exe (readlink: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68570 ms_dispat ceph NOFD /proc/68556/task/68570/fd (opendir: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68571 ms_local ceph cwd unknown /proc/68556/task/68571/cwd (readlink: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68571 ms_local ceph rtd unknown /proc/68556/task/68571/root (readlink: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68571 ms_local ceph txt unknown /proc/68556/task/68571/exe (readlink: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68571 ms_local ceph NOFD /proc/68556/task/68571/fd (opendir: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68572 safe_time ceph cwd unknown /proc/68556/task/68572/cwd (readlink: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68572 safe_time ceph rtd unknown /proc/68556/task/68572/root (readlink: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68572 safe_time ceph txt unknown /proc/68556/task/68572/exe (readlink: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68572 safe_time ceph NOFD /proc/68556/task/68572/fd (opendir: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68573 safe_time ceph cwd unknown /proc/68556/task/68573/cwd (readlink: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68573 safe_time ceph rtd unknown /proc/68556/task/68573/root (readlink: Permission denied) 2024-09-16T01:03:44.365 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68573 safe_time ceph txt unknown /proc/68556/task/68573/exe (readlink: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68573 safe_time ceph NOFD /proc/68556/task/68573/fd (opendir: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68574 ceph-mds ceph cwd unknown /proc/68556/task/68574/cwd (readlink: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68574 ceph-mds ceph rtd unknown /proc/68556/task/68574/root (readlink: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68574 ceph-mds ceph txt unknown /proc/68556/task/68574/exe (readlink: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68574 ceph-mds ceph NOFD /proc/68556/task/68574/fd (opendir: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68631 safe_time ceph cwd unknown /proc/68556/task/68631/cwd (readlink: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68631 safe_time ceph rtd unknown /proc/68556/task/68631/root (readlink: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68631 safe_time ceph txt unknown /proc/68556/task/68631/exe (readlink: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 68556 68631 safe_time ceph NOFD /proc/68556/task/68631/fd (opendir: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 69412 root cwd unknown /proc/69412/cwd (readlink: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 69412 root rtd unknown /proc/69412/root (readlink: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 69412 root txt unknown /proc/69412/exe (readlink: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 69412 root NOFD /proc/69412/fd (opendir: Permission denied) 2024-09-16T01:03:44.366 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 69414 root cwd unknown /proc/69414/cwd (readlink: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 69414 root rtd unknown /proc/69414/root (readlink: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 69414 root txt unknown /proc/69414/exe (readlink: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 69414 root NOFD /proc/69414/fd (opendir: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 ceph cwd unknown /proc/69420/cwd (readlink: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 ceph rtd unknown /proc/69420/root (readlink: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 ceph txt unknown /proc/69420/exe (readlink: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 ceph NOFD /proc/69420/fd (opendir: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69421 log ceph cwd unknown /proc/69420/task/69421/cwd (readlink: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69421 log ceph rtd unknown /proc/69420/task/69421/root (readlink: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69421 log ceph txt unknown /proc/69420/task/69421/exe (readlink: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69421 log ceph NOFD /proc/69420/task/69421/fd (opendir: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69423 msgr-work ceph cwd unknown /proc/69420/task/69423/cwd (readlink: Permission denied) 2024-09-16T01:03:44.367 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69423 msgr-work ceph rtd unknown /proc/69420/task/69423/root (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69423 msgr-work ceph txt unknown /proc/69420/task/69423/exe (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69423 msgr-work ceph NOFD /proc/69420/task/69423/fd (opendir: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69424 msgr-work ceph cwd unknown /proc/69420/task/69424/cwd (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69424 msgr-work ceph rtd unknown /proc/69420/task/69424/root (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69424 msgr-work ceph txt unknown /proc/69420/task/69424/exe (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69424 msgr-work ceph NOFD /proc/69420/task/69424/fd (opendir: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69425 msgr-work ceph cwd unknown /proc/69420/task/69425/cwd (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69425 msgr-work ceph rtd unknown /proc/69420/task/69425/root (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69425 msgr-work ceph txt unknown /proc/69420/task/69425/exe (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69425 msgr-work ceph NOFD /proc/69420/task/69425/fd (opendir: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69429 service ceph cwd unknown /proc/69420/task/69429/cwd (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69429 service ceph rtd unknown /proc/69420/task/69429/root (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69429 service ceph txt unknown /proc/69420/task/69429/exe (readlink: Permission denied) 2024-09-16T01:03:44.368 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69429 service ceph NOFD /proc/69420/task/69429/fd (opendir: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69430 admin_soc ceph cwd unknown /proc/69420/task/69430/cwd (readlink: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69430 admin_soc ceph rtd unknown /proc/69420/task/69430/root (readlink: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69430 admin_soc ceph txt unknown /proc/69420/task/69430/exe (readlink: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69430 admin_soc ceph NOFD /proc/69420/task/69430/fd (opendir: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69431 signal_ha ceph cwd unknown /proc/69420/task/69431/cwd (readlink: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69431 signal_ha ceph rtd unknown /proc/69420/task/69431/root (readlink: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69431 signal_ha ceph txt unknown /proc/69420/task/69431/exe (readlink: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69431 signal_ha ceph NOFD /proc/69420/task/69431/fd (opendir: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69432 io_contex ceph cwd unknown /proc/69420/task/69432/cwd (readlink: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69432 io_contex ceph rtd unknown /proc/69420/task/69432/root (readlink: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69432 io_contex ceph txt unknown /proc/69420/task/69432/exe (readlink: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69432 io_contex ceph NOFD /proc/69420/task/69432/fd (opendir: Permission denied) 2024-09-16T01:03:44.369 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69433 io_contex ceph cwd unknown /proc/69420/task/69433/cwd (readlink: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69433 io_contex ceph rtd unknown /proc/69420/task/69433/root (readlink: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69433 io_contex ceph txt unknown /proc/69420/task/69433/exe (readlink: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69433 io_contex ceph NOFD /proc/69420/task/69433/fd (opendir: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69434 ms_dispat ceph cwd unknown /proc/69420/task/69434/cwd (readlink: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69434 ms_dispat ceph rtd unknown /proc/69420/task/69434/root (readlink: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69434 ms_dispat ceph txt unknown /proc/69420/task/69434/exe (readlink: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69434 ms_dispat ceph NOFD /proc/69420/task/69434/fd (opendir: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69435 ms_local ceph cwd unknown /proc/69420/task/69435/cwd (readlink: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69435 ms_local ceph rtd unknown /proc/69420/task/69435/root (readlink: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69435 ms_local ceph txt unknown /proc/69420/task/69435/exe (readlink: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69435 ms_local ceph NOFD /proc/69420/task/69435/fd (opendir: Permission denied) 2024-09-16T01:03:44.370 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69436 safe_time ceph cwd unknown /proc/69420/task/69436/cwd (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69436 safe_time ceph rtd unknown /proc/69420/task/69436/root (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69436 safe_time ceph txt unknown /proc/69420/task/69436/exe (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69436 safe_time ceph NOFD /proc/69420/task/69436/fd (opendir: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69437 safe_time ceph cwd unknown /proc/69420/task/69437/cwd (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69437 safe_time ceph rtd unknown /proc/69420/task/69437/root (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69437 safe_time ceph txt unknown /proc/69420/task/69437/exe (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69437 safe_time ceph NOFD /proc/69420/task/69437/fd (opendir: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69438 ceph-mds ceph cwd unknown /proc/69420/task/69438/cwd (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69438 ceph-mds ceph rtd unknown /proc/69420/task/69438/root (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69438 ceph-mds ceph txt unknown /proc/69420/task/69438/exe (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69438 ceph-mds ceph NOFD /proc/69420/task/69438/fd (opendir: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69509 safe_time ceph cwd unknown /proc/69420/task/69509/cwd (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69509 safe_time ceph rtd unknown /proc/69420/task/69509/root (readlink: Permission denied) 2024-09-16T01:03:44.371 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69509 safe_time ceph txt unknown /proc/69420/task/69509/exe (readlink: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 69509 safe_time ceph NOFD /proc/69420/task/69509/fd (opendir: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74071 ceph_time ceph cwd unknown /proc/69420/task/74071/cwd (readlink: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74071 ceph_time ceph rtd unknown /proc/69420/task/74071/root (readlink: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74071 ceph_time ceph txt unknown /proc/69420/task/74071/exe (readlink: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74071 ceph_time ceph NOFD /proc/69420/task/74071/fd (opendir: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74072 OpHistory ceph cwd unknown /proc/69420/task/74072/cwd (readlink: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74072 OpHistory ceph rtd unknown /proc/69420/task/74072/root (readlink: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74072 OpHistory ceph txt unknown /proc/69420/task/74072/exe (readlink: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74072 OpHistory ceph NOFD /proc/69420/task/74072/fd (opendir: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74073 ms_dispat ceph cwd unknown /proc/69420/task/74073/cwd (readlink: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74073 ms_dispat ceph rtd unknown /proc/69420/task/74073/root (readlink: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74073 ms_dispat ceph txt unknown /proc/69420/task/74073/exe (readlink: Permission denied) 2024-09-16T01:03:44.372 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74073 ms_dispat ceph NOFD /proc/69420/task/74073/fd (opendir: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74074 ms_dispat ceph cwd unknown /proc/69420/task/74074/cwd (readlink: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74074 ms_dispat ceph rtd unknown /proc/69420/task/74074/root (readlink: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74074 ms_dispat ceph txt unknown /proc/69420/task/74074/exe (readlink: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74074 ms_dispat ceph NOFD /proc/69420/task/74074/fd (opendir: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74075 mds_rank_ ceph cwd unknown /proc/69420/task/74075/cwd (readlink: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74075 mds_rank_ ceph rtd unknown /proc/69420/task/74075/root (readlink: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74075 mds_rank_ ceph txt unknown /proc/69420/task/74075/exe (readlink: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74075 mds_rank_ ceph NOFD /proc/69420/task/74075/fd (opendir: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74076 PQ_Finish ceph cwd unknown /proc/69420/task/74076/cwd (readlink: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74076 PQ_Finish ceph rtd unknown /proc/69420/task/74076/root (readlink: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74076 PQ_Finish ceph txt unknown /proc/69420/task/74076/exe (readlink: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74076 PQ_Finish ceph NOFD /proc/69420/task/74076/fd (opendir: Permission denied) 2024-09-16T01:03:44.373 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74077 safe_time ceph cwd unknown /proc/69420/task/74077/cwd (readlink: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74077 safe_time ceph rtd unknown /proc/69420/task/74077/root (readlink: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74077 safe_time ceph txt unknown /proc/69420/task/74077/exe (readlink: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74077 safe_time ceph NOFD /proc/69420/task/74077/fd (opendir: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74078 MR_Finish ceph cwd unknown /proc/69420/task/74078/cwd (readlink: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74078 MR_Finish ceph rtd unknown /proc/69420/task/74078/root (readlink: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74078 MR_Finish ceph txt unknown /proc/69420/task/74078/exe (readlink: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74078 MR_Finish ceph NOFD /proc/69420/task/74078/fd (opendir: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74080 md_submit ceph cwd unknown /proc/69420/task/74080/cwd (readlink: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74080 md_submit ceph rtd unknown /proc/69420/task/74080/root (readlink: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74080 md_submit ceph txt unknown /proc/69420/task/74080/exe (readlink: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69420 74080 md_submit ceph NOFD /proc/69420/task/74080/fd (opendir: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 69737 root cwd unknown /proc/69737/cwd (readlink: Permission denied) 2024-09-16T01:03:44.374 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 69737 root rtd unknown /proc/69737/root (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 69737 root txt unknown /proc/69737/exe (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 69737 root NOFD /proc/69737/fd (opendir: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 69739 root cwd unknown /proc/69739/cwd (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 69739 root rtd unknown /proc/69739/root (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 69739 root txt unknown /proc/69739/exe (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:podman-in 69739 root NOFD /proc/69739/fd (opendir: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 ceph cwd unknown /proc/69754/cwd (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 ceph rtd unknown /proc/69754/root (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 ceph txt unknown /proc/69754/exe (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 ceph NOFD /proc/69754/fd (opendir: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69766 log ceph cwd unknown /proc/69754/task/69766/cwd (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69766 log ceph rtd unknown /proc/69754/task/69766/root (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69766 log ceph txt unknown /proc/69754/task/69766/exe (readlink: Permission denied) 2024-09-16T01:03:44.375 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69766 log ceph NOFD /proc/69754/task/69766/fd (opendir: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69768 msgr-work ceph cwd unknown /proc/69754/task/69768/cwd (readlink: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69768 msgr-work ceph rtd unknown /proc/69754/task/69768/root (readlink: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69768 msgr-work ceph txt unknown /proc/69754/task/69768/exe (readlink: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69768 msgr-work ceph NOFD /proc/69754/task/69768/fd (opendir: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69769 msgr-work ceph cwd unknown /proc/69754/task/69769/cwd (readlink: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69769 msgr-work ceph rtd unknown /proc/69754/task/69769/root (readlink: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69769 msgr-work ceph txt unknown /proc/69754/task/69769/exe (readlink: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69769 msgr-work ceph NOFD /proc/69754/task/69769/fd (opendir: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69770 msgr-work ceph cwd unknown /proc/69754/task/69770/cwd (readlink: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69770 msgr-work ceph rtd unknown /proc/69754/task/69770/root (readlink: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69770 msgr-work ceph txt unknown /proc/69754/task/69770/exe (readlink: Permission denied) 2024-09-16T01:03:44.376 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69770 msgr-work ceph NOFD /proc/69754/task/69770/fd (opendir: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69774 service ceph cwd unknown /proc/69754/task/69774/cwd (readlink: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69774 service ceph rtd unknown /proc/69754/task/69774/root (readlink: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69774 service ceph txt unknown /proc/69754/task/69774/exe (readlink: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69774 service ceph NOFD /proc/69754/task/69774/fd (opendir: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69775 admin_soc ceph cwd unknown /proc/69754/task/69775/cwd (readlink: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69775 admin_soc ceph rtd unknown /proc/69754/task/69775/root (readlink: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69775 admin_soc ceph txt unknown /proc/69754/task/69775/exe (readlink: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69775 admin_soc ceph NOFD /proc/69754/task/69775/fd (opendir: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69776 signal_ha ceph cwd unknown /proc/69754/task/69776/cwd (readlink: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69776 signal_ha ceph rtd unknown /proc/69754/task/69776/root (readlink: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69776 signal_ha ceph txt unknown /proc/69754/task/69776/exe (readlink: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69776 signal_ha ceph NOFD /proc/69754/task/69776/fd (opendir: Permission denied) 2024-09-16T01:03:44.377 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69777 io_contex ceph cwd unknown /proc/69754/task/69777/cwd (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69777 io_contex ceph rtd unknown /proc/69754/task/69777/root (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69777 io_contex ceph txt unknown /proc/69754/task/69777/exe (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69777 io_contex ceph NOFD /proc/69754/task/69777/fd (opendir: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69778 io_contex ceph cwd unknown /proc/69754/task/69778/cwd (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69778 io_contex ceph rtd unknown /proc/69754/task/69778/root (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69778 io_contex ceph txt unknown /proc/69754/task/69778/exe (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69778 io_contex ceph NOFD /proc/69754/task/69778/fd (opendir: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69779 ms_dispat ceph cwd unknown /proc/69754/task/69779/cwd (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69779 ms_dispat ceph rtd unknown /proc/69754/task/69779/root (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69779 ms_dispat ceph txt unknown /proc/69754/task/69779/exe (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69779 ms_dispat ceph NOFD /proc/69754/task/69779/fd (opendir: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69780 ms_local ceph cwd unknown /proc/69754/task/69780/cwd (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69780 ms_local ceph rtd unknown /proc/69754/task/69780/root (readlink: Permission denied) 2024-09-16T01:03:44.378 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69780 ms_local ceph txt unknown /proc/69754/task/69780/exe (readlink: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69780 ms_local ceph NOFD /proc/69754/task/69780/fd (opendir: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69781 safe_time ceph cwd unknown /proc/69754/task/69781/cwd (readlink: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69781 safe_time ceph rtd unknown /proc/69754/task/69781/root (readlink: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69781 safe_time ceph txt unknown /proc/69754/task/69781/exe (readlink: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69781 safe_time ceph NOFD /proc/69754/task/69781/fd (opendir: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69782 safe_time ceph cwd unknown /proc/69754/task/69782/cwd (readlink: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69782 safe_time ceph rtd unknown /proc/69754/task/69782/root (readlink: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69782 safe_time ceph txt unknown /proc/69754/task/69782/exe (readlink: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69782 safe_time ceph NOFD /proc/69754/task/69782/fd (opendir: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69783 ceph-mds ceph cwd unknown /proc/69754/task/69783/cwd (readlink: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69783 ceph-mds ceph rtd unknown /proc/69754/task/69783/root (readlink: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69783 ceph-mds ceph txt unknown /proc/69754/task/69783/exe (readlink: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69783 ceph-mds ceph NOFD /proc/69754/task/69783/fd (opendir: Permission denied) 2024-09-16T01:03:44.379 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69844 safe_time ceph cwd unknown /proc/69754/task/69844/cwd (readlink: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69844 safe_time ceph rtd unknown /proc/69754/task/69844/root (readlink: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69844 safe_time ceph txt unknown /proc/69754/task/69844/exe (readlink: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 69844 safe_time ceph NOFD /proc/69754/task/69844/fd (opendir: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73977 ceph_time ceph cwd unknown /proc/69754/task/73977/cwd (readlink: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73977 ceph_time ceph rtd unknown /proc/69754/task/73977/root (readlink: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73977 ceph_time ceph txt unknown /proc/69754/task/73977/exe (readlink: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73977 ceph_time ceph NOFD /proc/69754/task/73977/fd (opendir: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73978 OpHistory ceph cwd unknown /proc/69754/task/73978/cwd (readlink: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73978 OpHistory ceph rtd unknown /proc/69754/task/73978/root (readlink: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73978 OpHistory ceph txt unknown /proc/69754/task/73978/exe (readlink: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73978 OpHistory ceph NOFD /proc/69754/task/73978/fd (opendir: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73979 ms_dispat ceph cwd unknown /proc/69754/task/73979/cwd (readlink: Permission denied) 2024-09-16T01:03:44.380 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73979 ms_dispat ceph rtd unknown /proc/69754/task/73979/root (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73979 ms_dispat ceph txt unknown /proc/69754/task/73979/exe (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73979 ms_dispat ceph NOFD /proc/69754/task/73979/fd (opendir: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73980 ms_dispat ceph cwd unknown /proc/69754/task/73980/cwd (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73980 ms_dispat ceph rtd unknown /proc/69754/task/73980/root (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73980 ms_dispat ceph txt unknown /proc/69754/task/73980/exe (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73980 ms_dispat ceph NOFD /proc/69754/task/73980/fd (opendir: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73981 mds_rank_ ceph cwd unknown /proc/69754/task/73981/cwd (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73981 mds_rank_ ceph rtd unknown /proc/69754/task/73981/root (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73981 mds_rank_ ceph txt unknown /proc/69754/task/73981/exe (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73981 mds_rank_ ceph NOFD /proc/69754/task/73981/fd (opendir: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73982 PQ_Finish ceph cwd unknown /proc/69754/task/73982/cwd (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73982 PQ_Finish ceph rtd unknown /proc/69754/task/73982/root (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73982 PQ_Finish ceph txt unknown /proc/69754/task/73982/exe (readlink: Permission denied) 2024-09-16T01:03:44.381 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73982 PQ_Finish ceph NOFD /proc/69754/task/73982/fd (opendir: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73983 safe_time ceph cwd unknown /proc/69754/task/73983/cwd (readlink: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73983 safe_time ceph rtd unknown /proc/69754/task/73983/root (readlink: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73983 safe_time ceph txt unknown /proc/69754/task/73983/exe (readlink: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73983 safe_time ceph NOFD /proc/69754/task/73983/fd (opendir: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73984 MR_Finish ceph cwd unknown /proc/69754/task/73984/cwd (readlink: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73984 MR_Finish ceph rtd unknown /proc/69754/task/73984/root (readlink: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73984 MR_Finish ceph txt unknown /proc/69754/task/73984/exe (readlink: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73984 MR_Finish ceph NOFD /proc/69754/task/73984/fd (opendir: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73985 md_submit ceph cwd unknown /proc/69754/task/73985/cwd (readlink: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73985 md_submit ceph rtd unknown /proc/69754/task/73985/root (readlink: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73985 md_submit ceph txt unknown /proc/69754/task/73985/exe (readlink: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 73985 md_submit ceph NOFD /proc/69754/task/73985/fd (opendir: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74067 ms_dispat ceph cwd unknown /proc/69754/task/74067/cwd (readlink: Permission denied) 2024-09-16T01:03:44.382 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74067 ms_dispat ceph rtd unknown /proc/69754/task/74067/root (readlink: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74067 ms_dispat ceph txt unknown /proc/69754/task/74067/exe (readlink: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74067 ms_dispat ceph NOFD /proc/69754/task/74067/fd (opendir: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74068 quiesce.a ceph cwd unknown /proc/69754/task/74068/cwd (readlink: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74068 quiesce.a ceph rtd unknown /proc/69754/task/74068/root (readlink: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74068 quiesce.a ceph txt unknown /proc/69754/task/74068/exe (readlink: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74068 quiesce.a ceph NOFD /proc/69754/task/74068/fd (opendir: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74069 quiesce_d ceph cwd unknown /proc/69754/task/74069/cwd (readlink: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74069 quiesce_d ceph rtd unknown /proc/69754/task/74069/root (readlink: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74069 quiesce_d ceph txt unknown /proc/69754/task/74069/exe (readlink: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:ceph-mds 69754 74069 quiesce_d ceph NOFD /proc/69754/task/74069/fd (opendir: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 70294 root cwd unknown /proc/70294/cwd (readlink: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 70294 root rtd unknown /proc/70294/root (readlink: Permission denied) 2024-09-16T01:03:44.383 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 70294 root txt unknown /proc/70294/exe (readlink: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/u 70294 root NOFD /proc/70294/fd (opendir: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 73359 root cwd unknown /proc/73359/cwd (readlink: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 73359 root rtd unknown /proc/73359/root (readlink: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 73359 root txt unknown /proc/73359/exe (readlink: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 73359 root NOFD /proc/73359/fd (opendir: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 74301 root cwd unknown /proc/74301/cwd (readlink: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 74301 root rtd unknown /proc/74301/root (readlink: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 74301 root txt unknown /proc/74301/exe (readlink: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/0 74301 root NOFD /proc/74301/fd (opendir: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 77292 root cwd unknown /proc/77292/cwd (readlink: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 77292 root rtd unknown /proc/77292/root (readlink: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 77292 root txt unknown /proc/77292/exe (readlink: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/1 77292 root NOFD /proc/77292/fd (opendir: Permission denied) 2024-09-16T01:03:44.384 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 79524 root cwd unknown /proc/79524/cwd (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 79524 root rtd unknown /proc/79524/root (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 79524 root txt unknown /proc/79524/exe (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/2 79524 root NOFD /proc/79524/fd (opendir: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 81598 root cwd unknown /proc/81598/cwd (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 81598 root rtd unknown /proc/81598/root (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 81598 root txt unknown /proc/81598/exe (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 81598 root NOFD /proc/81598/fd (opendir: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 82322 root cwd unknown /proc/82322/cwd (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 82322 root rtd unknown /proc/82322/root (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 82322 root txt unknown /proc/82322/exe (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/7 82322 root NOFD /proc/82322/fd (opendir: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 82556 root cwd unknown /proc/82556/cwd (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 82556 root rtd unknown /proc/82556/root (readlink: Permission denied) 2024-09-16T01:03:44.385 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 82556 root txt unknown /proc/82556/exe (readlink: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/4 82556 root NOFD /proc/82556/fd (opendir: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:anacron 82695 root cwd unknown /proc/82695/cwd (readlink: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:anacron 82695 root rtd unknown /proc/82695/root (readlink: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:anacron 82695 root txt unknown /proc/82695/exe (readlink: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:anacron 82695 root NOFD /proc/82695/fd (opendir: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83015 root cwd unknown /proc/83015/cwd (readlink: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83015 root rtd unknown /proc/83015/root (readlink: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83015 root txt unknown /proc/83015/exe (readlink: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83015 root NOFD /proc/83015/fd (opendir: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83016 root cwd unknown /proc/83016/cwd (readlink: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83016 root rtd unknown /proc/83016/root (readlink: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83016 root txt unknown /proc/83016/exe (readlink: Permission denied) 2024-09-16T01:03:44.386 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83016 root NOFD /proc/83016/fd (opendir: Permission denied) 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83017 root cwd unknown /proc/83017/cwd (readlink: Permission denied) 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83017 root rtd unknown /proc/83017/root (readlink: Permission denied) 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83017 root txt unknown /proc/83017/exe (readlink: Permission denied) 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/R 83017 root NOFD /proc/83017/fd (opendir: Permission denied) 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 86566 root cwd unknown /proc/86566/cwd (readlink: Permission denied) 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 86566 root rtd unknown /proc/86566/root (readlink: Permission denied) 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 86566 root txt unknown /proc/86566/exe (readlink: Permission denied) 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/3 86566 root NOFD /proc/86566/fd (opendir: Permission denied) 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu rtd DIR 8,1 4096 2 / 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-16T01:03:44.387 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-16T01:03:44.388 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu 0r FIFO 0,13 0t0 245763 pipe 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu 1w FIFO 0,13 0t0 245764 pipe 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:timeout 89133 ubuntu 2w FIFO 0,13 0t0 245765 pipe 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu rtd DIR 8,1 4096 2 / 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-16T01:03:44.389 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu 0r FIFO 0,13 0t0 245763 pipe 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu 1w FIFO 0,13 0t0 245764 pipe 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu 2w FIFO 0,13 0t0 245765 pipe 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:fsync-tes 89161 ubuntu 255r REG 8,1 207 661868 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-16T01:03:44.390 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 90797 root cwd unknown /proc/90797/cwd (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 90797 root rtd unknown /proc/90797/root (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 90797 root txt unknown /proc/90797/exe (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/6 90797 root NOFD /proc/90797/fd (opendir: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 91122 root cwd unknown /proc/91122/cwd (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 91122 root rtd unknown /proc/91122/root (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 91122 root txt unknown /proc/91122/exe (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:kworker/5 91122 root NOFD /proc/91122/fd (opendir: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 91703 root cwd unknown /proc/91703/cwd (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 91703 root rtd unknown /proc/91703/root (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 91703 root txt unknown /proc/91703/exe (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:sudo 91703 root NOFD /proc/91703/fd (opendir: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:cephadm 91720 root cwd unknown /proc/91720/cwd (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:cephadm 91720 root rtd unknown /proc/91720/root (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:cephadm 91720 root txt unknown /proc/91720/exe (readlink: Permission denied) 2024-09-16T01:03:44.391 INFO:tasks.workunit.client.0.smithi012.stdout:cephadm 91720 root NOFD /proc/91720/fd (opendir: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 root cwd unknown /proc/91761/cwd (readlink: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 root rtd unknown /proc/91761/root (readlink: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 root txt unknown /proc/91761/exe (readlink: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 root NOFD /proc/91761/fd (opendir: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91762 podman root cwd unknown /proc/91761/task/91762/cwd (readlink: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91762 podman root rtd unknown /proc/91761/task/91762/root (readlink: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91762 podman root txt unknown /proc/91761/task/91762/exe (readlink: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91762 podman root NOFD /proc/91761/task/91762/fd (opendir: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91763 podman root cwd unknown /proc/91761/task/91763/cwd (readlink: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91763 podman root rtd unknown /proc/91761/task/91763/root (readlink: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91763 podman root txt unknown /proc/91761/task/91763/exe (readlink: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91763 podman root NOFD /proc/91761/task/91763/fd (opendir: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91764 podman root cwd unknown /proc/91761/task/91764/cwd (readlink: Permission denied) 2024-09-16T01:03:44.392 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91764 podman root rtd unknown /proc/91761/task/91764/root (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91764 podman root txt unknown /proc/91761/task/91764/exe (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91764 podman root NOFD /proc/91761/task/91764/fd (opendir: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91765 podman root cwd unknown /proc/91761/task/91765/cwd (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91765 podman root rtd unknown /proc/91761/task/91765/root (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91765 podman root txt unknown /proc/91761/task/91765/exe (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91765 podman root NOFD /proc/91761/task/91765/fd (opendir: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91766 podman root cwd unknown /proc/91761/task/91766/cwd (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91766 podman root rtd unknown /proc/91761/task/91766/root (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91766 podman root txt unknown /proc/91761/task/91766/exe (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91766 podman root NOFD /proc/91761/task/91766/fd (opendir: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91767 podman root cwd unknown /proc/91761/task/91767/cwd (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91767 podman root rtd unknown /proc/91761/task/91767/root (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91767 podman root txt unknown /proc/91761/task/91767/exe (readlink: Permission denied) 2024-09-16T01:03:44.393 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91767 podman root NOFD /proc/91761/task/91767/fd (opendir: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91768 podman root cwd unknown /proc/91761/task/91768/cwd (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91768 podman root rtd unknown /proc/91761/task/91768/root (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91768 podman root txt unknown /proc/91761/task/91768/exe (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91768 podman root NOFD /proc/91761/task/91768/fd (opendir: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91769 podman root cwd unknown /proc/91761/task/91769/cwd (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91769 podman root rtd unknown /proc/91761/task/91769/root (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91769 podman root txt unknown /proc/91761/task/91769/exe (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91769 podman root NOFD /proc/91761/task/91769/fd (opendir: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91770 podman root cwd unknown /proc/91761/task/91770/cwd (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91770 podman root rtd unknown /proc/91761/task/91770/root (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91770 podman root txt unknown /proc/91761/task/91770/exe (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91770 podman root NOFD /proc/91761/task/91770/fd (opendir: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91771 podman root cwd unknown /proc/91761/task/91771/cwd (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91771 podman root rtd unknown /proc/91761/task/91771/root (readlink: Permission denied) 2024-09-16T01:03:44.394 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91771 podman root txt unknown /proc/91761/task/91771/exe (readlink: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91771 podman root NOFD /proc/91761/task/91771/fd (opendir: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91772 podman root cwd unknown /proc/91761/task/91772/cwd (readlink: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91772 podman root rtd unknown /proc/91761/task/91772/root (readlink: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91772 podman root txt unknown /proc/91761/task/91772/exe (readlink: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91772 podman root NOFD /proc/91761/task/91772/fd (opendir: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91773 podman root cwd unknown /proc/91761/task/91773/cwd (readlink: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91773 podman root rtd unknown /proc/91761/task/91773/root (readlink: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91773 podman root txt unknown /proc/91761/task/91773/exe (readlink: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91773 podman root NOFD /proc/91761/task/91773/fd (opendir: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91778 podman root cwd unknown /proc/91761/task/91778/cwd (readlink: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91778 podman root rtd unknown /proc/91761/task/91778/root (readlink: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91778 podman root txt unknown /proc/91761/task/91778/exe (readlink: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91761 91778 podman root NOFD /proc/91761/task/91778/fd (opendir: Permission denied) 2024-09-16T01:03:44.395 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 91775 root cwd unknown /proc/91775/cwd (readlink: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 91775 root rtd unknown /proc/91775/root (readlink: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 91775 root txt unknown /proc/91775/exe (readlink: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:conmon 91775 root NOFD /proc/91775/fd (opendir: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 root cwd unknown /proc/91828/cwd (readlink: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 root rtd unknown /proc/91828/root (readlink: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 root txt unknown /proc/91828/exe (readlink: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 root NOFD /proc/91828/fd (opendir: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91829 podman root cwd unknown /proc/91828/task/91829/cwd (readlink: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91829 podman root rtd unknown /proc/91828/task/91829/root (readlink: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91829 podman root txt unknown /proc/91828/task/91829/exe (readlink: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91829 podman root NOFD /proc/91828/task/91829/fd (opendir: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91830 podman root cwd unknown /proc/91828/task/91830/cwd (readlink: Permission denied) 2024-09-16T01:03:44.396 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91830 podman root rtd unknown /proc/91828/task/91830/root (readlink: Permission denied) 2024-09-16T01:03:44.397 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91830 podman root txt unknown /proc/91828/task/91830/exe (readlink: Permission denied) 2024-09-16T01:03:44.397 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91830 podman root NOFD /proc/91828/task/91830/fd (opendir: Permission denied) 2024-09-16T01:03:44.397 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91831 podman root cwd unknown /proc/91828/task/91831/cwd (readlink: Permission denied) 2024-09-16T01:03:44.397 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91831 podman root rtd unknown /proc/91828/task/91831/root (readlink: Permission denied) 2024-09-16T01:03:44.397 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91831 podman root txt unknown /proc/91828/task/91831/exe (readlink: Permission denied) 2024-09-16T01:03:44.397 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91831 podman root NOFD /proc/91828/task/91831/fd (opendir: Permission denied) 2024-09-16T01:03:44.400 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91832 podman root cwd unknown /proc/91828/task/91832/cwd (readlink: Permission denied) 2024-09-16T01:03:44.400 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91832 podman root rtd unknown /proc/91828/task/91832/root (readlink: Permission denied) 2024-09-16T01:03:44.400 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91832 podman root txt unknown /proc/91828/task/91832/exe (readlink: Permission denied) 2024-09-16T01:03:44.400 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91832 podman root NOFD /proc/91828/task/91832/fd (opendir: Permission denied) 2024-09-16T01:03:44.400 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91833 podman root cwd unknown /proc/91828/task/91833/cwd (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91833 podman root rtd unknown /proc/91828/task/91833/root (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91833 podman root txt unknown /proc/91828/task/91833/exe (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91833 podman root NOFD /proc/91828/task/91833/fd (opendir: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91834 podman root cwd unknown /proc/91828/task/91834/cwd (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91834 podman root rtd unknown /proc/91828/task/91834/root (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91834 podman root txt unknown /proc/91828/task/91834/exe (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91834 podman root NOFD /proc/91828/task/91834/fd (opendir: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91835 podman root cwd unknown /proc/91828/task/91835/cwd (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91835 podman root rtd unknown /proc/91828/task/91835/root (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91835 podman root txt unknown /proc/91828/task/91835/exe (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91835 podman root NOFD /proc/91828/task/91835/fd (opendir: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91836 podman root cwd unknown /proc/91828/task/91836/cwd (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91836 podman root rtd unknown /proc/91828/task/91836/root (readlink: Permission denied) 2024-09-16T01:03:44.401 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91836 podman root txt unknown /proc/91828/task/91836/exe (readlink: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91836 podman root NOFD /proc/91828/task/91836/fd (opendir: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91837 podman root cwd unknown /proc/91828/task/91837/cwd (readlink: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91837 podman root rtd unknown /proc/91828/task/91837/root (readlink: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91837 podman root txt unknown /proc/91828/task/91837/exe (readlink: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91837 podman root NOFD /proc/91828/task/91837/fd (opendir: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91838 podman root cwd unknown /proc/91828/task/91838/cwd (readlink: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91838 podman root rtd unknown /proc/91828/task/91838/root (readlink: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91838 podman root txt unknown /proc/91828/task/91838/exe (readlink: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91838 podman root NOFD /proc/91828/task/91838/fd (opendir: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91839 podman root cwd unknown /proc/91828/task/91839/cwd (readlink: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91839 podman root rtd unknown /proc/91828/task/91839/root (readlink: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91839 podman root txt unknown /proc/91828/task/91839/exe (readlink: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:podman 91828 91839 podman root NOFD /proc/91828/task/91839/fd (opendir: Permission denied) 2024-09-16T01:03:44.402 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu rtd DIR 8,1 4096 2 / 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-16T01:03:44.403 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu 0r FIFO 0,13 0t0 245763 pipe 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu 1w FIFO 0,13 0t0 245764 pipe 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu 2w FIFO 0,13 0t0 245765 pipe 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu 3r DIR 0,20 0 1 /proc 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu 4r DIR 0,20 0 251966 /proc/91840/fd 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu 5w FIFO 0,13 0t0 251971 pipe 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91840 ubuntu 6r FIFO 0,13 0t0 251972 pipe 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu rtd DIR 8,1 4096 2 / 2024-09-16T01:03:44.404 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-16T01:03:44.405 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-16T01:03:44.405 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-16T01:03:44.405 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-16T01:03:44.405 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-16T01:03:44.405 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-16T01:03:44.405 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-16T01:03:44.405 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-16T01:03:44.405 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-16T01:03:44.405 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-16T01:03:44.406 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-16T01:03:44.406 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-16T01:03:44.406 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-16T01:03:44.406 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-16T01:03:44.406 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-16T01:03:44.406 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-16T01:03:44.406 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-16T01:03:44.406 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu 4r FIFO 0,13 0t0 251971 pipe 2024-09-16T01:03:44.406 INFO:tasks.workunit.client.0.smithi012.stdout:lsof 91841 ubuntu 7w FIFO 0,13 0t0 251972 pipe 2024-09-16T01:03:44.406 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T01:03:44.407 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T01:03:44.449 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-16T01:03:44.449 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T01:03:44.822 DEBUG:teuthology.parallel:result is None 2024-09-16T01:03:44.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T01:03:44.856 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T01:03:44.856 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-16T01:03:44.866 INFO:tasks.quiescer:joining Quiescers 2024-09-16T01:03:44.866 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-16T01:03:44.867 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:03:44.880 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '77ad929a', total seconds elapsed: 23.1 2024-09-16T01:03:44.880 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.55 2024-09-16T01:03:44.880 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:03:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:44 smithi098 ceph-mon[35346]: pgmap v439: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 18 MiB/s wr, 14 op/s 2024-09-16T01:03:45.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:44 smithi119 ceph-mon[35049]: pgmap v439: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 18 MiB/s wr, 14 op/s 2024-09-16T01:03:45.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:44 smithi012 ceph-mon[31197]: pgmap v439: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 18 MiB/s wr, 14 op/s 2024-09-16T01:03:45.190 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:45.194 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.012+0000 7fca178eb640 1 -- 172.21.15.12:0/4140277990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca10102ef0 msgr2=0x7fca1010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.012+0000 7fca178eb640 1 --2- 172.21.15.12:0/4140277990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca10102ef0 0x7fca1010da40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fca08009ca0 tx=0x7fca0802a950 comp rx=0 tx=0).stop 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.012+0000 7fca178eb640 1 -- 172.21.15.12:0/4140277990 shutdown_connections 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.012+0000 7fca178eb640 1 --2- 172.21.15.12:0/4140277990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca10102ef0 0x7fca1010da40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.012+0000 7fca178eb640 1 --2- 172.21.15.12:0/4140277990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca10102570 0x7fca101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.012+0000 7fca178eb640 1 --2- 172.21.15.12:0/4140277990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca10100e20 0x7fca10101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.012+0000 7fca178eb640 1 -- 172.21.15.12:0/4140277990 >> 172.21.15.12:0/4140277990 conn(0x7fca100fc7d0 msgr2=0x7fca100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.012+0000 7fca178eb640 1 -- 172.21.15.12:0/4140277990 shutdown_connections 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.012+0000 7fca178eb640 1 -- 172.21.15.12:0/4140277990 wait complete. 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca178eb640 1 Processor -- start 2024-09-16T01:03:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca178eb640 1 -- start start 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca178eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca10100e20 0x7fca101992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca178eb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca10102570 0x7fca10199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca178eb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca10102ef0 0x7fca101a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca178eb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fca10110f80 con 0x7fca10102570 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca178eb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fca10110e00 con 0x7fca10100e20 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca178eb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca10111100 con 0x7fca10102ef0 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca14e86640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca10102570 0x7fca10199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca14e86640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca10102570 0x7fca10199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56656/0 (socket says 172.21.15.12:56656) 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.013+0000 7fca14e86640 1 -- 172.21.15.12:0/2838366300 learned_addr learned my addr 172.21.15.12:0/2838366300 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca15687640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca10100e20 0x7fca101992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca15e88640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca10102ef0 0x7fca101a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca14e86640 1 -- 172.21.15.12:0/2838366300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca10102ef0 msgr2=0x7fca101a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca14e86640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca10102ef0 0x7fca101a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca14e86640 1 -- 172.21.15.12:0/2838366300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca10100e20 msgr2=0x7fca101992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca14e86640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca10100e20 0x7fca101992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca14e86640 1 -- 172.21.15.12:0/2838366300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca101a4890 con 0x7fca10102570 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca14e86640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca10102570 0x7fca10199810 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fca0000d950 tx=0x7fca0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca067fc640 1 -- 172.21.15.12:0/2838366300 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00017070 con 0x7fca10102570 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca178eb640 1 -- 172.21.15.12:0/2838366300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca101a4a60 con 0x7fca10102570 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca067fc640 1 -- 172.21.15.12:0/2838366300 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca00009c30 con 0x7fca10102570 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca067fc640 1 -- 172.21.15.12:0/2838366300 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0000f6b0 con 0x7fca10102570 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.014+0000 7fca178eb640 1 -- 172.21.15.12:0/2838366300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca101a4f70 con 0x7fca10102570 2024-09-16T01:03:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.015+0000 7fca178eb640 1 -- 172.21.15.12:0/2838366300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca10101200 con 0x7fca10102570 2024-09-16T01:03:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.016+0000 7fca067fc640 1 -- 172.21.15.12:0/2838366300 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fca000109d0 con 0x7fca10102570 2024-09-16T01:03:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.017+0000 7fca067fc640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9fc0a3240 0x7fc9fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.017+0000 7fca15687640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9fc0a3240 0x7fc9fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.017+0000 7fca067fc640 1 -- 172.21.15.12:0/2838366300 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fca000cf820 con 0x7fca10102570 2024-09-16T01:03:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.018+0000 7fca15687640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9fc0a3240 0x7fc9fc0a5700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00bbe0 tx=0x7fca0c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.021+0000 7fca067fc640 1 -- 172.21.15.12:0/2838366300 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca00009de0 con 0x7fca10102570 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.914+0000 7f592d29a640 1 -- 172.21.15.12:0/3383181890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5928103650 msgr2=0x7f592810bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.914+0000 7f592d29a640 1 --2- 172.21.15.12:0/3383181890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5928103650 0x7f592810bb40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5910009900 tx=0x7f591002a480 comp rx=0 tx=0).stop 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.914+0000 7f592d29a640 1 -- 172.21.15.12:0/3383181890 shutdown_connections 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.914+0000 7f592d29a640 1 --2- 172.21.15.12:0/3383181890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592810c160 0x7f592810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.914+0000 7f592d29a640 1 --2- 172.21.15.12:0/3383181890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5928103650 0x7f592810bb40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.914+0000 7f592d29a640 1 --2- 172.21.15.12:0/3383181890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5928102d30 0x7f5928103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.914+0000 7f592d29a640 1 -- 172.21.15.12:0/3383181890 >> 172.21.15.12:0/3383181890 conn(0x7f59280fc7d0 msgr2=0x7f59280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.914+0000 7f592d29a640 1 -- 172.21.15.12:0/3383181890 shutdown_connections 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.914+0000 7f592d29a640 1 -- 172.21.15.12:0/3383181890 wait complete. 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.914+0000 7f592d29a640 1 Processor -- start 2024-09-16T01:03:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f592d29a640 1 -- start start 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f592d29a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5928102d30 0x7f5928198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f592d29a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5928103650 0x7f5928198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f592d29a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592810c160 0x7f592819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f592d29a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5928111f60 con 0x7f5928102d30 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f592d29a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5928111de0 con 0x7f592810c160 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f592d29a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f59281120e0 con 0x7f5928103650 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f5926ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5928102d30 0x7f5928198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f5926ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5928102d30 0x7f5928198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56634/0 (socket says 172.21.15.12:56634) 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f5926ffd640 1 -- 172.21.15.12:0/4231804640 learned_addr learned my addr 172.21.15.12:0/4231804640 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f59267fc640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5928103650 0x7f5928198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f59277fe640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592810c160 0x7f592819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f5926ffd640 1 -- 172.21.15.12:0/4231804640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5928103650 msgr2=0x7f5928198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f5926ffd640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5928103650 0x7f5928198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f5926ffd640 1 -- 172.21.15.12:0/4231804640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592810c160 msgr2=0x7f592819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f5926ffd640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592810c160 0x7f592819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f5926ffd640 1 -- 172.21.15.12:0/4231804640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592819d3b0 con 0x7f5928102d30 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f59267fc640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5928103650 0x7f5928198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f59277fe640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592810c160 0x7f592819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.915+0000 7f5926ffd640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5928102d30 0x7f5928198400 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f592000cce0 tx=0x7f592000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.916+0000 7f591ffff640 1 -- 172.21.15.12:0/4231804640 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592000f650 con 0x7f5928102d30 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.916+0000 7f592d29a640 1 -- 172.21.15.12:0/4231804640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592819d6a0 con 0x7f5928102d30 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.916+0000 7f591ffff640 1 -- 172.21.15.12:0/4231804640 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f592000fcd0 con 0x7f5928102d30 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.916+0000 7f591ffff640 1 -- 172.21.15.12:0/4231804640 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920018c70 con 0x7f5928102d30 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.916+0000 7f592d29a640 1 -- 172.21.15.12:0/4231804640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59281a4f80 con 0x7f5928102d30 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.917+0000 7f592d29a640 1 -- 172.21.15.12:0/4231804640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5928103110 con 0x7f5928102d30 2024-09-16T01:03:46.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.918+0000 7f591ffff640 1 -- 172.21.15.12:0/4231804640 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f592000f7f0 con 0x7f5928102d30 2024-09-16T01:03:46.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.919+0000 7f591ffff640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f59140a3240 0x7f59140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:46.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.919+0000 7f59267fc640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f59140a3240 0x7f59140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:46.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.919+0000 7f591ffff640 1 -- 172.21.15.12:0/4231804640 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f59200d0240 con 0x7f5928102d30 2024-09-16T01:03:46.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.919+0000 7f59267fc640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f59140a3240 0x7f59140a5700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f592810d610 tx=0x7f5910005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:46.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:45.923+0000 7f591ffff640 1 -- 172.21.15.12:0/4231804640 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5920014030 con 0x7f5928102d30 2024-09-16T01:03:46.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.138+0000 7f592d29a640 1 -- 172.21.15.12:0/4231804640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5928107200 con 0x7f5928102d30 2024-09-16T01:03:46.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.138+0000 7f591ffff640 1 -- 172.21.15.12:0/4231804640 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f592009cba0 con 0x7f5928102d30 2024-09-16T01:03:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:03:46.169 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.141+0000 7f592d29a640 1 -- 172.21.15.12:0/4231804640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f59140a3240 msgr2=0x7f59140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.141+0000 7f592d29a640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f59140a3240 0x7f59140a5700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f592810d610 tx=0x7f5910005a20 comp rx=0 tx=0).stop 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.141+0000 7f592d29a640 1 -- 172.21.15.12:0/4231804640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5928102d30 msgr2=0x7f5928198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.141+0000 7f592d29a640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5928102d30 0x7f5928198400 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f592000cce0 tx=0x7f592000a620 comp rx=0 tx=0).stop 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.141+0000 7f592d29a640 1 -- 172.21.15.12:0/4231804640 shutdown_connections 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.141+0000 7f592d29a640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f59140a3240 0x7f59140a5700 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.141+0000 7f592d29a640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592810c160 0x7f592819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.141+0000 7f592d29a640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5928103650 0x7f5928198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.141+0000 7f592d29a640 1 --2- 172.21.15.12:0/4231804640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5928102d30 0x7f5928198400 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.141+0000 7f592d29a640 1 -- 172.21.15.12:0/4231804640 >> 172.21.15.12:0/4231804640 conn(0x7f59280fc7d0 msgr2=0x7f59280fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:46.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.142+0000 7f592d29a640 1 -- 172.21.15.12:0/4231804640 shutdown_connections 2024-09-16T01:03:46.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.142+0000 7f592d29a640 1 -- 172.21.15.12:0/4231804640 wait complete. 2024-09-16T01:03:46.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.245+0000 7fca178eb640 1 -- 172.21.15.12:0/2838366300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca101a51a0 con 0x7fca10102570 2024-09-16T01:03:46.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.245+0000 7fca067fc640 1 -- 172.21.15.12:0/2838366300 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7fca0009bb30 con 0x7fca10102570 2024-09-16T01:03:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:03:46.248 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:03:46.248 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:03:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 -- 172.21.15.12:0/2838366300 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9fc0a3240 msgr2=0x7fc9fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9fc0a3240 0x7fc9fc0a5700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00bbe0 tx=0x7fca0c00b390 comp rx=0 tx=0).stop 2024-09-16T01:03:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 -- 172.21.15.12:0/2838366300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca10102570 msgr2=0x7fca10199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca10102570 0x7fca10199810 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fca0000d950 tx=0x7fca0000de10 comp rx=0 tx=0).stop 2024-09-16T01:03:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 -- 172.21.15.12:0/2838366300 shutdown_connections 2024-09-16T01:03:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fc9fc0a3240 0x7fc9fc0a5700 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca10102ef0 0x7fca101a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca10102570 0x7fca10199810 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 --2- 172.21.15.12:0/2838366300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca10100e20 0x7fca101992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 -- 172.21.15.12:0/2838366300 >> 172.21.15.12:0/2838366300 conn(0x7fca100fc7d0 msgr2=0x7fca10106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:46.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 -- 172.21.15.12:0/2838366300 shutdown_connections 2024-09-16T01:03:46.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:46.248+0000 7fca178eb640 1 -- 172.21.15.12:0/2838366300 wait complete. 2024-09-16T01:03:46.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:46 smithi012 ceph-mon[31197]: pgmap v440: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 20 MiB/s wr, 16 op/s 2024-09-16T01:03:46.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:46 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/4231804640' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:46.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:46 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2838366300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:46 smithi098 ceph-mon[35346]: pgmap v440: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 20 MiB/s wr, 16 op/s 2024-09-16T01:03:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:46 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/4231804640' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:46 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2838366300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:46 smithi119 ceph-mon[35049]: pgmap v440: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 20 MiB/s wr, 16 op/s 2024-09-16T01:03:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:46 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/4231804640' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:46 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2838366300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:03:47.470 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db --cancel --all' 2024-09-16T01:03:47.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24518 quiesce db --cancel --all 2024-09-16T01:03:47.763 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0' 2024-09-16T01:03:47.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24518 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0 2024-09-16T01:03:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:48.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.402+0000 7f1f373f6640 1 -- 172.21.15.12:0/544353036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f30106f10 msgr2=0x7f1f3010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:48.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.402+0000 7f1f373f6640 1 --2- 172.21.15.12:0/544353036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f30106f10 0x7f1f3010ea90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009900 tx=0x7f1f2802a3f0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.402+0000 7f1f373f6640 1 -- 172.21.15.12:0/544353036 shutdown_connections 2024-09-16T01:03:48.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.402+0000 7f1f373f6640 1 --2- 172.21.15.12:0/544353036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f30106f10 0x7f1f3010ea90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.402+0000 7f1f373f6640 1 --2- 172.21.15.12:0/544353036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f30102790 0x7f1f301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.402+0000 7f1f373f6640 1 --2- 172.21.15.12:0/544353036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f30101de0 0x7f1f301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.402+0000 7f1f373f6640 1 -- 172.21.15.12:0/544353036 >> 172.21.15.12:0/544353036 conn(0x7f1f300fd8c0 msgr2=0x7f1f300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.402+0000 7f1f373f6640 1 -- 172.21.15.12:0/544353036 shutdown_connections 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.402+0000 7f1f373f6640 1 -- 172.21.15.12:0/544353036 wait complete. 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.403+0000 7f1f373f6640 1 Processor -- start 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.403+0000 7f1f373f6640 1 -- start start 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.403+0000 7f1f373f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f30101de0 0x7f1f300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.403+0000 7f1f373f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f30102790 0x7f1f30074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.403+0000 7f1f373f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f30106f10 0x7f1f30074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.403+0000 7f1f373f6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f30111f90 con 0x7f1f30101de0 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.403+0000 7f1f373f6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1f30111e10 con 0x7f1f30102790 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.403+0000 7f1f373f6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1f30112110 con 0x7f1f30106f10 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.403+0000 7f1f35192640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f30101de0 0x7f1f300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f35192640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f30101de0 0x7f1f300744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38066/0 (socket says 172.21.15.12:38066) 2024-09-16T01:03:48.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f35192640 1 -- 172.21.15.12:0/1361246646 learned_addr learned my addr 172.21.15.12:0/1361246646 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f34991640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f30102790 0x7f1f30074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f35993640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f30106f10 0x7f1f30074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f35192640 1 -- 172.21.15.12:0/1361246646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f30106f10 msgr2=0x7f1f30074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f35192640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f30106f10 0x7f1f30074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f35192640 1 -- 172.21.15.12:0/1361246646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f30102790 msgr2=0x7f1f30074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f35192640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f30102790 0x7f1f30074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f35192640 1 -- 172.21.15.12:0/1361246646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f301a68d0 con 0x7f1f30101de0 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f34991640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f30102790 0x7f1f30074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f35192640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f30101de0 0x7f1f300744f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000cce0 tx=0x7f1f2000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f2e7fc640 1 -- 172.21.15.12:0/1361246646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000f650 con 0x7f1f30101de0 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f2e7fc640 1 -- 172.21.15.12:0/1361246646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2000fcd0 con 0x7f1f30101de0 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f373f6640 1 -- 172.21.15.12:0/1361246646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f301a6bc0 con 0x7f1f30101de0 2024-09-16T01:03:48.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f2e7fc640 1 -- 172.21.15.12:0/1361246646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20018c70 con 0x7f1f30101de0 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.404+0000 7f1f373f6640 1 -- 172.21.15.12:0/1361246646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f301a7150 con 0x7f1f30101de0 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f2e7fc640 1 -- 172.21.15.12:0/1361246646 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1f2000f7f0 con 0x7f1f30101de0 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f397cf740 1 Processor -- start 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f397cf740 1 -- start start 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d4ea00 0x561e18d4ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d59be0 0x561e18d5bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f397cf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561e18cb3200 con 0x561e18d4ea00 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f397cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561e18c59dc0 con 0x561e18d59be0 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f397cf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561e18caf1c0 con 0x561e18d4f320 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f35993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d4ea00 0x561e18d4ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f2e7fc640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1f180a32c0 0x7f1f180a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f35993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d4ea00 0x561e18d4ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38078/0 (socket says 172.21.15.12:38078) 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.407+0000 7f1f35993640 1 -- 172.21.15.12:0/3505647450 learned_addr learned my addr 172.21.15.12:0/3505647450 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f35192640 1 --2- 172.21.15.12:0/3505647450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f34991640 1 --2- 172.21.15.12:0/3505647450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d59be0 0x561e18d5bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f35993640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1f180a32c0 0x7f1f180a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f2e7fc640 1 -- 172.21.15.12:0/1361246646 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f1f200d0180 con 0x7f1f30101de0 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f35993640 1 -- 172.21.15.12:0/3505647450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 msgr2=0x561e18d596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f35993640 1 --2- 172.21.15.12:0/3505647450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f35993640 1 -- 172.21.15.12:0/3505647450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d59be0 msgr2=0x561e18d5bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f35993640 1 --2- 172.21.15.12:0/3505647450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d59be0 0x561e18d5bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f35993640 1 -- 172.21.15.12:0/3505647450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e18a24620 con 0x561e18d4ea00 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f34991640 1 --2- 172.21.15.12:0/3505647450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d59be0 0x561e18d5bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f35993640 1 --2- 172.21.15.12:0/3505647450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d4ea00 0x561e18d4ede0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1f28005ab0 tx=0x7f1f28004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a68ea52724f9c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:48.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f35993640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1f180a32c0 0x7f1f180a5780 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1f28031550 tx=0x7f1f28047000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:48.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f177fe640 1 -- 172.21.15.12:0/3505647450 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28035070 con 0x561e18d4ea00 2024-09-16T01:03:48.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f177fe640 1 -- 172.21.15.12:0/3505647450 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f28003bc0 con 0x561e18d4ea00 2024-09-16T01:03:48.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.408+0000 7f1f177fe640 1 -- 172.21.15.12:0/3505647450 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2803d460 con 0x561e18d4ea00 2024-09-16T01:03:48.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.409+0000 7f1f397cf740 1 -- 172.21.15.12:0/3505647450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d4ea00 msgr2=0x561e18d4ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:48.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.409+0000 7f1f397cf740 1 --2- 172.21.15.12:0/3505647450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d4ea00 0x561e18d4ede0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1f28005ab0 tx=0x7f1f28004040 comp rx=0 tx=0).stop 2024-09-16T01:03:48.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.409+0000 7f1f397cf740 1 -- 172.21.15.12:0/3505647450 shutdown_connections 2024-09-16T01:03:48.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.409+0000 7f1f397cf740 1 --2- 172.21.15.12:0/3505647450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d59be0 0x561e18d5bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.409+0000 7f1f397cf740 1 --2- 172.21.15.12:0/3505647450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.409+0000 7f1f397cf740 1 --2- 172.21.15.12:0/3505647450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d4ea00 0x561e18d4ede0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.409+0000 7f1f397cf740 1 -- 172.21.15.12:0/3505647450 >> 172.21.15.12:0/3505647450 conn(0x561e18d4af90 msgr2=0x561e18d4b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.409+0000 7f1f397cf740 1 -- 172.21.15.12:0/3505647450 shutdown_connections 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.409+0000 7f1f397cf740 1 -- 172.21.15.12:0/3505647450 wait complete. 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.409+0000 7f1f397cf740 1 -- start start 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f397cf740 1 Processor -- start 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d59530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d567e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d56d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f397cf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561e18d5c7b0 con 0x561e18d59be0 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f397cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561e18c4dc50 con 0x561e18d4ea00 2024-09-16T01:03:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f397cf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561e18d5c930 con 0x561e18d4f320 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f397cf740 10 client.0 _ll_register_callbacks cb 0x561e18c5fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f35993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d56d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f35993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d56d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38090/0 (socket says 172.21.15.12:38090) 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f35993640 1 -- 172.21.15.12:0/4015282219 learned_addr learned my addr 172.21.15.12:0/4015282219 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f35192640 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d59530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f34991640 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f35993640 1 -- 172.21.15.12:0/4015282219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 msgr2=0x561e18d567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f35993640 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f35993640 1 -- 172.21.15.12:0/4015282219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 msgr2=0x561e18d59530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f35993640 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d59530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.410+0000 7f1f35993640 1 -- 172.21.15.12:0/4015282219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e18d57570 con 0x561e18d59be0 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.411+0000 7f1f35993640 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d56d40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1f2803a830 tx=0x7f1f2802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2058e4a056b09aba server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:48.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.411+0000 7f1f14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.411+0000 7f1f14ff9640 1 -- 172.21.15.12:0/4015282219 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28035040 con 0x561e18d59be0 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.411+0000 7f1f397cf740 1 -- 172.21.15.12:0/4015282219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f28003bc0 con 0x561e18d59be0 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.411+0000 7f1f14ff9640 1 -- 172.21.15.12:0/4015282219 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f1f28003d70 con 0x561e18d59be0 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.411+0000 7f1f14ff9640 1 -- 172.21.15.12:0/4015282219 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f28063050 con 0x561e18d59be0 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.411+0000 7f1f397cf740 10 client.16197 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.411+0000 7f1f397cf740 1 -- 172.21.15.12:0/4015282219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561e18d68360 con 0x561e18d59be0 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.411+0000 7f1f14ff9640 1 -- 172.21.15.12:0/4015282219 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f28003bc0 con 0x561e18d59be0 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.411+0000 7f1f14ff9640 1 -- 172.21.15.12:0/4015282219 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1f2803dba0 con 0x561e18d59be0 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.412+0000 7f1f397cf740 10 client.16197 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.412+0000 7f1f397cf740 10 client.16197 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.412+0000 7f1f397cf740 20 client.16197 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.412+0000 7f1f397cf740 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x561e18d69a20 0x561e18d6be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.412+0000 7f1f397cf740 4 client.16197 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.412+0000 7f1f397cf740 1 -- 172.21.15.12:0/4015282219 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e18cc0770 con 0x561e18d69a20 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.412+0000 7f1f35192640 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x561e18d69a20 0x561e18d6be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.412+0000 7f1f35192640 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x561e18d69a20 0x561e18d6be40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b82f3af16b9042 server_cookie=683f802520efacdf in_seq=0 out_seq=0 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.412+0000 7f1f14ff9640 10 client.16197 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f14ff9640 1 -- 172.21.15.12:0/4015282219 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e18cc0770 con 0x561e18d69a20 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f14ff9640 10 client.16197 handle_command_reply: tid=0 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f397cf740 1 client.16197 shutdown 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f397cf740 1 -- 172.21.15.12:0/4015282219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 msgr2=0x561e18d56d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f397cf740 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d56d40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1f2803a830 tx=0x7f1f2802a3f0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f397cf740 1 -- 172.21.15.12:0/4015282219 shutdown_connections 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f397cf740 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x561e18d69a20 0x561e18d6be40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f397cf740 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d56d40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f397cf740 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f14ff9640 0 client.16197 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:48.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f397cf740 1 --2- 172.21.15.12:0/4015282219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d59530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.413+0000 7f1f397cf740 1 -- 172.21.15.12:0/4015282219 >> 172.21.15.12:0/4015282219 conn(0x561e18d4af90 msgr2=0x561e18d4a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:48.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.414+0000 7f1f397cf740 1 -- 172.21.15.12:0/4015282219 shutdown_connections 2024-09-16T01:03:48.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.414+0000 7f1f397cf740 1 -- 172.21.15.12:0/4015282219 wait complete. 2024-09-16T01:03:48.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.414+0000 7f1f397cf740 20 client.16197 trim_cache size 0 max 16384 2024-09-16T01:03:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.431+0000 7f1f397cf740 1 Processor -- start 2024-09-16T01:03:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f397cf740 1 -- start start 2024-09-16T01:03:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d65a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d71750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d71c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f397cf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f301b0d10 con 0x561e18d59be0 2024-09-16T01:03:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f397cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1f301b2850 con 0x561e18d4ea00 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f397cf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1f301b13e0 con 0x561e18d4f320 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f35993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d71c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f35993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d71c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38106/0 (socket says 172.21.15.12:38106) 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f35993640 1 -- 172.21.15.12:0/1507099340 learned_addr learned my addr 172.21.15.12:0/1507099340 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f35192640 1 --2- 172.21.15.12:0/1507099340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d65a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f34991640 1 --2- 172.21.15.12:0/1507099340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d71750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f35993640 1 -- 172.21.15.12:0/1507099340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 msgr2=0x561e18d71750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f35993640 1 --2- 172.21.15.12:0/1507099340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d71750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f35993640 1 -- 172.21.15.12:0/1507099340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 msgr2=0x561e18d65a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f35993640 1 --2- 172.21.15.12:0/1507099340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d65a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f35993640 1 -- 172.21.15.12:0/1507099340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e18d4c040 con 0x561e18d59be0 2024-09-16T01:03:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.432+0000 7f1f35192640 1 --2- 172.21.15.12:0/1507099340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d65a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:48.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.433+0000 7f1f35993640 1 --2- 172.21.15.12:0/1507099340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d71c90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1f28001eb0 tx=0x7f1f280097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fee53c54fdfb4b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.433+0000 7f1f16ffd640 1 -- 172.21.15.12:0/1507099340 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28035040 con 0x561e18d59be0 2024-09-16T01:03:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.433+0000 7f1f16ffd640 1 -- 172.21.15.12:0/1507099340 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2803a860 con 0x561e18d59be0 2024-09-16T01:03:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.433+0000 7f1f16ffd640 1 -- 172.21.15.12:0/1507099340 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28052ae0 con 0x561e18d59be0 2024-09-16T01:03:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 -- 172.21.15.12:0/1507099340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 msgr2=0x561e18d71c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 --2- 172.21.15.12:0/1507099340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d71c90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1f28001eb0 tx=0x7f1f280097c0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 -- 172.21.15.12:0/1507099340 shutdown_connections 2024-09-16T01:03:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 --2- 172.21.15.12:0/1507099340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18d71c90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 --2- 172.21.15.12:0/1507099340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d71750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 --2- 172.21.15.12:0/1507099340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d65a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 -- 172.21.15.12:0/1507099340 >> 172.21.15.12:0/1507099340 conn(0x561e18d4af90 msgr2=0x561e18d4a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 -- 172.21.15.12:0/1507099340 shutdown_connections 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 -- 172.21.15.12:0/1507099340 wait complete. 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 -- start start 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.434+0000 7f1f397cf740 1 Processor -- start 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d5d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d5d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f397cf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18dd2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f397cf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f301b2180 con 0x561e18d59be0 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f397cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1f301b1ab0 con 0x561e18d4ea00 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f397cf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1f301aecf0 con 0x561e18d4f320 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f397cf740 10 client.0 _ll_register_callbacks cb 0x7f1f240071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f35993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18dd2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f35993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18dd2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38122/0 (socket says 172.21.15.12:38122) 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f35993640 1 -- 172.21.15.12:0/99948393 learned_addr learned my addr 172.21.15.12:0/99948393 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f35192640 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d5d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f34991640 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d5d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f35993640 1 -- 172.21.15.12:0/99948393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 msgr2=0x561e18d5d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f35993640 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d5d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f35993640 1 -- 172.21.15.12:0/99948393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 msgr2=0x561e18d5d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f35993640 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d5d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f35993640 1 -- 172.21.15.12:0/99948393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e18d570b0 con 0x561e18d59be0 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f35993640 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18dd2710 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1f2804a040 tx=0x7f1f2802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1319dad840766154 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.435+0000 7f1f14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f14ff9640 1 -- 172.21.15.12:0/99948393 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28035040 con 0x561e18d59be0 2024-09-16T01:03:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f14ff9640 1 -- 172.21.15.12:0/99948393 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f1f28003bc0 con 0x561e18d59be0 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f397cf740 1 -- 172.21.15.12:0/99948393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f2803a860 con 0x561e18d59be0 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f14ff9640 1 -- 172.21.15.12:0/99948393 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f2807a050 con 0x561e18d59be0 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f397cf740 10 client.16203 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f397cf740 1 -- 172.21.15.12:0/99948393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561e18dd3d90 con 0x561e18d59be0 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f14ff9640 1 -- 172.21.15.12:0/99948393 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2803a860 con 0x561e18d59be0 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f14ff9640 1 -- 172.21.15.12:0/99948393 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1f28005020 con 0x561e18d59be0 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f397cf740 10 client.16203 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f397cf740 10 client.16203 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f397cf740 20 client.16203 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f397cf740 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x561e18d69a20 0x561e18dd64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f397cf740 4 client.16203 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-16T01:03:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.436+0000 7f1f397cf740 1 -- 172.21.15.12:0/99948393 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x561e18cbac80 con 0x561e18d69a20 2024-09-16T01:03:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.437+0000 7f1f35192640 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x561e18d69a20 0x561e18dd64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.437+0000 7f1f35192640 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x561e18d69a20 0x561e18dd64c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc1bc71e96f040b3 server_cookie=c2efe3229a95a7eb in_seq=0 out_seq=0 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.437+0000 7f1f14ff9640 10 client.16203 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.437+0000 7f1f14ff9640 1 -- 172.21.15.12:0/99948393 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x561e18cbac80 con 0x561e18d69a20 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.437+0000 7f1f14ff9640 10 client.16203 handle_command_reply: tid=0 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.437+0000 7f1f397cf740 1 client.16203 shutdown 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.437+0000 7f1f397cf740 1 -- 172.21.15.12:0/99948393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 msgr2=0x561e18dd2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.437+0000 7f1f397cf740 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18dd2710 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1f2804a040 tx=0x7f1f2802a3f0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f397cf740 1 -- 172.21.15.12:0/99948393 shutdown_connections 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f397cf740 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x561e18d69a20 0x561e18dd64c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f397cf740 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e18d59be0 0x561e18dd2710 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f14ff9640 0 client.16203 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f397cf740 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e18d4f320 0x561e18d5d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f397cf740 1 --2- 172.21.15.12:0/99948393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e18d4ea00 0x561e18d5d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f397cf740 1 -- 172.21.15.12:0/99948393 >> 172.21.15.12:0/99948393 conn(0x561e18d4af90 msgr2=0x561e18d51510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f397cf740 1 -- 172.21.15.12:0/99948393 shutdown_connections 2024-09-16T01:03:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f397cf740 1 -- 172.21.15.12:0/99948393 wait complete. 2024-09-16T01:03:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f397cf740 20 client.16203 trim_cache size 0 max 16384 2024-09-16T01:03:48.444 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:03:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 29, 2024-09-16T01:03:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24518, 2024-09-16T01:03:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 8, 2024-09-16T01:03:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": {} 2024-09-16T01:03:48.445 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:03:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f373f6640 1 -- 172.21.15.12:0/1361246646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1f180a32c0 msgr2=0x7f1f180a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f373f6640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1f180a32c0 0x7f1f180a5780 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1f28031550 tx=0x7f1f28047000 comp rx=0 tx=0).stop 2024-09-16T01:03:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f373f6640 1 -- 172.21.15.12:0/1361246646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f30101de0 msgr2=0x7f1f300744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.438+0000 7f1f373f6640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f30101de0 0x7f1f300744f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000cce0 tx=0x7f1f2000a620 comp rx=0 tx=0).stop 2024-09-16T01:03:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.439+0000 7f1f373f6640 1 -- 172.21.15.12:0/1361246646 shutdown_connections 2024-09-16T01:03:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.439+0000 7f1f373f6640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1f180a32c0 0x7f1f180a5780 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.439+0000 7f1f373f6640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f30106f10 0x7f1f30074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.439+0000 7f1f373f6640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f30102790 0x7f1f30074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.439+0000 7f1f373f6640 1 --2- 172.21.15.12:0/1361246646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f30101de0 0x7f1f300744f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.439+0000 7f1f373f6640 1 -- 172.21.15.12:0/1361246646 >> 172.21.15.12:0/1361246646 conn(0x7f1f300fd8c0 msgr2=0x7f1f300ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.439+0000 7f1f373f6640 1 -- 172.21.15.12:0/1361246646 shutdown_connections 2024-09-16T01:03:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:48.439+0000 7f1f373f6640 1 -- 172.21.15.12:0/1361246646 wait complete. 2024-09-16T01:03:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:48 smithi119 ceph-mon[35049]: pgmap v441: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 21 MiB/s wr, 14 op/s 2024-09-16T01:03:49.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:48 smithi012 ceph-mon[31197]: pgmap v441: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 21 MiB/s wr, 14 op/s 2024-09-16T01:03:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:48 smithi098 ceph-mon[35346]: pgmap v441: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 21 MiB/s wr, 14 op/s 2024-09-16T01:03:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.787+0000 7f85284d4640 1 -- 172.21.15.12:0/2295437726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8520106f10 msgr2=0x7f852010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.787+0000 7f85284d4640 1 --2- 172.21.15.12:0/2295437726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8520106f10 0x7f852010ea90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8518009ca0 tx=0x7f851802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.787+0000 7f85284d4640 1 -- 172.21.15.12:0/2295437726 shutdown_connections 2024-09-16T01:03:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.787+0000 7f85284d4640 1 --2- 172.21.15.12:0/2295437726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8520106f10 0x7f852010ea90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.787+0000 7f85284d4640 1 --2- 172.21.15.12:0/2295437726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8520102790 0x7f85201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.787+0000 7f85284d4640 1 --2- 172.21.15.12:0/2295437726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8520101de0 0x7f85201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.787+0000 7f85284d4640 1 -- 172.21.15.12:0/2295437726 >> 172.21.15.12:0/2295437726 conn(0x7f85200fd8c0 msgr2=0x7f85200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.787+0000 7f85284d4640 1 -- 172.21.15.12:0/2295437726 shutdown_connections 2024-09-16T01:03:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.787+0000 7f85284d4640 1 -- 172.21.15.12:0/2295437726 wait complete. 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f85284d4640 1 Processor -- start 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f85284d4640 1 -- start start 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f85284d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8520101de0 0x7f8520198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f85284d4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8520102790 0x7f8520198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f85284d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8520106f10 0x7f852019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f85284d4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8520111f70 con 0x7f8520101de0 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f85284d4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8520111df0 con 0x7f8520102790 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f85284d4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f85201120f0 con 0x7f8520106f10 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f8526270640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8520101de0 0x7f8520198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f8526270640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8520101de0 0x7f8520198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38150/0 (socket says 172.21.15.12:38150) 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f8526270640 1 -- 172.21.15.12:0/2622519614 learned_addr learned my addr 172.21.15.12:0/2622519614 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f8525a6f640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8520102790 0x7f8520198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f8526270640 1 -- 172.21.15.12:0/2622519614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8520106f10 msgr2=0x7f852019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f8526a71640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8520106f10 0x7f852019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f8526270640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8520106f10 0x7f852019cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f8526270640 1 -- 172.21.15.12:0/2622519614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8520102790 msgr2=0x7f8520198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f8526270640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8520102790 0x7f8520198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.788+0000 7f8526270640 1 -- 172.21.15.12:0/2622519614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852019d2e0 con 0x7f8520101de0 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.789+0000 7f8526270640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8520101de0 0x7f8520198330 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f851c00c920 tx=0x7f851c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.789+0000 7f85177fe640 1 -- 172.21.15.12:0/2622519614 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c007c70 con 0x7f8520101de0 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.789+0000 7f85284d4640 1 -- 172.21.15.12:0/2622519614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852019d5d0 con 0x7f8520101de0 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.789+0000 7f85177fe640 1 -- 172.21.15.12:0/2622519614 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f851c007e10 con 0x7f8520101de0 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.789+0000 7f85177fe640 1 -- 172.21.15.12:0/2622519614 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c018890 con 0x7f8520101de0 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.789+0000 7f85284d4640 1 -- 172.21.15.12:0/2622519614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85201a4eb0 con 0x7f8520101de0 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.791+0000 7f85177fe640 1 -- 172.21.15.12:0/2622519614 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f851c018a70 con 0x7f8520101de0 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.791+0000 7f852a8ad740 1 Processor -- start 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f852a8ad740 1 -- start start 2024-09-16T01:03:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feae730 0x55b43feaeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43febde40 0x55b43fec0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f852a8ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b43fe13160 con 0x55b43feaf050 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f852a8ad740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b43fdba720 con 0x55b43febde40 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f852a8ad740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b43fe0f120 con 0x55b43feae730 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526270640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526270640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38152/0 (socket says 172.21.15.12:38152) 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526270640 1 -- 172.21.15.12:0/565681500 learned_addr learned my addr 172.21.15.12:0/565681500 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8525a6f640 1 --2- 172.21.15.12:0/565681500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43febde40 0x55b43fec0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526a71640 1 --2- 172.21.15.12:0/565681500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feae730 0x55b43feaeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f85177fe640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f850c0a3240 0x7f850c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526270640 1 -- 172.21.15.12:0/565681500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feae730 msgr2=0x55b43feaeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526270640 1 --2- 172.21.15.12:0/565681500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feae730 0x55b43feaeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526270640 1 -- 172.21.15.12:0/565681500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43febde40 msgr2=0x55b43fec0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526270640 1 --2- 172.21.15.12:0/565681500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43febde40 0x55b43fec0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526270640 1 -- 172.21.15.12:0/565681500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b43fb84ba0 con 0x55b43feaf050 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526a71640 1 --2- 172.21.15.12:0/565681500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feae730 0x55b43feaeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.792+0000 7f8526a71640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f850c0a3240 0x7f850c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.793+0000 7f85177fe640 1 -- 172.21.15.12:0/2622519614 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f851c0cfed0 con 0x7f8520101de0 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.793+0000 7f8526270640 1 --2- 172.21.15.12:0/565681500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febd900 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f851c07f450 tx=0x7f851c066ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0049ea91ea686c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.793+0000 7f8514ff9640 1 -- 172.21.15.12:0/565681500 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c09ba90 con 0x55b43feaf050 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.793+0000 7f8526a71640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f850c0a3240 0x7f850c0a5700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8518005cc0 tx=0x7f85180095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.793+0000 7f8514ff9640 1 -- 172.21.15.12:0/565681500 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f851c080720 con 0x55b43feaf050 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.793+0000 7f8514ff9640 1 -- 172.21.15.12:0/565681500 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c0d3a00 con 0x55b43feaf050 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 -- 172.21.15.12:0/565681500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 msgr2=0x55b43febd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 --2- 172.21.15.12:0/565681500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febd900 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f851c07f450 tx=0x7f851c066ac0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 -- 172.21.15.12:0/565681500 shutdown_connections 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 --2- 172.21.15.12:0/565681500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43febde40 0x55b43fec0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 --2- 172.21.15.12:0/565681500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febd900 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 --2- 172.21.15.12:0/565681500 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feae730 0x55b43feaeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 -- 172.21.15.12:0/565681500 >> 172.21.15.12:0/565681500 conn(0x55b43feaade0 msgr2=0x55b43feab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 -- 172.21.15.12:0/565681500 shutdown_connections 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 -- 172.21.15.12:0/565681500 wait complete. 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 -- start start 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 Processor -- start 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feae730 0x55b43febad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.794+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43febde40 0x55b43febb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f852a8ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b43fec0a10 con 0x55b43feaf050 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f852a8ad740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b43fd9b900 con 0x55b43feae730 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f852a8ad740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b43fec0b90 con 0x55b43febde40 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f852a8ad740 10 client.0 _ll_register_callbacks cb 0x55b43fd99780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8525a6f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8526270640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feae730 0x55b43febad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8525a6f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38168/0 (socket says 172.21.15.12:38168) 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8525a6f640 1 -- 172.21.15.12:0/572995442 learned_addr learned my addr 172.21.15.12:0/572995442 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8526a71640 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43febde40 0x55b43febb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8525a6f640 1 -- 172.21.15.12:0/572995442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43febde40 msgr2=0x55b43febb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8525a6f640 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43febde40 0x55b43febb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8525a6f640 1 -- 172.21.15.12:0/572995442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feae730 msgr2=0x55b43febad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8525a6f640 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feae730 0x55b43febad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8525a6f640 1 -- 172.21.15.12:0/572995442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b43fddbc50 con 0x55b43feaf050 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8525a6f640 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febb290 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f851000efd0 tx=0x7f8510010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5322f15c699d761d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8509ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8509ffb640 1 -- 172.21.15.12:0/572995442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8510004220 con 0x55b43feaf050 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f8509ffb640 1 -- 172.21.15.12:0/572995442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f85100043c0 con 0x55b43feaf050 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.795+0000 7f852a8ad740 1 -- 172.21.15.12:0/572995442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b43fe20890 con 0x55b43feaf050 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f8509ffb640 1 -- 172.21.15.12:0/572995442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f851000c910 con 0x55b43feaf050 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f852a8ad740 10 client.16215 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f852a8ad740 1 -- 172.21.15.12:0/572995442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b43fecc700 con 0x55b43feaf050 2024-09-16T01:03:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f8509ffb640 1 -- 172.21.15.12:0/572995442 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b43fe20890 con 0x55b43feaf050 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f8509ffb640 1 -- 172.21.15.12:0/572995442 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8510011440 con 0x55b43feaf050 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f852a8ad740 10 client.16215 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f852a8ad740 10 client.16215 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f852a8ad740 20 client.16215 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f852a8ad740 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b43fecdfc0 0x55b43fed0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f852a8ad740 4 client.16215 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.796+0000 7f852a8ad740 1 -- 172.21.15.12:0/572995442 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b43fe1abe0 con 0x55b43fecdfc0 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.797+0000 7f8526270640 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b43fecdfc0 0x55b43fed0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.797+0000 7f8526270640 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b43fecdfc0 0x55b43fed0440 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c055d012824af2a0 server_cookie=6e7e3b0a88b52a1e in_seq=0 out_seq=0 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.797+0000 7f8509ffb640 10 client.16215 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.798+0000 7f8509ffb640 1 -- 172.21.15.12:0/572995442 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b43fe1abe0 con 0x55b43fecdfc0 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.798+0000 7f8509ffb640 10 client.16215 handle_command_reply: tid=0 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.798+0000 7f852a8ad740 1 client.16215 shutdown 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 1 -- 172.21.15.12:0/572995442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 msgr2=0x55b43febb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febb290 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f851000efd0 tx=0x7f8510010b60 comp rx=0 tx=0).stop 2024-09-16T01:03:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 1 -- 172.21.15.12:0/572995442 shutdown_connections 2024-09-16T01:03:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b43fecdfc0 0x55b43fed0440 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43febde40 0x55b43febb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feaf050 0x55b43febb290 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 1 --2- 172.21.15.12:0/572995442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feae730 0x55b43febad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 1 -- 172.21.15.12:0/572995442 >> 172.21.15.12:0/572995442 conn(0x55b43feaade0 msgr2=0x55b43feb0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f8509ffb640 0 client.16215 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 1 -- 172.21.15.12:0/572995442 shutdown_connections 2024-09-16T01:03:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 1 -- 172.21.15.12:0/572995442 wait complete. 2024-09-16T01:03:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.799+0000 7f852a8ad740 20 client.16215 trim_cache size 0 max 16384 2024-09-16T01:03:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f852a8ad740 1 Processor -- start 2024-09-16T01:03:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f852a8ad740 1 -- start start 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feae730 0x55b43febccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feaf050 0x55b43fed5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43febde40 0x55b43fed6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f852a8ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f85201ac9d0 con 0x55b43febde40 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f852a8ad740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f85201ae510 con 0x55b43feae730 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f852a8ad740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f85201ad0a0 con 0x55b43feaf050 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f8526a71640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43febde40 0x55b43fed6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f8526a71640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43febde40 0x55b43fed6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38180/0 (socket says 172.21.15.12:38180) 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.816+0000 7f8526a71640 1 -- 172.21.15.12:0/2126483333 learned_addr learned my addr 172.21.15.12:0/2126483333 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f8526270640 1 --2- 172.21.15.12:0/2126483333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feae730 0x55b43febccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f8525a6f640 1 --2- 172.21.15.12:0/2126483333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feaf050 0x55b43fed5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f8526a71640 1 -- 172.21.15.12:0/2126483333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feaf050 msgr2=0x55b43fed5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f8526a71640 1 --2- 172.21.15.12:0/2126483333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feaf050 0x55b43fed5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f8526a71640 1 -- 172.21.15.12:0/2126483333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feae730 msgr2=0x55b43febccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f8526a71640 1 --2- 172.21.15.12:0/2126483333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feae730 0x55b43febccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f8526a71640 1 -- 172.21.15.12:0/2126483333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b43feb9d00 con 0x55b43febde40 2024-09-16T01:03:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f8526a71640 1 --2- 172.21.15.12:0/2126483333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43febde40 0x55b43fed6290 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8518031f20 tx=0x7f8518036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa0f2442e7f82ae server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f850bfff640 1 -- 172.21.15.12:0/2126483333 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518004040 con 0x55b43febde40 2024-09-16T01:03:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f850bfff640 1 -- 172.21.15.12:0/2126483333 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8518036070 con 0x55b43febde40 2024-09-16T01:03:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.817+0000 7f850bfff640 1 -- 172.21.15.12:0/2126483333 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851802fe00 con 0x55b43febde40 2024-09-16T01:03:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 -- 172.21.15.12:0/2126483333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43febde40 msgr2=0x55b43fed6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 --2- 172.21.15.12:0/2126483333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43febde40 0x55b43fed6290 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8518031f20 tx=0x7f8518036000 comp rx=0 tx=0).stop 2024-09-16T01:03:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 -- 172.21.15.12:0/2126483333 shutdown_connections 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 --2- 172.21.15.12:0/2126483333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43febde40 0x55b43fed6290 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 --2- 172.21.15.12:0/2126483333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43feaf050 0x55b43fed5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 --2- 172.21.15.12:0/2126483333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feae730 0x55b43febccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 -- 172.21.15.12:0/2126483333 >> 172.21.15.12:0/2126483333 conn(0x55b43feaade0 msgr2=0x55b43febc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 -- 172.21.15.12:0/2126483333 shutdown_connections 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 -- 172.21.15.12:0/2126483333 wait complete. 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 -- start start 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.818+0000 7f852a8ad740 1 Processor -- start 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feae730 0x55b43fec6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feaf050 0x55b43fec1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f852a8ad740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43febde40 0x55b43fec1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f852a8ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f85201ade40 con 0x55b43feae730 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f852a8ad740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f85201ad770 con 0x55b43feaf050 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f852a8ad740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f85201aa9b0 con 0x55b43febde40 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f852a8ad740 10 client.0 _ll_register_callbacks cb 0x7f851000e350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8526270640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feae730 0x55b43fec6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8525a6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feaf050 0x55b43fec1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8526270640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feae730 0x55b43fec6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38184/0 (socket says 172.21.15.12:38184) 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8526270640 1 -- 172.21.15.12:0/3617642109 learned_addr learned my addr 172.21.15.12:0/3617642109 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8525a6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feaf050 0x55b43fec1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.12:60670/0 (socket says 172.21.15.12:60670) 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8526a71640 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43febde40 0x55b43fec1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8526270640 1 -- 172.21.15.12:0/3617642109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43febde40 msgr2=0x55b43fec1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8526270640 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43febde40 0x55b43fec1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8526270640 1 -- 172.21.15.12:0/3617642109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feaf050 msgr2=0x55b43fec1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8526270640 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feaf050 0x55b43fec1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.819+0000 7f8526270640 1 -- 172.21.15.12:0/3617642109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b43fec2140 con 0x55b43feae730 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f8526270640 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feae730 0x55b43fec6310 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f851c098b00 tx=0x7f851c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260c9b2a730c441d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f8509ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f8509ffb640 1 -- 172.21.15.12:0/3617642109 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c06be10 con 0x55b43feae730 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f8509ffb640 1 -- 172.21.15.12:0/3617642109 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f851c097fc0 con 0x55b43feae730 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f852a8ad740 1 -- 172.21.15.12:0/3617642109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8518036070 con 0x55b43feae730 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f8509ffb640 1 -- 172.21.15.12:0/3617642109 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f851c00de20 con 0x55b43feae730 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f852a8ad740 10 client.16221 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f852a8ad740 1 -- 172.21.15.12:0/3617642109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b43ff38a90 con 0x55b43feae730 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f8509ffb640 1 -- 172.21.15.12:0/3617642109 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8518036070 con 0x55b43feae730 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f8509ffb640 1 -- 172.21.15.12:0/3617642109 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f851c0bc0b0 con 0x55b43feae730 2024-09-16T01:03:49.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f852a8ad740 10 client.16221 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f852a8ad740 10 client.16221 resolve_mds: validated gid 24518 aka daemon mds.b 2024-09-16T01:03:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f852a8ad740 20 client.16221 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f852a8ad740 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b43ff38e40 0x55b43ff3b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f852a8ad740 4 client.16221 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}] 2024-09-16T01:03:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.820+0000 7f852a8ad740 1 -- 172.21.15.12:0/3617642109 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}) -- 0x55b43fd96f40 con 0x55b43ff38e40 2024-09-16T01:03:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.821+0000 7f8525a6f640 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b43ff38e40 0x55b43ff3b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.821+0000 7f8509ffb640 10 client.16221 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.821+0000 7f8525a6f640 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b43ff38e40 0x55b43ff3b230 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c54223575d3716f9 server_cookie=a27503f7d6dd7fdf in_seq=0 out_seq=0 2024-09-16T01:03:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.829+0000 7f8509ffb640 1 -- 172.21.15.12:0/3617642109 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b43fd96f40 con 0x55b43ff38e40 2024-09-16T01:03:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.829+0000 7f8509ffb640 10 client.16221 handle_command_reply: tid=0 2024-09-16T01:03:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 client.16221 shutdown 2024-09-16T01:03:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 -- 172.21.15.12:0/3617642109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feae730 msgr2=0x55b43fec6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feae730 0x55b43fec6310 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f851c098b00 tx=0x7f851c000bc0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 -- 172.21.15.12:0/3617642109 shutdown_connections 2024-09-16T01:03:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x55b43ff38e40 0x55b43ff3b230 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b43febde40 0x55b43fec1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b43feaf050 0x55b43fec1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f8509ffb640 0 client.16221 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 --2- 172.21.15.12:0/3617642109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b43feae730 0x55b43fec6310 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 -- 172.21.15.12:0/3617642109 >> 172.21.15.12:0/3617642109 conn(0x55b43feaade0 msgr2=0x55b43febcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 -- 172.21.15.12:0/3617642109 shutdown_connections 2024-09-16T01:03:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 1 -- 172.21.15.12:0/3617642109 wait complete. 2024-09-16T01:03:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f852a8ad740 20 client.16221 trim_cache size 0 max 16384 2024-09-16T01:03:49.833 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:03:49.833 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 29, 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24518, 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 10, 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "be790073": { 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 10, 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 139.6, 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-16T01:03:49.834 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-16T01:03:49.835 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-16T01:03:49.835 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-16T01:03:49.835 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-16T01:03:49.835 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-16T01:03:49.835 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:49.835 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:49.835 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:49.835 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:49.835 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:03:49.835 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:03:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f85284d4640 1 -- 172.21.15.12:0/2622519614 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f850c0a3240 msgr2=0x7f850c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f85284d4640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f850c0a3240 0x7f850c0a5700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8518005cc0 tx=0x7f85180095c0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f85284d4640 1 -- 172.21.15.12:0/2622519614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8520101de0 msgr2=0x7f8520198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f85284d4640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8520101de0 0x7f8520198330 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f851c00c920 tx=0x7f851c00cde0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.830+0000 7f85284d4640 1 -- 172.21.15.12:0/2622519614 shutdown_connections 2024-09-16T01:03:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.831+0000 7f85284d4640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f850c0a3240 0x7f850c0a5700 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.831+0000 7f85284d4640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8520106f10 0x7f852019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.831+0000 7f85284d4640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8520102790 0x7f8520198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.831+0000 7f85284d4640 1 --2- 172.21.15.12:0/2622519614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8520101de0 0x7f8520198330 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:49.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.831+0000 7f85284d4640 1 -- 172.21.15.12:0/2622519614 >> 172.21.15.12:0/2622519614 conn(0x7f85200fd8c0 msgr2=0x7f85200febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:49.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.831+0000 7f85284d4640 1 -- 172.21.15.12:0/2622519614 shutdown_connections 2024-09-16T01:03:49.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:49.831+0000 7f85284d4640 1 -- 172.21.15.12:0/2622519614 wait complete. 2024-09-16T01:03:50.616 INFO:tasks.quiescer:done joining Quiescers 2024-09-16T01:03:50.617 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-16T01:03:50.629 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-16T01:03:51.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:50 smithi119 ceph-mon[35049]: pgmap v442: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-16T01:03:51.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:50 smithi012 ceph-mon[31197]: pgmap v442: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-16T01:03:51.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:50 smithi098 ceph-mon[35346]: pgmap v442: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-16T01:03:53.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:52 smithi119 ceph-mon[35049]: pgmap v443: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 MiB/s wr, 15 op/s 2024-09-16T01:03:53.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:52 smithi012 ceph-mon[31197]: pgmap v443: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 MiB/s wr, 15 op/s 2024-09-16T01:03:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:52 smithi098 ceph-mon[35346]: pgmap v443: 129 pgs: 129 active+clean; 258 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 MiB/s wr, 15 op/s 2024-09-16T01:03:55.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:54 smithi119 ceph-mon[35049]: pgmap v444: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 14 op/s 2024-09-16T01:03:55.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:54 smithi012 ceph-mon[31197]: pgmap v444: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 14 op/s 2024-09-16T01:03:55.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:54 smithi098 ceph-mon[35346]: pgmap v444: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 14 op/s 2024-09-16T01:03:57.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:56 smithi119 ceph-mon[35049]: pgmap v445: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.8 MiB/s wr, 14 op/s 2024-09-16T01:03:57.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:56 smithi012 ceph-mon[31197]: pgmap v445: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.8 MiB/s wr, 14 op/s 2024-09-16T01:03:57.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:56 smithi098 ceph-mon[35346]: pgmap v445: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.8 MiB/s wr, 14 op/s 2024-09-16T01:03:57.288 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:03:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.051+0000 7f55d87b3640 1 -- 172.21.15.12:0/711700157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d0106a80 msgr2=0x7f55d0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.051+0000 7f55d87b3640 1 --2- 172.21.15.12:0/711700157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d0106a80 0x7f55d0106e60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009930 tx=0x7f55cc02a420 comp rx=0 tx=0).stop 2024-09-16T01:03:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.051+0000 7f55d87b3640 1 -- 172.21.15.12:0/711700157 shutdown_connections 2024-09-16T01:03:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.051+0000 7f55d87b3640 1 --2- 172.21.15.12:0/711700157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55d0101420 0x7f55d010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.051+0000 7f55d87b3640 1 --2- 172.21.15.12:0/711700157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55d0100a80 0x7f55d0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.051+0000 7f55d87b3640 1 --2- 172.21.15.12:0/711700157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d0106a80 0x7f55d0106e60 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.051+0000 7f55d87b3640 1 -- 172.21.15.12:0/711700157 >> 172.21.15.12:0/711700157 conn(0x7f55d00fc7a0 msgr2=0x7f55d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.051+0000 7f55d87b3640 1 -- 172.21.15.12:0/711700157 shutdown_connections 2024-09-16T01:03:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.051+0000 7f55d87b3640 1 -- 172.21.15.12:0/711700157 wait complete. 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d87b3640 1 Processor -- start 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d87b3640 1 -- start start 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d87b3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55d0100a80 0x7f55d01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d87b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55d0101420 0x7f55d01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d87b3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d0106a80 0x7f55d019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d87b3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55d0111fa0 con 0x7f55d0106a80 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d87b3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f55d0111e20 con 0x7f55d0100a80 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d87b3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f55d0112120 con 0x7f55d0101420 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d6d50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d0106a80 0x7f55d019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d6d50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d0106a80 0x7f55d019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55456/0 (socket says 172.21.15.12:55456) 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d6d50640 1 -- 172.21.15.12:0/267538213 learned_addr learned my addr 172.21.15.12:0/267538213 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d6d50640 1 -- 172.21.15.12:0/267538213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55d0101420 msgr2=0x7f55d01989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d6d50640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55d0101420 0x7f55d01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d654f640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55d0100a80 0x7f55d01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d6d50640 1 -- 172.21.15.12:0/267538213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55d0100a80 msgr2=0x7f55d01984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d6d50640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55d0100a80 0x7f55d01984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d6d50640 1 -- 172.21.15.12:0/267538213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d019d450 con 0x7f55d0106a80 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.052+0000 7f55d654f640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55d0100a80 0x7f55d01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.053+0000 7f55d6d50640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d0106a80 0x7f55d019cd70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f55c800eb10 tx=0x7f55c800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.053+0000 7f55c77fe640 1 -- 172.21.15.12:0/267538213 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8004b20 con 0x7f55d0106a80 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.053+0000 7f55c77fe640 1 -- 172.21.15.12:0/267538213 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55c8004cc0 con 0x7f55d0106a80 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.053+0000 7f55d87b3640 1 -- 172.21.15.12:0/267538213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d019d740 con 0x7f55d0106a80 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.053+0000 7f55c77fe640 1 -- 172.21.15.12:0/267538213 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8010760 con 0x7f55d0106a80 2024-09-16T01:03:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.053+0000 7f55d87b3640 1 -- 172.21.15.12:0/267538213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d01a5020 con 0x7f55d0106a80 2024-09-16T01:03:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.055+0000 7f55c77fe640 1 -- 172.21.15.12:0/267538213 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f55c8005020 con 0x7f55d0106a80 2024-09-16T01:03:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.055+0000 7f55dab8c740 1 Processor -- start 2024-09-16T01:03:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55dab8c740 1 -- start start 2024-09-16T01:03:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096e4a0 0x5570f096e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f0979140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f097ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55dab8c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5570f08d42e0 con 0x5570f0979680 2024-09-16T01:03:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55dab8c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5570f087bce0 con 0x5570f096e4a0 2024-09-16T01:03:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55dab8c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5570f08d02a0 con 0x5570f096edc0 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55d5d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f097ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55d5d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f097ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55460/0 (socket says 172.21.15.12:55460) 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55d5d4e640 1 -- 172.21.15.12:0/383431234 learned_addr learned my addr 172.21.15.12:0/383431234 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/383431234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096e4a0 0x5570f096e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55d654f640 1 --2- 172.21.15.12:0/383431234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f0979140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.056+0000 7f55c77fe640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55bc0a32c0 0x7f55bc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55d5d4e640 1 -- 172.21.15.12:0/383431234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 msgr2=0x5570f0979140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/383431234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f0979140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55d5d4e640 1 -- 172.21.15.12:0/383431234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096e4a0 msgr2=0x5570f096e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/383431234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096e4a0 0x5570f096e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55d6d50640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55bc0a32c0 0x7f55bc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55d5d4e640 1 -- 172.21.15.12:0/383431234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f0860440 con 0x5570f0979680 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55d654f640 1 --2- 172.21.15.12:0/383431234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f0979140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55c77fe640 1 -- 172.21.15.12:0/267538213 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f55c80d02f0 con 0x7f55d0106a80 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/383431234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f097ba70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f55c0013760 tx=0x7f55c000c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63d4b6a6b5203ff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55c4ff9640 1 -- 172.21.15.12:0/383431234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0004220 con 0x5570f0979680 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55d6d50640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55bc0a32c0 0x7f55bc0a5780 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f55c80049d0 tx=0x7f55c8066ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55c4ff9640 1 -- 172.21.15.12:0/383431234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55c00043c0 con 0x5570f0979680 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.057+0000 7f55c4ff9640 1 -- 172.21.15.12:0/383431234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0009a60 con 0x5570f0979680 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 -- 172.21.15.12:0/383431234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 msgr2=0x5570f097ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 --2- 172.21.15.12:0/383431234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f097ba70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f55c0013760 tx=0x7f55c000c270 comp rx=0 tx=0).stop 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 -- 172.21.15.12:0/383431234 shutdown_connections 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 --2- 172.21.15.12:0/383431234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f097ba70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 --2- 172.21.15.12:0/383431234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f0979140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 --2- 172.21.15.12:0/383431234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096e4a0 0x5570f096e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 -- 172.21.15.12:0/383431234 >> 172.21.15.12:0/383431234 conn(0x5570f096aa30 msgr2=0x5570f096ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 -- 172.21.15.12:0/383431234 shutdown_connections 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 -- 172.21.15.12:0/383431234 wait complete. 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 -- start start 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.058+0000 7f55dab8c740 1 Processor -- start 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096e4a0 0x5570f0979010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096edc0 0x5570f09762c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0976840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55dab8c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5570f097c250 con 0x5570f0979680 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55dab8c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5570f088f050 con 0x5570f096edc0 2024-09-16T01:03:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55dab8c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5570f097c3d0 con 0x5570f096e4a0 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55dab8c740 10 client.0 _ll_register_callbacks cb 0x5570f08cf160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d5d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0976840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d5d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0976840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55476/0 (socket says 172.21.15.12:55476) 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d5d4e640 1 -- 172.21.15.12:0/3901929886 learned_addr learned my addr 172.21.15.12:0/3901929886 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096e4a0 0x5570f0979010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d654f640 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096edc0 0x5570f09762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d5d4e640 1 -- 172.21.15.12:0/3901929886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096e4a0 msgr2=0x5570f0979010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096e4a0 0x5570f0979010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d5d4e640 1 -- 172.21.15.12:0/3901929886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096edc0 msgr2=0x5570f09762c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096edc0 0x5570f09762c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d5d4e640 1 -- 172.21.15.12:0/3901929886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f06453c0 con 0x5570f0979680 2024-09-16T01:03:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0976840 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f55c0003fa0 tx=0x7f55c0009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb48bd3cfc0a5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.059+0000 7f55b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55b9ffb640 1 -- 172.21.15.12:0/3901929886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0013020 con 0x5570f0979680 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55b9ffb640 1 -- 172.21.15.12:0/3901929886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f55c00131c0 con 0x5570f0979680 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55dab8c740 1 -- 172.21.15.12:0/3901929886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55c00043c0 con 0x5570f0979680 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55b9ffb640 1 -- 172.21.15.12:0/3901929886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55c00047e0 con 0x5570f0979680 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55dab8c740 10 client.16233 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55dab8c740 1 -- 172.21.15.12:0/3901929886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5570f0987c40 con 0x5570f0979680 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55b9ffb640 1 -- 172.21.15.12:0/3901929886 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55c00043c0 con 0x5570f0979680 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55b9ffb640 1 -- 172.21.15.12:0/3901929886 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f55c0029060 con 0x5570f0979680 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55dab8c740 10 client.16233 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55dab8c740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55dab8c740 20 client.16233 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55dab8c740 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5570f0989040 0x5570f098b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55dab8c740 4 client.16233 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.060+0000 7f55dab8c740 1 -- 172.21.15.12:0/3901929886 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570f08e1850 con 0x5570f0989040 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.061+0000 7f55d654f640 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5570f0989040 0x5570f098b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.061+0000 7f55d654f640 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5570f0989040 0x5570f098b430 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5302d787f31e410f server_cookie=7766bbd615d29094 in_seq=0 out_seq=0 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.061+0000 7f55b9ffb640 10 client.16233 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55b9ffb640 1 -- 172.21.15.12:0/3901929886 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570f08e1850 con 0x5570f0989040 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55b9ffb640 10 client.16233 handle_command_reply: tid=0 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 client.16233 shutdown 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 -- 172.21.15.12:0/3901929886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 msgr2=0x5570f0976840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0976840 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f55c0003fa0 tx=0x7f55c0009720 comp rx=0 tx=0).stop 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 -- 172.21.15.12:0/3901929886 shutdown_connections 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5570f0989040 0x5570f098b430 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0976840 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096edc0 0x5570f09762c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 --2- 172.21.15.12:0/3901929886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096e4a0 0x5570f0979010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55b9ffb640 0 client.16233 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 -- 172.21.15.12:0/3901929886 >> 172.21.15.12:0/3901929886 conn(0x5570f096aa30 msgr2=0x5570f0970710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 -- 172.21.15.12:0/3901929886 shutdown_connections 2024-09-16T01:03:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 1 -- 172.21.15.12:0/3901929886 wait complete. 2024-09-16T01:03:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.062+0000 7f55dab8c740 20 client.16233 trim_cache size 0 max 16384 2024-09-16T01:03:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.079+0000 7f55dab8c740 1 Processor -- start 2024-09-16T01:03:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.079+0000 7f55dab8c740 1 -- start start 2024-09-16T01:03:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096e4a0 0x5570f09854b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f0990b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0991080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55dab8c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55d01aed70 con 0x5570f0979680 2024-09-16T01:03:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55dab8c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f55d01b08b0 con 0x5570f096e4a0 2024-09-16T01:03:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55dab8c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f55d01af440 con 0x5570f096edc0 2024-09-16T01:03:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d5d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0991080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d5d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0991080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55490/0 (socket says 172.21.15.12:55490) 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d5d4e640 1 -- 172.21.15.12:0/3444078692 learned_addr learned my addr 172.21.15.12:0/3444078692 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/3444078692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096e4a0 0x5570f09854b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d654f640 1 --2- 172.21.15.12:0/3444078692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f0990b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d5d4e640 1 -- 172.21.15.12:0/3444078692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 msgr2=0x5570f0990b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/3444078692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f0990b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d5d4e640 1 -- 172.21.15.12:0/3444078692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096e4a0 msgr2=0x5570f09854b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/3444078692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096e4a0 0x5570f09854b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d5d4e640 1 -- 172.21.15.12:0/3444078692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f0979380 con 0x5570f0979680 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/3444078692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0991080 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f55c0007020 tx=0x7f55c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d06e2afea00037d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.080+0000 7f55bbfff640 1 -- 172.21.15.12:0/3444078692 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0004320 con 0x5570f0979680 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55bbfff640 1 -- 172.21.15.12:0/3444078692 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55c0005a10 con 0x5570f0979680 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55bbfff640 1 -- 172.21.15.12:0/3444078692 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0004bc0 con 0x5570f0979680 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55dab8c740 1 -- 172.21.15.12:0/3444078692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 msgr2=0x5570f0991080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55dab8c740 1 --2- 172.21.15.12:0/3444078692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0991080 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f55c0007020 tx=0x7f55c00046c0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55dab8c740 1 -- 172.21.15.12:0/3444078692 shutdown_connections 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55dab8c740 1 --2- 172.21.15.12:0/3444078692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f0979680 0x5570f0991080 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55dab8c740 1 --2- 172.21.15.12:0/3444078692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f0990b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55dab8c740 1 --2- 172.21.15.12:0/3444078692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f096e4a0 0x5570f09854b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55dab8c740 1 -- 172.21.15.12:0/3444078692 >> 172.21.15.12:0/3444078692 conn(0x5570f096aa30 msgr2=0x5570f09718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55dab8c740 1 -- 172.21.15.12:0/3444078692 shutdown_connections 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55dab8c740 1 -- 172.21.15.12:0/3444078692 wait complete. 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.081+0000 7f55dab8c740 1 -- start start 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55dab8c740 1 Processor -- start 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f096e4a0 0x5570f0981dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f097d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55dab8c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f0979680 0x5570f097d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55dab8c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55d01b01e0 con 0x5570f096e4a0 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55dab8c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f55d01afb10 con 0x5570f0979680 2024-09-16T01:03:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55dab8c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f55d01acd50 con 0x5570f096edc0 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55dab8c740 10 client.0 _ll_register_callbacks cb 0x7f55c000ccb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d5d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f096e4a0 0x5570f0981dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d5d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f096e4a0 0x5570f0981dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55504/0 (socket says 172.21.15.12:55504) 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d5d4e640 1 -- 172.21.15.12:0/954494964 learned_addr learned my addr 172.21.15.12:0/954494964 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f0979680 0x5570f097d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d654f640 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f097d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d5d4e640 1 -- 172.21.15.12:0/954494964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 msgr2=0x5570f097d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f097d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d5d4e640 1 -- 172.21.15.12:0/954494964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f0979680 msgr2=0x5570f097d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f0979680 0x5570f097d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d5d4e640 1 -- 172.21.15.12:0/954494964 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f097deb0 con 0x5570f096e4a0 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.082+0000 7f55d654f640 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f097d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55d5d4e640 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f096e4a0 0x5570f0981dc0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f55c000a010 tx=0x7f55c00052c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f04e18876d37305 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:03:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55b9ffb640 1 -- 172.21.15.12:0/954494964 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0013040 con 0x5570f096e4a0 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55b9ffb640 1 -- 172.21.15.12:0/954494964 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f55c00131e0 con 0x5570f096e4a0 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55dab8c740 1 -- 172.21.15.12:0/954494964 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55c0005a10 con 0x5570f096e4a0 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55b9ffb640 1 -- 172.21.15.12:0/954494964 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55c0043050 con 0x5570f096e4a0 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55dab8c740 10 client.16239 fetch_fsmap learned FSMap version 29 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55dab8c740 1 -- 172.21.15.12:0/954494964 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5570f09f3b80 con 0x5570f096e4a0 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55b9ffb640 1 -- 172.21.15.12:0/954494964 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55c0005a10 con 0x5570f096e4a0 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55b9ffb640 1 -- 172.21.15.12:0/954494964 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f55c0034040 con 0x5570f096e4a0 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55dab8c740 10 client.16239 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55dab8c740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55dab8c740 20 client.16239 populate_metadata read hostname 'smithi012' 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55dab8c740 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5570f09f4210 0x5570f09f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55dab8c740 4 client.16239 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.083+0000 7f55dab8c740 1 -- 172.21.15.12:0/954494964 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5570f08dbd60 con 0x5570f09f4210 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55d654f640 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5570f09f4210 0x5570f09f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55d654f640 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5570f09f4210 0x5570f09f6630 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9898abc5bc0a614e server_cookie=4e4693823de38077 in_seq=0 out_seq=0 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55b9ffb640 10 client.16239 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55b9ffb640 1 -- 172.21.15.12:0/954494964 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5570f08dbd60 con 0x5570f09f4210 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55b9ffb640 10 client.16239 handle_command_reply: tid=0 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 client.16239 shutdown 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 -- 172.21.15.12:0/954494964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f096e4a0 msgr2=0x5570f0981dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f096e4a0 0x5570f0981dc0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f55c000a010 tx=0x7f55c00052c0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 -- 172.21.15.12:0/954494964 shutdown_connections 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x5570f09f4210 0x5570f09f6630 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5570f0979680 0x5570f097d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570f096edc0 0x5570f097d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55b9ffb640 0 client.16239 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 --2- 172.21.15.12:0/954494964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570f096e4a0 0x5570f0981dc0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 -- 172.21.15.12:0/954494964 >> 172.21.15.12:0/954494964 conn(0x5570f096aa30 msgr2=0x5570f096fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 -- 172.21.15.12:0/954494964 shutdown_connections 2024-09-16T01:03:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.084+0000 7f55dab8c740 1 -- 172.21.15.12:0/954494964 wait complete. 2024-09-16T01:03:58.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55dab8c740 20 client.16239 trim_cache size 0 max 16384 2024-09-16T01:03:58.098 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:03:58.098 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-16T01:03:58.098 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-16T01:03:58.098 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 -- 172.21.15.12:0/267538213 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55bc0a32c0 msgr2=0x7f55bc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55bc0a32c0 0x7f55bc0a5780 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f55c80049d0 tx=0x7f55c8066ee0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 -- 172.21.15.12:0/267538213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d0106a80 msgr2=0x7f55d019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d0106a80 0x7f55d019cd70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f55c800eb10 tx=0x7f55c800c2d0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 -- 172.21.15.12:0/267538213 shutdown_connections 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f55bc0a32c0 0x7f55bc0a5780 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d0106a80 0x7f55d019cd70 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55d0101420 0x7f55d01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 --2- 172.21.15.12:0/267538213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55d0100a80 0x7f55d01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 -- 172.21.15.12:0/267538213 >> 172.21.15.12:0/267538213 conn(0x7f55d00fc7a0 msgr2=0x7f55d00fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 -- 172.21.15.12:0/267538213 shutdown_connections 2024-09-16T01:03:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:58.085+0000 7f55d87b3640 1 -- 172.21.15.12:0/267538213 wait complete. 2024-09-16T01:03:58.907 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-16T01:03:58.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:03:59.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:03:58 smithi098 ceph-mon[35346]: pgmap v446: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-16T01:03:59.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:03:58 smithi119 ceph-mon[35049]: pgmap v446: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-16T01:03:59.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:03:58 smithi012 ceph-mon[31197]: pgmap v446: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-16T01:03:59.168 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:03:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.643+0000 7f84a31e6640 1 -- 172.21.15.12:0/3279432219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c10c180 msgr2=0x7f849c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.643+0000 7f84a31e6640 1 --2- 172.21.15.12:0/3279432219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c10c180 0x7f849c10e600 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8494009ca0 tx=0x7f849402a950 comp rx=0 tx=0).stop 2024-09-16T01:03:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.643+0000 7f84a31e6640 1 -- 172.21.15.12:0/3279432219 shutdown_connections 2024-09-16T01:03:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.643+0000 7f84a31e6640 1 --2- 172.21.15.12:0/3279432219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c10c180 0x7f849c10e600 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.643+0000 7f84a31e6640 1 --2- 172.21.15.12:0/3279432219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849c1036c0 0x7f849c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.643+0000 7f84a31e6640 1 --2- 172.21.15.12:0/3279432219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102da0 0x7f849c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.643+0000 7f84a31e6640 1 -- 172.21.15.12:0/3279432219 >> 172.21.15.12:0/3279432219 conn(0x7f849c0fc7a0 msgr2=0x7f849c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.643+0000 7f84a31e6640 1 -- 172.21.15.12:0/3279432219 shutdown_connections 2024-09-16T01:03:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.643+0000 7f84a31e6640 1 -- 172.21.15.12:0/3279432219 wait complete. 2024-09-16T01:03:59.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a31e6640 1 Processor -- start 2024-09-16T01:03:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a31e6640 1 -- start start 2024-09-16T01:03:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a31e6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102da0 0x7f849c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a31e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849c1036c0 0x7f849c19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a31e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c10c180 0x7f849c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a31e6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f849c111fa0 con 0x7f849c10c180 2024-09-16T01:03:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a31e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f849c111e20 con 0x7f849c1036c0 2024-09-16T01:03:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a31e6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f849c112120 con 0x7f849c102da0 2024-09-16T01:03:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a1783640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c10c180 0x7f849c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a1783640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c10c180 0x7f849c19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55530/0 (socket says 172.21.15.12:55530) 2024-09-16T01:03:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a1783640 1 -- 172.21.15.12:0/4292365004 learned_addr learned my addr 172.21.15.12:0/4292365004 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:03:59.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f849bfff640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849c1036c0 0x7f849c19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a0f82640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102da0 0x7f849c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a1783640 1 -- 172.21.15.12:0/4292365004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102da0 msgr2=0x7f849c19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a1783640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102da0 0x7f849c19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a1783640 1 -- 172.21.15.12:0/4292365004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849c1036c0 msgr2=0x7f849c19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a1783640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849c1036c0 0x7f849c19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f84a1783640 1 -- 172.21.15.12:0/4292365004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c19f680 con 0x7f849c10c180 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.644+0000 7f849bfff640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849c1036c0 0x7f849c19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.645+0000 7f84a1783640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c10c180 0x7f849c19efa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8494006010 tx=0x7f849402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.645+0000 7f8499ffb640 1 -- 172.21.15.12:0/4292365004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8494034040 con 0x7f849c10c180 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.645+0000 7f8499ffb640 1 -- 172.21.15.12:0/4292365004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8494003e00 con 0x7f849c10c180 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.645+0000 7f84a31e6640 1 -- 172.21.15.12:0/4292365004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849c19f910 con 0x7f849c10c180 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.645+0000 7f8499ffb640 1 -- 172.21.15.12:0/4292365004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84940456e0 con 0x7f849c10c180 2024-09-16T01:03:59.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.645+0000 7f84a31e6640 1 -- 172.21.15.12:0/4292365004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849c1a7250 con 0x7f849c10c180 2024-09-16T01:03:59.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.646+0000 7f84a31e6640 1 -- 172.21.15.12:0/4292365004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849c103180 con 0x7f849c10c180 2024-09-16T01:03:59.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.647+0000 7f8499ffb640 1 -- 172.21.15.12:0/4292365004 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8494037020 con 0x7f849c10c180 2024-09-16T01:03:59.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.648+0000 7f8499ffb640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f848c0a32c0 0x7f848c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:59.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.648+0000 7f8499ffb640 1 -- 172.21.15.12:0/4292365004 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f84940f0fb0 con 0x7f849c10c180 2024-09-16T01:03:59.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.648+0000 7f84a0f82640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f848c0a32c0 0x7f848c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:59.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.649+0000 7f84a0f82640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f848c0a32c0 0x7f848c0a5780 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f849000a810 tx=0x7f8490008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:59.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.651+0000 7f8499ffb640 1 -- 172.21.15.12:0/4292365004 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84940811b0 con 0x7f849c10c180 2024-09-16T01:03:59.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.869+0000 7f84a31e6640 1 -- 172.21.15.12:0/4292365004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f849c19ba30 con 0x7f849c10c180 2024-09-16T01:03:59.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.870+0000 7f8499ffb640 1 -- 172.21.15.12:0/4292365004 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f849c19ba30 con 0x7f849c10c180 2024-09-16T01:03:59.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:03:59.872 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:03:59.872 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:03:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 -- 172.21.15.12:0/4292365004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f848c0a32c0 msgr2=0x7f848c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f848c0a32c0 0x7f848c0a5780 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f849000a810 tx=0x7f8490008040 comp rx=0 tx=0).stop 2024-09-16T01:03:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 -- 172.21.15.12:0/4292365004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c10c180 msgr2=0x7f849c19efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c10c180 0x7f849c19efa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8494006010 tx=0x7f849402f710 comp rx=0 tx=0).stop 2024-09-16T01:03:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 -- 172.21.15.12:0/4292365004 shutdown_connections 2024-09-16T01:03:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f848c0a32c0 0x7f848c0a5780 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c10c180 0x7f849c19efa0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849c1036c0 0x7f849c19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 --2- 172.21.15.12:0/4292365004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102da0 0x7f849c19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 -- 172.21.15.12:0/4292365004 >> 172.21.15.12:0/4292365004 conn(0x7f849c0fc7a0 msgr2=0x7f849c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 -- 172.21.15.12:0/4292365004 shutdown_connections 2024-09-16T01:03:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:03:59.872+0000 7f84a31e6640 1 -- 172.21.15.12:0/4292365004 wait complete. 2024-09-16T01:04:00.541 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-16T01:04:00.801 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:00.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:00 smithi012 ceph-mon[31197]: pgmap v447: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 88 KiB/s wr, 12 op/s 2024-09-16T01:04:00.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:00 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/4292365004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:04:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:00 smithi119 ceph-mon[35049]: pgmap v447: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 88 KiB/s wr, 12 op/s 2024-09-16T01:04:01.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:00 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/4292365004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:04:01.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:00 smithi098 ceph-mon[35346]: pgmap v447: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 88 KiB/s wr, 12 op/s 2024-09-16T01:04:01.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:00 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/4292365004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:04:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.247+0000 7ffb55a48640 1 -- 172.21.15.12:0/1227194454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb50102570 msgr2=0x7ffb501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.247+0000 7ffb55a48640 1 --2- 172.21.15.12:0/1227194454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb50102570 0x7ffb501029b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009900 tx=0x7ffb4402a480 comp rx=0 tx=0).stop 2024-09-16T01:04:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.247+0000 7ffb55a48640 1 -- 172.21.15.12:0/1227194454 shutdown_connections 2024-09-16T01:04:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.247+0000 7ffb55a48640 1 --2- 172.21.15.12:0/1227194454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb50102ef0 0x7ffb5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.247+0000 7ffb55a48640 1 --2- 172.21.15.12:0/1227194454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb50102570 0x7ffb501029b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.247+0000 7ffb55a48640 1 --2- 172.21.15.12:0/1227194454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb50100e20 0x7ffb50101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.247+0000 7ffb55a48640 1 -- 172.21.15.12:0/1227194454 >> 172.21.15.12:0/1227194454 conn(0x7ffb500fc7d0 msgr2=0x7ffb500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.247+0000 7ffb55a48640 1 -- 172.21.15.12:0/1227194454 shutdown_connections 2024-09-16T01:04:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.247+0000 7ffb55a48640 1 -- 172.21.15.12:0/1227194454 wait complete. 2024-09-16T01:04:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb55a48640 1 Processor -- start 2024-09-16T01:04:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb55a48640 1 -- start start 2024-09-16T01:04:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb55a48640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb50100e20 0x7ffb5010e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb55a48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb50102570 0x7ffb5010ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb55a48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb50102ef0 0x7ffb5010f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb55a48640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50112100 con 0x7ffb50100e20 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb55a48640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50111f80 con 0x7ffb50102570 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb55a48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50112280 con 0x7ffb50102ef0 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb4effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb50100e20 0x7ffb5010e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb4effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb50100e20 0x7ffb5010e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55540/0 (socket says 172.21.15.12:55540) 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.248+0000 7ffb4effd640 1 -- 172.21.15.12:0/498545572 learned_addr learned my addr 172.21.15.12:0/498545572 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb50102ef0 0x7ffb5010f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb4e7fc640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb50102570 0x7ffb5010ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb4effd640 1 -- 172.21.15.12:0/498545572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb50102ef0 msgr2=0x7ffb5010f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb4effd640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb50102ef0 0x7ffb5010f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb4effd640 1 -- 172.21.15.12:0/498545572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb50102570 msgr2=0x7ffb5010ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb4effd640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb50102570 0x7ffb5010ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb4effd640 1 -- 172.21.15.12:0/498545572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb501a69c0 con 0x7ffb50100e20 2024-09-16T01:04:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb50102ef0 0x7ffb5010f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb4e7fc640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb50102570 0x7ffb5010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb4effd640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb50100e20 0x7ffb5010e700 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000ba50 tx=0x7ffb4000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb54a46640 1 -- 172.21.15.12:0/498545572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40019070 con 0x7ffb50100e20 2024-09-16T01:04:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb54a46640 1 -- 172.21.15.12:0/498545572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb4000cbe0 con 0x7ffb50100e20 2024-09-16T01:04:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb55a48640 1 -- 172.21.15.12:0/498545572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb501a6cb0 con 0x7ffb50100e20 2024-09-16T01:04:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb54a46640 1 -- 172.21.15.12:0/498545572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb400076e0 con 0x7ffb50100e20 2024-09-16T01:04:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.249+0000 7ffb55a48640 1 -- 172.21.15.12:0/498545572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb501a71a0 con 0x7ffb50100e20 2024-09-16T01:04:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb54a46640 1 -- 172.21.15.12:0/498545572 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffb4001c070 con 0x7ffb50100e20 2024-09-16T01:04:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb57e21740 1 Processor -- start 2024-09-16T01:04:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb57e21740 1 -- start start 2024-09-16T01:04:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d6b40 0x5599e17d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d55d0 0x5599e17d5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17e2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb57e21740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5599e173b2f0 con 0x5599e17e0370 2024-09-16T01:04:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb57e21740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5599e16e2cf0 con 0x5599e17d55d0 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb57e21740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5599e17372b0 con 0x5599e17d6b40 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb4e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb4e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17e2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55556/0 (socket says 172.21.15.12:55556) 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb4e7fc640 1 -- 172.21.15.12:0/209941697 learned_addr learned my addr 172.21.15.12:0/209941697 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.252+0000 7ffb54a46640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffb380a32c0 0x7ffb380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb4effd640 1 --2- 172.21.15.12:0/209941697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d55d0 0x5599e17d5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffb380a32c0 0x7ffb380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/209941697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d6b40 0x5599e17d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb54a46640 1 -- 172.21.15.12:0/498545572 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7ffb400cf2a0 con 0x7ffb50100e20 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb4e7fc640 1 -- 172.21.15.12:0/209941697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d6b40 msgr2=0x5599e17d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb4e7fc640 1 --2- 172.21.15.12:0/209941697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d6b40 0x5599e17d5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb4e7fc640 1 -- 172.21.15.12:0/209941697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d55d0 msgr2=0x5599e17d5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb4e7fc640 1 --2- 172.21.15.12:0/209941697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d55d0 0x5599e17d5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb4e7fc640 1 -- 172.21.15.12:0/209941697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e16c73a0 con 0x5599e17e0370 2024-09-16T01:04:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffb380a32c0 0x7ffb380a5780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffb480136a0 tx=0x7ffb4800b600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb4e7fc640 1 --2- 172.21.15.12:0/209941697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17e2760 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ffb44006010 tx=0x7ffb44004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf5d192294ffefd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb35ffb640 1 -- 172.21.15.12:0/209941697 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4403f070 con 0x5599e17e0370 2024-09-16T01:04:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb35ffb640 1 -- 172.21.15.12:0/209941697 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb440046c0 con 0x5599e17e0370 2024-09-16T01:04:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.253+0000 7ffb35ffb640 1 -- 172.21.15.12:0/209941697 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44035030 con 0x5599e17e0370 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.254+0000 7ffb57e21740 1 -- 172.21.15.12:0/209941697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 msgr2=0x5599e17e2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.254+0000 7ffb57e21740 1 --2- 172.21.15.12:0/209941697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17e2760 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ffb44006010 tx=0x7ffb44004390 comp rx=0 tx=0).stop 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.254+0000 7ffb57e21740 1 -- 172.21.15.12:0/209941697 shutdown_connections 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.254+0000 7ffb57e21740 1 --2- 172.21.15.12:0/209941697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17e2760 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.254+0000 7ffb57e21740 1 --2- 172.21.15.12:0/209941697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d55d0 0x5599e17d5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.254+0000 7ffb57e21740 1 --2- 172.21.15.12:0/209941697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d6b40 0x5599e17d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.254+0000 7ffb57e21740 1 -- 172.21.15.12:0/209941697 >> 172.21.15.12:0/209941697 conn(0x5599e179e310 msgr2=0x5599e17d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.254+0000 7ffb57e21740 1 -- 172.21.15.12:0/209941697 shutdown_connections 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.254+0000 7ffb57e21740 1 -- 172.21.15.12:0/209941697 wait complete. 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.254+0000 7ffb57e21740 1 -- start start 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb57e21740 1 Processor -- start 2024-09-16T01:04:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d55d0 0x5599e17dfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d6b40 0x5599e17dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17dd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb57e21740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5599e17e3010 con 0x5599e17e0370 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb57e21740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5599e16f6060 con 0x5599e17d6b40 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb57e21740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5599e17e3190 con 0x5599e17d55d0 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb57e21740 10 client.0 _ll_register_callbacks cb 0x5599e14498c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17dd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17dd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55558/0 (socket says 172.21.15.12:55558) 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb4f7fe640 1 -- 172.21.15.12:0/2346440275 learned_addr learned my addr 172.21.15.12:0/2346440275 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb4e7fc640 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d6b40 0x5599e17dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.255+0000 7ffb4effd640 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d55d0 0x5599e17dfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb4f7fe640 1 -- 172.21.15.12:0/2346440275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d55d0 msgr2=0x5599e17dfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d55d0 0x5599e17dfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb4f7fe640 1 -- 172.21.15.12:0/2346440275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d6b40 msgr2=0x5599e17dcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d6b40 0x5599e17dcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb4f7fe640 1 -- 172.21.15.12:0/2346440275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e14ac3c0 con 0x5599e17e0370 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17dd4e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffb48011ab0 tx=0x7ffb480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f3e572beedf690 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb2effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb2effd640 1 -- 172.21.15.12:0/2346440275 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48023070 con 0x5599e17e0370 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb57e21740 1 -- 172.21.15.12:0/2346440275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb440046c0 con 0x5599e17e0370 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb2effd640 1 -- 172.21.15.12:0/2346440275 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7ffb48010c80 con 0x5599e17e0370 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb2effd640 1 -- 172.21.15.12:0/2346440275 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb4802f050 con 0x5599e17e0370 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb57e21740 10 client.16257 fetch_fsmap learned FSMap version 29 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb57e21740 1 -- 172.21.15.12:0/2346440275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5599e17eead0 con 0x5599e17e0370 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.256+0000 7ffb2effd640 1 -- 172.21.15.12:0/2346440275 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb440046c0 con 0x5599e17e0370 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.257+0000 7ffb2effd640 1 -- 172.21.15.12:0/2346440275 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ffb480273b0 con 0x5599e17e0370 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.257+0000 7ffb57e21740 10 client.16257 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:04:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.257+0000 7ffb57e21740 10 client.16257 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.257+0000 7ffb57e21740 20 client.16257 populate_metadata read hostname 'smithi012' 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.257+0000 7ffb57e21740 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5599e17efee0 0x5599e17f2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.257+0000 7ffb57e21740 4 client.16257 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.257+0000 7ffb57e21740 1 -- 172.21.15.12:0/2346440275 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599e1748860 con 0x5599e17efee0 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.257+0000 7ffb4effd640 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5599e17efee0 0x5599e17f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.257+0000 7ffb2effd640 10 client.16257 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.257+0000 7ffb4effd640 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5599e17efee0 0x5599e17f2330 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=21d2fbdebde04fcf server_cookie=9673647a89c820c7 in_seq=0 out_seq=0 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb2effd640 1 -- 172.21.15.12:0/2346440275 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599e1748860 con 0x5599e17efee0 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb2effd640 10 client.16257 handle_command_reply: tid=0 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 client.16257 shutdown 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 -- 172.21.15.12:0/2346440275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 msgr2=0x5599e17dd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17dd4e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffb48011ab0 tx=0x7ffb480046c0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 -- 172.21.15.12:0/2346440275 shutdown_connections 2024-09-16T01:04:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5599e17efee0 0x5599e17f2330 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17dd4e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d6b40 0x5599e17dcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 --2- 172.21.15.12:0/2346440275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d55d0 0x5599e17dfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 -- 172.21.15.12:0/2346440275 >> 172.21.15.12:0/2346440275 conn(0x5599e179e310 msgr2=0x5599e17d7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb2effd640 0 client.16257 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:04:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 -- 172.21.15.12:0/2346440275 shutdown_connections 2024-09-16T01:04:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 1 -- 172.21.15.12:0/2346440275 wait complete. 2024-09-16T01:04:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.258+0000 7ffb57e21740 20 client.16257 trim_cache size 0 max 16384 2024-09-16T01:04:01.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb57e21740 1 Processor -- start 2024-09-16T01:04:01.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb57e21740 1 -- start start 2024-09-16T01:04:01.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d55d0 0x5599e17ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d6b40 0x5599e17d4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb57e21740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b0da0 con 0x5599e17e0370 2024-09-16T01:04:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb57e21740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b28e0 con 0x5599e17d55d0 2024-09-16T01:04:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb57e21740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b1470 con 0x5599e17d6b40 2024-09-16T01:04:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17f7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55566/0 (socket says 172.21.15.12:55566) 2024-09-16T01:04:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb4f7fe640 1 -- 172.21.15.12:0/1532315727 learned_addr learned my addr 172.21.15.12:0/1532315727 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb4e7fc640 1 --2- 172.21.15.12:0/1532315727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d6b40 0x5599e17d4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb4effd640 1 --2- 172.21.15.12:0/1532315727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d55d0 0x5599e17ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb4f7fe640 1 -- 172.21.15.12:0/1532315727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d6b40 msgr2=0x5599e17d4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/1532315727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d6b40 0x5599e17d4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb4f7fe640 1 -- 172.21.15.12:0/1532315727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d55d0 msgr2=0x5599e17ec2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/1532315727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d55d0 0x5599e17ec2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.272+0000 7ffb4f7fe640 1 -- 172.21.15.12:0/1532315727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e17db4d0 con 0x5599e17e0370 2024-09-16T01:04:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/1532315727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17f7c00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffb48027780 tx=0x7ffb48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc1324d229900af server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb357fa640 1 -- 172.21.15.12:0/1532315727 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48037020 con 0x5599e17e0370 2024-09-16T01:04:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb357fa640 1 -- 172.21.15.12:0/1532315727 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb48010800 con 0x5599e17e0370 2024-09-16T01:04:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb357fa640 1 -- 172.21.15.12:0/1532315727 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48023040 con 0x5599e17e0370 2024-09-16T01:04:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb57e21740 1 -- 172.21.15.12:0/1532315727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 msgr2=0x5599e17f7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb57e21740 1 --2- 172.21.15.12:0/1532315727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17f7c00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffb48027780 tx=0x7ffb48004730 comp rx=0 tx=0).stop 2024-09-16T01:04:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb57e21740 1 -- 172.21.15.12:0/1532315727 shutdown_connections 2024-09-16T01:04:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb57e21740 1 --2- 172.21.15.12:0/1532315727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17e0370 0x5599e17f7c00 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb57e21740 1 --2- 172.21.15.12:0/1532315727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17d6b40 0x5599e17d4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb57e21740 1 --2- 172.21.15.12:0/1532315727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d55d0 0x5599e17ec2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.273+0000 7ffb57e21740 1 -- 172.21.15.12:0/1532315727 >> 172.21.15.12:0/1532315727 conn(0x5599e179e310 msgr2=0x5599e17db850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.274+0000 7ffb57e21740 1 -- 172.21.15.12:0/1532315727 shutdown_connections 2024-09-16T01:04:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.274+0000 7ffb57e21740 1 -- 172.21.15.12:0/1532315727 wait complete. 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.274+0000 7ffb57e21740 1 -- start start 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.274+0000 7ffb57e21740 1 Processor -- start 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.274+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17d55d0 0x5599e17e8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.274+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d6b40 0x5599e17e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.274+0000 7ffb57e21740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17e0370 0x5599e17e43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb57e21740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b2210 con 0x5599e17d55d0 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb57e21740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b1b40 con 0x5599e17d6b40 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb57e21740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501aed80 con 0x5599e17e0370 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17d55d0 0x5599e17e8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb57e21740 10 client.0 _ll_register_callbacks cb 0x7ffb4800b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17d55d0 0x5599e17e8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55578/0 (socket says 172.21.15.12:55578) 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4effd640 1 -- 172.21.15.12:0/1822668706 learned_addr learned my addr 172.21.15.12:0/1822668706 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4f7fe640 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17e0370 0x5599e17e43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4e7fc640 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d6b40 0x5599e17e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4effd640 1 -- 172.21.15.12:0/1822668706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17e0370 msgr2=0x5599e17e43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4effd640 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17e0370 0x5599e17e43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4effd640 1 -- 172.21.15.12:0/1822668706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d6b40 msgr2=0x5599e17e3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4effd640 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d6b40 0x5599e17e3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4effd640 1 -- 172.21.15.12:0/1822668706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e17e4bc0 con 0x5599e17d55d0 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb4effd640 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17d55d0 0x5599e17e8b70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ffb40097240 tx=0x7ffb4006d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f6106397867126 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb2effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb2effd640 1 -- 172.21.15.12:0/1822668706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4009f910 con 0x5599e17d55d0 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb2effd640 1 -- 172.21.15.12:0/1822668706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7ffb40099860 con 0x5599e17d55d0 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.275+0000 7ffb57e21740 1 -- 172.21.15.12:0/1822668706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb48010800 con 0x5599e17d55d0 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb2effd640 1 -- 172.21.15.12:0/1822668706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb4006a0c0 con 0x5599e17d55d0 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb57e21740 10 client.16263 fetch_fsmap learned FSMap version 29 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb57e21740 1 -- 172.21.15.12:0/1822668706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5599e185ac40 con 0x5599e17d55d0 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb2effd640 1 -- 172.21.15.12:0/1822668706 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb48010800 con 0x5599e17d55d0 2024-09-16T01:04:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb2effd640 1 -- 172.21.15.12:0/1822668706 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ffb4009a9b0 con 0x5599e17d55d0 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb57e21740 10 client.16263 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb57e21740 10 client.16263 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb57e21740 20 client.16263 populate_metadata read hostname 'smithi012' 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb57e21740 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5599e185b360 0x5599e185d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb57e21740 4 client.16263 mds_command: new command op to 14601 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb57e21740 1 -- 172.21.15.12:0/1822668706 --> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5599e1742d70 con 0x5599e185b360 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb4e7fc640 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5599e185b360 0x5599e185d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.276+0000 7ffb2effd640 10 client.16263 ms_handle_connect on v2:172.21.15.12:6840/1625323518 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb4e7fc640 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5599e185b360 0x5599e185d750 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=35d1020a02766f64 server_cookie=64a49f6ad52b43c3 in_seq=0 out_seq=0 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb2effd640 1 -- 172.21.15.12:0/1822668706 <== mds.4 v2:172.21.15.12:6840/1625323518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5599e1742d70 con 0x5599e185b360 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb2effd640 10 client.16263 handle_command_reply: tid=0 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 client.16263 shutdown 2024-09-16T01:04:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 -- 172.21.15.12:0/1822668706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17d55d0 msgr2=0x5599e17e8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17d55d0 0x5599e17e8b70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ffb40097240 tx=0x7ffb4006d330 comp rx=0 tx=0).stop 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 -- 172.21.15.12:0/1822668706 shutdown_connections 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.12:6840/1625323518,v1:172.21.15.12:6841/1625323518] conn(0x5599e185b360 0x5599e185d750 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599e17e0370 0x5599e17e43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599e17d6b40 0x5599e17e3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb2effd640 0 client.16263 ms_handle_reset on v2:172.21.15.12:6840/1625323518 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 --2- 172.21.15.12:0/1822668706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e17d55d0 0x5599e17e8b70 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 -- 172.21.15.12:0/1822668706 >> 172.21.15.12:0/1822668706 conn(0x5599e179e310 msgr2=0x5599e17d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 -- 172.21.15.12:0/1822668706 shutdown_connections 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 1 -- 172.21.15.12:0/1822668706 wait complete. 2024-09-16T01:04:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.277+0000 7ffb57e21740 20 client.16263 trim_cache size 0 max 16384 2024-09-16T01:04:01.285 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:04:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 -- 172.21.15.12:0/498545572 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffb380a32c0 msgr2=0x7ffb380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffb380a32c0 0x7ffb380a5780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffb480136a0 tx=0x7ffb4800b600 comp rx=0 tx=0).stop 2024-09-16T01:04:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 -- 172.21.15.12:0/498545572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb50100e20 msgr2=0x7ffb5010e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb50100e20 0x7ffb5010e700 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000ba50 tx=0x7ffb4000bf10 comp rx=0 tx=0).stop 2024-09-16T01:04:01.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 -- 172.21.15.12:0/498545572 shutdown_connections 2024-09-16T01:04:01.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7ffb380a32c0 0x7ffb380a5780 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb50102ef0 0x7ffb5010f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb50102570 0x7ffb5010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 --2- 172.21.15.12:0/498545572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb50100e20 0x7ffb5010e700 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:01.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 -- 172.21.15.12:0/498545572 >> 172.21.15.12:0/498545572 conn(0x7ffb500fc7d0 msgr2=0x7ffb50106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:01.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 -- 172.21.15.12:0/498545572 shutdown_connections 2024-09-16T01:04:01.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:01.278+0000 7ffb55a48640 1 -- 172.21.15.12:0/498545572 wait complete. 2024-09-16T01:04:02.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-16T01:04:02.356 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:02.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.832+0000 7fa1b58a0640 1 -- 172.21.15.12:0/1616013797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b0102dd0 msgr2=0x7fa1b01031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:02.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.832+0000 7fa1b58a0640 1 --2- 172.21.15.12:0/1616013797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b0102dd0 0x7fa1b01031b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009930 tx=0x7fa1a802a420 comp rx=0 tx=0).stop 2024-09-16T01:04:02.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.832+0000 7fa1b58a0640 1 -- 172.21.15.12:0/1616013797 shutdown_connections 2024-09-16T01:04:02.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.832+0000 7fa1b58a0640 1 --2- 172.21.15.12:0/1616013797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b0108300 0x7fa1b010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.832+0000 7fa1b58a0640 1 --2- 172.21.15.12:0/1616013797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b0103780 0x7fa1b0107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.832+0000 7fa1b58a0640 1 --2- 172.21.15.12:0/1616013797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b0102dd0 0x7fa1b01031b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.832+0000 7fa1b58a0640 1 -- 172.21.15.12:0/1616013797 >> 172.21.15.12:0/1616013797 conn(0x7fa1b00fc7d0 msgr2=0x7fa1b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.832+0000 7fa1b58a0640 1 -- 172.21.15.12:0/1616013797 shutdown_connections 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.832+0000 7fa1b58a0640 1 -- 172.21.15.12:0/1616013797 wait complete. 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.832+0000 7fa1b58a0640 1 Processor -- start 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1b58a0640 1 -- start start 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1b58a0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b0102dd0 0x7fa1b0100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1b58a0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b0103780 0x7fa1b0100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1b58a0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b0108300 0x7fa1b01014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1b58a0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b0112090 con 0x7fa1b0102dd0 2024-09-16T01:04:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1b58a0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b0111f10 con 0x7fa1b0108300 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1b58a0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b0112210 con 0x7fa1b0103780 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1aeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b0102dd0 0x7fa1b0100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1aeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b0102dd0 0x7fa1b0100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55590/0 (socket says 172.21.15.12:55590) 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1aeffd640 1 -- 172.21.15.12:0/2668448961 learned_addr learned my addr 172.21.15.12:0/2668448961 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1ae7fc640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b0103780 0x7fa1b0100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b0108300 0x7fa1b01014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1aeffd640 1 -- 172.21.15.12:0/2668448961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b0103780 msgr2=0x7fa1b0100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b0103780 0x7fa1b0100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1aeffd640 1 -- 172.21.15.12:0/2668448961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b0108300 msgr2=0x7fa1b01014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b0108300 0x7fa1b01014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1aeffd640 1 -- 172.21.15.12:0/2668448961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b01a6a10 con 0x7fa1b0102dd0 2024-09-16T01:04:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.833+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b0102dd0 0x7fa1b0100a30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009230 tx=0x7fa1a8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.834+0000 7fa1b489e640 1 -- 172.21.15.12:0/2668448961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a803f030 con 0x7fa1b0102dd0 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.834+0000 7fa1b58a0640 1 -- 172.21.15.12:0/2668448961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b01a6ca0 con 0x7fa1b0102dd0 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.834+0000 7fa1b489e640 1 -- 172.21.15.12:0/2668448961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a8003ad0 con 0x7fa1b0102dd0 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.834+0000 7fa1b489e640 1 -- 172.21.15.12:0/2668448961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8035070 con 0x7fa1b0102dd0 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.834+0000 7fa1b58a0640 1 -- 172.21.15.12:0/2668448961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b01a7180 con 0x7fa1b0102dd0 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1b489e640 1 -- 172.21.15.12:0/2668448961 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa1a8042030 con 0x7fa1b0102dd0 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1b7c79740 1 Processor -- start 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1b7c79740 1 -- start start 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f921090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f9215d0 0x56487f921a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f92c370 0x56487f92e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56487f8872f0 con 0x56487f922b40 2024-09-16T01:04:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56487f82ecf0 con 0x56487f9215d0 2024-09-16T01:04:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56487f8832b0 con 0x56487f92c370 2024-09-16T01:04:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1af7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f921090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.836+0000 7fa1af7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f921090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55592/0 (socket says 172.21.15.12:55592) 2024-09-16T01:04:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1af7fe640 1 -- 172.21.15.12:0/725786709 learned_addr learned my addr 172.21.15.12:0/725786709 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1b489e640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a3240 0x7fa19c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/725786709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f9215d0 0x56487f921a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1ae7fc640 1 --2- 172.21.15.12:0/725786709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f92c370 0x56487f92e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1af7fe640 1 -- 172.21.15.12:0/725786709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f92c370 msgr2=0x56487f92e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/725786709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f92c370 0x56487f92e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1af7fe640 1 -- 172.21.15.12:0/725786709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f9215d0 msgr2=0x56487f921a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/725786709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f9215d0 0x56487f921a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1af7fe640 1 -- 172.21.15.12:0/725786709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56487f8133a0 con 0x56487f922b40 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1b489e640 1 -- 172.21.15.12:0/2668448961 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa1a80f01f0 con 0x7fa1b0102dd0 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a3240 0x7fa19c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/725786709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f921090 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0007f50 tx=0x7fa1a000e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372e993ccbe33e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1a5ffb640 1 -- 172.21.15.12:0/725786709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0022070 con 0x56487f922b40 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1a5ffb640 1 -- 172.21.15.12:0/725786709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a0011b70 con 0x56487f922b40 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.837+0000 7fa1a5ffb640 1 -- 172.21.15.12:0/725786709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a001a400 con 0x56487f922b40 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.838+0000 7fa1b7c79740 1 -- 172.21.15.12:0/725786709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 msgr2=0x56487f921090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.838+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/725786709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f921090 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0007f50 tx=0x7fa1a000e7e0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.838+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a3240 0x7fa19c0a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa1a001f000 tx=0x7fa1a0020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.838+0000 7fa1b7c79740 1 -- 172.21.15.12:0/725786709 shutdown_connections 2024-09-16T01:04:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.838+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/725786709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f92c370 0x56487f92e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.838+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/725786709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f9215d0 0x56487f921a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.838+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/725786709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f921090 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.838+0000 7fa1b7c79740 1 -- 172.21.15.12:0/725786709 >> 172.21.15.12:0/725786709 conn(0x56487f8ea310 msgr2=0x56487f91dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.839+0000 7fa1b7c79740 1 -- 172.21.15.12:0/725786709 shutdown_connections 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.839+0000 7fa1b7c79740 1 -- 172.21.15.12:0/725786709 wait complete. 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.839+0000 7fa1b7c79740 1 -- start start 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.839+0000 7fa1b7c79740 1 Processor -- start 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f92bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f922b40 0x56487f928fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f929570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56487f92f070 con 0x56487f9215d0 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56487f842060 con 0x56487f92c370 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56487f92f1f0 con 0x56487f922b40 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1b7c79740 10 client.0 _ll_register_callbacks cb 0x56487f5958c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1aeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f92bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1aeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f92bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55596/0 (socket says 172.21.15.12:55596) 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1aeffd640 1 -- 172.21.15.12:0/1117428765 learned_addr learned my addr 172.21.15.12:0/1117428765 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1ae7fc640 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f922b40 0x56487f928fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f929570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1aeffd640 1 -- 172.21.15.12:0/1117428765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f922b40 msgr2=0x56487f928fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f922b40 0x56487f928fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1aeffd640 1 -- 172.21.15.12:0/1117428765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 msgr2=0x56487f929570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f929570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1aeffd640 1 -- 172.21.15.12:0/1117428765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56487f5f83c0 con 0x56487f9215d0 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f92bd20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009900 tx=0x7fa1a802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc27700b31cfcfa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa18effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.840+0000 7fa18effd640 1 -- 172.21.15.12:0/1117428765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8049050 con 0x56487f9215d0 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa1b7c79740 1 -- 172.21.15.12:0/1117428765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1a0011b70 con 0x56487f9215d0 2024-09-16T01:04:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa18effd640 1 -- 172.21.15.12:0/1117428765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa1a8003c80 con 0x56487f9215d0 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa18effd640 1 -- 172.21.15.12:0/1117428765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa1a80c0860 con 0x56487f9215d0 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa1b7c79740 10 client.16275 fetch_fsmap learned FSMap version 29 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa1b7c79740 1 -- 172.21.15.12:0/1117428765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56487f93aac0 con 0x56487f9215d0 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa18effd640 1 -- 172.21.15.12:0/1117428765 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a0011b70 con 0x56487f9215d0 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa18effd640 1 -- 172.21.15.12:0/1117428765 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa1a80bc7a0 con 0x56487f9215d0 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa1b7c79740 10 client.16275 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa1b7c79740 10 client.16275 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa1b7c79740 20 client.16275 populate_metadata read hostname 'smithi012' 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x56487f93c150 0x56487f93e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa1b7c79740 4 client.16275 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa1b7c79740 1 -- 172.21.15.12:0/1117428765 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56487f894860 con 0x56487f93c150 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.841+0000 7fa1ae7fc640 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x56487f93c150 0x56487f93e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.842+0000 7fa1ae7fc640 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x56487f93c150 0x56487f93e5b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3c9dde9a4e8c29a3 server_cookie=f615190c6dee71ab in_seq=0 out_seq=0 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.842+0000 7fa18effd640 10 client.16275 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa18effd640 1 -- 172.21.15.12:0/1117428765 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56487f894860 con 0x56487f93c150 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa18effd640 10 client.16275 handle_command_reply: tid=0 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 client.16275 shutdown 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 -- 172.21.15.12:0/1117428765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 msgr2=0x56487f92bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f92bd20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009900 tx=0x7fa1a802a420 comp rx=0 tx=0).stop 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 -- 172.21.15.12:0/1117428765 shutdown_connections 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x56487f93c150 0x56487f93e5b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f929570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f922b40 0x56487f928fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/1117428765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f92bd20 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 -- 172.21.15.12:0/1117428765 >> 172.21.15.12:0/1117428765 conn(0x56487f8ea310 msgr2=0x56487f923930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa18effd640 0 client.16275 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:04:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 -- 172.21.15.12:0/1117428765 shutdown_connections 2024-09-16T01:04:02.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 1 -- 172.21.15.12:0/1117428765 wait complete. 2024-09-16T01:04:02.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.843+0000 7fa1b7c79740 20 client.16275 trim_cache size 0 max 16384 2024-09-16T01:04:02.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1b7c79740 1 Processor -- start 2024-09-16T01:04:02.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1b7c79740 1 -- start start 2024-09-16T01:04:02.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f9278a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f922b40 0x56487f92af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f924120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b01b0d30 con 0x56487f9215d0 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b01b2870 con 0x56487f92c370 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b01b1400 con 0x56487f922b40 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1aeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f9278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1aeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f9278a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55612/0 (socket says 172.21.15.12:55612) 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.856+0000 7fa1aeffd640 1 -- 172.21.15.12:0/2594091455 learned_addr learned my addr 172.21.15.12:0/2594091455 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1ae7fc640 1 --2- 172.21.15.12:0/2594091455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f922b40 0x56487f92af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/2594091455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f924120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1aeffd640 1 -- 172.21.15.12:0/2594091455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f922b40 msgr2=0x56487f92af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/2594091455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f922b40 0x56487f92af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1aeffd640 1 -- 172.21.15.12:0/2594091455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 msgr2=0x56487f924120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/2594091455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f924120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1aeffd640 1 -- 172.21.15.12:0/2594091455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56487f927f80 con 0x56487f9215d0 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/2594091455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f924120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/2594091455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f9278a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80b8910 tx=0x7fa1a80ba9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7222c149c6f67ab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1a57fa640 1 -- 172.21.15.12:0/2594091455 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8049050 con 0x56487f9215d0 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1a57fa640 1 -- 172.21.15.12:0/2594091455 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a80ede50 con 0x56487f9215d0 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.857+0000 7fa1a57fa640 1 -- 172.21.15.12:0/2594091455 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80b8b20 con 0x56487f9215d0 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.858+0000 7fa1b7c79740 1 -- 172.21.15.12:0/2594091455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 msgr2=0x56487f9278a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.858+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/2594091455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f9278a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80b8910 tx=0x7fa1a80ba9c0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.858+0000 7fa1b7c79740 1 -- 172.21.15.12:0/2594091455 shutdown_connections 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.858+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/2594091455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f924120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.858+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/2594091455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f922b40 0x56487f92af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.858+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/2594091455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f9215d0 0x56487f9278a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.858+0000 7fa1b7c79740 1 -- 172.21.15.12:0/2594091455 >> 172.21.15.12:0/2594091455 conn(0x56487f8ea310 msgr2=0x56487f92a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:02.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.858+0000 7fa1b7c79740 1 -- 172.21.15.12:0/2594091455 shutdown_connections 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.858+0000 7fa1b7c79740 1 -- 172.21.15.12:0/2594091455 wait complete. 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.858+0000 7fa1b7c79740 1 -- start start 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1b7c79740 1 Processor -- start 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f9215d0 0x56487f934a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f92fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1b7c79740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f9302f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b01b21a0 con 0x56487f922b40 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b01b1ad0 con 0x56487f92c370 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1b7c79740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b01aed10 con 0x56487f9215d0 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1b7c79740 10 client.0 _ll_register_callbacks cb 0x7fa1a8005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1ae7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f92fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1ae7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f92fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55622/0 (socket says 172.21.15.12:55622) 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1ae7fc640 1 -- 172.21.15.12:0/745174676 learned_addr learned my addr 172.21.15.12:0/745174676 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:02.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f9215d0 0x56487f934a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f9302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1ae7fc640 1 -- 172.21.15.12:0/745174676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f9215d0 msgr2=0x56487f934a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1ae7fc640 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f9215d0 0x56487f934a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1ae7fc640 1 -- 172.21.15.12:0/745174676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 msgr2=0x56487f9302f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1ae7fc640 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f9302f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1ae7fc640 1 -- 172.21.15.12:0/745174676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56487f930960 con 0x56487f922b40 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f9215d0 0x56487f934a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1af7fe640 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f9302f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa1ae7fc640 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f92fdb0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa198004700 tx=0x7fa198004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7604a2edfcb8a419 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.859+0000 7fa18effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa18effd640 1 -- 172.21.15.12:0/745174676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19801c310 con 0x56487f922b40 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa18effd640 1 -- 172.21.15.12:0/745174676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa19801c4b0 con 0x56487f922b40 2024-09-16T01:04:02.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa1b7c79740 1 -- 172.21.15.12:0/745174676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1a80ede50 con 0x56487f922b40 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa18effd640 1 -- 172.21.15.12:0/745174676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa19802d050 con 0x56487f922b40 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa1b7c79740 10 client.16281 fetch_fsmap learned FSMap version 29 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa1b7c79740 1 -- 172.21.15.12:0/745174676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56487f9a6d00 con 0x56487f922b40 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa18effd640 1 -- 172.21.15.12:0/745174676 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a80ede50 con 0x56487f922b40 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa18effd640 1 -- 172.21.15.12:0/745174676 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa198012ac0 con 0x56487f922b40 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa1b7c79740 10 client.16281 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa1b7c79740 10 client.16281 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa1b7c79740 20 client.16281 populate_metadata read hostname 'smithi012' 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x56487f9a74b0 0x56487f9a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa1b7c79740 4 client.16281 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.860+0000 7fa1b7c79740 1 -- 172.21.15.12:0/745174676 --> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56487f88ed70 con 0x56487f9a74b0 2024-09-16T01:04:02.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x56487f9a74b0 0x56487f9a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1aeffd640 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x56487f9a74b0 0x56487f9a98d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5c4723f693f92fa7 server_cookie=ea8949810c500500 in_seq=0 out_seq=0 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa18effd640 10 client.16281 ms_handle_connect on v2:172.21.15.98:6834/1575072845 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa18effd640 1 -- 172.21.15.12:0/745174676 <== mds.3 v2:172.21.15.98:6834/1575072845 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56487f88ed70 con 0x56487f9a74b0 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa18effd640 10 client.16281 handle_command_reply: tid=0 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1b7c79740 1 client.16281 shutdown 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1b7c79740 1 -- 172.21.15.12:0/745174676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 msgr2=0x56487f92fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f92fdb0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa198004700 tx=0x7fa198004410 comp rx=0 tx=0).stop 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1b7c79740 1 -- 172.21.15.12:0/745174676 shutdown_connections 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.98:6834/1575072845,v1:172.21.15.98:6835/1575072845] conn(0x56487f9a74b0 0x56487f9a98d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56487f92c370 0x56487f9302f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56487f922b40 0x56487f92fdb0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1b7c79740 1 --2- 172.21.15.12:0/745174676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56487f9215d0 0x56487f934a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa1b7c79740 1 -- 172.21.15.12:0/745174676 >> 172.21.15.12:0/745174676 conn(0x56487f8ea310 msgr2=0x56487f91c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:02.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.861+0000 7fa18effd640 0 client.16281 ms_handle_reset on v2:172.21.15.98:6834/1575072845 2024-09-16T01:04:02.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b7c79740 1 -- 172.21.15.12:0/745174676 shutdown_connections 2024-09-16T01:04:02.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b7c79740 1 -- 172.21.15.12:0/745174676 wait complete. 2024-09-16T01:04:02.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b7c79740 20 client.16281 trim_cache size 0 max 16384 2024-09-16T01:04:02.871 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:04:02.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 -- 172.21.15.12:0/2668448961 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a3240 msgr2=0x7fa19c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:02.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a3240 0x7fa19c0a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa1a001f000 tx=0x7fa1a0020000 comp rx=0 tx=0).stop 2024-09-16T01:04:02.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 -- 172.21.15.12:0/2668448961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b0102dd0 msgr2=0x7fa1b0100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:02.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b0102dd0 0x7fa1b0100a30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009230 tx=0x7fa1a8004270 comp rx=0 tx=0).stop 2024-09-16T01:04:02.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 -- 172.21.15.12:0/2668448961 shutdown_connections 2024-09-16T01:04:02.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa19c0a3240 0x7fa19c0a5700 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1b0108300 0x7fa1b01014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1b0103780 0x7fa1b0100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 --2- 172.21.15.12:0/2668448961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1b0102dd0 0x7fa1b0100a30 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:02.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 -- 172.21.15.12:0/2668448961 >> 172.21.15.12:0/2668448961 conn(0x7fa1b00fc7d0 msgr2=0x7fa1b0105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:02.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.862+0000 7fa1b58a0640 1 -- 172.21.15.12:0/2668448961 shutdown_connections 2024-09-16T01:04:02.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:02.863+0000 7fa1b58a0640 1 -- 172.21.15.12:0/2668448961 wait complete. 2024-09-16T01:04:03.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:02 smithi119 ceph-mon[35049]: pgmap v448: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-16T01:04:03.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:02 smithi012 ceph-mon[31197]: pgmap v448: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-16T01:04:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:02 smithi098 ceph-mon[35346]: pgmap v448: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-16T01:04:03.686 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-16T01:04:03.948 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.544+0000 7f75e7b64640 1 -- 172.21.15.12:0/2975783768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e0101280 msgr2=0x7f75e010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.544+0000 7f75e7b64640 1 --2- 172.21.15.12:0/2975783768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e0101280 0x7f75e010df40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009900 tx=0x7f75d002a410 comp rx=0 tx=0).stop 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.545+0000 7f75e7b64640 1 -- 172.21.15.12:0/2975783768 shutdown_connections 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.545+0000 7f75e7b64640 1 --2- 172.21.15.12:0/2975783768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75e010e480 0x7f75e0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.545+0000 7f75e7b64640 1 --2- 172.21.15.12:0/2975783768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e0101280 0x7f75e010df40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.545+0000 7f75e7b64640 1 --2- 172.21.15.12:0/2975783768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e01008d0 0x7f75e0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.545+0000 7f75e7b64640 1 -- 172.21.15.12:0/2975783768 >> 172.21.15.12:0/2975783768 conn(0x7f75e00fc7a0 msgr2=0x7f75e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.545+0000 7f75e7b64640 1 -- 172.21.15.12:0/2975783768 shutdown_connections 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.545+0000 7f75e7b64640 1 -- 172.21.15.12:0/2975783768 wait complete. 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.545+0000 7f75e7b64640 1 Processor -- start 2024-09-16T01:04:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.545+0000 7f75e7b64640 1 -- start start 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e7b64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e01008d0 0x7f75e019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e7b64640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e0101280 0x7f75e019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e7b64640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75e010e480 0x7f75e019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e7b64640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f75e01141e0 con 0x7f75e0101280 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e7b64640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0114060 con 0x7f75e01008d0 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e7b64640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0114360 con 0x7f75e010e480 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e50ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e0101280 0x7f75e019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e50ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e0101280 0x7f75e019ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55638/0 (socket says 172.21.15.12:55638) 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e50ff640 1 -- 172.21.15.12:0/2628338522 learned_addr learned my addr 172.21.15.12:0/2628338522 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e5900640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e01008d0 0x7f75e019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e6101640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75e010e480 0x7f75e019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e50ff640 1 -- 172.21.15.12:0/2628338522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75e010e480 msgr2=0x7f75e019efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e50ff640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75e010e480 0x7f75e019efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e50ff640 1 -- 172.21.15.12:0/2628338522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e01008d0 msgr2=0x7f75e019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:04.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e50ff640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e01008d0 0x7f75e019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e50ff640 1 -- 172.21.15.12:0/2628338522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e019f6b0 con 0x7f75e0101280 2024-09-16T01:04:04.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75e50ff640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e0101280 0x7f75e019ac40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f75d0006010 tx=0x7f75d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:04.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75d6ffd640 1 -- 172.21.15.12:0/2628338522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d003f030 con 0x7f75e0101280 2024-09-16T01:04:04.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.546+0000 7f75d6ffd640 1 -- 172.21.15.12:0/2628338522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d0003ce0 con 0x7f75e0101280 2024-09-16T01:04:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.547+0000 7f75e7b64640 1 -- 172.21.15.12:0/2628338522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e019f940 con 0x7f75e0101280 2024-09-16T01:04:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.547+0000 7f75d6ffd640 1 -- 172.21.15.12:0/2628338522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d0035070 con 0x7f75e0101280 2024-09-16T01:04:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.547+0000 7f75e7b64640 1 -- 172.21.15.12:0/2628338522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e01a7280 con 0x7f75e0101280 2024-09-16T01:04:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.549+0000 7f75d6ffd640 1 -- 172.21.15.12:0/2628338522 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f75d0042030 con 0x7f75e0101280 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.549+0000 7f75e9f3d740 1 Processor -- start 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.549+0000 7f75e9f3d740 1 -- start start 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.549+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cc9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.549+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cc95d0 0x55f012cc9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cd4370 0x55f012cd6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f012c2f2f0 con 0x55f012ccab40 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f012bd6cf0 con 0x55f012cc95d0 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f012c2b2b0 con 0x55f012cd4370 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e6101640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cc9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e6101640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cc9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55648/0 (socket says 172.21.15.12:55648) 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e6101640 1 -- 172.21.15.12:0/789223673 learned_addr learned my addr 172.21.15.12:0/789223673 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e5900640 1 --2- 172.21.15.12:0/789223673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cc95d0 0x55f012cc9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75d6ffd640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75cc0a32c0 0x7f75cc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e50ff640 1 --2- 172.21.15.12:0/789223673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cd4370 0x55f012cd6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e6101640 1 -- 172.21.15.12:0/789223673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cd4370 msgr2=0x55f012cd6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e6101640 1 --2- 172.21.15.12:0/789223673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cd4370 0x55f012cd6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e6101640 1 -- 172.21.15.12:0/789223673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cc95d0 msgr2=0x55f012cc9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e6101640 1 --2- 172.21.15.12:0/789223673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cc95d0 0x55f012cc9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e6101640 1 -- 172.21.15.12:0/789223673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f012bbb3a0 con 0x55f012ccab40 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.550+0000 7f75e6101640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75cc0a32c0 0x7f75cc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.551+0000 7f75d6ffd640 1 -- 172.21.15.12:0/2628338522 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f75d00f0180 con 0x7f75e0101280 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.551+0000 7f75e6101640 1 --2- 172.21.15.12:0/789223673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cc9090 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c4a0 tx=0x7f75d800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813e3dd535a42eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.551+0000 7f75e6101640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75cc0a32c0 0x7f75cc0a5780 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f75d8018000 tx=0x7f75d8019000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.551+0000 7f75cbfff640 1 -- 172.21.15.12:0/789223673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8019830 con 0x55f012ccab40 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.551+0000 7f75cbfff640 1 -- 172.21.15.12:0/789223673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d800a400 con 0x55f012ccab40 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.551+0000 7f75cbfff640 1 -- 172.21.15.12:0/789223673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d80175e0 con 0x55f012ccab40 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.552+0000 7f75e9f3d740 1 -- 172.21.15.12:0/789223673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 msgr2=0x55f012cc9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.552+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/789223673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cc9090 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c4a0 tx=0x7f75d800c960 comp rx=0 tx=0).stop 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.552+0000 7f75e9f3d740 1 -- 172.21.15.12:0/789223673 shutdown_connections 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.552+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/789223673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cd4370 0x55f012cd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.552+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/789223673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cc95d0 0x55f012cc9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.552+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/789223673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cc9090 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.552+0000 7f75e9f3d740 1 -- 172.21.15.12:0/789223673 >> 172.21.15.12:0/789223673 conn(0x55f012c92310 msgr2=0x55f012cc5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.552+0000 7f75e9f3d740 1 -- 172.21.15.12:0/789223673 shutdown_connections 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.552+0000 7f75e9f3d740 1 -- 172.21.15.12:0/789223673 wait complete. 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e9f3d740 1 -- start start 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e9f3d740 1 Processor -- start 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cd3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012ccab40 0x55f012cd1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012cd4370 0x55f012cd1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f012cd7070 con 0x55f012cd4370 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f012bea060 con 0x55f012ccab40 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f012cd71f0 con 0x55f012cc95d0 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e9f3d740 10 client.0 _ll_register_callbacks cb 0x55f01293d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e6101640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012cd4370 0x55f012cd1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e6101640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012cd4370 0x55f012cd1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55658/0 (socket says 172.21.15.12:55658) 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e6101640 1 -- 172.21.15.12:0/975594478 learned_addr learned my addr 172.21.15.12:0/975594478 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.553+0000 7f75e50ff640 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012ccab40 0x55f012cd1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75e5900640 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cd3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75e6101640 1 -- 172.21.15.12:0/975594478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 msgr2=0x55f012cd3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75e6101640 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cd3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75e6101640 1 -- 172.21.15.12:0/975594478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012ccab40 msgr2=0x55f012cd1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75e6101640 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012ccab40 0x55f012cd1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75e6101640 1 -- 172.21.15.12:0/975594478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0129a03c0 con 0x55f012cd4370 2024-09-16T01:04:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75e6101640 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012cd4370 0x55f012cd1810 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f75d800ae10 tx=0x7f75d800a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91558e49ca8d6003 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75c97fa640 1 -- 172.21.15.12:0/975594478 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8017c60 con 0x55f012cd4370 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75c97fa640 1 -- 172.21.15.12:0/975594478 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f75d8017e00 con 0x55f012cd4370 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75e9f3d740 1 -- 172.21.15.12:0/975594478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75d800a400 con 0x55f012cd4370 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75c97fa640 1 -- 172.21.15.12:0/975594478 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f75d8009bc0 con 0x55f012cd4370 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75e9f3d740 10 client.16293 fetch_fsmap learned FSMap version 29 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.554+0000 7f75e9f3d740 1 -- 172.21.15.12:0/975594478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f012ce2b90 con 0x55f012cd4370 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75c97fa640 1 -- 172.21.15.12:0/975594478 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d800a400 con 0x55f012cd4370 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75c97fa640 1 -- 172.21.15.12:0/975594478 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f75d8022470 con 0x55f012cd4370 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75e9f3d740 10 client.16293 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75e9f3d740 10 client.16293 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75e9f3d740 20 client.16293 populate_metadata read hostname 'smithi012' 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f012ce3ee0 0x55f012ce62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75e9f3d740 4 client.16293 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:04:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75e9f3d740 1 -- 172.21.15.12:0/975594478 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f012c3c860 con 0x55f012ce3ee0 2024-09-16T01:04:04.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75e5900640 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f012ce3ee0 0x55f012ce62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75e5900640 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f012ce3ee0 0x55f012ce62d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=996a933de22d085 server_cookie=793c12d749037d65 in_seq=0 out_seq=0 2024-09-16T01:04:04.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.555+0000 7f75c97fa640 10 client.16293 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:04:04.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.556+0000 7f75c97fa640 1 -- 172.21.15.12:0/975594478 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f012c3c860 con 0x55f012ce3ee0 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.556+0000 7f75c97fa640 10 client.16293 handle_command_reply: tid=0 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.556+0000 7f75e9f3d740 1 client.16293 shutdown 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.556+0000 7f75e9f3d740 1 -- 172.21.15.12:0/975594478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012cd4370 msgr2=0x55f012cd1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.556+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012cd4370 0x55f012cd1810 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f75d800ae10 tx=0x7f75d800a7e0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.556+0000 7f75e9f3d740 1 -- 172.21.15.12:0/975594478 shutdown_connections 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.557+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f012ce3ee0 0x55f012ce62d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.557+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012cd4370 0x55f012cd1810 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.557+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012ccab40 0x55f012cd1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.557+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/975594478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cd3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.557+0000 7f75e9f3d740 1 -- 172.21.15.12:0/975594478 >> 172.21.15.12:0/975594478 conn(0x55f012c92310 msgr2=0x55f012ccb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.557+0000 7f75c97fa640 0 client.16293 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.557+0000 7f75e9f3d740 1 -- 172.21.15.12:0/975594478 shutdown_connections 2024-09-16T01:04:04.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.557+0000 7f75e9f3d740 1 -- 172.21.15.12:0/975594478 wait complete. 2024-09-16T01:04:04.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.557+0000 7f75e9f3d740 20 client.16293 trim_cache size 0 max 16384 2024-09-16T01:04:04.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e9f3d740 1 Processor -- start 2024-09-16T01:04:04.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e9f3d740 1 -- start start 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cd0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012ccc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 0x55f012ccc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f75e01b0df0 con 0x55f012ccab40 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f75e01b2930 con 0x55f012cd4370 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f75e01b14c0 con 0x55f012cc95d0 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e50ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012ccc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e50ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012ccc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55660/0 (socket says 172.21.15.12:55660) 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e50ff640 1 -- 172.21.15.12:0/601994621 learned_addr learned my addr 172.21.15.12:0/601994621 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e5900640 1 --2- 172.21.15.12:0/601994621 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cd0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e6101640 1 --2- 172.21.15.12:0/601994621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 0x55f012ccc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e50ff640 1 -- 172.21.15.12:0/601994621 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 msgr2=0x55f012cd0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:04.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e50ff640 1 --2- 172.21.15.12:0/601994621 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cd0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e50ff640 1 -- 172.21.15.12:0/601994621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 msgr2=0x55f012ccc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:04.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e50ff640 1 --2- 172.21.15.12:0/601994621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 0x55f012ccc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.570+0000 7f75e50ff640 1 -- 172.21.15.12:0/601994621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f012cc54f0 con 0x55f012ccab40 2024-09-16T01:04:04.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75e50ff640 1 --2- 172.21.15.12:0/601994621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012ccc120 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f75d00bc140 tx=0x7f75d0087270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de610ec3729fc39b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:04.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75cb7fe640 1 -- 172.21.15.12:0/601994621 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d0049070 con 0x55f012ccab40 2024-09-16T01:04:04.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75cb7fe640 1 -- 172.21.15.12:0/601994621 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d00bcb40 con 0x55f012ccab40 2024-09-16T01:04:04.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75cb7fe640 1 -- 172.21.15.12:0/601994621 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d00ec040 con 0x55f012ccab40 2024-09-16T01:04:04.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75e9f3d740 1 -- 172.21.15.12:0/601994621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 msgr2=0x55f012ccc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:04.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/601994621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012ccc120 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f75d00bc140 tx=0x7f75d0087270 comp rx=0 tx=0).stop 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75e9f3d740 1 -- 172.21.15.12:0/601994621 shutdown_connections 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/601994621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 0x55f012ccc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/601994621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012ccc120 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/601994621 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cd0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.571+0000 7f75e9f3d740 1 -- 172.21.15.12:0/601994621 >> 172.21.15.12:0/601994621 conn(0x55f012c92310 msgr2=0x55f012cd3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 1 -- 172.21.15.12:0/601994621 shutdown_connections 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 1 -- 172.21.15.12:0/601994621 wait complete. 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 1 -- start start 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 1 Processor -- start 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cdc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cd7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 0x55f012cd8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f75e01b2260 con 0x55f012ccab40 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f75e01b1b90 con 0x55f012cd4370 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f75e01aedd0 con 0x55f012cc95d0 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e9f3d740 10 client.0 _ll_register_callbacks cb 0x7f75dc00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.572+0000 7f75e50ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cd7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e50ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cd7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55668/0 (socket says 172.21.15.12:55668) 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e50ff640 1 -- 172.21.15.12:0/2365713850 learned_addr learned my addr 172.21.15.12:0/2365713850 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e5900640 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cdc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e6101640 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 0x55f012cd8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e50ff640 1 -- 172.21.15.12:0/2365713850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 msgr2=0x55f012cdc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e50ff640 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cdc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e50ff640 1 -- 172.21.15.12:0/2365713850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 msgr2=0x55f012cd8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e50ff640 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 0x55f012cd8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e50ff640 1 -- 172.21.15.12:0/2365713850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f012cd87e0 con 0x55f012ccab40 2024-09-16T01:04:04.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e6101640 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 0x55f012cd8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e50ff640 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cd7ce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f75d00bc3d0 tx=0x7f75d002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ce6d8117b71399 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75c97fa640 1 -- 172.21.15.12:0/2365713850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d00d5060 con 0x55f012ccab40 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75c97fa640 1 -- 172.21.15.12:0/2365713850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f75d003b460 con 0x55f012ccab40 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e9f3d740 1 -- 172.21.15.12:0/2365713850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75d00bcb40 con 0x55f012ccab40 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75c97fa640 1 -- 172.21.15.12:0/2365713850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f75d0049070 con 0x55f012ccab40 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e9f3d740 10 client.16299 fetch_fsmap learned FSMap version 29 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.573+0000 7f75e9f3d740 1 -- 172.21.15.12:0/2365713850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f012d4e770 con 0x55f012ccab40 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.574+0000 7f75c97fa640 1 -- 172.21.15.12:0/2365713850 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d00bcb40 con 0x55f012ccab40 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.574+0000 7f75c97fa640 1 -- 172.21.15.12:0/2365713850 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f75d003bc20 con 0x55f012ccab40 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.574+0000 7f75e9f3d740 10 client.16299 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.574+0000 7f75e9f3d740 10 client.16299 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.574+0000 7f75e9f3d740 20 client.16299 populate_metadata read hostname 'smithi012' 2024-09-16T01:04:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.574+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f012d4ee40 0x55f012d51260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.574+0000 7f75e9f3d740 4 client.16299 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.574+0000 7f75e9f3d740 1 -- 172.21.15.12:0/2365713850 --> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f012c36d70 con 0x55f012d4ee40 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.574+0000 7f75e5900640 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f012d4ee40 0x55f012d51260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e5900640 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f012d4ee40 0x55f012d51260 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c11f5e74e06a41c2 server_cookie=f607787ff0d62380 in_seq=0 out_seq=0 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75c97fa640 10 client.16299 ms_handle_connect on v2:172.21.15.119:6838/3964855150 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75c97fa640 1 -- 172.21.15.12:0/2365713850 <== mds.2 v2:172.21.15.119:6838/3964855150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f012c36d70 con 0x55f012d4ee40 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75c97fa640 10 client.16299 handle_command_reply: tid=0 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 client.16299 shutdown 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 -- 172.21.15.12:0/2365713850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 msgr2=0x55f012cd7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cd7ce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f75d00bc3d0 tx=0x7f75d002a410 comp rx=0 tx=0).stop 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 -- 172.21.15.12:0/2365713850 shutdown_connections 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.119:6838/3964855150,v1:172.21.15.119:6839/3964855150] conn(0x55f012d4ee40 0x55f012d51260 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f012cd4370 0x55f012cd8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f012ccab40 0x55f012cd7ce0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75c97fa640 0 client.16299 ms_handle_reset on v2:172.21.15.119:6838/3964855150 2024-09-16T01:04:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 --2- 172.21.15.12:0/2365713850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f012cc95d0 0x55f012cdc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 -- 172.21.15.12:0/2365713850 >> 172.21.15.12:0/2365713850 conn(0x55f012c92310 msgr2=0x55f012cc44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 -- 172.21.15.12:0/2365713850 shutdown_connections 2024-09-16T01:04:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 1 -- 172.21.15.12:0/2365713850 wait complete. 2024-09-16T01:04:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.575+0000 7f75e9f3d740 20 client.16299 trim_cache size 0 max 16384 2024-09-16T01:04:04.581 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:04:04.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 -- 172.21.15.12:0/2628338522 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75cc0a32c0 msgr2=0x7f75cc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:04.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75cc0a32c0 0x7f75cc0a5780 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f75d8018000 tx=0x7f75d8019000 comp rx=0 tx=0).stop 2024-09-16T01:04:04.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 -- 172.21.15.12:0/2628338522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e0101280 msgr2=0x7f75e019ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:04.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e0101280 0x7f75e019ac40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f75d0006010 tx=0x7f75d00042f0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 -- 172.21.15.12:0/2628338522 shutdown_connections 2024-09-16T01:04:04.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f75cc0a32c0 0x7f75cc0a5780 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75e010e480 0x7f75e019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e0101280 0x7f75e019ac40 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 --2- 172.21.15.12:0/2628338522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75e01008d0 0x7f75e019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:04.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 -- 172.21.15.12:0/2628338522 >> 172.21.15.12:0/2628338522 conn(0x7f75e00fc7a0 msgr2=0x7f75e00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:04.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 -- 172.21.15.12:0/2628338522 shutdown_connections 2024-09-16T01:04:04.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:04.576+0000 7f75e7b64640 1 -- 172.21.15.12:0/2628338522 wait complete. 2024-09-16T01:04:05.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:04 smithi119 ceph-mon[35049]: pgmap v449: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-16T01:04:05.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:04 smithi012 ceph-mon[31197]: pgmap v449: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-16T01:04:05.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:04 smithi098 ceph-mon[35346]: pgmap v449: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-16T01:04:05.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-16T01:04:05.646 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.101+0000 7f48ff0d4640 1 -- 172.21.15.12:0/166680095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48f8102790 msgr2=0x7f48f81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.101+0000 7f48ff0d4640 1 --2- 172.21.15.12:0/166680095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48f8102790 0x7f48f81067e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009900 tx=0x7f48ec02a410 comp rx=0 tx=0).stop 2024-09-16T01:04:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 -- 172.21.15.12:0/166680095 shutdown_connections 2024-09-16T01:04:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 --2- 172.21.15.12:0/166680095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f8106f10 0x7f48f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 --2- 172.21.15.12:0/166680095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48f8102790 0x7f48f81067e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 --2- 172.21.15.12:0/166680095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f8101de0 0x7f48f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 -- 172.21.15.12:0/166680095 >> 172.21.15.12:0/166680095 conn(0x7f48f80fd8c0 msgr2=0x7f48f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 -- 172.21.15.12:0/166680095 shutdown_connections 2024-09-16T01:04:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 -- 172.21.15.12:0/166680095 wait complete. 2024-09-16T01:04:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 Processor -- start 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 -- start start 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48f8101de0 0x7f48f819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f8102790 0x7f48f819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f8106f10 0x7f48f819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8111f90 con 0x7f48f8101de0 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8111e10 con 0x7f48f8102790 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.102+0000 7f48ff0d4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8112110 con 0x7f48f8106f10 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48fce70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48f8101de0 0x7f48f819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48fce70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48f8101de0 0x7f48f819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55698/0 (socket says 172.21.15.12:55698) 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48fce70640 1 -- 172.21.15.12:0/1758303428 learned_addr learned my addr 172.21.15.12:0/1758303428 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48fd671640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f8106f10 0x7f48f819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48f7fff640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f8102790 0x7f48f819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48fce70640 1 -- 172.21.15.12:0/1758303428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f8106f10 msgr2=0x7f48f819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:06.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48fce70640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f8106f10 0x7f48f819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48fce70640 1 -- 172.21.15.12:0/1758303428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f8102790 msgr2=0x7f48f819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48fce70640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f8102790 0x7f48f819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48fce70640 1 -- 172.21.15.12:0/1758303428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f819f660 con 0x7f48f8101de0 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48f7fff640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f8102790 0x7f48f819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48fce70640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48f8101de0 0x7f48f819a6b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f48e800b4a0 tx=0x7f48e800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48f5ffb640 1 -- 172.21.15.12:0/1758303428 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8014070 con 0x7f48f8101de0 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48ff0d4640 1 -- 172.21.15.12:0/1758303428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f819f950 con 0x7f48f8101de0 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48f5ffb640 1 -- 172.21.15.12:0/1758303428 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e8010af0 con 0x7f48f8101de0 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48f5ffb640 1 -- 172.21.15.12:0/1758303428 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8017d10 con 0x7f48f8101de0 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.103+0000 7f48ff0d4640 1 -- 172.21.15.12:0/1758303428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f81a7230 con 0x7f48f8101de0 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f48f5ffb640 1 -- 172.21.15.12:0/1758303428 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f48e8017070 con 0x7f48f8101de0 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f49014ad740 1 Processor -- start 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f49014ad740 1 -- start start 2024-09-16T01:04:06.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f49014ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f11090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f49014ad740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 0x5556e8f11a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f49014ad740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f1c370 0x5556e8f1e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f49014ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5556e8e772f0 con 0x5556e8f12b40 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f49014ad740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5556e8e1ecf0 con 0x5556e8f115d0 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f49014ad740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5556e8e732b0 con 0x5556e8f1c370 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f48fd671640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f11090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f48fd671640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f11090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55702/0 (socket says 172.21.15.12:55702) 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f48f5ffb640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48e00a3240 0x7f48e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.106+0000 7f48fd671640 1 -- 172.21.15.12:0/338811030 learned_addr learned my addr 172.21.15.12:0/338811030 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48fce70640 1 --2- 172.21.15.12:0/338811030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 0x5556e8f11a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48f7fff640 1 --2- 172.21.15.12:0/338811030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f1c370 0x5556e8f1e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48f5ffb640 1 -- 172.21.15.12:0/1758303428 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f48e80cf0f0 con 0x7f48f8101de0 2024-09-16T01:04:06.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48fd671640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48e00a3240 0x7f48e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48fd671640 1 -- 172.21.15.12:0/338811030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f1c370 msgr2=0x5556e8f1e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48fd671640 1 --2- 172.21.15.12:0/338811030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f1c370 0x5556e8f1e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48fd671640 1 -- 172.21.15.12:0/338811030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 msgr2=0x5556e8f11a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48fd671640 1 --2- 172.21.15.12:0/338811030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 0x5556e8f11a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48fd671640 1 -- 172.21.15.12:0/338811030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556e8e033a0 con 0x5556e8f12b40 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48fd671640 1 --2- 172.21.15.12:0/338811030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f11090 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f48f0012910 tx=0x7f48f0012dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9b6e8f8e857ae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48fd671640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48e00a3240 0x7f48e00a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f48f001a000 tx=0x7f48f001c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48deffd640 1 -- 172.21.15.12:0/338811030 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0004d20 con 0x5556e8f12b40 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48deffd640 1 -- 172.21.15.12:0/338811030 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f0020030 con 0x5556e8f12b40 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.107+0000 7f48deffd640 1 -- 172.21.15.12:0/338811030 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f001c950 con 0x5556e8f12b40 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.108+0000 7f49014ad740 1 -- 172.21.15.12:0/338811030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 msgr2=0x5556e8f11090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.108+0000 7f49014ad740 1 --2- 172.21.15.12:0/338811030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f11090 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f48f0012910 tx=0x7f48f0012dd0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.108+0000 7f49014ad740 1 -- 172.21.15.12:0/338811030 shutdown_connections 2024-09-16T01:04:06.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.108+0000 7f49014ad740 1 --2- 172.21.15.12:0/338811030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f1c370 0x5556e8f1e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.108+0000 7f49014ad740 1 --2- 172.21.15.12:0/338811030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 0x5556e8f11a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.108+0000 7f49014ad740 1 --2- 172.21.15.12:0/338811030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f11090 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.108+0000 7f49014ad740 1 -- 172.21.15.12:0/338811030 >> 172.21.15.12:0/338811030 conn(0x5556e8eda310 msgr2=0x5556e8f0dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.108+0000 7f49014ad740 1 -- 172.21.15.12:0/338811030 shutdown_connections 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.108+0000 7f49014ad740 1 -- 172.21.15.12:0/338811030 wait complete. 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.108+0000 7f49014ad740 1 -- start start 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f49014ad740 1 Processor -- start 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f49014ad740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 0x5556e8f1bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f49014ad740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f12b40 0x5556e8f19090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f49014ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f197d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f49014ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5556e8f1f010 con 0x5556e8f1c370 2024-09-16T01:04:06.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f49014ad740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5556e8e32060 con 0x5556e8f115d0 2024-09-16T01:04:06.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f49014ad740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5556e8f1f190 con 0x5556e8f12b40 2024-09-16T01:04:06.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f49014ad740 10 client.0 _ll_register_callbacks cb 0x5556e8b858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:06.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48fd671640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f197d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48fd671640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f197d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55704/0 (socket says 172.21.15.12:55704) 2024-09-16T01:04:06.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48fd671640 1 -- 172.21.15.12:0/3620513926 learned_addr learned my addr 172.21.15.12:0/3620513926 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:06.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48fce70640 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 0x5556e8f1bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48f7fff640 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f12b40 0x5556e8f19090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48fd671640 1 -- 172.21.15.12:0/3620513926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f12b40 msgr2=0x5556e8f19090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:06.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48fd671640 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f12b40 0x5556e8f19090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48fd671640 1 -- 172.21.15.12:0/3620513926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 msgr2=0x5556e8f1bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48fd671640 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 0x5556e8f1bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48fd671640 1 -- 172.21.15.12:0/3620513926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556e8be83c0 con 0x5556e8f1c370 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.109+0000 7f48fce70640 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 0x5556e8f1bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.110+0000 7f48fd671640 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f197d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f48f001cfc0 tx=0x7f48f00125f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6a3b08a6eb0c74 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.110+0000 7f48d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.110+0000 7f48d7fff640 1 -- 172.21.15.12:0/3620513926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0032060 con 0x5556e8f1c370 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.110+0000 7f48d7fff640 1 -- 172.21.15.12:0/3620513926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f48f0003970 con 0x5556e8f1c370 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.110+0000 7f49014ad740 1 -- 172.21.15.12:0/3620513926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48f0020030 con 0x5556e8f1c370 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.110+0000 7f48d7fff640 1 -- 172.21.15.12:0/3620513926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48f001c9a0 con 0x5556e8f1c370 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.110+0000 7f49014ad740 10 client.16311 fetch_fsmap learned FSMap version 29 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.110+0000 7f49014ad740 1 -- 172.21.15.12:0/3620513926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5556e8f2ab40 con 0x5556e8f1c370 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.111+0000 7f48d7fff640 1 -- 172.21.15.12:0/3620513926 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f0020030 con 0x5556e8f1c370 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.111+0000 7f48d7fff640 1 -- 172.21.15.12:0/3620513926 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f48f002d410 con 0x5556e8f1c370 2024-09-16T01:04:06.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.111+0000 7f49014ad740 10 client.16311 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:04:06.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.111+0000 7f49014ad740 10 client.16311 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-16T01:04:06.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.111+0000 7f49014ad740 20 client.16311 populate_metadata read hostname 'smithi012' 2024-09-16T01:04:06.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.111+0000 7f49014ad740 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5556e8f2bfa0 0x5556e8f2e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.111+0000 7f49014ad740 4 client.16311 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:04:06.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.111+0000 7f49014ad740 1 -- 172.21.15.12:0/3620513926 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556e8e84860 con 0x5556e8f2bfa0 2024-09-16T01:04:06.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.112+0000 7f48fce70640 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5556e8f2bfa0 0x5556e8f2e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.112+0000 7f48fce70640 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5556e8f2bfa0 0x5556e8f2e390 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f87fe7fb48b2923c server_cookie=50939078cd97073a in_seq=0 out_seq=0 2024-09-16T01:04:06.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.112+0000 7f48d7fff640 10 client.16311 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:04:06.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f48d7fff640 1 -- 172.21.15.12:0/3620513926 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556e8e84860 con 0x5556e8f2bfa0 2024-09-16T01:04:06.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f48d7fff640 10 client.16311 handle_command_reply: tid=0 2024-09-16T01:04:06.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 client.16311 shutdown 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 -- 172.21.15.12:0/3620513926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 msgr2=0x5556e8f197d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f197d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f48f001cfc0 tx=0x7f48f00125f0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 -- 172.21.15.12:0/3620513926 shutdown_connections 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5556e8f2bfa0 0x5556e8f2e390 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f48d7fff640 0 client.16311 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f197d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f12b40 0x5556e8f19090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 --2- 172.21.15.12:0/3620513926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f115d0 0x5556e8f1bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 -- 172.21.15.12:0/3620513926 >> 172.21.15.12:0/3620513926 conn(0x5556e8eda310 msgr2=0x5556e8f13960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 -- 172.21.15.12:0/3620513926 shutdown_connections 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 1 -- 172.21.15.12:0/3620513926 wait complete. 2024-09-16T01:04:06.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.113+0000 7f49014ad740 20 client.16311 trim_cache size 0 max 16384 2024-09-16T01:04:06.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.126+0000 7f49014ad740 1 Processor -- start 2024-09-16T01:04:06.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.126+0000 7f49014ad740 1 -- start start 2024-09-16T01:04:06.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.126+0000 7f49014ad740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 0x5556e8f18950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.126+0000 7f49014ad740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f12b40 0x5556e8f282b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.126+0000 7f49014ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f1b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.126+0000 7f49014ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81b0e60 con 0x5556e8f1c370 2024-09-16T01:04:06.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.126+0000 7f49014ad740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81b29a0 con 0x5556e8f12b40 2024-09-16T01:04:06.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.126+0000 7f49014ad740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81b1530 con 0x5556e8f115d0 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fd671640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f1b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fd671640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f1b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55710/0 (socket says 172.21.15.12:55710) 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fd671640 1 -- 172.21.15.12:0/3172154480 learned_addr learned my addr 172.21.15.12:0/3172154480 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48f7fff640 1 --2- 172.21.15.12:0/3172154480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f12b40 0x5556e8f282b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fce70640 1 --2- 172.21.15.12:0/3172154480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 0x5556e8f18950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fd671640 1 -- 172.21.15.12:0/3172154480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 msgr2=0x5556e8f18950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fd671640 1 --2- 172.21.15.12:0/3172154480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 0x5556e8f18950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fd671640 1 -- 172.21.15.12:0/3172154480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f12b40 msgr2=0x5556e8f282b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fd671640 1 --2- 172.21.15.12:0/3172154480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f12b40 0x5556e8f282b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fd671640 1 -- 172.21.15.12:0/3172154480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556e8f0c310 con 0x5556e8f1c370 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fce70640 1 --2- 172.21.15.12:0/3172154480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 0x5556e8f18950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48fd671640 1 --2- 172.21.15.12:0/3172154480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f1b000 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f48f0007930 tx=0x7f48f0012dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c26144c3f65728d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:06.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48de7fc640 1 -- 172.21.15.12:0/3172154480 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0032070 con 0x5556e8f1c370 2024-09-16T01:04:06.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48de7fc640 1 -- 172.21.15.12:0/3172154480 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f0020040 con 0x5556e8f1c370 2024-09-16T01:04:06.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.127+0000 7f48de7fc640 1 -- 172.21.15.12:0/3172154480 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f002dca0 con 0x5556e8f1c370 2024-09-16T01:04:06.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 -- 172.21.15.12:0/3172154480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 msgr2=0x5556e8f1b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:06.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 --2- 172.21.15.12:0/3172154480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f1b000 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f48f0007930 tx=0x7f48f0012dd0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 -- 172.21.15.12:0/3172154480 shutdown_connections 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 --2- 172.21.15.12:0/3172154480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f1c370 0x5556e8f1b000 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 --2- 172.21.15.12:0/3172154480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f12b40 0x5556e8f282b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 --2- 172.21.15.12:0/3172154480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 0x5556e8f18950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 -- 172.21.15.12:0/3172154480 >> 172.21.15.12:0/3172154480 conn(0x5556e8eda310 msgr2=0x5556e8f1a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 -- 172.21.15.12:0/3172154480 shutdown_connections 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 -- 172.21.15.12:0/3172154480 wait complete. 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 -- start start 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.128+0000 7f49014ad740 1 Processor -- start 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f49014ad740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 0x5556e8f24730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f49014ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f24c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f49014ad740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f1c370 0x5556e8f1faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f49014ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81b22d0 con 0x5556e8f12b40 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f49014ad740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81b1c00 con 0x5556e8f1c370 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f49014ad740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81aee40 con 0x5556e8f115d0 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f49014ad740 10 client.0 _ll_register_callbacks cb 0x7f48e8017630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f48f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f24c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f48f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f24c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55722/0 (socket says 172.21.15.12:55722) 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f48f7fff640 1 -- 172.21.15.12:0/1767664513 learned_addr learned my addr 172.21.15.12:0/1767664513 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f48fd671640 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f1c370 0x5556e8f1faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f48fce70640 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 0x5556e8f24730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f48f7fff640 1 -- 172.21.15.12:0/1767664513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 msgr2=0x5556e8f24730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f48f7fff640 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 0x5556e8f24730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f48f7fff640 1 -- 172.21.15.12:0/1767664513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f1c370 msgr2=0x5556e8f1faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f48f7fff640 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f1c370 0x5556e8f1faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.129+0000 7f48f7fff640 1 -- 172.21.15.12:0/1767664513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556e8f0d510 con 0x5556e8f12b40 2024-09-16T01:04:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f48f7fff640 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f24c70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009230 tx=0x7f48ec0317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bc1588fb66b1f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f48d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f48d7fff640 1 -- 172.21.15.12:0/1767664513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec035040 con 0x5556e8f12b40 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f49014ad740 1 -- 172.21.15.12:0/1767664513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48f0020040 con 0x5556e8f12b40 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f48d7fff640 1 -- 172.21.15.12:0/1767664513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f48ec004040 con 0x5556e8f12b40 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f48d7fff640 1 -- 172.21.15.12:0/1767664513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48ec04f050 con 0x5556e8f12b40 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f49014ad740 10 client.16317 fetch_fsmap learned FSMap version 29 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f49014ad740 1 -- 172.21.15.12:0/1767664513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5556e8f1ecf0 con 0x5556e8f12b40 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f48d7fff640 1 -- 172.21.15.12:0/1767664513 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f0020040 con 0x5556e8f12b40 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f48d7fff640 1 -- 172.21.15.12:0/1767664513 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f48ec004750 con 0x5556e8f12b40 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.130+0000 7f49014ad740 10 client.16317 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f49014ad740 10 client.16317 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f49014ad740 20 client.16317 populate_metadata read hostname 'smithi012' 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f49014ad740 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5556e8f2bfa0 0x5556e8f98870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f49014ad740 4 client.16317 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f49014ad740 1 -- 172.21.15.12:0/1767664513 --> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556e8e7ed70 con 0x5556e8f2bfa0 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f48fce70640 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5556e8f2bfa0 0x5556e8f98870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f48d7fff640 10 client.16317 ms_handle_connect on v2:172.21.15.98:6836/390846726 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f48fce70640 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5556e8f2bfa0 0x5556e8f98870 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51ed644328ee9f00 server_cookie=16f768663df0fa57 in_seq=0 out_seq=0 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f48d7fff640 1 -- 172.21.15.12:0/1767664513 <== mds.1 v2:172.21.15.98:6836/390846726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556e8e7ed70 con 0x5556e8f2bfa0 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f48d7fff640 10 client.16317 handle_command_reply: tid=0 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.131+0000 7f49014ad740 1 client.16317 shutdown 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 1 -- 172.21.15.12:0/1767664513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 msgr2=0x5556e8f24c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f24c70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009230 tx=0x7f48ec0317e0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 1 -- 172.21.15.12:0/1767664513 shutdown_connections 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.98:6836/390846726,v1:172.21.15.98:6837/390846726] conn(0x5556e8f2bfa0 0x5556e8f98870 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556e8f1c370 0x5556e8f1faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556e8f12b40 0x5556e8f24c70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f48d7fff640 0 client.16317 ms_handle_reset on v2:172.21.15.98:6836/390846726 2024-09-16T01:04:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 1 --2- 172.21.15.12:0/1767664513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5556e8f115d0 0x5556e8f24730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 1 -- 172.21.15.12:0/1767664513 >> 172.21.15.12:0/1767664513 conn(0x5556e8eda310 msgr2=0x5556e8f1b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 1 -- 172.21.15.12:0/1767664513 shutdown_connections 2024-09-16T01:04:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 1 -- 172.21.15.12:0/1767664513 wait complete. 2024-09-16T01:04:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f49014ad740 20 client.16317 trim_cache size 0 max 16384 2024-09-16T01:04:06.138 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:04:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f48ff0d4640 1 -- 172.21.15.12:0/1758303428 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48e00a3240 msgr2=0x7f48e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f48ff0d4640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48e00a3240 0x7f48e00a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f48f001a000 tx=0x7f48f001c000 comp rx=0 tx=0).stop 2024-09-16T01:04:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f48ff0d4640 1 -- 172.21.15.12:0/1758303428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48f8101de0 msgr2=0x7f48f819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.132+0000 7f48ff0d4640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48f8101de0 0x7f48f819a6b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f48e800b4a0 tx=0x7f48e800b960 comp rx=0 tx=0).stop 2024-09-16T01:04:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.133+0000 7f48ff0d4640 1 -- 172.21.15.12:0/1758303428 shutdown_connections 2024-09-16T01:04:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.133+0000 7f48ff0d4640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f48e00a3240 0x7f48e00a5700 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.133+0000 7f48ff0d4640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f8106f10 0x7f48f819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.133+0000 7f48ff0d4640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f8102790 0x7f48f819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.133+0000 7f48ff0d4640 1 --2- 172.21.15.12:0/1758303428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48f8101de0 0x7f48f819a6b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.133+0000 7f48ff0d4640 1 -- 172.21.15.12:0/1758303428 >> 172.21.15.12:0/1758303428 conn(0x7f48f80fd8c0 msgr2=0x7f48f80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:06.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.133+0000 7f48ff0d4640 1 -- 172.21.15.12:0/1758303428 shutdown_connections 2024-09-16T01:04:06.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:06.133+0000 7f48ff0d4640 1 -- 172.21.15.12:0/1758303428 wait complete. 2024-09-16T01:04:06.808 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:06 smithi012 ceph-mon[31197]: pgmap v450: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-16T01:04:06.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-16T01:04:07.094 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:07.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:06 smithi119 ceph-mon[35049]: pgmap v450: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-16T01:04:07.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:06 smithi098 ceph-mon[35346]: pgmap v450: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-16T01:04:07.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.595+0000 7f65440e9640 1 -- 172.21.15.12:0/3688436238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f653c10e480 msgr2=0x7f653c110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.595+0000 7f65440e9640 1 --2- 172.21.15.12:0/3688436238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f653c10e480 0x7f653c110870 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6534009ca0 tx=0x7f653402a8c0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.596+0000 7f65440e9640 1 -- 172.21.15.12:0/3688436238 shutdown_connections 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.596+0000 7f65440e9640 1 --2- 172.21.15.12:0/3688436238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f653c10e480 0x7f653c110870 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.596+0000 7f65440e9640 1 --2- 172.21.15.12:0/3688436238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f653c101280 0x7f653c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.596+0000 7f65440e9640 1 --2- 172.21.15.12:0/3688436238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f653c1008d0 0x7f653c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.596+0000 7f65440e9640 1 -- 172.21.15.12:0/3688436238 >> 172.21.15.12:0/3688436238 conn(0x7f653c0fc7a0 msgr2=0x7f653c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.596+0000 7f65440e9640 1 -- 172.21.15.12:0/3688436238 shutdown_connections 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.596+0000 7f65440e9640 1 -- 172.21.15.12:0/3688436238 wait complete. 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.596+0000 7f65440e9640 1 Processor -- start 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.596+0000 7f65440e9640 1 -- start start 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f65440e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f653c1008d0 0x7f653c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f65440e9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f653c101280 0x7f653c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f65440e9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f653c10e480 0x7f653c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f65440e9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f653c114160 con 0x7f653c10e480 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f65440e9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f653c113fe0 con 0x7f653c101280 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f65440e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1142e0 con 0x7f653c1008d0 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6542686640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f653c10e480 0x7f653c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6542686640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f653c10e480 0x7f653c19efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57356/0 (socket says 172.21.15.12:57356) 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6542686640 1 -- 172.21.15.12:0/2072286682 learned_addr learned my addr 172.21.15.12:0/2072286682 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6541e85640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f653c1008d0 0x7f653c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6541684640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f653c101280 0x7f653c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6542686640 1 -- 172.21.15.12:0/2072286682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f653c1008d0 msgr2=0x7f653c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6542686640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f653c1008d0 0x7f653c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6542686640 1 -- 172.21.15.12:0/2072286682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f653c101280 msgr2=0x7f653c19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6542686640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f653c101280 0x7f653c19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6542686640 1 -- 172.21.15.12:0/2072286682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c19f690 con 0x7f653c10e480 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.597+0000 7f6542686640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f653c10e480 0x7f653c19efb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f653402ade0 tx=0x7f65340319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.598+0000 7f6532ffd640 1 -- 172.21.15.12:0/2072286682 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534003c30 con 0x7f653c10e480 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.598+0000 7f6532ffd640 1 -- 172.21.15.12:0/2072286682 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6534003dd0 con 0x7f653c10e480 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.598+0000 7f65440e9640 1 -- 172.21.15.12:0/2072286682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c19f920 con 0x7f653c10e480 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.598+0000 7f6532ffd640 1 -- 172.21.15.12:0/2072286682 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653402fc40 con 0x7f653c10e480 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.598+0000 7f65440e9640 1 -- 172.21.15.12:0/2072286682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c1a7260 con 0x7f653c10e480 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.600+0000 7f6532ffd640 1 -- 172.21.15.12:0/2072286682 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6534004050 con 0x7f653c10e480 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.600+0000 7f65464c2740 1 Processor -- start 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f65464c2740 1 -- start start 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f65464c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe40c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f65464c2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40c5d0 0x559dfe40ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f65464c2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe417370 0x559dfe419760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f65464c2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559dfe3722f0 con 0x559dfe40c5d0 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f65464c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559dfe319cf0 con 0x559dfe40db40 2024-09-16T01:04:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f65464c2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559dfe36e2b0 con 0x559dfe417370 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f6532ffd640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65280a3240 0x7f65280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f6541e85640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40c5d0 0x559dfe40ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f6541e85640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40c5d0 0x559dfe40ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57366/0 (socket says 172.21.15.12:57366) 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f6541e85640 1 -- 172.21.15.12:0/240082520 learned_addr learned my addr 172.21.15.12:0/240082520 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f6542686640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65280a3240 0x7f65280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f6541684640 1 --2- 172.21.15.12:0/240082520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe40c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f6541684640 1 --2- 172.21.15.12:0/240082520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe417370 0x559dfe419760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.601+0000 7f6532ffd640 1 -- 172.21.15.12:0/2072286682 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f65340f0ff0 con 0x7f653c10e480 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6541e85640 1 -- 172.21.15.12:0/240082520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe417370 msgr2=0x559dfe419760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6541e85640 1 --2- 172.21.15.12:0/240082520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe417370 0x559dfe419760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6541e85640 1 -- 172.21.15.12:0/240082520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 msgr2=0x559dfe40c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6541e85640 1 --2- 172.21.15.12:0/240082520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe40c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6541e85640 1 -- 172.21.15.12:0/240082520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dfe2fe3a0 con 0x559dfe40c5d0 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6541684640 1 --2- 172.21.15.12:0/240082520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe417370 0x559dfe419760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6541e85640 1 --2- 172.21.15.12:0/240082520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40c5d0 0x559dfe40ca10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6538009cf0 tx=0x7f6538011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5a49d705e621b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6542686640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65280a3240 0x7f65280a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f65340b9c60 tx=0x7f6534087c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6527fff640 1 -- 172.21.15.12:0/240082520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538004230 con 0x559dfe40c5d0 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6527fff640 1 -- 172.21.15.12:0/240082520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65380043d0 con 0x559dfe40c5d0 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.602+0000 7f6527fff640 1 -- 172.21.15.12:0/240082520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65380197e0 con 0x559dfe40c5d0 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 -- 172.21.15.12:0/240082520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40c5d0 msgr2=0x559dfe40ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 --2- 172.21.15.12:0/240082520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40c5d0 0x559dfe40ca10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6538009cf0 tx=0x7f6538011810 comp rx=0 tx=0).stop 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 -- 172.21.15.12:0/240082520 shutdown_connections 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 --2- 172.21.15.12:0/240082520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe417370 0x559dfe419760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 --2- 172.21.15.12:0/240082520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40c5d0 0x559dfe40ca10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 --2- 172.21.15.12:0/240082520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe40c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 -- 172.21.15.12:0/240082520 >> 172.21.15.12:0/240082520 conn(0x559dfe3d5310 msgr2=0x559dfe408c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 -- 172.21.15.12:0/240082520 shutdown_connections 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 -- 172.21.15.12:0/240082520 wait complete. 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 -- start start 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.603+0000 7f65464c2740 1 Processor -- start 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f65464c2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe416ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f65464c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe413f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f65464c2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe4144f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f65464c2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559dfe41a070 con 0x559dfe417370 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f65464c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559dfe32d060 con 0x559dfe40db40 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f65464c2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559dfe41a1f0 con 0x559dfe40c5d0 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f65464c2740 10 client.0 _ll_register_callbacks cb 0x559dfe0808c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541684640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe4144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541684640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe4144f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57380/0 (socket says 172.21.15.12:57380) 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541684640 1 -- 172.21.15.12:0/2440500775 learned_addr learned my addr 172.21.15.12:0/2440500775 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541684640 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe416ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541e85640 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe413f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541684640 1 -- 172.21.15.12:0/2440500775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 msgr2=0x559dfe416ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541684640 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe416ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541684640 1 -- 172.21.15.12:0/2440500775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 msgr2=0x559dfe413f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541684640 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe413f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541684640 1 -- 172.21.15.12:0/2440500775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dfe0e33c0 con 0x559dfe417370 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f6541684640 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe4144f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f652c012cc0 tx=0x7f652c016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7e6d6c3a8d456a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.604+0000 7f65257fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65257fa640 1 -- 172.21.15.12:0/2440500775 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c00ce90 con 0x559dfe417370 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65257fa640 1 -- 172.21.15.12:0/2440500775 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f652c004030 con 0x559dfe417370 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65464c2740 1 -- 172.21.15.12:0/2440500775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65380043d0 con 0x559dfe417370 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65257fa640 1 -- 172.21.15.12:0/2440500775 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f652c027050 con 0x559dfe417370 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65464c2740 10 client.16329 fetch_fsmap learned FSMap version 29 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65464c2740 1 -- 172.21.15.12:0/2440500775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559dfe425ae0 con 0x559dfe417370 2024-09-16T01:04:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65257fa640 1 -- 172.21.15.12:0/2440500775 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65380043d0 con 0x559dfe417370 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65257fa640 1 -- 172.21.15.12:0/2440500775 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f652c011560 con 0x559dfe417370 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65464c2740 10 client.16329 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65464c2740 10 client.16329 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65464c2740 20 client.16329 populate_metadata read hostname 'smithi012' 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65464c2740 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559dfe427330 0x559dfe4297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65464c2740 4 client.16329 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.605+0000 7f65464c2740 1 -- 172.21.15.12:0/2440500775 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dfe37f860 con 0x559dfe427330 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.606+0000 7f6541e85640 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559dfe427330 0x559dfe4297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.606+0000 7f6541e85640 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559dfe427330 0x559dfe4297b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b15f218973abd160 server_cookie=3370fc20afae3af5 in_seq=0 out_seq=0 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.606+0000 7f65257fa640 10 client.16329 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65257fa640 1 -- 172.21.15.12:0/2440500775 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559dfe37f860 con 0x559dfe427330 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65257fa640 10 client.16329 handle_command_reply: tid=0 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 client.16329 shutdown 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 -- 172.21.15.12:0/2440500775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 msgr2=0x559dfe4144f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe4144f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f652c012cc0 tx=0x7f652c016040 comp rx=0 tx=0).stop 2024-09-16T01:04:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 -- 172.21.15.12:0/2440500775 shutdown_connections 2024-09-16T01:04:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559dfe427330 0x559dfe4297b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe4144f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe413f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 --2- 172.21.15.12:0/2440500775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe416ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65257fa640 0 client.16329 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:04:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 -- 172.21.15.12:0/2440500775 >> 172.21.15.12:0/2440500775 conn(0x559dfe3d5310 msgr2=0x559dfe40e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 -- 172.21.15.12:0/2440500775 shutdown_connections 2024-09-16T01:04:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 1 -- 172.21.15.12:0/2440500775 wait complete. 2024-09-16T01:04:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.607+0000 7f65464c2740 20 client.16329 trim_cache size 0 max 16384 2024-09-16T01:04:07.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f65464c2740 1 Processor -- start 2024-09-16T01:04:07.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f65464c2740 1 -- start start 2024-09-16T01:04:07.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f65464c2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe423310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f65464c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe408700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f65464c2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe408c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f65464c2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b0e30 con 0x559dfe417370 2024-09-16T01:04:07.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f65464c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b2970 con 0x559dfe40db40 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f65464c2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b1500 con 0x559dfe40c5d0 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f6541684640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe408c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f6541684640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe408c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57390/0 (socket says 172.21.15.12:57390) 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.620+0000 7f6541684640 1 -- 172.21.15.12:0/1836206053 learned_addr learned my addr 172.21.15.12:0/1836206053 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f6541e85640 1 --2- 172.21.15.12:0/1836206053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe408700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f6541684640 1 -- 172.21.15.12:0/1836206053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 msgr2=0x559dfe423310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f6541684640 1 --2- 172.21.15.12:0/1836206053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe423310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f6541684640 1 -- 172.21.15.12:0/1836206053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 msgr2=0x559dfe408700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f6541684640 1 --2- 172.21.15.12:0/1836206053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe408700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f6541684640 1 -- 172.21.15.12:0/1836206053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dfe409180 con 0x559dfe417370 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f6541e85640 1 --2- 172.21.15.12:0/1836206053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe408700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f6541684640 1 --2- 172.21.15.12:0/1836206053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe408c40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f652c001eb0 tx=0x7f652c00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f43a3e486891c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f65277fe640 1 -- 172.21.15.12:0/1836206053 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c00ce90 con 0x559dfe417370 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f65277fe640 1 -- 172.21.15.12:0/1836206053 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f652c003c60 con 0x559dfe417370 2024-09-16T01:04:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.621+0000 7f65277fe640 1 -- 172.21.15.12:0/1836206053 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c0116a0 con 0x559dfe417370 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 -- 172.21.15.12:0/1836206053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 msgr2=0x559dfe408c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 --2- 172.21.15.12:0/1836206053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe408c40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f652c001eb0 tx=0x7f652c00f7a0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 -- 172.21.15.12:0/1836206053 shutdown_connections 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 --2- 172.21.15.12:0/1836206053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe417370 0x559dfe408c40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 --2- 172.21.15.12:0/1836206053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe40db40 0x559dfe408700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 --2- 172.21.15.12:0/1836206053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe423310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 -- 172.21.15.12:0/1836206053 >> 172.21.15.12:0/1836206053 conn(0x559dfe3d5310 msgr2=0x559dfe412860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 -- 172.21.15.12:0/1836206053 shutdown_connections 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 -- 172.21.15.12:0/1836206053 wait complete. 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 -- start start 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.622+0000 7f65464c2740 1 Processor -- start 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65464c2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe41f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65464c2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40db40 0x559dfe41f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65464c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe417370 0x559dfe410610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65464c2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b22a0 con 0x559dfe40db40 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65464c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b1bd0 con 0x559dfe417370 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65464c2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1aee10 con 0x559dfe40c5d0 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65464c2740 10 client.0 _ll_register_callbacks cb 0x7f652c00f360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541e85640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40db40 0x559dfe41f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541e85640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40db40 0x559dfe41f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57394/0 (socket says 172.21.15.12:57394) 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541684640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe417370 0x559dfe410610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541e85640 1 -- 172.21.15.12:0/1583730628 learned_addr learned my addr 172.21.15.12:0/1583730628 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541684640 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe41f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541e85640 1 -- 172.21.15.12:0/1583730628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 msgr2=0x559dfe41f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541e85640 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe41f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541e85640 1 -- 172.21.15.12:0/1583730628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe417370 msgr2=0x559dfe410610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541e85640 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe417370 0x559dfe410610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541e85640 1 -- 172.21.15.12:0/1583730628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dfe410b50 con 0x559dfe40db40 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541684640 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe417370 0x559dfe410610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f6541e85640 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40db40 0x559dfe41f9c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6538019490 tx=0x7f6538009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98e107515801077 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65257fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65257fa640 1 -- 172.21.15.12:0/1583730628 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538032060 con 0x559dfe40db40 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65257fa640 1 -- 172.21.15.12:0/1583730628 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f6538005250 con 0x559dfe40db40 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.623+0000 7f65464c2740 1 -- 172.21.15.12:0/1583730628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f652c003c60 con 0x559dfe40db40 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65257fa640 1 -- 172.21.15.12:0/1583730628 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6538039050 con 0x559dfe40db40 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65464c2740 10 client.16335 fetch_fsmap learned FSMap version 29 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65464c2740 1 -- 172.21.15.12:0/1583730628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559dfe4917d0 con 0x559dfe40db40 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65257fa640 1 -- 172.21.15.12:0/1583730628 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f652c003c60 con 0x559dfe40db40 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65257fa640 1 -- 172.21.15.12:0/1583730628 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6538019730 con 0x559dfe40db40 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65464c2740 10 client.16335 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65464c2740 10 client.16335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:04:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65464c2740 20 client.16335 populate_metadata read hostname 'smithi012' 2024-09-16T01:04:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65464c2740 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559dfe491df0 0x559dfe494210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65464c2740 4 client.16335 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:04:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f65464c2740 1 -- 172.21.15.12:0/1583730628 --> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559dfe379d70 con 0x559dfe491df0 2024-09-16T01:04:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.624+0000 7f6541684640 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559dfe491df0 0x559dfe494210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f6541684640 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559dfe491df0 0x559dfe494210 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c277f7d99d0935 server_cookie=f6fd4877014fa6e2 in_seq=0 out_seq=0 2024-09-16T01:04:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65257fa640 10 client.16335 ms_handle_connect on v2:172.21.15.98:6838/2784619271 2024-09-16T01:04:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65257fa640 1 -- 172.21.15.12:0/1583730628 <== mds.0 v2:172.21.15.98:6838/2784619271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559dfe379d70 con 0x559dfe491df0 2024-09-16T01:04:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65257fa640 10 client.16335 handle_command_reply: tid=0 2024-09-16T01:04:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65464c2740 1 client.16335 shutdown 2024-09-16T01:04:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65464c2740 1 -- 172.21.15.12:0/1583730628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40db40 msgr2=0x559dfe41f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65464c2740 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40db40 0x559dfe41f9c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6538019490 tx=0x7f6538009f80 comp rx=0 tx=0).stop 2024-09-16T01:04:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65464c2740 1 -- 172.21.15.12:0/1583730628 shutdown_connections 2024-09-16T01:04:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65464c2740 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.98:6838/2784619271,v1:172.21.15.98:6839/2784619271] conn(0x559dfe491df0 0x559dfe494210 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65464c2740 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559dfe417370 0x559dfe410610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65464c2740 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dfe40db40 0x559dfe41f9c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65464c2740 1 --2- 172.21.15.12:0/1583730628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559dfe40c5d0 0x559dfe41f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65257fa640 0 client.16335 ms_handle_reset on v2:172.21.15.98:6838/2784619271 2024-09-16T01:04:07.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65464c2740 1 -- 172.21.15.12:0/1583730628 >> 172.21.15.12:0/1583730628 conn(0x559dfe3d5310 msgr2=0x559dfe4126f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:07.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.625+0000 7f65464c2740 1 -- 172.21.15.12:0/1583730628 shutdown_connections 2024-09-16T01:04:07.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65464c2740 1 -- 172.21.15.12:0/1583730628 wait complete. 2024-09-16T01:04:07.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65464c2740 20 client.16335 trim_cache size 0 max 16384 2024-09-16T01:04:07.632 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-16T01:04:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 -- 172.21.15.12:0/2072286682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65280a3240 msgr2=0x7f65280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65280a3240 0x7f65280a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f65340b9c60 tx=0x7f6534087c20 comp rx=0 tx=0).stop 2024-09-16T01:04:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 -- 172.21.15.12:0/2072286682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f653c10e480 msgr2=0x7f653c19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f653c10e480 0x7f653c19efb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f653402ade0 tx=0x7f65340319f0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 -- 172.21.15.12:0/2072286682 shutdown_connections 2024-09-16T01:04:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f65280a3240 0x7f65280a5700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f653c10e480 0x7f653c19efb0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f653c101280 0x7f653c19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 --2- 172.21.15.12:0/2072286682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f653c1008d0 0x7f653c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:07.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 -- 172.21.15.12:0/2072286682 >> 172.21.15.12:0/2072286682 conn(0x7f653c0fc7a0 msgr2=0x7f653c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:07.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 -- 172.21.15.12:0/2072286682 shutdown_connections 2024-09-16T01:04:07.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:07.626+0000 7f65440e9640 1 -- 172.21.15.12:0/2072286682 wait complete. 2024-09-16T01:04:08.358 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-16T01:04:08.359 INFO:tasks.fwd_scrub:done joining 2024-09-16T01:04:08.359 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-16T01:04:08.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:04:08.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.477+0000 7feee4b18640 1 -- 172.21.15.12:0/1425728448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee0104ee0 msgr2=0x7feee01072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:08.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.477+0000 7feee4b18640 1 --2- 172.21.15.12:0/1425728448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee0104ee0 0x7feee01072d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7feed4009900 tx=0x7feed402a410 comp rx=0 tx=0).stop 2024-09-16T01:04:08.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.477+0000 7feee4b18640 1 -- 172.21.15.12:0/1425728448 shutdown_connections 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.477+0000 7feee4b18640 1 --2- 172.21.15.12:0/1425728448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feee0107810 0x7feee0109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.477+0000 7feee4b18640 1 --2- 172.21.15.12:0/1425728448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee0104ee0 0x7feee01072d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.477+0000 7feee4b18640 1 --2- 172.21.15.12:0/1425728448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee01025b0 0x7feee01049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.477+0000 7feee4b18640 1 -- 172.21.15.12:0/1425728448 >> 172.21.15.12:0/1425728448 conn(0x7feee00fc1b0 msgr2=0x7feee00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.477+0000 7feee4b18640 1 -- 172.21.15.12:0/1425728448 shutdown_connections 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.477+0000 7feee4b18640 1 -- 172.21.15.12:0/1425728448 wait complete. 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feee4b18640 1 Processor -- start 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feee4b18640 1 -- start start 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feee4b18640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee01025b0 0x7feee0197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feee4b18640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee0104ee0 0x7feee0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feee4b18640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feee0107810 0x7feee019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feee4b18640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feee010d7c0 con 0x7feee01025b0 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feee4b18640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feee010d640 con 0x7feee0104ee0 2024-09-16T01:04:08.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feee4b18640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feee010d940 con 0x7feee0107810 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feede59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee01025b0 0x7feee0197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feede59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee01025b0 0x7feee0197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57416/0 (socket says 172.21.15.12:57416) 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feede59c640 1 -- 172.21.15.12:0/1723256926 learned_addr learned my addr 172.21.15.12:0/1723256926 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.478+0000 7feeded9d640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feee0107810 0x7feee019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feeddd9b640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee0104ee0 0x7feee0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feede59c640 1 -- 172.21.15.12:0/1723256926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feee0107810 msgr2=0x7feee019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feede59c640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feee0107810 0x7feee019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feede59c640 1 -- 172.21.15.12:0/1723256926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee0104ee0 msgr2=0x7feee0198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feede59c640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee0104ee0 0x7feee0198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feede59c640 1 -- 172.21.15.12:0/1723256926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee019faf0 con 0x7feee01025b0 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feeded9d640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feee0107810 0x7feee019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feeddd9b640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee0104ee0 0x7feee0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:08.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feede59c640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee01025b0 0x7feee0197ed0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7feed000c890 tx=0x7feed000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:08.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feecf7fe640 1 -- 172.21.15.12:0/1723256926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0004220 con 0x7feee01025b0 2024-09-16T01:04:08.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feee4b18640 1 -- 172.21.15.12:0/1723256926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee019fde0 con 0x7feee01025b0 2024-09-16T01:04:08.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feecf7fe640 1 -- 172.21.15.12:0/1723256926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feed00043c0 con 0x7feee01025b0 2024-09-16T01:04:08.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feecf7fe640 1 -- 172.21.15.12:0/1723256926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0004a00 con 0x7feee01025b0 2024-09-16T01:04:08.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.479+0000 7feee4b18640 1 -- 172.21.15.12:0/1723256926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee01a0240 con 0x7feee01025b0 2024-09-16T01:04:08.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.480+0000 7feee4b18640 1 -- 172.21.15.12:0/1723256926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee00fdca0 con 0x7feee01025b0 2024-09-16T01:04:08.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.481+0000 7feecf7fe640 1 -- 172.21.15.12:0/1723256926 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7feed00079b0 con 0x7feee01025b0 2024-09-16T01:04:08.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.482+0000 7feecf7fe640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7feec80a3250 0x7feec80a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:08.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.482+0000 7feecf7fe640 1 -- 172.21.15.12:0/1723256926 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7feed00cfa80 con 0x7feee01025b0 2024-09-16T01:04:08.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.482+0000 7feeddd9b640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7feec80a3250 0x7feec80a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:08.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.482+0000 7feeddd9b640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7feec80a3250 0x7feec80a5710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feed4000c00 tx=0x7feed4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:08.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.486+0000 7feecf7fe640 1 -- 172.21.15.12:0/1723256926 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feed00d1e20 con 0x7feee01025b0 2024-09-16T01:04:08.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.667+0000 7feee4b18640 1 -- 172.21.15.12:0/1723256926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feee0062ef0 con 0x7feee01025b0 2024-09-16T01:04:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.668+0000 7feecf7fe640 1 -- 172.21.15.12:0/1723256926 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24678 (secure 0 0 0) 0x7feed0014030 con 0x7feee01025b0 2024-09-16T01:04:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:04:08.670 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T01:00:45.617096+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 -- 172.21.15.12:0/1723256926 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7feec80a3250 msgr2=0x7feec80a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7feec80a3250 0x7feec80a5710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feed4000c00 tx=0x7feed4031400 comp rx=0 tx=0).stop 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 -- 172.21.15.12:0/1723256926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee01025b0 msgr2=0x7feee0197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee01025b0 0x7feee0197ed0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7feed000c890 tx=0x7feed000cd50 comp rx=0 tx=0).stop 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 -- 172.21.15.12:0/1723256926 shutdown_connections 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7feec80a3250 0x7feec80a5710 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feee0107810 0x7feee019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee0104ee0 0x7feee0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 --2- 172.21.15.12:0/1723256926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee01025b0 0x7feee0197ed0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 -- 172.21.15.12:0/1723256926 >> 172.21.15.12:0/1723256926 conn(0x7feee00fc1b0 msgr2=0x7feee0102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 -- 172.21.15.12:0/1723256926 shutdown_connections 2024-09-16T01:04:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.671+0000 7feee4b18640 1 -- 172.21.15.12:0/1723256926 wait complete. 2024-09-16T01:04:08.683 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T00:53:57.343965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T00:58:32.985046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T00:58:35.488668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-16T00:58:42.009484+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-16T01:04:08.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.790+0000 7f936285e640 1 -- 172.21.15.12:0/1711164712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c104f10 msgr2=0x7f935c105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.790+0000 7f936285e640 1 --2- 172.21.15.12:0/1711164712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c104f10 0x7f935c105390 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9344009900 tx=0x7f934402a3f0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.791+0000 7f936285e640 1 -- 172.21.15.12:0/1711164712 shutdown_connections 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.791+0000 7f936285e640 1 --2- 172.21.15.12:0/1711164712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f935c1058d0 0x7f935c10c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.791+0000 7f936285e640 1 --2- 172.21.15.12:0/1711164712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c104f10 0x7f935c105390 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.791+0000 7f936285e640 1 --2- 172.21.15.12:0/1711164712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935c103d20 0x7f935c104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.791+0000 7f936285e640 1 -- 172.21.15.12:0/1711164712 >> 172.21.15.12:0/1711164712 conn(0x7f935c0ff480 msgr2=0x7f935c1018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.791+0000 7f936285e640 1 -- 172.21.15.12:0/1711164712 shutdown_connections 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.791+0000 7f936285e640 1 -- 172.21.15.12:0/1711164712 wait complete. 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.791+0000 7f936285e640 1 Processor -- start 2024-09-16T01:04:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.791+0000 7f936285e640 1 -- start start 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.791+0000 7f936285e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935c103d20 0x7f935c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f936285e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c104f10 0x7f935c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f936285e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f935c1058d0 0x7f935c1a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f936285e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f935c10f9a0 con 0x7f935c104f10 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f936285e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f935c10f820 con 0x7f935c103d20 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f936285e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f935c10fb20 con 0x7f935c1058d0 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f935b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c104f10 0x7f935c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f935b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c104f10 0x7f935c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57444/0 (socket says 172.21.15.12:57444) 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f935b7fe640 1 -- 172.21.15.12:0/60818017 learned_addr learned my addr 172.21.15.12:0/60818017 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f935bfff640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935c103d20 0x7f935c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f9360dfb640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f935c1058d0 0x7f935c1a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f935b7fe640 1 -- 172.21.15.12:0/60818017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f935c1058d0 msgr2=0x7f935c1a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f935b7fe640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f935c1058d0 0x7f935c1a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f935b7fe640 1 -- 172.21.15.12:0/60818017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935c103d20 msgr2=0x7f935c19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f935b7fe640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935c103d20 0x7f935c19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f935b7fe640 1 -- 172.21.15.12:0/60818017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c1a1c50 con 0x7f935c104f10 2024-09-16T01:04:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f935b7fe640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c104f10 0x7f935c19a570 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9344009230 tx=0x7f9344004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f93597fa640 1 -- 172.21.15.12:0/60818017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934403f030 con 0x7f935c104f10 2024-09-16T01:04:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f93597fa640 1 -- 172.21.15.12:0/60818017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9344003ce0 con 0x7f935c104f10 2024-09-16T01:04:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f93597fa640 1 -- 172.21.15.12:0/60818017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344035070 con 0x7f935c104f10 2024-09-16T01:04:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.792+0000 7f936285e640 1 -- 172.21.15.12:0/60818017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c1a1ee0 con 0x7f935c104f10 2024-09-16T01:04:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.793+0000 7f936285e640 1 -- 172.21.15.12:0/60818017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c1a2340 con 0x7f935c104f10 2024-09-16T01:04:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.793+0000 7f936285e640 1 -- 172.21.15.12:0/60818017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935c10b160 con 0x7f935c104f10 2024-09-16T01:04:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.795+0000 7f93597fa640 1 -- 172.21.15.12:0/60818017 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9344042030 con 0x7f935c104f10 2024-09-16T01:04:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.795+0000 7f93597fa640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f93480a3250 0x7f93480a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.795+0000 7f935bfff640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f93480a3250 0x7f93480a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.795+0000 7f93597fa640 1 -- 172.21.15.12:0/60818017 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f93440f0540 con 0x7f935c104f10 2024-09-16T01:04:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.796+0000 7f935bfff640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f93480a3250 0x7f93480a5710 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f934c005fd0 tx=0x7f934c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:08.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.799+0000 7f93597fa640 1 -- 172.21.15.12:0/60818017 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93440bc8b0 con 0x7f935c104f10 2024-09-16T01:04:08.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.976+0000 7f936285e640 1 -- 172.21.15.12:0/60818017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f935c02da10 con 0x7f935c104f10 2024-09-16T01:04:08.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.976+0000 7f93597fa640 1 -- 172.21.15.12:0/60818017 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f93440c0bb0 con 0x7f935c104f10 2024-09-16T01:04:08.977 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-16T01:04:08.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 -- 172.21.15.12:0/60818017 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f93480a3250 msgr2=0x7f93480a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f93480a3250 0x7f93480a5710 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f934c005fd0 tx=0x7f934c00b410 comp rx=0 tx=0).stop 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 -- 172.21.15.12:0/60818017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c104f10 msgr2=0x7f935c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c104f10 0x7f935c19a570 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9344009230 tx=0x7f9344004360 comp rx=0 tx=0).stop 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 -- 172.21.15.12:0/60818017 shutdown_connections 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f93480a3250 0x7f93480a5710 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f935c1058d0 0x7f935c1a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c104f10 0x7f935c19a570 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 --2- 172.21.15.12:0/60818017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f935c103d20 0x7f935c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 -- 172.21.15.12:0/60818017 >> 172.21.15.12:0/60818017 conn(0x7f935c0ff480 msgr2=0x7f935c108330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 -- 172.21.15.12:0/60818017 shutdown_connections 2024-09-16T01:04:08.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:08.979+0000 7f936285e640 1 -- 172.21.15.12:0/60818017 wait complete. 2024-09-16T01:04:08.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:08 smithi012 ceph-mon[31197]: pgmap v451: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:04:08.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:08 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1723256926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:04:08.991 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T01:04:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:08 smithi119 ceph-mon[35049]: pgmap v451: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:04:09.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:08 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1723256926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:04:09.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.096+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/395698071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a8101c20 msgr2=0x7fa2a81020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.096+0000 7fa2ae7c4640 1 --2- 172.21.15.12:0/395698071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a8101c20 0x7fa2a81020a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009900 tx=0x7fa29c02a410 comp rx=0 tx=0).stop 2024-09-16T01:04:09.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.096+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/395698071 shutdown_connections 2024-09-16T01:04:09.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.096+0000 7fa2ae7c4640 1 --2- 172.21.15.12:0/395698071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a81025e0 0x7fa2a8108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.096+0000 7fa2ae7c4640 1 --2- 172.21.15.12:0/395698071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a8101c20 0x7fa2a81020a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.096+0000 7fa2ae7c4640 1 --2- 172.21.15.12:0/395698071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a8100a30 0x7fa2a8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.096+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/395698071 >> 172.21.15.12:0/395698071 conn(0x7fa2a80fc1b0 msgr2=0x7fa2a80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:09.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.096+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/395698071 shutdown_connections 2024-09-16T01:04:09.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.096+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/395698071 wait complete. 2024-09-16T01:04:09.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.097+0000 7fa2ae7c4640 1 Processor -- start 2024-09-16T01:04:09.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.097+0000 7fa2ae7c4640 1 -- start start 2024-09-16T01:04:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.097+0000 7fa2ae7c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a8100a30 0x7fa2a81049c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.097+0000 7fa2ae7c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a8101c20 0x7fa2a8103000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.097+0000 7fa2ae7c4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a81025e0 0x7fa2a8103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.097+0000 7fa2ae7c4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a810c710 con 0x7fa2a8101c20 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.097+0000 7fa2ae7c4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a810c590 con 0x7fa2a81025e0 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.097+0000 7fa2ae7c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a810c890 con 0x7fa2a8100a30 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.097+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a8101c20 0x7fa2a8103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a8101c20 0x7fa2a8103000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57466/0 (socket says 172.21.15.12:57466) 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a77fe640 1 -- 172.21.15.12:0/1876589147 learned_addr learned my addr 172.21.15.12:0/1876589147 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2acd61640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a81025e0 0x7fa2a8103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a7fff640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a8100a30 0x7fa2a81049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a77fe640 1 -- 172.21.15.12:0/1876589147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a8100a30 msgr2=0x7fa2a81049c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a77fe640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a8100a30 0x7fa2a81049c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a77fe640 1 -- 172.21.15.12:0/1876589147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a81025e0 msgr2=0x7fa2a8103540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a77fe640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a81025e0 0x7fa2a8103540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a77fe640 1 -- 172.21.15.12:0/1876589147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a8103dd0 con 0x7fa2a8101c20 2024-09-16T01:04:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a7fff640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a8100a30 0x7fa2a81049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:09.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a77fe640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a8101c20 0x7fa2a8103000 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa29c031610 tx=0x7fa29c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:09.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a57fa640 1 -- 172.21.15.12:0/1876589147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c03f030 con 0x7fa2a8101c20 2024-09-16T01:04:09.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/1876589147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a81a2010 con 0x7fa2a8101c20 2024-09-16T01:04:09.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a57fa640 1 -- 172.21.15.12:0/1876589147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa29c003ce0 con 0x7fa2a8101c20 2024-09-16T01:04:09.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2a57fa640 1 -- 172.21.15.12:0/1876589147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c035070 con 0x7fa2a8101c20 2024-09-16T01:04:09.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.098+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/1876589147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a81a2630 con 0x7fa2a8101c20 2024-09-16T01:04:09.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.099+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/1876589147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a81a2890 con 0x7fa2a8101c20 2024-09-16T01:04:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.100+0000 7fa2a57fa640 1 -- 172.21.15.12:0/1876589147 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa29c042030 con 0x7fa2a8101c20 2024-09-16T01:04:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.101+0000 7fa2a57fa640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa2900a3250 0x7fa2900a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.101+0000 7fa2a7fff640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa2900a3250 0x7fa2900a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.101+0000 7fa2a57fa640 1 -- 172.21.15.12:0/1876589147 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fa29c0f0290 con 0x7fa2a8101c20 2024-09-16T01:04:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.102+0000 7fa2a7fff640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa2900a3250 0x7fa2900a5710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8101a80 tx=0x7fa29800a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.105+0000 7fa2a57fa640 1 -- 172.21.15.12:0/1876589147 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa29c0bcc50 con 0x7fa2a8101c20 2024-09-16T01:04:09.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:08 smithi098 ceph-mon[35346]: pgmap v451: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:04:09.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:08 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1723256926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:04:09.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.281+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/1876589147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa2a81a2eb0 con 0x7fa2a8101c20 2024-09-16T01:04:09.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.282+0000 7fa2a57fa640 1 -- 172.21.15.12:0/1876589147 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7fa29c0bc550 con 0x7fa2a8101c20 2024-09-16T01:04:09.282 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-09-16T01:04:09.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/1876589147 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa2900a3250 msgr2=0x7fa2900a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa2900a3250 0x7fa2900a5710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8101a80 tx=0x7fa29800a560 comp rx=0 tx=0).stop 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/1876589147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a8101c20 msgr2=0x7fa2a8103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a8101c20 0x7fa2a8103000 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa29c031610 tx=0x7fa29c004430 comp rx=0 tx=0).stop 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/1876589147 shutdown_connections 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fa2900a3250 0x7fa2900a5710 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2a81025e0 0x7fa2a8103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a8101c20 0x7fa2a8103000 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 --2- 172.21.15.12:0/1876589147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a8100a30 0x7fa2a81049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/1876589147 >> 172.21.15.12:0/1876589147 conn(0x7fa2a80fc1b0 msgr2=0x7fa2a806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/1876589147 shutdown_connections 2024-09-16T01:04:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.284+0000 7fa2ae7c4640 1 -- 172.21.15.12:0/1876589147 wait complete. 2024-09-16T01:04:09.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T01:04:09.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.401+0000 7fdf5a42e640 1 -- 172.21.15.12:0/602160821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf541036d0 msgr2=0x7fdf54109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.401+0000 7fdf5a42e640 1 --2- 172.21.15.12:0/602160821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf541036d0 0x7fdf54109f60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009ca0 tx=0x7fdf4c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.401+0000 7fdf5a42e640 1 -- 172.21.15.12:0/602160821 shutdown_connections 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.401+0000 7fdf5a42e640 1 --2- 172.21.15.12:0/602160821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf541036d0 0x7fdf54109f60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.401+0000 7fdf5a42e640 1 --2- 172.21.15.12:0/602160821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf54102d10 0x7fdf54103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.401+0000 7fdf5a42e640 1 --2- 172.21.15.12:0/602160821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf54101b20 0x7fdf54101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.401+0000 7fdf5a42e640 1 -- 172.21.15.12:0/602160821 >> 172.21.15.12:0/602160821 conn(0x7fdf540fd2a0 msgr2=0x7fdf540ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.401+0000 7fdf5a42e640 1 -- 172.21.15.12:0/602160821 shutdown_connections 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.401+0000 7fdf5a42e640 1 -- 172.21.15.12:0/602160821 wait complete. 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf5a42e640 1 Processor -- start 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf5a42e640 1 -- start start 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf5a42e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf54101b20 0x7fdf54075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf5a42e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf54102d10 0x7fdf540745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf5a42e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf541036d0 0x7fdf54074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf5a42e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5410d780 con 0x7fdf541036d0 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf5a42e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5410d600 con 0x7fdf54101b20 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf5a42e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5410d900 con 0x7fdf54102d10 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf589cb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf541036d0 0x7fdf54074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf589cb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf541036d0 0x7fdf54074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57482/0 (socket says 172.21.15.12:57482) 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf589cb640 1 -- 172.21.15.12:0/2623310464 learned_addr learned my addr 172.21.15.12:0/2623310464 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.402+0000 7fdf53fff640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf54101b20 0x7fdf54075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf589cb640 1 -- 172.21.15.12:0/2623310464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf54102d10 msgr2=0x7fdf540745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf537fe640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf54102d10 0x7fdf540745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf589cb640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf54102d10 0x7fdf540745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf589cb640 1 -- 172.21.15.12:0/2623310464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf54101b20 msgr2=0x7fdf54075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf589cb640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf54101b20 0x7fdf54075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf589cb640 1 -- 172.21.15.12:0/2623310464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf540753b0 con 0x7fdf541036d0 2024-09-16T01:04:09.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf589cb640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf541036d0 0x7fdf54074b20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c005e30 tx=0x7fdf4c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:09.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf517fa640 1 -- 172.21.15.12:0/2623310464 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c003c30 con 0x7fdf541036d0 2024-09-16T01:04:09.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf517fa640 1 -- 172.21.15.12:0/2623310464 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf4c003dd0 con 0x7fdf541036d0 2024-09-16T01:04:09.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf5a42e640 1 -- 172.21.15.12:0/2623310464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf541a1ef0 con 0x7fdf541036d0 2024-09-16T01:04:09.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf517fa640 1 -- 172.21.15.12:0/2623310464 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c02fde0 con 0x7fdf541036d0 2024-09-16T01:04:09.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.403+0000 7fdf5a42e640 1 -- 172.21.15.12:0/2623310464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf541a2350 con 0x7fdf541036d0 2024-09-16T01:04:09.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.404+0000 7fdf5a42e640 1 -- 172.21.15.12:0/2623310464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf54108f60 con 0x7fdf541036d0 2024-09-16T01:04:09.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.405+0000 7fdf517fa640 1 -- 172.21.15.12:0/2623310464 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdf4c004050 con 0x7fdf541036d0 2024-09-16T01:04:09.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.406+0000 7fdf517fa640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdf3c0a3250 0x7fdf3c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.406+0000 7fdf53fff640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdf3c0a3250 0x7fdf3c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.406+0000 7fdf517fa640 1 -- 172.21.15.12:0/2623310464 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fdf4c0f1070 con 0x7fdf541036d0 2024-09-16T01:04:09.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.406+0000 7fdf53fff640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdf3c0a3250 0x7fdf3c0a5710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf44005fd0 tx=0x7fdf4400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:09.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.410+0000 7fdf517fa640 1 -- 172.21.15.12:0/2623310464 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf4c0bd9d0 con 0x7fdf541036d0 2024-09-16T01:04:09.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.588+0000 7fdf5a42e640 1 -- 172.21.15.12:0/2623310464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdf54062e90 con 0x7fdf541036d0 2024-09-16T01:04:09.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.588+0000 7fdf517fa640 1 -- 172.21.15.12:0/2623310464 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7fdf4c0bd2d0 con 0x7fdf541036d0 2024-09-16T01:04:09.590 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-09-16T01:04:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.590+0000 7fdf5a42e640 1 -- 172.21.15.12:0/2623310464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdf3c0a3250 msgr2=0x7fdf3c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.590+0000 7fdf5a42e640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdf3c0a3250 0x7fdf3c0a5710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf44005fd0 tx=0x7fdf4400b410 comp rx=0 tx=0).stop 2024-09-16T01:04:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.590+0000 7fdf5a42e640 1 -- 172.21.15.12:0/2623310464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf541036d0 msgr2=0x7fdf54074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.590+0000 7fdf5a42e640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf541036d0 0x7fdf54074b20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c005e30 tx=0x7fdf4c031ee0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.590+0000 7fdf5a42e640 1 -- 172.21.15.12:0/2623310464 shutdown_connections 2024-09-16T01:04:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.590+0000 7fdf5a42e640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdf3c0a3250 0x7fdf3c0a5710 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.590+0000 7fdf5a42e640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf541036d0 0x7fdf54074b20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.591+0000 7fdf5a42e640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf54102d10 0x7fdf540745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.591+0000 7fdf5a42e640 1 --2- 172.21.15.12:0/2623310464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf54101b20 0x7fdf54075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.591+0000 7fdf5a42e640 1 -- 172.21.15.12:0/2623310464 >> 172.21.15.12:0/2623310464 conn(0x7fdf540fd2a0 msgr2=0x7fdf54106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.591+0000 7fdf5a42e640 1 -- 172.21.15.12:0/2623310464 shutdown_connections 2024-09-16T01:04:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.591+0000 7fdf5a42e640 1 -- 172.21.15.12:0/2623310464 wait complete. 2024-09-16T01:04:09.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-16T01:04:09.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.709+0000 7f5c9b568640 1 -- 172.21.15.12:0/2986175122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c941025b0 msgr2=0x7f5c94108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.709+0000 7f5c9b568640 1 --2- 172.21.15.12:0/2986175122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c941025b0 0x7f5c94108e40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009ca0 tx=0x7f5c8c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.709+0000 7f5c9b568640 1 -- 172.21.15.12:0/2986175122 shutdown_connections 2024-09-16T01:04:09.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.709+0000 7f5c9b568640 1 --2- 172.21.15.12:0/2986175122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c941025b0 0x7f5c94108e40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.709+0000 7f5c9b568640 1 --2- 172.21.15.12:0/2986175122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c94101bf0 0x7f5c94102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.709+0000 7f5c9b568640 1 --2- 172.21.15.12:0/2986175122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c94100a00 0x7f5c94100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.709+0000 7f5c9b568640 1 -- 172.21.15.12:0/2986175122 >> 172.21.15.12:0/2986175122 conn(0x7f5c940fc140 msgr2=0x7f5c940fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:09.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.709+0000 7f5c9b568640 1 -- 172.21.15.12:0/2986175122 shutdown_connections 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.709+0000 7f5c9b568640 1 -- 172.21.15.12:0/2986175122 wait complete. 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c9b568640 1 Processor -- start 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c9b568640 1 -- start start 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c9b568640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c94100a00 0x7f5c94197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c9b568640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c94101bf0 0x7f5c94198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c9b568640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c941025b0 0x7f5c9419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c9b568640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9410d7d0 con 0x7f5c94100a00 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c9b568640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9410d650 con 0x7f5c94101bf0 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c9b568640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9410d950 con 0x7f5c941025b0 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c99304640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c94100a00 0x7f5c94197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c99304640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c94100a00 0x7f5c94197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57490/0 (socket says 172.21.15.12:57490) 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c99304640 1 -- 172.21.15.12:0/4032854276 learned_addr learned my addr 172.21.15.12:0/4032854276 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c98b03640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c94101bf0 0x7f5c94198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c99304640 1 -- 172.21.15.12:0/4032854276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c941025b0 msgr2=0x7f5c9419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c99304640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c941025b0 0x7f5c9419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c99304640 1 -- 172.21.15.12:0/4032854276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c94101bf0 msgr2=0x7f5c94198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c99304640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c94101bf0 0x7f5c94198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c99304640 1 -- 172.21.15.12:0/4032854276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9419fa40 con 0x7f5c94100a00 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c98b03640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c94101bf0 0x7f5c94198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.710+0000 7f5c99304640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c94100a00 0x7f5c94197e20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000e9c0 tx=0x7f5c9000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.711+0000 7f5c8a7fc640 1 -- 172.21.15.12:0/4032854276 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9000cd80 con 0x7f5c94100a00 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.711+0000 7f5c8a7fc640 1 -- 172.21.15.12:0/4032854276 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c900035f0 con 0x7f5c94100a00 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.711+0000 7f5c8a7fc640 1 -- 172.21.15.12:0/4032854276 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90010690 con 0x7f5c94100a00 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.711+0000 7f5c9b568640 1 -- 172.21.15.12:0/4032854276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9419fd30 con 0x7f5c94100a00 2024-09-16T01:04:09.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.711+0000 7f5c9b568640 1 -- 172.21.15.12:0/4032854276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c941a01d0 con 0x7f5c94100a00 2024-09-16T01:04:09.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.712+0000 7f5c9b568640 1 -- 172.21.15.12:0/4032854276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c94107de0 con 0x7f5c94100a00 2024-09-16T01:04:09.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.714+0000 7f5c8a7fc640 1 -- 172.21.15.12:0/4032854276 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5c900037a0 con 0x7f5c94100a00 2024-09-16T01:04:09.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.714+0000 7f5c8a7fc640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5c800a3250 0x7f5c800a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:09.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.714+0000 7f5c8a7fc640 1 -- 172.21.15.12:0/4032854276 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f5c900d0230 con 0x7f5c94100a00 2024-09-16T01:04:09.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.714+0000 7f5c98b03640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5c800a3250 0x7f5c800a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:09.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.715+0000 7f5c98b03640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5c800a3250 0x7f5c800a5710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5c94199330 tx=0x7f5c84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:09.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.718+0000 7f5c8a7fc640 1 -- 172.21.15.12:0/4032854276 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c9009cc80 con 0x7f5c94100a00 2024-09-16T01:04:09.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:09 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/60818017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:04:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:09 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1876589147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:04:09.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:09 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2623310464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:04:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.896+0000 7f5c9b568640 1 -- 172.21.15.12:0/4032854276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5c9402da70 con 0x7f5c94100a00 2024-09-16T01:04:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.896+0000 7f5c8a7fc640 1 -- 172.21.15.12:0/4032854276 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7f5c9009c580 con 0x7f5c94100a00 2024-09-16T01:04:09.897 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-09-16T01:04:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 -- 172.21.15.12:0/4032854276 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5c800a3250 msgr2=0x7f5c800a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5c800a3250 0x7f5c800a5710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5c94199330 tx=0x7f5c84005f90 comp rx=0 tx=0).stop 2024-09-16T01:04:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 -- 172.21.15.12:0/4032854276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c94100a00 msgr2=0x7f5c94197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c94100a00 0x7f5c94197e20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000e9c0 tx=0x7f5c9000ee80 comp rx=0 tx=0).stop 2024-09-16T01:04:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 -- 172.21.15.12:0/4032854276 shutdown_connections 2024-09-16T01:04:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f5c800a3250 0x7f5c800a5710 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c941025b0 0x7f5c9419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c94101bf0 0x7f5c94198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 --2- 172.21.15.12:0/4032854276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c94100a00 0x7f5c94197e20 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 -- 172.21.15.12:0/4032854276 >> 172.21.15.12:0/4032854276 conn(0x7f5c940fc140 msgr2=0x7f5c94104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 -- 172.21.15.12:0/4032854276 shutdown_connections 2024-09-16T01:04:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:09.898+0000 7f5c9b568640 1 -- 172.21.15.12:0/4032854276 wait complete. 2024-09-16T01:04:09.910 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-16T01:04:10.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.012+0000 7f1e00b49640 1 -- 172.21.15.12:0/1995842706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc101c00 msgr2=0x7f1dfc102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:10.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.012+0000 7f1e00b49640 1 --2- 172.21.15.12:0/1995842706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc101c00 0x7f1dfc102080 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009900 tx=0x7f1de402a410 comp rx=0 tx=0).stop 2024-09-16T01:04:10.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.013+0000 7f1e00b49640 1 -- 172.21.15.12:0/1995842706 shutdown_connections 2024-09-16T01:04:10.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.013+0000 7f1e00b49640 1 --2- 172.21.15.12:0/1995842706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc1025c0 0x7f1dfc108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:10.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.013+0000 7f1e00b49640 1 --2- 172.21.15.12:0/1995842706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc101c00 0x7f1dfc102080 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:10.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.013+0000 7f1e00b49640 1 --2- 172.21.15.12:0/1995842706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dfc100a10 0x7f1dfc100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:10.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.013+0000 7f1e00b49640 1 -- 172.21.15.12:0/1995842706 >> 172.21.15.12:0/1995842706 conn(0x7f1dfc0fc170 msgr2=0x7f1dfc0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:10.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.013+0000 7f1e00b49640 1 -- 172.21.15.12:0/1995842706 shutdown_connections 2024-09-16T01:04:10.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.013+0000 7f1e00b49640 1 -- 172.21.15.12:0/1995842706 wait complete. 2024-09-16T01:04:10.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.013+0000 7f1e00b49640 1 Processor -- start 2024-09-16T01:04:10.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.013+0000 7f1e00b49640 1 -- start start 2024-09-16T01:04:10.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1e00b49640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dfc100a10 0x7f1dfc197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1e00b49640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc101c00 0x7f1dfc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1e00b49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc1025c0 0x7f1dfc19f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1e00b49640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10d7e0 con 0x7f1dfc1025c0 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1e00b49640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10d660 con 0x7f1dfc101c00 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1e00b49640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10d960 con 0x7f1dfc100a10 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1dfad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc1025c0 0x7f1dfc19f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1dfad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc1025c0 0x7f1dfc19f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57500/0 (socket says 172.21.15.12:57500) 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1dfad9d640 1 -- 172.21.15.12:0/1397842236 learned_addr learned my addr 172.21.15.12:0/1397842236 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1dfa59c640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dfc100a10 0x7f1dfc197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1df9d9b640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc101c00 0x7f1dfc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1dfad9d640 1 -- 172.21.15.12:0/1397842236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dfc100a10 msgr2=0x7f1dfc197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1dfad9d640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dfc100a10 0x7f1dfc197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1dfad9d640 1 -- 172.21.15.12:0/1397842236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc101c00 msgr2=0x7f1dfc198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1dfad9d640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc101c00 0x7f1dfc198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1dfad9d640 1 -- 172.21.15.12:0/1397842236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc19fa10 con 0x7f1dfc1025c0 2024-09-16T01:04:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1df9d9b640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc101c00 0x7f1dfc198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1dfad9d640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc1025c0 0x7f1dfc19f3a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00cce0 tx=0x7f1dec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1df37fe640 1 -- 172.21.15.12:0/1397842236 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00f450 con 0x7f1dfc1025c0 2024-09-16T01:04:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1df37fe640 1 -- 172.21.15.12:0/1397842236 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dec00fad0 con 0x7f1dfc1025c0 2024-09-16T01:04:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1e00b49640 1 -- 172.21.15.12:0/1397842236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc19fd00 con 0x7f1dfc1025c0 2024-09-16T01:04:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1df37fe640 1 -- 172.21.15.12:0/1397842236 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec018c10 con 0x7f1dfc1025c0 2024-09-16T01:04:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.014+0000 7f1e00b49640 1 -- 172.21.15.12:0/1397842236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc1a01d0 con 0x7f1dfc1025c0 2024-09-16T01:04:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.016+0000 7f1e00b49640 1 -- 172.21.15.12:0/1397842236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc107dd0 con 0x7f1dfc1025c0 2024-09-16T01:04:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.017+0000 7f1df37fe640 1 -- 172.21.15.12:0/1397842236 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1dec00f5f0 con 0x7f1dfc1025c0 2024-09-16T01:04:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.017+0000 7f1df37fe640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1de80a3250 0x7f1de80a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.018+0000 7f1dfa59c640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1de80a3250 0x7f1de80a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.018+0000 7f1df37fe640 1 -- 172.21.15.12:0/1397842236 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f1dec0d03c0 con 0x7f1dfc1025c0 2024-09-16T01:04:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.018+0000 7f1dfa59c640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1de80a3250 0x7f1de80a5710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1df4005fd0 tx=0x7f1df400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.022+0000 7f1df37fe640 1 -- 172.21.15.12:0/1397842236 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1dec014030 con 0x7f1dfc1025c0 2024-09-16T01:04:10.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:09 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/60818017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:04:10.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:09 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1876589147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:04:10.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:09 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2623310464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:04:10.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:09 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/60818017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:04:10.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:09 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1876589147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:04:10.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:09 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2623310464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:04:10.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.248+0000 7f1e00b49640 1 -- 172.21.15.12:0/1397842236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f1dfc062e20 con 0x7f1dfc1025c0 2024-09-16T01:04:10.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.255+0000 7f1df37fe640 1 -- 172.21.15.12:0/1397842236 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742338 (secure 0 0 0) 0x7f1dec09cd20 con 0x7f1dfc1025c0 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 18, 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: "active_gid": 14150, 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: "active_name": "x", 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addrs": { 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2024-09-16T01:04:10.265 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2160939611 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2160939611 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addr": "172.21.15.12:6801/2160939611", 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: "active_change": "2024-09-16T00:51:42.808954+0000", 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: "active_mgr_features": 4540701547738038271, 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: "available": true, 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: "standbys": [ 2024-09-16T01:04:10.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 24109, 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "z", 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540701547738038271, 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.267 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.269 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.271 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.271 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.271 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.271 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.271 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.271 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.271 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.271 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.271 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.271 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.272 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.274 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.275 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.276 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.277 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.278 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-16T01:04:10.279 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-16T01:04:10.280 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.281 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.282 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.283 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:10.284 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-16T01:04:10.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.287 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.288 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.289 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.290 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.293 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.294 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.295 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.296 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-16T01:04:10.297 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-16T01:04:10.299 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-16T01:04:10.300 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T01:04:10.302 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.303 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T01:04:10.304 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T01:04:10.305 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T01:04:10.307 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.309 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.311 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.312 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.313 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.314 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.315 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.319 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.320 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T01:04:10.321 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-16T01:04:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-16T01:04:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T01:04:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-16T01:04:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T01:04:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T01:04:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T01:04:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-16T01:04:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-16T01:04:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-16T01:04:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T01:04:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T01:04:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T01:04:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T01:04:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T01:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-16T01:04:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T01:04:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T01:04:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T01:04:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T01:04:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-16T01:04:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T01:04:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T01:04:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T01:04:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T01:04:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T01:04:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-16T01:04:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T01:04:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-16T01:04:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-16T01:04:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-16T01:04:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.432 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T01:04:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T01:04:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-16T01:04:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-16T01:04:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-16T01:04:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T01:04:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-16T01:04:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-16T01:04:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-16T01:04:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-16T01:04:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-16T01:04:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-16T01:04:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T01:04:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-16T01:04:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-16T01:04:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-16T01:04:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-16T01:04:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-16T01:04:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T01:04:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-16T01:04:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-16T01:04:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-16T01:04:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-16T01:04:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-16T01:04:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-16T01:04:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-16T01:04:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 24119, 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "y", 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540701547738038271, 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-16T01:04:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-16T01:04:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T01:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T01:04:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T01:04:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-16T01:04:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-16T01:04:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T01:04:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-16T01:04:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-16T01:04:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-16T01:04:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-16T01:04:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-16T01:04:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-16T01:04:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-16T01:04:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-16T01:04:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-16T01:04:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T01:04:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T01:04:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T01:04:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T01:04:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.840 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-16T01:04:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-16T01:04:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-16T01:04:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-16T01:04:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-16T01:04:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-16T01:04:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-09-16T01:04:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-09-16T01:04:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-16T01:04:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-16T01:04:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-16T01:04:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-16T01:04:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T01:04:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T01:04:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-16T01:04:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-16T01:04:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-16T01:04:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-16T01:04:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-16T01:04:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-16T01:04:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-16T01:04:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-16T01:04:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-16T01:04:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-16T01:04:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.011 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-16T01:04:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T01:04:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-16T01:04:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-16T01:04:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-16T01:04:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-16T01:04:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-16T01:04:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "modules": [ 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "dashboard", 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "iostat", 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "nfs", 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "restful" 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-16T01:04:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-16T01:04:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-16T01:04:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-16T01:04:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-16T01:04:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-16T01:04:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-16T01:04:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-16T01:04:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T01:04:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-16T01:04:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-16T01:04:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-16T01:04:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-16T01:04:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-16T01:04:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-16T01:04:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-16T01:04:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T01:04:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-16T01:04:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-16T01:04:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-16T01:04:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T01:04:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T01:04:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T01:04:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T01:04:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.248 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T01:04:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T01:04:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T01:04:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T01:04:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-16T01:04:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T01:04:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-16T01:04:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-16T01:04:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-16T01:04:11.293 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.294 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-16T01:04:11.295 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.296 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.297 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.298 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.299 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.300 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.301 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T01:04:11.302 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.303 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.304 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.305 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.306 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.307 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.310 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.311 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.312 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.312 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.312 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.312 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.312 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.312 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.312 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.312 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.314 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.315 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.316 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.317 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.318 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-16T01:04:11.319 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.320 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-16T01:04:11.321 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.322 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.324 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.325 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.326 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.327 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.328 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.329 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.330 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.331 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.332 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.333 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.334 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.335 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.336 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.337 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.338 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-09-16T01:04:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-16T01:04:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-16T01:04:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T01:04:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-16T01:04:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-16T01:04:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-16T01:04:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-16T01:04:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-16T01:04:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-16T01:04:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-16T01:04:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-16T01:04:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-16T01:04:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.455 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.456 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-16T01:04:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-16T01:04:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T01:04:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-16T01:04:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-16T01:04:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-16T01:04:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T01:04:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-16T01:04:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-16T01:04:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-16T01:04:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "services": { 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "dashboard": "https://172.21.15.12:8443/" 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "always_on_modules": { 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "octopus": [ 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-16T01:04:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "pacific": [ 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-16T01:04:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "quincy": [ 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-16T01:04:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "reef": [ 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-16T01:04:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "squid": [ 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-16T01:04:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: "last_failure_osd_epoch": 3, 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: "active_clients": [ 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 499860702 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "libcephsqlite", 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 331692041 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2085088969 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-16T01:04:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-16T01:04:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-16T01:04:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 399505588 2024-09-16T01:04:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-16T01:04:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-16T01:04:11.559 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:04:11.560 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:10 smithi098 ceph-mon[35346]: pgmap v452: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:04:11.560 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:10 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/4032854276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-16T01:04:11.560 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:10 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1397842236' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-16T01:04:11.560 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:10 smithi119 ceph-mon[35049]: pgmap v452: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:04:11.560 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:10 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/4032854276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-16T01:04:11.561 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:10 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1397842236' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-16T01:04:11.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 -- 172.21.15.12:0/1397842236 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1de80a3250 msgr2=0x7f1de80a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1de80a3250 0x7f1de80a5710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1df4005fd0 tx=0x7f1df400b390 comp rx=0 tx=0).stop 2024-09-16T01:04:11.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 -- 172.21.15.12:0/1397842236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc1025c0 msgr2=0x7f1dfc19f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc1025c0 0x7f1dfc19f3a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00cce0 tx=0x7f1dec00a620 comp rx=0 tx=0).stop 2024-09-16T01:04:11.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 -- 172.21.15.12:0/1397842236 shutdown_connections 2024-09-16T01:04:11.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f1de80a3250 0x7f1de80a5710 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dfc1025c0 0x7f1dfc19f3a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc101c00 0x7f1dfc198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 --2- 172.21.15.12:0/1397842236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dfc100a10 0x7f1dfc197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 -- 172.21.15.12:0/1397842236 >> 172.21.15.12:0/1397842236 conn(0x7f1dfc0fc170 msgr2=0x7f1dfc104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:11.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 -- 172.21.15.12:0/1397842236 shutdown_connections 2024-09-16T01:04:11.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:10.260+0000 7f1e00b49640 1 -- 172.21.15.12:0/1397842236 wait complete. 2024-09-16T01:04:11.611 DEBUG:tasks.check_counter:Getting stats from a 2024-09-16T01:04:11.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-16T01:04:11.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:10 smithi012 ceph-mon[31197]: pgmap v452: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:04:11.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:10 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/4032854276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-16T01:04:11.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:10 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1397842236' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-16T01:04:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:12.431 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 43, 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 49, 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 16276, 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 212483, 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 27, 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 7, 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.013028975, 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.001267061, 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.008968406, 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000249226, 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 43, 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.016589132, 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000385793 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 47, 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000008012, 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000170 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 173, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 305, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 62238, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 263020, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 8, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 4, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.031268583, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.013113386, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.015796470, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.001835064, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 308, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.041798462, 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000135709 2024-09-16T01:04:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 372, 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000082254, 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000221 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 194784 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 173, 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 167, 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 502488, 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 83308, 2024-09-16T01:04:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 7, 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 5, 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.021284994, 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.007659074, 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.017521874, 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000324966, 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 166, 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.061899676, 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000372889 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 31, 2024-09-16T01:04:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000006261, 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000201 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 487392, 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 64928 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 1, 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-MDSRank": { 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 46, 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.001253037, 2024-09-16T01:04:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000027239 2024-09-16T01:04:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-PurgeQueue": { 2024-09-16T01:04:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-16T01:04:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 2, 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000010919, 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000005459 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "request": 0, 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "reply": 0, 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "reply_latency": { 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_reply": 0, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "forward": 0, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_complete": 0, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_keys": 0, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_commit": 11, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_split": 0, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_merge": 0, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes": 10, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_top": 0, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_bottom": 10, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pin_tail": 0, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pinned": 10, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_expired": 0, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_with_caps": 0, 2024-09-16T01:04:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": 0, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "subtrees": 1, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse": 6, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_hit": 6, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_forward": 0, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_discover": 0, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_remote_ino": 0, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_lock": 0, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "load_cent": 2000, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "q": 2, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "exported": 0, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "exported_inodes": 0, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "imported": 0, 2024-09-16T01:04:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "imported_inodes": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_dir_fetch": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_peer_discover": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rfiles": 8, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rbytes": 269505890, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rsnaps": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_set_tag": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_file_inodes": 0, 2024-09-16T01:04:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_cap_release": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "process_request_cap_release": 0 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache": { 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update_receipt": 0, 2024-09-16T01:04:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_try_discover": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_send_discover": 1, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_handle_discover": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_delayed": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_created": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_enqueued": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_reintegrated": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_migrated": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_processing": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_started": 0, 2024-09-16T01:04:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_completed": 0, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_path": 2, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_inode": 2, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_exportdir": 0, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_flush": 0, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragstats": 0, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_inodestats": 0 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log": { 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "evlrg": 0, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "evadd": 2, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "evex": 0, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "evtrm": 0, 2024-09-16T01:04:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "ev": 2, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "evexg": 0, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "evexd": 0, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "segadd": 2, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "segex": 0, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "segtrm": 0, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "seg": 2, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "segmjr": 2, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "segexg": 0, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "segexd": 0, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "expos": 4194304, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "wrpos": 4194892, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "rdpos": 0, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "jlat": { 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1, 2024-09-16T01:04:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.001301530, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001301530 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "replayed": 0 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_mem": { 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 13, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "ino+": 13, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "ino-": 0, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "dir": 11, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "dir+": 12, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "dir-": 1, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "dn": 10, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "dn+": 10, 2024-09-16T01:04:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "dn-": 0, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "cap": 0, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "cap+": 0, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "cap-": 0, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "rss": 50488, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "heap": 223520 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_server": { 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_client_request": 0, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_server_request": 0, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_request": 0, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_session": 0, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_peer_request": 0, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "req_create_latency": { 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getattr_latency": { 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getfilelock_latency": { 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "req_link_latency": { 2024-09-16T01:04:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookup_latency": { 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookuphash_latency": { 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupino_latency": { 2024-09-16T01:04:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupname_latency": { 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupparent_latency": { 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupsnap_latency": { 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lssnap_latency": { 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mkdir_latency": { 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mknod_latency": { 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mksnap_latency": { 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "req_open_latency": { 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "req_readdir_latency": { 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rename_latency": { 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "req_renamesnap_latency": { 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "req_snapdiff_latency": { 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmdir_latency": { 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmsnap_latency": { 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmxattr_latency": { 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setattr_latency": { 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setdirlayout_latency": { 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setfilelock_latency": { 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setlayout_latency": { 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setxattr_latency": { 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "req_symlink_latency": { 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "req_unlink_latency": { 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getvxattr_latency": { 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_sessions": { 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "session_count": 0, 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "session_add": 0, 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "session_remove": 0, 2024-09-16T01:04:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_open": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_stale": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "total_load": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "average_load": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "avg_session_uptime": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "mdthresh_evicted": 0 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 229943, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 73, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 8672, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 163, 2024-09-16T01:04:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 50872, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 198, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter": { 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "op_active": 0, 2024-09-16T01:04:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "op_laggy": 0, 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send": 35, 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send_bytes": 10710, 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "op_resend": 33, 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "op_reply": 35, 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "op_latency": { 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 35, 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.255997720, 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.007314220 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "op_inflight": 0, 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "oplen_avg": { 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 35, 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 57 2024-09-16T01:04:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "op": 35, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "op_r": 0, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "op_w": 35, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "op_rmw": 0, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "op_pg": 0, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_stat": 0, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_create": 10, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_read": 0, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_write": 1, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writefull": 5, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writesame": 0, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_append": 0, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_zero": 0, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_truncate": 0, 2024-09-16T01:04:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_delete": 6, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_mapext": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_sparse_read": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_clonerange": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_getxattr": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_setxattr": 20, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_rmxattr": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_call": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_watch": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_notify": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls": 0, 2024-09-16T01:04:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_other": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_active": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_send": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_resend": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_ping": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_active": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_send": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_resend": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_active": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_send": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_resend": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_active": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_send": 0, 2024-09-16T01:04:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_resend": 0, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "command_active": 0, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "command_send": 0, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "command_resend": 0, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "map_epoch": 89, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "map_full": 0, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "map_inc": 4, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_sessions": 9, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_open": 9, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_close": 0, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_laggy": 0, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_wr": 14, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_rd": 0, 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_del": 1 2024-09-16T01:04:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "oft": { 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_objs": 1, 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_updates": 0, 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_removes": 0 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "osd-slow-ops": { 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_ops_count": 4 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "purge_queue": { 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops": 0, 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing": 0, 2024-09-16T01:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_high_water": 0, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed_ops": 0, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed": 0, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_item_in_journal": 0 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 385, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 536270, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 385, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-16T01:04:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 385, 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 536270, 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_bytes": { 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-16T01:04:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 35, 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 10710, 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 35, 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 10710, 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_ops": { 2024-09-16T01:04:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 1024, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 35, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 35, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 35, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 35, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-16T01:04:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle-0x56059fcc6960": { 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 2, 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 588, 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 2, 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 1, 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 588, 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:12.478 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:04:13.096 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:12 smithi012 ceph-mon[31197]: pgmap v453: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:04:13.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:12 smithi119 ceph-mon[35049]: pgmap v453: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:04:13.126 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-16T01:04:13.126 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-16T01:04:13.126 DEBUG:tasks.check_counter:Getting stats from d 2024-09-16T01:04:13.126 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-16T01:04:13.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:12 smithi098 ceph-mon[35346]: pgmap v453: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:04:13.386 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:13.845 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 4, 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 4, 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 2992, 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 448, 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.003945390, 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000058052, 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.002320011, 2024-09-16T01:04:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 3, 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.004164764, 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001388254 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-16T01:04:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 448 2024-09-16T01:04:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 1, 2024-09-16T01:04:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 77, 2024-09-16T01:04:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 160, 2024-09-16T01:04:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 92032, 2024-09-16T01:04:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 3, 2024-09-16T01:04:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 2, 2024-09-16T01:04:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.006514756, 2024-09-16T01:04:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.004543835, 2024-09-16T01:04:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.001145343, 2024-09-16T01:04:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:04:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 75, 2024-09-16T01:04:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.003317059, 2024-09-16T01:04:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000044227 2024-09-16T01:04:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-16T01:04:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 92032 2024-09-16T01:04:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 106, 2024-09-16T01:04:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 103, 2024-09-16T01:04:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 447616, 2024-09-16T01:04:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 62128, 2024-09-16T01:04:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2024-09-16T01:04:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2024-09-16T01:04:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.016212050, 2024-09-16T01:04:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.006552617, 2024-09-16T01:04:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.013546422, 2024-09-16T01:04:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:04:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 102, 2024-09-16T01:04:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.005413982, 2024-09-16T01:04:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000053078 2024-09-16T01:04:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 447616, 2024-09-16T01:04:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 62128 2024-09-16T01:04:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-16T01:04:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2024-09-16T01:04:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-16T01:04:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148880, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 29, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-16T01:04:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 107, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 432659, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 107, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 107, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 432659, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:13.862 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:04:14.800 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-16T01:04:14.800 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-16T01:04:14.800 DEBUG:tasks.check_counter:Getting stats from g 2024-09-16T01:04:14.801 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-16T01:04:15.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:14 smithi119 ceph-mon[35049]: pgmap v454: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:04:15.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:14 smithi012 ceph-mon[31197]: pgmap v454: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:04:15.165 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:15.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:14 smithi098 ceph-mon[35346]: pgmap v454: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-16T01:04:15.776 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:04:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 405, 2024-09-16T01:04:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 400, 2024-09-16T01:04:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 569434, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 153942, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 5, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.048264929, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.021225424, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.018359042, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.007853626, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 399, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.018422625, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000046171 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 470560, 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 60768 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 300, 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 371, 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 81062, 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 288827, 2024-09-16T01:04:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 5, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 4, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.029669775, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.011607541, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.009191467, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.006476489, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 370, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.016180224, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000043730 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 194960 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 4, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 6, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 1629, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 1284, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 5, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 4, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.001434876, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000072161, 2024-09-16T01:04:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.001144103, 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000086554, 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 4, 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.002160813, 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000540203 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:04:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 1, 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-MDSRank": { 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1177, 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.027527994, 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000023388 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-PurgeQueue": { 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-16T01:04:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "request": 0, 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "reply": 0, 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "reply_latency": { 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_reply": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "forward": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_complete": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_keys": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_commit": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_split": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_merge": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_top": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_bottom": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pin_tail": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pinned": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_expired": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_with_caps": 0, 2024-09-16T01:04:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "subtrees": 1, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_hit": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_forward": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_discover": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_remote_ino": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_lock": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "load_cent": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "q": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "exported": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "exported_inodes": 0, 2024-09-16T01:04:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "imported": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "imported_inodes": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_dir_fetch": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_peer_discover": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rfiles": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rbytes": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rsnaps": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_set_tag": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:04:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_file_inodes": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_cap_release": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "process_request_cap_release": 0 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache": { 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update": 0, 2024-09-16T01:04:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update_receipt": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_try_discover": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_send_discover": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_handle_discover": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_delayed": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_created": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_enqueued": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_reintegrated": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_migrated": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_processing": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:04:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_started": 0, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_completed": 0, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_exportdir": 0, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_flush": 0, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragstats": 0, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_inodestats": 0 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log": { 2024-09-16T01:04:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "evlrg": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "evadd": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "evex": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "evtrm": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "ev": 2, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "evexg": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "evexd": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "segadd": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "segex": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "segtrm": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "seg": 2, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "segmjr": 2, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "segexg": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "segexd": 0, 2024-09-16T01:04:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "expos": 4194304, 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "wrpos": 4194892, 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rdpos": 4194352, 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "jlat": { 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "replayed": 2 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_mem": { 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 3, 2024-09-16T01:04:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "ino+": 3, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "ino-": 0, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "dir": 1, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "dir+": 1, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "dir-": 0, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "dn": 0, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "dn+": 0, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "dn-": 0, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "cap": 0, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "cap+": 0, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "cap-": 0, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rss": 47340, 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "heap": 215328 2024-09-16T01:04:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_server": { 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_client_request": 0, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_server_request": 0, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_request": 0, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_session": 0, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_peer_request": 0, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "req_create_latency": { 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getattr_latency": { 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getfilelock_latency": { 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "req_link_latency": { 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookup_latency": { 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookuphash_latency": { 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupino_latency": { 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupname_latency": { 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupparent_latency": { 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupsnap_latency": { 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lssnap_latency": { 2024-09-16T01:04:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mkdir_latency": { 2024-09-16T01:04:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mknod_latency": { 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mksnap_latency": { 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "req_open_latency": { 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "req_readdir_latency": { 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rename_latency": { 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "req_renamesnap_latency": { 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "req_snapdiff_latency": { 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmdir_latency": { 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmsnap_latency": { 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmxattr_latency": { 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setattr_latency": { 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setdirlayout_latency": { 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setfilelock_latency": { 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setlayout_latency": { 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setxattr_latency": { 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "req_symlink_latency": { 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "req_unlink_latency": { 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getvxattr_latency": { 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_sessions": { 2024-09-16T01:04:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "session_count": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "session_add": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "session_remove": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_open": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_stale": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "total_load": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "average_load": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "avg_session_uptime": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "mdthresh_evicted": 0 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 197319, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 52, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 8672, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 163, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 8512, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 13, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-16T01:04:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter": { 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "op_active": 0, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "op_laggy": 0, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send": 592, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send_bytes": 21, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "op_resend": 3, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "op_reply": 592, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "op_latency": { 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 592, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.527995357, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000891884 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "op_inflight": 0, 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "oplen_avg": { 2024-09-16T01:04:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 592, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 593 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "op": 592, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "op_r": 592, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "op_w": 0, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "op_rmw": 0, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "op_pg": 0, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_stat": 293, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_create": 0, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_read": 297, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_write": 0, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writefull": 0, 2024-09-16T01:04:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writesame": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_append": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_zero": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_truncate": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_delete": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_mapext": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_sparse_read": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_clonerange": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_getxattr": 1, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_setxattr": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_rmxattr": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_call": 0, 2024-09-16T01:04:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_watch": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_notify": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_other": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_active": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_send": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_resend": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_ping": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_active": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_send": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_resend": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_active": 0, 2024-09-16T01:04:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_send": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_resend": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_active": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_send": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_resend": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "command_active": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "command_send": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "command_resend": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "map_epoch": 89, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "map_full": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "map_inc": 4, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_sessions": 6, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_open": 6, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_close": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_laggy": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_wr": 0, 2024-09-16T01:04:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_rd": 2, 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_del": 0 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "oft": { 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_objs": 0, 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_updates": 0, 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_removes": 0 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "osd-slow-ops": { 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_ops_count": 0 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "purge_queue": { 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops": 0, 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:04:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing": 0, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_high_water": 0, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed_ops": 0, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed": 0, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_item_in_journal": 0 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 705, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 580005, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 705, 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 705, 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 580005, 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_bytes": { 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-16T01:04:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 592, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 593, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 592, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 593, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_ops": { 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 1024, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 592, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 592, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 592, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 592, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-16T01:04:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle-0x5631844acb40": { 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-16T01:04:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:15.822 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:04:16.783 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-16T01:04:16.784 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-16T01:04:16.784 DEBUG:tasks.check_counter:Getting stats from j 2024-09-16T01:04:16.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-16T01:04:16.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:16 smithi012 ceph-mon[31197]: pgmap v455: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:04:17.050 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:17.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:16 smithi119 ceph-mon[35049]: pgmap v455: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:04:17.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:16 smithi098 ceph-mon[35346]: pgmap v455: 129 pgs: 129 active+clean; 257 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-16T01:04:17.563 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 4, 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 4, 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 2992, 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 448, 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.003354874, 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000039718, 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.002379159, 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 3, 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.004209668, 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001403222 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 448 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 108, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 105, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 448160, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 63408, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.014868974, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.006441355, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.011692822, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 104, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.005086760, 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000048911 2024-09-16T01:04:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 448160, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 63408 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 1, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 79, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 160, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 92384, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 3, 2024-09-16T01:04:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 2, 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.007286272, 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.005123547, 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.001310204, 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 77, 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.003801115, 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000049365 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 92384 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148880, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 29, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2024-09-16T01:04:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-16T01:04:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 109, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 432919, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 109, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 109, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 432919, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-16T01:04:17.574 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-16T01:04:18.388 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-16T01:04:18.389 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-16T01:04:18.389 DEBUG:tasks.check_counter:Getting stats from b 2024-09-16T01:04:18.389 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-16T01:04:18.650 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:04:19.055 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:18 smithi098 ceph-mon[35346]: pgmap v456: 129 pgs: 129 active+clean; 221 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 363 KiB/s wr, 96 op/s 2024-09-16T01:04:19.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:18 smithi119 ceph-mon[35049]: pgmap v456: 129 pgs: 129 active+clean; 221 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 363 KiB/s wr, 96 op/s 2024-09-16T01:04:19.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:18 smithi012 ceph-mon[31197]: pgmap v456: 129 pgs: 129 active+clean; 221 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 363 KiB/s wr, 96 op/s 2024-09-16T01:04:19.164 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T01:04:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 780, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 622, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 659111, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 225199, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 9, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 4, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.073636065, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.028374979, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.047186869, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.004171246, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 624, 2024-09-16T01:04:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.233372481, 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000373994 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 714, 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000151847, 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000212 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 518192, 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 71872 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 553, 2024-09-16T01:04:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 610, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 185896, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 408999, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 12, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 6, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.051910950, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.019195866, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.028978507, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.006796602, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 609, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.688381357, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001130347 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 478, 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000099225, 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000207 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 212416 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 1141, 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 854, 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 385600, 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 1540265, 2024-09-16T01:04:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 67, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 9, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.130112983, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.035658028, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.070479984, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.026887025, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 849, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.875596845, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001031327 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1111, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000202245, 2024-09-16T01:04:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000182 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 194224, 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 110896 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 380, 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.086713738, 2024-09-16T01:04:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000228194 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 86, 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.003126003, 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000036348 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 70, 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 70, 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-16T01:04:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 70, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.066876139, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000955373 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 12, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 25, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-09-16T01:04:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 25, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 24, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 1, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 1, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 2, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 115, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 106, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 0, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-09-16T01:04:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 4, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 69, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 4, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 234, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 69, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-16T01:04:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 41, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 5, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 36, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 28, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 1, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 26, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 47, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 112, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 76, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 4, 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 29 2024-09-16T01:04:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 0, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 6, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 6, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 6, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-09-16T01:04:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 2, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 29, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 5, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 152, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 152, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 2, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-16T01:04:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 4775371, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 127, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.256059105, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002016213 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 24, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 34, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 10, 2024-09-16T01:04:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 18, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 20, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 2, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 25, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 35, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 10, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 1, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 21, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 20, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 55676, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 231712 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-16T01:04:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 90, 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 70, 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 14, 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 8, 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.005413518, 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000676689 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 27, 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.006643834, 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000246067 2024-09-16T01:04:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 5, 2024-09-16T01:04:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001374870, 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000274974 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 8, 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.013326235, 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001665779 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000193615, 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000193615 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3, 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.003447856, 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001149285 2024-09-16T01:04:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.002112523, 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001056261 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.007918254, 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.003959127 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001572044, 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000786022 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-16T01:04:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 8, 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.020036199, 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002504524 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-16T01:04:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 4, 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.004837191, 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001209297 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 3, 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 2, 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 18, 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 18, 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 193, 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-16T01:04:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 330980, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 115, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8672, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 163, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 100389, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 843, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 865, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 597809, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 32, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 865, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 865, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 20.666691849, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.023892129 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 865, 2024-09-16T01:04:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 911 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 865, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 81, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 784, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 0, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 11, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 7, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 129, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 24, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-16T01:04:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 585, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 74, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 22, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:04:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-16T01:04:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 89, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 10, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 12, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 12, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 48, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 0, 2024-09-16T01:04:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 11 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 31 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 65, 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-16T01:04:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 5, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 73, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 6, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 2470, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 975649, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 2470, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2470, 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 975649, 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 865, 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 598447, 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 865, 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 598447, 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-16T01:04:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 865, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 865, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 865, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 865, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 6, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 638, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 6, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 638, 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x560cda99e960": { 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 599, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 152, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 581067, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 152, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 127, 2024-09-16T01:04:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 580468, 2024-09-16T01:04:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:19.209 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T01:04:20.101 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-16T01:04:20.102 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-16T01:04:20.102 DEBUG:tasks.check_counter:Getting stats from e 2024-09-16T01:04:20.102 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-16T01:04:20.371 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:04:20.905 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T01:04:20.905 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 293, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 306, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 100453, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 140633, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 10, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.035924417, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.015115824, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.017348040, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.001983467, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 308, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.036413869, 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000118226 2024-09-16T01:04:20.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 531, 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000141360, 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000266 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 191, 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 181, 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 518000, 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 113967, 2024-09-16T01:04:20.907 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 10, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 5, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.026896462, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.008865195, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.024208794, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000375571, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 181, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.033149476, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000183146 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 31, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000006918, 2024-09-16T01:04:20.908 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000223 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 501952, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 70192 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 39, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 126, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 9401, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 386381, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 24, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 8, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.017730874, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.005506244, 2024-09-16T01:04:20.909 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.009839845, 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000873336, 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 120, 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.011440580, 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000095338 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 48, 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000007435, 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000154 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 5776, 2024-09-16T01:04:20.910 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 206592 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 53, 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001626209, 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000030683 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:20.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000038088, 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000019044 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 5, 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 3, 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3, 2024-09-16T01:04:20.912 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001076976, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000358992 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 2, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 11, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 14, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 14, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-09-16T01:04:20.913 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 14, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 2, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 2, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 2, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 13, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 9, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 2, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-09-16T01:04:20.914 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 8, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 269505890, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:04:20.915 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 6, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 6, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 6, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 2 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-16T01:04:20.916 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 3, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:04:20.917 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 2, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 10, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 5, 2024-09-16T01:04:20.918 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 5, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 2, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 4195734, 2024-09-16T01:04:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 4, 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.007092083, 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001773020 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 17, 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 17, 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 0, 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 15, 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 16, 2024-09-16T01:04:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 1, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 14, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 14, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 0, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 2, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 3, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 1, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 50208, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 223520 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 7, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 5, 2024-09-16T01:04:20.921 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 7, 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000908416, 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000454208 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.922 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.923 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000168560, 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000168560 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.924 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.925 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-16T01:04:20.926 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.926 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.926 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.927 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-16T01:04:20.927 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.927 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.927 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.927 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-16T01:04:20.927 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.927 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.927 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-16T01:04:20.928 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.929 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:20.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 2, 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 1, 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 2, 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 2, 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 194, 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-16T01:04:20.934 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:20.935 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:20.936 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 263623, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 95, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:20.937 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8672, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 163, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 68437, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 294, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.938 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 44, 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 12394, 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 33, 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 44, 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 44, 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.202996958, 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.004613567 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-16T01:04:20.939 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 44, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 70 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 44, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 0, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 44, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 0, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 10, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 0, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 4, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 7, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-16T01:04:20.940 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 6, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 20, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-16T01:04:20.941 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-16T01:04:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 89, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 4, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 9, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 9, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 21, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 0, 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 2 2024-09-16T01:04:20.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 12 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:04:20.944 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 519, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 569743, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 519, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:20.945 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 519, 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 569743, 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:20.946 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 44, 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 12394, 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 44, 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 12394, 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-16T01:04:20.947 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 44, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 44, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 44, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 44, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.948 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-16T01:04:20.949 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x562dcde2e960": { 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 5, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 1430, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 5, 2024-09-16T01:04:20.950 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:20.951 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:20.951 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 4, 2024-09-16T01:04:20.951 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1430, 2024-09-16T01:04:20.951 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:20.951 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:20.951 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:20.951 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:20.951 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:20.951 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:20.951 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T01:04:21.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:20 smithi119 ceph-mon[35049]: pgmap v457: 129 pgs: 129 active+clean; 97 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 826 KiB/s wr, 210 op/s 2024-09-16T01:04:21.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:20 smithi012 ceph-mon[31197]: pgmap v457: 129 pgs: 129 active+clean; 97 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 826 KiB/s wr, 210 op/s 2024-09-16T01:04:21.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:20 smithi098 ceph-mon[35346]: pgmap v457: 129 pgs: 129 active+clean; 97 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 826 KiB/s wr, 210 op/s 2024-09-16T01:04:21.822 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-16T01:04:21.822 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-16T01:04:21.822 DEBUG:tasks.check_counter:Getting stats from h 2024-09-16T01:04:21.822 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-16T01:04:22.071 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:04:22.598 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T01:04:22.598 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:22.598 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 184, 2024-09-16T01:04:22.598 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 258, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 58271, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 67375, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 10, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.032331040, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.012703015, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.014756838, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.002010808, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 256, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.070206048, 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000274242 2024-09-16T01:04:22.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 393, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000106044, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000269 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 48, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 122, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 19554, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 412599, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 25, 2024-09-16T01:04:22.600 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 5, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.016719287, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.004469672, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.011089868, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000299040, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 121, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.021378793, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000176684 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 47, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000007882, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000167 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.601 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 200336 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 178, 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 166, 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 520874, 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 88186, 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 7, 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 4, 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.023379079, 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.009118137, 2024-09-16T01:04:22.602 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.020353605, 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000175206, 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 165, 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.023084159, 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000139903 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 30, 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000019598, 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000653 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 507344, 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 67824 2024-09-16T01:04:22.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 33, 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001781676, 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000053990 2024-09-16T01:04:22.604 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:22.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.605 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-16T01:04:22.605 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-16T01:04:22.605 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-16T01:04:22.605 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000012175, 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000006087 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 0, 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 0, 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.606 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 11, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 10, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 10, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 10, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-09-16T01:04:22.607 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 1, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 6, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 6, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 0, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-09-16T01:04:22.608 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 8, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 269505890, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:04:22.609 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 0, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 0 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-16T01:04:22.610 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 1, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:04:22.611 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 2, 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 2, 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-16T01:04:22.612 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 2, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 2, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 2, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-09-16T01:04:22.613 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 4194892, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001315213, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001315213 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 13, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 13, 2024-09-16T01:04:22.614 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 0, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 11, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 12, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 1, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 10, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 10, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 0, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 0, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 0, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 50116, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 223520 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 0, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-09-16T01:04:22.615 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 0, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 0, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.616 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-16T01:04:22.617 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.618 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.618 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.618 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-16T01:04:22.618 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.618 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.618 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-16T01:04:22.619 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.620 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.621 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-16T01:04:22.623 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.624 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.626 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.627 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.628 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:22.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.628 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-16T01:04:22.628 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 0, 2024-09-16T01:04:22.628 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 0, 2024-09-16T01:04:22.628 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 0, 2024-09-16T01:04:22.628 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 0, 2024-09-16T01:04:22.628 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-16T01:04:22.628 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 0, 2024-09-16T01:04:22.629 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 0, 2024-09-16T01:04:22.629 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 0, 2024-09-16T01:04:22.629 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-16T01:04:22.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.629 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-16T01:04:22.630 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:22.630 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:22.630 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:22.630 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:22.630 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:22.630 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:22.631 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:22.631 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:22.631 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:22.631 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:22.631 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:22.631 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:22.632 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:22.632 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:22.632 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:22.632 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:22.632 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:22.633 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:22.633 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:22.633 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:22.633 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:22.633 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:22.633 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:22.634 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:22.634 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:22.634 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:22.634 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:22.634 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:22.635 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:22.635 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:22.635 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:22.635 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-16T01:04:22.635 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:22.635 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:22.636 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:22.636 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:22.636 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 262135, 2024-09-16T01:04:22.636 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 85, 2024-09-16T01:04:22.636 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:22.637 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:22.637 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-16T01:04:22.637 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-16T01:04:22.637 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:22.637 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:22.637 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:22.638 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:22.638 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8672, 2024-09-16T01:04:22.638 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 163, 2024-09-16T01:04:22.638 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:22.638 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:22.638 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:22.639 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-16T01:04:22.639 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 50872, 2024-09-16T01:04:22.639 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 198, 2024-09-16T01:04:22.639 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:22.639 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-16T01:04:22.639 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:22.640 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-16T01:04:22.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.640 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-16T01:04:22.640 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-16T01:04:22.640 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-16T01:04:22.641 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 35, 2024-09-16T01:04:22.641 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 10710, 2024-09-16T01:04:22.641 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 33, 2024-09-16T01:04:22.641 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 35, 2024-09-16T01:04:22.641 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-16T01:04:22.641 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 35, 2024-09-16T01:04:22.642 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.219996721, 2024-09-16T01:04:22.642 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.006285620 2024-09-16T01:04:22.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.642 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-16T01:04:22.642 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-16T01:04:22.642 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 35, 2024-09-16T01:04:22.643 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 57 2024-09-16T01:04:22.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.643 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 35, 2024-09-16T01:04:22.643 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 0, 2024-09-16T01:04:22.643 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 35, 2024-09-16T01:04:22.643 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-16T01:04:22.644 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-16T01:04:22.644 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 0, 2024-09-16T01:04:22.644 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 10, 2024-09-16T01:04:22.644 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 0, 2024-09-16T01:04:22.644 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 1, 2024-09-16T01:04:22.645 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 5, 2024-09-16T01:04:22.645 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-16T01:04:22.645 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-16T01:04:22.645 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-16T01:04:22.645 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-09-16T01:04:22.645 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 6, 2024-09-16T01:04:22.646 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-16T01:04:22.646 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-16T01:04:22.646 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-16T01:04:22.646 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 0, 2024-09-16T01:04:22.646 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 20, 2024-09-16T01:04:22.646 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:04:22.647 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-16T01:04:22.647 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:04:22.647 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-16T01:04:22.647 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-16T01:04:22.647 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-16T01:04:22.648 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:04:22.648 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-16T01:04:22.648 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:04:22.648 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-09-16T01:04:22.648 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-16T01:04:22.648 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-16T01:04:22.649 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-16T01:04:22.649 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-16T01:04:22.649 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-16T01:04:22.649 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-16T01:04:22.649 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-16T01:04:22.649 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-16T01:04:22.650 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-16T01:04:22.650 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-16T01:04:22.650 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-16T01:04:22.650 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-16T01:04:22.650 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 89, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 4, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 9, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 9, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-16T01:04:22.651 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 14, 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 0, 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 1 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 4 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.652 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 406, 2024-09-16T01:04:22.653 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 551546, 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 406, 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 406, 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 551546, 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 35, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 10710, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 35, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 10710, 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:22.655 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:22.656 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 35, 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 35, 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 35, 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 35, 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-16T01:04:22.657 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x56030dbe2960": { 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 2, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 588, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 2, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 1, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 588, 2024-09-16T01:04:22.659 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:22.660 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:22.660 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:22.660 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:22.660 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:22.660 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:22.660 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T01:04:23.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:22 smithi119 ceph-mon[35049]: pgmap v458: 129 pgs: 129 active+clean; 37 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 969 KiB/s wr, 246 op/s 2024-09-16T01:04:23.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:22 smithi012 ceph-mon[31197]: pgmap v458: 129 pgs: 129 active+clean; 37 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 969 KiB/s wr, 246 op/s 2024-09-16T01:04:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:22 smithi098 ceph-mon[35346]: pgmap v458: 129 pgs: 129 active+clean; 37 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 969 KiB/s wr, 246 op/s 2024-09-16T01:04:23.407 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-16T01:04:23.407 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-16T01:04:23.407 DEBUG:tasks.check_counter:Getting stats from k 2024-09-16T01:04:23.408 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-16T01:04:23.651 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:04:24.168 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T01:04:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 308, 2024-09-16T01:04:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 310, 2024-09-16T01:04:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 82199, 2024-09-16T01:04:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 98008, 2024-09-16T01:04:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 6, 2024-09-16T01:04:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 2, 2024-09-16T01:04:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.030632181, 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.012178769, 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.007535187, 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.007278656, 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 308, 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.014739699, 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000047856 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 185, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 263, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 47454, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 258285, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 4, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.024946068, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.009099152, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.007142453, 2024-09-16T01:04:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.006260517, 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 262, 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.017833017, 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000068064 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 201040 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 426, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 419, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 593296, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 162578, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 3, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 2, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.057129822, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.019580739, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.025604795, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.012670177, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 418, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.025610735, 2024-09-16T01:04:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000061269 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 491488, 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 66224 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-16T01:04:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1368, 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.042850171, 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000031323 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 0, 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 0, 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-09-16T01:04:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 1, 2024-09-16T01:04:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-16T01:04:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:04:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 0, 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 0 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-09-16T01:04:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:04:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 0, 2024-09-16T01:04:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 3, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 0, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-09-16T01:04:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 4195200, 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 4194892, 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 3 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 3, 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 3, 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 0, 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 1, 2024-09-16T01:04:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 1, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 0, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 0, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 0, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 0, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 0, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 0, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 48504, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 215328 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 0, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-09-16T01:04:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 0, 2024-09-16T01:04:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 0, 2024-09-16T01:04:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-09-16T01:04:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-16T01:04:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 1, 2024-09-16T01:04:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 0, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 0, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 0, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 1432, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 191054, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 51, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8672, 2024-09-16T01:04:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 163, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 8512, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 13, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-16T01:04:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 791, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 21, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 3, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 791, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 791, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.410993908, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000519587 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 791, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 792 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 791, 2024-09-16T01:04:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 791, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 481, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 308, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-16T01:04:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 1, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-09-16T01:04:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-16T01:04:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 89, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 4, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 5, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 5, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 0, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 2, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 0 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 0, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:04:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 915, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 631339, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 915, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 915, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 631339, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 791, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 901, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 791, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 901, 2024-09-16T01:04:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 791, 2024-09-16T01:04:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 791, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 791, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 791, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:24.211 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x56048a8d2b40": { 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-16T01:04:24.212 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T01:04:24.213 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T01:04:24.974 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-16T01:04:24.974 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-16T01:04:24.974 DEBUG:tasks.check_counter:Getting stats from c 2024-09-16T01:04:24.974 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-16T01:04:25.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:24 smithi119 ceph-mon[35049]: pgmap v459: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 969 KiB/s wr, 246 op/s 2024-09-16T01:04:25.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:24 smithi012 ceph-mon[31197]: pgmap v459: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 969 KiB/s wr, 246 op/s 2024-09-16T01:04:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:24 smithi098 ceph-mon[35346]: pgmap v459: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 969 KiB/s wr, 246 op/s 2024-09-16T01:04:25.235 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:04:25.845 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 688, 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 690, 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 783160, 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 218794, 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 6, 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.068829765, 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.021771720, 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.018809801, 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.021471384, 2024-09-16T01:04:25.846 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 688, 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.027722071, 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000040293 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:25.847 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 125, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 118, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 492488, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 65802, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.019442023, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.007657711, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.015781954, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000097717, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 117, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.011071616, 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000094629 2024-09-16T01:04:25.848 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 490832, 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 64464 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 310, 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 385, 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 78253, 2024-09-16T01:04:25.849 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 297503, 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.037821029, 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.014766266, 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.009438062, 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.010229601, 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 384, 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.020203215, 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000052612 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.850 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 200512 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-16T01:04:25.851 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1656, 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.046028504, 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000027794 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-16T01:04:25.852 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-09-16T01:04:25.853 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 20, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 20, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 20, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 2, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-09-16T01:04:25.854 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 4, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 234, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2024-09-16T01:04:25.855 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:04:25.856 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-09-16T01:04:25.857 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-09-16T01:04:25.858 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "evlrg": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 152, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-09-16T01:04:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 2, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "segmjr": 2, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 4775371, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 4774772, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 152 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.860 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 14, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 20, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 6, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 9, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 11, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 2, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 20, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 25, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 5, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 48556, 2024-09-16T01:04:25.861 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 215328 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-09-16T01:04:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-09-16T01:04:25.863 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.864 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.865 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.866 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.866 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-09-16T01:04:25.866 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.866 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.866 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.866 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.867 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.868 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.869 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.870 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:04:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 3, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 2, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 1, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 1431, 2024-09-16T01:04:25.873 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:25.874 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:25.875 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 189217, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 48, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:25.876 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 8672, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 163, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 57090, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 273, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-16T01:04:25.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 997, 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 26, 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 4, 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 997, 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 997, 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.463987988, 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000465384 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.878 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 997, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 998 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 997, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 997, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 608, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 386, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-09-16T01:04:25.879 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 2, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-09-16T01:04:25.880 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-09-16T01:04:25.881 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 89, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 4, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 5, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 5, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2024-09-16T01:04:25.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2024-09-16T01:04:25.883 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed_ops": 0, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 1119, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 1244041, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 1119, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:25.884 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1119, 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1244041, 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:25.885 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 997, 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 581077, 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 997, 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 581077, 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.886 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 997, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 997, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 997, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 997, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.887 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-16T01:04:25.888 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x5627aceecb40": { 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:25.889 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:25.890 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-16T01:04:26.852 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-16T01:04:26.852 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-16T01:04:26.852 DEBUG:tasks.check_counter:Getting stats from f 2024-09-16T01:04:26.853 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-16T01:04:27.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:26 smithi119 ceph-mon[35049]: pgmap v460: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 969 KiB/s wr, 247 op/s 2024-09-16T01:04:27.099 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:04:27.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:26 smithi012 ceph-mon[31197]: pgmap v460: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 969 KiB/s wr, 247 op/s 2024-09-16T01:04:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:26 smithi098 ceph-mon[35346]: pgmap v460: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 969 KiB/s wr, 247 op/s 2024-09-16T01:04:27.669 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 615, 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 617, 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 184937, 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 195577, 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 6, 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.066379355, 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.022552410, 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.017450421, 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.019982461, 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:27.670 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 615, 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.025634118, 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000041681 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 127, 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 118, 2024-09-16T01:04:27.671 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 494492, 2024-09-16T01:04:27.672 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 66090, 2024-09-16T01:04:27.672 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 3, 2024-09-16T01:04:27.672 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-16T01:04:27.672 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.021401865, 2024-09-16T01:04:27.672 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.007722236, 2024-09-16T01:04:27.672 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.019208882, 2024-09-16T01:04:27.672 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000055999, 2024-09-16T01:04:27.672 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:27.672 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 118, 2024-09-16T01:04:27.672 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.012042282, 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000102053 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 493936, 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 65392 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:27.673 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 2, 2024-09-16T01:04:27.674 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 80, 2024-09-16T01:04:27.674 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 428, 2024-09-16T01:04:27.674 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 200558, 2024-09-16T01:04:27.674 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-16T01:04:27.674 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2024-09-16T01:04:27.674 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.005934355, 2024-09-16T01:04:27.674 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.003393222, 2024-09-16T01:04:27.674 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.001548261, 2024-09-16T01:04:27.674 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000030278, 2024-09-16T01:04:27.674 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 78, 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.006563342, 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000084145 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 200240 2024-09-16T01:04:27.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.676 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-16T01:04:27.676 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-09-16T01:04:27.676 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-16T01:04:27.676 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.676 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-09-16T01:04:27.676 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-16T01:04:27.677 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-16T01:04:27.677 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1229, 2024-09-16T01:04:27.677 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.035981992, 2024-09-16T01:04:27.677 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000029277 2024-09-16T01:04:27.677 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:27.677 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.677 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-09-16T01:04:27.677 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-16T01:04:27.677 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-16T01:04:27.677 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-09-16T01:04:27.678 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2024-09-16T01:04:27.679 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 1, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-09-16T01:04:27.680 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:04:27.681 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.682 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-09-16T01:04:27.683 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "evlrg": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-09-16T01:04:27.684 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 2, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 2, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "segmjr": 2, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 4194892, 2024-09-16T01:04:27.685 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 4194352, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 2 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 3, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 3, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 0, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 1, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 1, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 0, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 0, 2024-09-16T01:04:27.686 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 48812, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 215328 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.687 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-09-16T01:04:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.689 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.689 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.689 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.689 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-09-16T01:04:27.689 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.689 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.689 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.689 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.689 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.693 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-09-16T01:04:27.693 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.693 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.693 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.693 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-09-16T01:04:27.693 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.693 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.693 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.695 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.697 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:04:27.698 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 0, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 0, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 0, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 0, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2024-09-16T01:04:27.699 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 0, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:27.700 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:27.701 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 181193, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 46, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:27.702 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 8672, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 163, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 8512, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 13, 2024-09-16T01:04:27.703 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 618, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 21, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 3, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 618, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 618, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.354990803, 2024-09-16T01:04:27.704 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000574418 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 618, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 619 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 618, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 618, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 306, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2024-09-16T01:04:27.705 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 310, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 1, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:04:27.706 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-09-16T01:04:27.707 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 89, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 4, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 4, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 4, 2024-09-16T01:04:27.708 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-09-16T01:04:27.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed_ops": 0, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-16T01:04:27.710 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 740, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 604101, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 740, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 740, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 604101, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-09-16T01:04:27.711 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 618, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 593, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 618, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 593, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.712 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.713 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.713 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:27.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.713 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-09-16T01:04:27.713 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:27.713 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-09-16T01:04:27.713 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 618, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 618, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 618, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 618, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.714 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-16T01:04:27.715 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x564a59b04b40": { 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:27.716 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:27.717 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:27.717 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-16T01:04:27.717 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-16T01:04:27.717 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:27.717 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:27.717 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:27.717 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:27.717 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:27.717 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:27.717 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-16T01:04:28.503 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-16T01:04:28.503 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-16T01:04:28.503 DEBUG:tasks.check_counter:Getting stats from i 2024-09-16T01:04:28.504 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-16T01:04:28.770 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:04:29.067 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:28 smithi119 ceph-mon[35049]: pgmap v461: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 969 KiB/s wr, 246 op/s 2024-09-16T01:04:29.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:28 smithi012 ceph-mon[31197]: pgmap v461: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 969 KiB/s wr, 246 op/s 2024-09-16T01:04:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:28 smithi098 ceph-mon[35346]: pgmap v461: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 969 KiB/s wr, 246 op/s 2024-09-16T01:04:29.349 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 323, 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 381, 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 554276, 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 153062, 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 9, 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.048589979, 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.017516577, 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.030568960, 2024-09-16T01:04:29.350 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.002051383, 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 383, 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.032848824, 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000085767 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 373, 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000125931, 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000337 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 508096, 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 70912 2024-09-16T01:04:29.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 44, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 121, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 16984, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 371636, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 20, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 7, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.013164303, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.004145174, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.007533823, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000357323, 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:29.352 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 119, 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.020812193, 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000174892 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 44, 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000014273, 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000324 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 201680 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.353 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 49, 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 53, 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 26220, 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 77493, 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 13, 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 6, 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.006941348, 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.001113329, 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.005711687, 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000279816, 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:29.354 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 49, 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.015121600, 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000308604 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 66, 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000020988, 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000318 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-09-16T01:04:29.355 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 37, 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.001448843, 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000039157 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2, 2024-09-16T01:04:29.356 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000008530, 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000004265 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 1, 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 1, 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1, 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000120492, 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000120492 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-09-16T01:04:29.357 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 11, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 10, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 10, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 10, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 1, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 1, 2024-09-16T01:04:29.358 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 1, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 6, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 6, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-09-16T01:04:29.359 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 8, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 269505890, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2024-09-16T01:04:29.360 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 1, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 1, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-09-16T01:04:29.361 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 1, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-09-16T01:04:29.362 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_path": 2, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_inode": 2, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "evlrg": 0, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 3, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-09-16T01:04:29.363 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 3, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 2, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 2, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "segmjr": 2, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 4195200, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 0, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2, 2024-09-16T01:04:29.364 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.003422325, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001711162 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 0 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 13, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 13, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 0, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 11, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 12, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 1, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 10, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 10, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 0, 2024-09-16T01:04:29.365 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 1, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 1, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 52168, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 223520 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 1, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 1, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 3, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.367 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1, 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000120492, 2024-09-16T01:04:29.368 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000120492 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.369 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.370 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.372 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.373 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.373 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.373 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-09-16T01:04:29.373 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.373 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.373 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.373 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.373 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-09-16T01:04:29.373 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.373 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-09-16T01:04:29.374 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.375 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-09-16T01:04:29.376 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 1, 2024-09-16T01:04:29.377 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 0, 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 1, 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 1, 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 1, 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 181, 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:29.378 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:29.379 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:29.380 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 238343, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 80, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:29.381 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 8672, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 163, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 51240, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 200, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-09-16T01:04:29.382 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 37, 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 11108, 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 32, 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 37, 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 37, 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.210994512, 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.005702554 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 37, 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 59 2024-09-16T01:04:29.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 37, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 0, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 37, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 0, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 10, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 0, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 2, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 6, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-09-16T01:04:29.384 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 6, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 20, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:04:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-09-16T01:04:29.386 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 89, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 4, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 8, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 8, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 14, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 0, 2024-09-16T01:04:29.387 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 1 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 1, 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 4 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:04:29.388 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed_ops": 0, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 412, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 549594, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 412, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:29.389 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 412, 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 549594, 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:29.390 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 37, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 11108, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 37, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 11108, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:29.391 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 37, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 37, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 37, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 37, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:29.392 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:29.393 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x555c13566960": { 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 3, 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 896, 2024-09-16T01:04:29.394 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 3, 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2, 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 896, 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:29.395 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-16T01:04:30.156 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-16T01:04:30.157 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-16T01:04:30.157 DEBUG:tasks.check_counter:Getting stats from l 2024-09-16T01:04:30.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-16T01:04:30.403 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:04:30.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:30 smithi098 ceph-mon[35346]: pgmap v462: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 606 KiB/s wr, 159 op/s 2024-09-16T01:04:31.049 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:30 smithi119 ceph-mon[35049]: pgmap v462: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 606 KiB/s wr, 159 op/s 2024-09-16T01:04:31.061 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 625, 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 627, 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 188075, 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 198751, 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 6, 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.067763746, 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.023496517, 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.017630536, 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.020032000, 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:31.062 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 625, 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.026980109, 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000043168 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:04:31.063 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 360, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 351, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 552502, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 141478, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.046455129, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.016472896, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.024464672, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.008519718, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 351, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.021581531, 2024-09-16T01:04:31.064 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000061485 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 495024, 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 67952 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 2, 2024-09-16T01:04:31.065 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 84, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 428, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 202878, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.006112701, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.003745534, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.001415933, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000055480, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 82, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.006896028, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000084097 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.066 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 202560 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-09-16T01:04:31.067 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1454, 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.042322004, 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000029107 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:31.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2024-09-16T01:04:31.069 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 1, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-09-16T01:04:31.070 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 0, 2024-09-16T01:04:31.071 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:04:31.072 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2024-09-16T01:04:31.073 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:04:31.074 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "evlrg": 0, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 5, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-09-16T01:04:31.075 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 2, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "segmjr": 2, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 4195734, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 4195426, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 5 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 3, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 3, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 0, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 1, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 1, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 0, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 0, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 0, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 0, 2024-09-16T01:04:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 47576, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 215328 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.078 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.079 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.080 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.081 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.083 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-09-16T01:04:31.083 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.083 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.083 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.083 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.085 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.086 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.087 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.088 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.089 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 1, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 2, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 1, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 1, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2024-09-16T01:04:31.090 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 1439, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:04:31.091 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:04:31.092 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:04:31.093 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 189257, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 49, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 8672, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 163, 2024-09-16T01:04:31.094 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 8512, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 13, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 857, 2024-09-16T01:04:31.095 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 21, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 3, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 857, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 857, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.447988399, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000522740 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 857, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 858 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 857, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 857, 2024-09-16T01:04:31.096 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 538, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 317, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-09-16T01:04:31.097 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 1, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-09-16T01:04:31.098 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-09-16T01:04:31.099 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 89, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 4, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 5, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 5, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2024-09-16T01:04:31.100 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "osd-slow-ops": { 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed_ops": 0, 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2024-09-16T01:04:31.101 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 983, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 643171, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 983, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 983, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 643171, 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:31.102 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 857, 2024-09-16T01:04:31.103 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 1435, 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 857, 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1435, 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:31.104 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 857, 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 857, 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 857, 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 857, 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.105 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.106 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x561938c68b40": { 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-16T01:04:31.107 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-16T01:04:31.108 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-16T01:04:31.108 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-16T01:04:31.108 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-16T01:04:31.108 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-16T01:04:31.108 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:31.108 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-16T01:04:31.108 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-16T01:04:31.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:30 smithi012 ceph-mon[31197]: pgmap v462: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 606 KiB/s wr, 159 op/s 2024-09-16T01:04:31.979 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-16T01:04:31.979 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-16T01:04:31.979 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-16T01:04:31.989 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-16T01:04:31.989 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T01:04:31.989 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:04:32.008 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-16T01:04:32.008 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:04:32.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T01:04:32.367 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:32.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.868+0000 7f900d6fa640 1 -- 172.21.15.12:0/4222573114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900810c170 msgr2=0x7f900810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.868+0000 7f900d6fa640 1 --2- 172.21.15.12:0/4222573114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900810c170 0x7f900810e610 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9000009900 tx=0x7f900002a480 comp rx=0 tx=0).stop 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.868+0000 7f900d6fa640 1 -- 172.21.15.12:0/4222573114 shutdown_connections 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.868+0000 7f900d6fa640 1 --2- 172.21.15.12:0/4222573114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900810c170 0x7f900810e610 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.868+0000 7f900d6fa640 1 --2- 172.21.15.12:0/4222573114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9008103660 0x7f900810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.868+0000 7f900d6fa640 1 --2- 172.21.15.12:0/4222573114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9008102d40 0x7f9008103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.868+0000 7f900d6fa640 1 -- 172.21.15.12:0/4222573114 >> 172.21.15.12:0/4222573114 conn(0x7f90080fc7a0 msgr2=0x7f90080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.868+0000 7f900d6fa640 1 -- 172.21.15.12:0/4222573114 shutdown_connections 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.868+0000 7f900d6fa640 1 -- 172.21.15.12:0/4222573114 wait complete. 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f900d6fa640 1 Processor -- start 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f900d6fa640 1 -- start start 2024-09-16T01:04:32.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f900d6fa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9008102d40 0x7f90081009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f900d6fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9008103660 0x7f9008100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f900d6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900810c170 0x7f9008101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f900d6fa640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9008111f70 con 0x7f900810c170 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f900d6fa640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9008111df0 con 0x7f9008102d40 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f900d6fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90081120f0 con 0x7f9008103660 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f90077fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900810c170 0x7f9008101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f90077fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900810c170 0x7f9008101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51738/0 (socket says 172.21.15.12:51738) 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f90077fe640 1 -- 172.21.15.12:0/550669061 learned_addr learned my addr 172.21.15.12:0/550669061 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f9006ffd640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9008102d40 0x7f90081009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.869+0000 7f90067fc640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9008103660 0x7f9008100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f90077fe640 1 -- 172.21.15.12:0/550669061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9008103660 msgr2=0x7f9008100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f90077fe640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9008103660 0x7f9008100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:32.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f90077fe640 1 -- 172.21.15.12:0/550669061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9008102d40 msgr2=0x7f90081009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f90077fe640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9008102d40 0x7f90081009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f90077fe640 1 -- 172.21.15.12:0/550669061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90081a68b0 con 0x7f900810c170 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f90077fe640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900810c170 0x7f9008101420 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9000005ab0 tx=0x7f9000004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f8feffff640 1 -- 172.21.15.12:0/550669061 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900003f030 con 0x7f900810c170 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f8feffff640 1 -- 172.21.15.12:0/550669061 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9000004440 con 0x7f900810c170 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f900d6fa640 1 -- 172.21.15.12:0/550669061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90081a6b40 con 0x7f900810c170 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f8feffff640 1 -- 172.21.15.12:0/550669061 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000035070 con 0x7f900810c170 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.870+0000 7f900d6fa640 1 -- 172.21.15.12:0/550669061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90081a7020 con 0x7f900810c170 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.871+0000 7f900d6fa640 1 -- 172.21.15.12:0/550669061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9008103120 con 0x7f900810c170 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.873+0000 7f8feffff640 1 -- 172.21.15.12:0/550669061 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9000042030 con 0x7f900810c170 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.874+0000 7f8feffff640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8ff00a3240 0x7f8ff00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.874+0000 7f9006ffd640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8ff00a3240 0x7f8ff00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.874+0000 7f8feffff640 1 -- 172.21.15.12:0/550669061 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f90000f01d0 con 0x7f900810c170 2024-09-16T01:04:32.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.875+0000 7f9006ffd640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8ff00a3240 0x7f8ff00a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8005fd0 tx=0x7f8ff8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:32.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:32.877+0000 7f8feffff640 1 -- 172.21.15.12:0/550669061 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90000bcb90 con 0x7f900810c170 2024-09-16T01:04:33.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.064+0000 7f900d6fa640 1 -- 172.21.15.12:0/550669061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f90081071e0 con 0x7f900810c170 2024-09-16T01:04:33.065 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:32 smithi012 ceph-mon[31197]: pgmap v463: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 143 KiB/s wr, 46 op/s 2024-09-16T01:04:33.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.065+0000 7f8feffff640 1 -- 172.21.15.12:0/550669061 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+591 (secure 0 0 0) 0x7f90000bc490 con 0x7f900810c170 2024-09-16T01:04:33.066 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2197597102 2024-09-17T00:51:42.808843+0000 2024-09-16T01:04:33.066 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2549589240 2024-09-17T00:51:42.808843+0000 2024-09-16T01:04:33.066 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/1863535251 2024-09-17T00:51:42.808843+0000 2024-09-16T01:04:33.066 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/570072659 2024-09-17T00:51:42.808843+0000 2024-09-16T01:04:33.066 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/1863535251 2024-09-17T00:51:42.808843+0000 2024-09-16T01:04:33.066 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1710824695 2024-09-17T00:51:19.512115+0000 2024-09-16T01:04:33.067 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/4246888310 2024-09-17T00:51:19.512115+0000 2024-09-16T01:04:33.067 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/3324219193 2024-09-17T00:51:19.512115+0000 2024-09-16T01:04:33.067 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/3324219193 2024-09-17T00:51:19.512115+0000 2024-09-16T01:04:33.067 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2420216586 2024-09-17T00:51:19.512115+0000 2024-09-16T01:04:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:listed 10 entries 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 -- 172.21.15.12:0/550669061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8ff00a3240 msgr2=0x7f8ff00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8ff00a3240 0x7f8ff00a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8005fd0 tx=0x7f8ff8009500 comp rx=0 tx=0).stop 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 -- 172.21.15.12:0/550669061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900810c170 msgr2=0x7f9008101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900810c170 0x7f9008101420 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9000005ab0 tx=0x7f9000004040 comp rx=0 tx=0).stop 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 -- 172.21.15.12:0/550669061 shutdown_connections 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f8ff00a3240 0x7f8ff00a5700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900810c170 0x7f9008101420 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9008103660 0x7f9008100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 --2- 172.21.15.12:0/550669061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9008102d40 0x7f90081009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 -- 172.21.15.12:0/550669061 >> 172.21.15.12:0/550669061 conn(0x7f90080fc7a0 msgr2=0x7f90080fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 -- 172.21.15.12:0/550669061 shutdown_connections 2024-09-16T01:04:33.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:33.067+0000 7f900d6fa640 1 -- 172.21.15.12:0/550669061 wait complete. 2024-09-16T01:04:33.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:32 smithi119 ceph-mon[35049]: pgmap v463: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 143 KiB/s wr, 46 op/s 2024-09-16T01:04:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:32 smithi098 ceph-mon[35346]: pgmap v463: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 143 KiB/s wr, 46 op/s 2024-09-16T01:04:33.878 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:04:33.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:04:33.879 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:04:33.926 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-16T01:04:33.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:04:33.926 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:04:33.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:04:33.959 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-16T01:04:34.016 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:04:34.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:04:34.016 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:04:34.079 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:33 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/550669061' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:04:34.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:04:34.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-16T01:04:34.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:33 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/550669061' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:04:34.178 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-16T01:04:34.193 INFO:tasks.cephadm:Teardown begin 2024-09-16T01:04:34.193 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:04:34.193 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:04:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:33 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/550669061' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:04:34.452 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:34.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:34 smithi012 ceph-mon[31197]: pgmap v464: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-16T01:04:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.959+0000 7fbbf44d3640 1 -- 172.21.15.12:0/1190153021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec10c170 msgr2=0x7fbbec10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.959+0000 7fbbf44d3640 1 --2- 172.21.15.12:0/1190153021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec10c170 0x7fbbec10e610 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009ca0 tx=0x7fbbe402a950 comp rx=0 tx=0).stop 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.959+0000 7fbbf44d3640 1 -- 172.21.15.12:0/1190153021 shutdown_connections 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.959+0000 7fbbf44d3640 1 --2- 172.21.15.12:0/1190153021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec10c170 0x7fbbec10e610 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.959+0000 7fbbf44d3640 1 --2- 172.21.15.12:0/1190153021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbec103660 0x7fbbec10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.959+0000 7fbbf44d3640 1 --2- 172.21.15.12:0/1190153021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbec102d40 0x7fbbec103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.959+0000 7fbbf44d3640 1 -- 172.21.15.12:0/1190153021 >> 172.21.15.12:0/1190153021 conn(0x7fbbec0fc7a0 msgr2=0x7fbbec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.959+0000 7fbbf44d3640 1 -- 172.21.15.12:0/1190153021 shutdown_connections 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.959+0000 7fbbf44d3640 1 -- 172.21.15.12:0/1190153021 wait complete. 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf44d3640 1 Processor -- start 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf44d3640 1 -- start start 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf44d3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbec102d40 0x7fbbec198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf44d3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbec103660 0x7fbbec1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:34.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf44d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec10c170 0x7fbbec19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf44d3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec111f70 con 0x7fbbec10c170 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf44d3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec111df0 con 0x7fbbec103660 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf44d3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1120f0 con 0x7fbbec102d40 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf2a70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec10c170 0x7fbbec19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf2a70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec10c170 0x7fbbec19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51764/0 (socket says 172.21.15.12:51764) 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.960+0000 7fbbf2a70640 1 -- 172.21.15.12:0/2873427463 learned_addr learned my addr 172.21.15.12:0/2873427463 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbf1a6e640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbec103660 0x7fbbec1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbf226f640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbec102d40 0x7fbbec198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbf2a70640 1 -- 172.21.15.12:0/2873427463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbec102d40 msgr2=0x7fbbec198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbf2a70640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbec102d40 0x7fbbec198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbf2a70640 1 -- 172.21.15.12:0/2873427463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbec103660 msgr2=0x7fbbec1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbf2a70640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbec103660 0x7fbbec1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbf2a70640 1 -- 172.21.15.12:0/2873427463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec19d320 con 0x7fbbec10c170 2024-09-16T01:04:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbf2a70640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec10c170 0x7fbbec19cc40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4006010 tx=0x7fbbe402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:34.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbe37fe640 1 -- 172.21.15.12:0/2873427463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4034040 con 0x7fbbec10c170 2024-09-16T01:04:34.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbf44d3640 1 -- 172.21.15.12:0/2873427463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbec19d5b0 con 0x7fbbec10c170 2024-09-16T01:04:34.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbe37fe640 1 -- 172.21.15.12:0/2873427463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbe4003e00 con 0x7fbbec10c170 2024-09-16T01:04:34.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbe37fe640 1 -- 172.21.15.12:0/2873427463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40456e0 con 0x7fbbec10c170 2024-09-16T01:04:34.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.961+0000 7fbbf44d3640 1 -- 172.21.15.12:0/2873427463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbec1a4ef0 con 0x7fbbec10c170 2024-09-16T01:04:34.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.962+0000 7fbbf44d3640 1 -- 172.21.15.12:0/2873427463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbec103120 con 0x7fbbec10c170 2024-09-16T01:04:34.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.964+0000 7fbbe37fe640 1 -- 172.21.15.12:0/2873427463 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbbe4037020 con 0x7fbbec10c170 2024-09-16T01:04:34.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.964+0000 7fbbe37fe640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbbd80a3240 0x7fbbd80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:34.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.964+0000 7fbbf226f640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbbd80a3240 0x7fbbd80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:34.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.965+0000 7fbbe37fe640 1 -- 172.21.15.12:0/2873427463 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7fbbe40f1030 con 0x7fbbec10c170 2024-09-16T01:04:34.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.965+0000 7fbbf226f640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbbd80a3240 0x7fbbd80a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80058c0 tx=0x7fbbe800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:34.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:34.967+0000 7fbbe37fe640 1 -- 172.21.15.12:0/2873427463 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbbe40811b0 con 0x7fbbec10c170 2024-09-16T01:04:35.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:34 smithi119 ceph-mon[35049]: pgmap v464: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-16T01:04:35.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.181+0000 7fbbf44d3640 1 -- 172.21.15.12:0/2873427463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbec1a5120 con 0x7fbbec10c170 2024-09-16T01:04:35.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.182+0000 7fbbe37fe640 1 -- 172.21.15.12:0/2873427463 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7fbbe40bd9f0 con 0x7fbbec10c170 2024-09-16T01:04:35.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:04:35.183 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:04:35.183 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:04:35.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 -- 172.21.15.12:0/2873427463 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbbd80a3240 msgr2=0x7fbbd80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:35.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbbd80a3240 0x7fbbd80a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80058c0 tx=0x7fbbe800a4c0 comp rx=0 tx=0).stop 2024-09-16T01:04:35.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 -- 172.21.15.12:0/2873427463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec10c170 msgr2=0x7fbbec19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:35.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec10c170 0x7fbbec19cc40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4006010 tx=0x7fbbe402f710 comp rx=0 tx=0).stop 2024-09-16T01:04:35.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 -- 172.21.15.12:0/2873427463 shutdown_connections 2024-09-16T01:04:35.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fbbd80a3240 0x7fbbd80a5700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:35.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec10c170 0x7fbbec19cc40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:35.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbec103660 0x7fbbec1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:35.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 --2- 172.21.15.12:0/2873427463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbec102d40 0x7fbbec198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:35.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 -- 172.21.15.12:0/2873427463 >> 172.21.15.12:0/2873427463 conn(0x7fbbec0fc7a0 msgr2=0x7fbbec0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:35.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.184+0000 7fbbf44d3640 1 -- 172.21.15.12:0/2873427463 shutdown_connections 2024-09-16T01:04:35.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:35.185+0000 7fbbf44d3640 1 -- 172.21.15.12:0/2873427463 wait complete. 2024-09-16T01:04:35.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:34 smithi098 ceph-mon[35346]: pgmap v464: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-16T01:04:36.074 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:35 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/2873427463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:04:36.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:35 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/2873427463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:04:36.110 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:04:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:35 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/2873427463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:04:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.895+0000 7f7889ad3640 1 -- 172.21.15.12:0/2924557557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7884101de0 msgr2=0x7f78841021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.895+0000 7f7889ad3640 1 --2- 172.21.15.12:0/2924557557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7884101de0 0x7f78841021c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7874009ca0 tx=0x7f787402a8c0 comp rx=0 tx=0).stop 2024-09-16T01:04:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.895+0000 7f7889ad3640 1 -- 172.21.15.12:0/2924557557 shutdown_connections 2024-09-16T01:04:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.895+0000 7f7889ad3640 1 --2- 172.21.15.12:0/2924557557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7884106f10 0x7f788410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.895+0000 7f7889ad3640 1 --2- 172.21.15.12:0/2924557557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7884102790 0x7f78841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.895+0000 7f7889ad3640 1 --2- 172.21.15.12:0/2924557557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7884101de0 0x7f78841021c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.895+0000 7f7889ad3640 1 -- 172.21.15.12:0/2924557557 >> 172.21.15.12:0/2924557557 conn(0x7f78840fd8c0 msgr2=0x7f78840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.895+0000 7f7889ad3640 1 -- 172.21.15.12:0/2924557557 shutdown_connections 2024-09-16T01:04:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.895+0000 7f7889ad3640 1 -- 172.21.15.12:0/2924557557 wait complete. 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.895+0000 7f7889ad3640 1 Processor -- start 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7889ad3640 1 -- start start 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7889ad3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7884101de0 0x7f78840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7889ad3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7884102790 0x7f7884074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7889ad3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7884106f10 0x7f7884074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7889ad3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7884111f70 con 0x7f7884106f10 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7889ad3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7884111df0 con 0x7f7884101de0 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7889ad3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f78841120f0 con 0x7f7884102790 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7883fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7884106f10 0x7f7884074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7883fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7884106f10 0x7f7884074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46266/0 (socket says 172.21.15.12:46266) 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7883fff640 1 -- 172.21.15.12:0/3342407434 learned_addr learned my addr 172.21.15.12:0/3342407434 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f78837fe640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7884101de0 0x7f78840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7882ffd640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7884102790 0x7f7884074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7883fff640 1 -- 172.21.15.12:0/3342407434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7884102790 msgr2=0x7f7884074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7883fff640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7884102790 0x7f7884074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7883fff640 1 -- 172.21.15.12:0/3342407434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7884101de0 msgr2=0x7f78840744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7883fff640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7884101de0 0x7f78840744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7883fff640 1 -- 172.21.15.12:0/3342407434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78841a6910 con 0x7f7884106f10 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.896+0000 7f7882ffd640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7884102790 0x7f7884074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.897+0000 7f7883fff640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7884106f10 0x7f7884074f70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f787c00d750 tx=0x7f787c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.897+0000 7f7880ff9640 1 -- 172.21.15.12:0/3342407434 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c017070 con 0x7f7884106f10 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.897+0000 7f7880ff9640 1 -- 172.21.15.12:0/3342407434 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f787c005500 con 0x7f7884106f10 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.897+0000 7f7880ff9640 1 -- 172.21.15.12:0/3342407434 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c004d90 con 0x7f7884106f10 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.897+0000 7f7889ad3640 1 -- 172.21.15.12:0/3342407434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78841a6c00 con 0x7f7884106f10 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.897+0000 7f7889ad3640 1 -- 172.21.15.12:0/3342407434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78841a70f0 con 0x7f7884106f10 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.898+0000 7f7889ad3640 1 -- 172.21.15.12:0/3342407434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78841021c0 con 0x7f7884106f10 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.899+0000 7f7880ff9640 1 -- 172.21.15.12:0/3342407434 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f787c004f30 con 0x7f7884106f10 2024-09-16T01:04:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.900+0000 7f7880ff9640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f786c0a3240 0x7f786c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:36.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.900+0000 7f78837fe640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f786c0a3240 0x7f786c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:36.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.900+0000 7f7880ff9640 1 -- 172.21.15.12:0/3342407434 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f787c0cfa10 con 0x7f7884106f10 2024-09-16T01:04:36.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.900+0000 7f78837fe640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f786c0a3240 0x7f786c0a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7874006010 tx=0x7f7874009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:36.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:36.903+0000 7f7880ff9640 1 -- 172.21.15.12:0/3342407434 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f787c09c370 con 0x7f7884106f10 2024-09-16T01:04:37.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:36 smithi119 ceph-mon[35049]: pgmap v465: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-16T01:04:37.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:36 smithi012 ceph-mon[31197]: pgmap v465: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-16T01:04:37.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.114+0000 7f7889ad3640 1 -- 172.21.15.12:0/3342407434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f788410a0f0 con 0x7f7884106f10 2024-09-16T01:04:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.115+0000 7f7880ff9640 1 -- 172.21.15.12:0/3342407434 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11971 (secure 0 0 0) 0x7f787c09bc70 con 0x7f7884106f10 2024-09-16T01:04:37.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:04:37.116 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"btime":"2024-09-16T01:01:04:663947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1483789466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1483789466},{"type":"v1","addr":"172.21.15.12:6835","nonce":1483789466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2487951096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2487951096},{"type":"v1","addr":"172.21.15.12:6837","nonce":2487951096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:58:37.161987+0000","modified":"2024-09-16T01:01:03.851345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24482,"mds_2":24475,"mds_3":24458,"mds_4":14601},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/3964724197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3964724197},{"type":"v1","addr":"172.21.15.12:6839","nonce":3964724197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":16,"addr":"172.21.15.12:6841/1625323518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1625323518},{"type":"v1","addr":"172.21.15.12:6841","nonce":1625323518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/489944636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":489944636},{"type":"v1","addr":"172.21.15.119:6833","nonce":489944636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6833/676872767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":676872767},{"type":"v1","addr":"172.21.15.98:6833","nonce":676872767}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/3086232870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3086232870},{"type":"v1","addr":"172.21.15.119:6835","nonce":3086232870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6837/3417248856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3417248856},{"type":"v1","addr":"172.21.15.119:6837","nonce":3417248856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":20,"addr":"172.21.15.98:6835/1575072845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1575072845},{"type":"v1","addr":"172.21.15.98:6835","nonce":1575072845}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.119:6839/3964855150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3964855150},{"type":"v1","addr":"172.21.15.119:6839","nonce":3964855150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.98:6837/390846726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":390846726},{"type":"v1","addr":"172.21.15.98:6837","nonce":390846726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6839/2784619271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2784619271},{"type":"v1","addr":"172.21.15.98:6839","nonce":2784619271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[14601,24458,24475,24482,24518]},"id":1}]} 2024-09-16T01:04:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 29 2024-09-16T01:04:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 -- 172.21.15.12:0/3342407434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f786c0a3240 msgr2=0x7f786c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f786c0a3240 0x7f786c0a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7874006010 tx=0x7f7874009360 comp rx=0 tx=0).stop 2024-09-16T01:04:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 -- 172.21.15.12:0/3342407434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7884106f10 msgr2=0x7f7884074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7884106f10 0x7f7884074f70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f787c00d750 tx=0x7f787c00dc10 comp rx=0 tx=0).stop 2024-09-16T01:04:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 -- 172.21.15.12:0/3342407434 shutdown_connections 2024-09-16T01:04:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f786c0a3240 0x7f786c0a5700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7884106f10 0x7f7884074f70 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7884102790 0x7f7884074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 --2- 172.21.15.12:0/3342407434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7884101de0 0x7f78840744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 -- 172.21.15.12:0/3342407434 >> 172.21.15.12:0/3342407434 conn(0x7f78840fd8c0 msgr2=0x7f78840fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 -- 172.21.15.12:0/3342407434 shutdown_connections 2024-09-16T01:04:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:37.117+0000 7f7889ad3640 1 -- 172.21.15.12:0/3342407434 wait complete. 2024-09-16T01:04:37.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:36 smithi098 ceph-mon[35346]: pgmap v465: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-16T01:04:37.899 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:04:38.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:37 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3342407434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:04:38.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:37 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3342407434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:04:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:37 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3342407434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:04:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.669+0000 7f910d2a7640 1 -- 172.21.15.12:0/2734315202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91081049c0 msgr2=0x7f9108108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.669+0000 7f910d2a7640 1 --2- 172.21.15.12:0/2734315202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91081049c0 0x7f9108108a10 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009900 tx=0x7f90f002a410 comp rx=0 tx=0).stop 2024-09-16T01:04:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.670+0000 7f910d2a7640 1 -- 172.21.15.12:0/2734315202 shutdown_connections 2024-09-16T01:04:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.670+0000 7f910d2a7640 1 --2- 172.21.15.12:0/2734315202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9108109140 0x7f9108110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.670+0000 7f910d2a7640 1 --2- 172.21.15.12:0/2734315202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91081049c0 0x7f9108108a10 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.670+0000 7f910d2a7640 1 --2- 172.21.15.12:0/2734315202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9108104010 0x7f91081043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.670+0000 7f910d2a7640 1 -- 172.21.15.12:0/2734315202 >> 172.21.15.12:0/2734315202 conn(0x7f91080ffa50 msgr2=0x7f9108101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.670+0000 7f910d2a7640 1 -- 172.21.15.12:0/2734315202 shutdown_connections 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.670+0000 7f910d2a7640 1 -- 172.21.15.12:0/2734315202 wait complete. 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.670+0000 7f910d2a7640 1 Processor -- start 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f910d2a7640 1 -- start start 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f910d2a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108104010 0x7f910819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f910d2a7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91081049c0 0x7f910819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f910d2a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9108109140 0x7f910819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f910d2a7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9108114140 con 0x7f9108104010 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f910d2a7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9108113fc0 con 0x7f91081049c0 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f910d2a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f91081142c0 con 0x7f9108109140 2024-09-16T01:04:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f9106ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108104010 0x7f910819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f9106ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108104010 0x7f910819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46278/0 (socket says 172.21.15.12:46278) 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f9106ffd640 1 -- 172.21.15.12:0/1361363214 learned_addr learned my addr 172.21.15.12:0/1361363214 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f91067fc640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91081049c0 0x7f910819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f91077fe640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9108109140 0x7f910819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f9106ffd640 1 -- 172.21.15.12:0/1361363214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9108109140 msgr2=0x7f910819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f9106ffd640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9108109140 0x7f910819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f9106ffd640 1 -- 172.21.15.12:0/1361363214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91081049c0 msgr2=0x7f910819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f9106ffd640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91081049c0 0x7f910819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f9106ffd640 1 -- 172.21.15.12:0/1361363214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910819f660 con 0x7f9108104010 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.671+0000 7f91077fe640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9108109140 0x7f910819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.672+0000 7f9106ffd640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108104010 0x7f910819a6b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f910000c890 tx=0x7f910000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.672+0000 7f90fffff640 1 -- 172.21.15.12:0/1361363214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100004220 con 0x7f9108104010 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.672+0000 7f910d2a7640 1 -- 172.21.15.12:0/1361363214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910819f950 con 0x7f9108104010 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.672+0000 7f90fffff640 1 -- 172.21.15.12:0/1361363214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91000043c0 con 0x7f9108104010 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.672+0000 7f90fffff640 1 -- 172.21.15.12:0/1361363214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100004a00 con 0x7f9108104010 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.672+0000 7f910d2a7640 1 -- 172.21.15.12:0/1361363214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91081a7230 con 0x7f9108104010 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.673+0000 7f910d2a7640 1 -- 172.21.15.12:0/1361363214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91081043f0 con 0x7f9108104010 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.674+0000 7f90fffff640 1 -- 172.21.15.12:0/1361363214 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f91000079b0 con 0x7f9108104010 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.675+0000 7f90fffff640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90f40a3240 0x7f90f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.676+0000 7f91067fc640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90f40a3240 0x7f90f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.676+0000 7f90fffff640 1 -- 172.21.15.12:0/1361363214 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f91000cfd50 con 0x7f9108104010 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.676+0000 7f91067fc640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90f40a3240 0x7f90f40a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009230 tx=0x7f90f00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.679+0000 7f90fffff640 1 -- 172.21.15.12:0/1361363214 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9100014030 con 0x7f9108104010 2024-09-16T01:04:38.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:38 smithi012 ceph-mon[31197]: pgmap v466: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T01:04:38.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.858+0000 7f910d2a7640 1 -- 172.21.15.12:0/1361363214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f910810c3e0 con 0x7f9108104010 2024-09-16T01:04:38.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.860+0000 7f90fffff640 1 -- 172.21.15.12:0/1361363214 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24678 (secure 0 0 0) 0x7f910009c710 con 0x7f9108104010 2024-09-16T01:04:38.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-16T01:04:38.861 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"9a476aac-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:50:45.145349+0000","modified":"2024-09-16T01:00:45.617096+0000","last_up_change":"2024-09-16T00:57:45.168610+0000","last_in_change":"2024-09-16T00:57:21.440967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:53:57.343965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T00:58:32.985046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T00:58:35.488668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T00:58:42.009484+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23b4eba0-9c04-4fa9-b8fb-73e21c94d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6803","nonce":363081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6805","nonce":363081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6809","nonce":363081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":363081419},{"type":"v1","addr":"172.21.15.12:6807","nonce":363081419}]},"public_addr":"172.21.15.12:6803/363081419","cluster_addr":"172.21.15.12:6805/363081419","heartbeat_back_addr":"172.21.15.12:6809/363081419","heartbeat_front_addr":"172.21.15.12:6807/363081419","state":["exists","up"]},{"osd":1,"uuid":"bc043dbf-d80e-4a37-b9c1-f54359868df5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6801","nonce":1011366493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6803","nonce":1011366493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6807","nonce":1011366493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1011366493},{"type":"v1","addr":"172.21.15.98:6805","nonce":1011366493}]},"public_addr":"172.21.15.98:6801/1011366493","cluster_addr":"172.21.15.98:6803/1011366493","heartbeat_back_addr":"172.21.15.98:6807/1011366493","heartbeat_front_addr":"172.21.15.98:6805/1011366493","state":["exists","up"]},{"osd":2,"uuid":"3e24aa9f-c324-40d0-9cef-1bdc211e0eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6801","nonce":3491429477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6803","nonce":3491429477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6807","nonce":3491429477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3491429477},{"type":"v1","addr":"172.21.15.119:6805","nonce":3491429477}]},"public_addr":"172.21.15.119:6801/3491429477","cluster_addr":"172.21.15.119:6803/3491429477","heartbeat_back_addr":"172.21.15.119:6807/3491429477","heartbeat_front_addr":"172.21.15.119:6805/3491429477","state":["exists","up"]},{"osd":3,"uuid":"e860e2c0-5765-406a-837e-cccb8b2ef8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6811","nonce":1376341190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6813","nonce":1376341190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6817","nonce":1376341190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1376341190},{"type":"v1","addr":"172.21.15.12:6815","nonce":1376341190}]},"public_addr":"172.21.15.12:6811/1376341190","cluster_addr":"172.21.15.12:6813/1376341190","heartbeat_back_addr":"172.21.15.12:6817/1376341190","heartbeat_front_addr":"172.21.15.12:6815/1376341190","state":["exists","up"]},{"osd":4,"uuid":"95ab617c-cff5-4bf9-9429-cba8e3da1d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6809","nonce":4152065816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6811","nonce":4152065816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6815","nonce":4152065816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4152065816},{"type":"v1","addr":"172.21.15.98:6813","nonce":4152065816}]},"public_addr":"172.21.15.98:6809/4152065816","cluster_addr":"172.21.15.98:6811/4152065816","heartbeat_back_addr":"172.21.15.98:6815/4152065816","heartbeat_front_addr":"172.21.15.98:6813/4152065816","state":["exists","up"]},{"osd":5,"uuid":"6524ca6c-c07a-497c-a034-8ad6055ca487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6809","nonce":2310752755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6811","nonce":2310752755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6815","nonce":2310752755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2310752755},{"type":"v1","addr":"172.21.15.119:6813","nonce":2310752755}]},"public_addr":"172.21.15.119:6809/2310752755","cluster_addr":"172.21.15.119:6811/2310752755","heartbeat_back_addr":"172.21.15.119:6815/2310752755","heartbeat_front_addr":"172.21.15.119:6813/2310752755","state":["exists","up"]},{"osd":6,"uuid":"575ceec2-6940-445f-87c3-1986e9efaf50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6819","nonce":2023873518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6821","nonce":2023873518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6825","nonce":2023873518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2023873518},{"type":"v1","addr":"172.21.15.12:6823","nonce":2023873518}]},"public_addr":"172.21.15.12:6819/2023873518","cluster_addr":"172.21.15.12:6821/2023873518","heartbeat_back_addr":"172.21.15.12:6825/2023873518","heartbeat_front_addr":"172.21.15.12:6823/2023873518","state":["exists","up"]},{"osd":7,"uuid":"7bbbdc0e-928f-4288-b7c3-c11d797dafc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6817","nonce":4018048637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6819","nonce":4018048637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6823","nonce":4018048637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":4018048637},{"type":"v1","addr":"172.21.15.98:6821","nonce":4018048637}]},"public_addr":"172.21.15.98:6817/4018048637","cluster_addr":"172.21.15.98:6819/4018048637","heartbeat_back_addr":"172.21.15.98:6823/4018048637","heartbeat_front_addr":"172.21.15.98:6821/4018048637","state":["exists","up"]},{"osd":8,"uuid":"5bf5d5ca-7917-4956-bca7-20126befb69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6817","nonce":1727447871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6819","nonce":1727447871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6823","nonce":1727447871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1727447871},{"type":"v1","addr":"172.21.15.119:6821","nonce":1727447871}]},"public_addr":"172.21.15.119:6817/1727447871","cluster_addr":"172.21.15.119:6819/1727447871","heartbeat_back_addr":"172.21.15.119:6823/1727447871","heartbeat_front_addr":"172.21.15.119:6821/1727447871","state":["exists","up"]},{"osd":9,"uuid":"13e32644-63a4-4a41-8eb7-36955407891c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6827","nonce":646713448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6829","nonce":646713448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6833","nonce":646713448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":646713448},{"type":"v1","addr":"172.21.15.12:6831","nonce":646713448}]},"public_addr":"172.21.15.12:6827/646713448","cluster_addr":"172.21.15.12:6829/646713448","heartbeat_back_addr":"172.21.15.12:6833/646713448","heartbeat_front_addr":"172.21.15.12:6831/646713448","state":["exists","up"]},{"osd":10,"uuid":"2f128201-841b-47a9-84ca-d116ed049062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6825","nonce":4044449416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6827","nonce":4044449416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6831","nonce":4044449416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4044449416},{"type":"v1","addr":"172.21.15.98:6829","nonce":4044449416}]},"public_addr":"172.21.15.98:6825/4044449416","cluster_addr":"172.21.15.98:6827/4044449416","heartbeat_back_addr":"172.21.15.98:6831/4044449416","heartbeat_front_addr":"172.21.15.98:6829/4044449416","state":["exists","up"]},{"osd":11,"uuid":"182d2b8d-ac09-47d4-8bea-716de07f7c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6825","nonce":4062307393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6827","nonce":4062307393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6831","nonce":4062307393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4062307393},{"type":"v1","addr":"172.21.15.119:6829","nonce":4062307393}]},"public_addr":"172.21.15.119:6825/4062307393","cluster_addr":"172.21.15.119:6827/4062307393","heartbeat_back_addr":"172.21.15.119:6831/4062307393","heartbeat_front_addr":"172.21.15.119:6829/4062307393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:05.126939+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:30.027820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:53:54.459704+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:19.551189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:44.923766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:10.657800+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:35.806689+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:00.645527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:26.197861+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:52.120980+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:17.683675+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:43.281007+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2197597102":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/2549589240":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6801/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/570072659":"2024-09-17T00:51:42.808843+0000","172.21.15.12:6800/1863535251":"2024-09-17T00:51:42.808843+0000","172.21.15.12:0/1710824695":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/4246888310":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6801/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:6800/3324219193":"2024-09-17T00:51:19.512115+0000","172.21.15.12:0/2420216586":"2024-09-17T00:51:19.512115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:04:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 -- 172.21.15.12:0/1361363214 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90f40a3240 msgr2=0x7f90f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90f40a3240 0x7f90f40a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009230 tx=0x7f90f00058d0 comp rx=0 tx=0).stop 2024-09-16T01:04:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 -- 172.21.15.12:0/1361363214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108104010 msgr2=0x7f910819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108104010 0x7f910819a6b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f910000c890 tx=0x7f910000cd50 comp rx=0 tx=0).stop 2024-09-16T01:04:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 -- 172.21.15.12:0/1361363214 shutdown_connections 2024-09-16T01:04:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90f40a3240 0x7f90f40a5700 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9108109140 0x7f910819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91081049c0 0x7f910819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 --2- 172.21.15.12:0/1361363214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9108104010 0x7f910819a6b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:38.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 -- 172.21.15.12:0/1361363214 >> 172.21.15.12:0/1361363214 conn(0x7f91080ffa50 msgr2=0x7f9108100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:38.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 -- 172.21.15.12:0/1361363214 shutdown_connections 2024-09-16T01:04:38.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:38.862+0000 7f910d2a7640 1 -- 172.21.15.12:0/1361363214 wait complete. 2024-09-16T01:04:39.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:38 smithi119 ceph-mon[35049]: pgmap v466: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T01:04:39.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:38 smithi098 ceph-mon[35346]: pgmap v466: 129 pgs: 129 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T01:04:39.687 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-16T01:04:39.950 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:40.073 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:39 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1361363214' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:04:40.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:39 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1361363214' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:04:40.197 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:39 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1361363214' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:04:40.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.439+0000 7f2126efe640 1 -- 172.21.15.12:0/3396013437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2120102790 msgr2=0x7f21201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.439+0000 7f2126efe640 1 --2- 172.21.15.12:0/3396013437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2120102790 0x7f21201067e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2108009900 tx=0x7f210802a410 comp rx=0 tx=0).stop 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.439+0000 7f2126efe640 1 -- 172.21.15.12:0/3396013437 shutdown_connections 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.439+0000 7f2126efe640 1 --2- 172.21.15.12:0/3396013437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2120106f10 0x7f212010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.439+0000 7f2126efe640 1 --2- 172.21.15.12:0/3396013437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2120102790 0x7f21201067e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.439+0000 7f2126efe640 1 --2- 172.21.15.12:0/3396013437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2120101de0 0x7f21201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.439+0000 7f2126efe640 1 -- 172.21.15.12:0/3396013437 >> 172.21.15.12:0/3396013437 conn(0x7f21200fd8c0 msgr2=0x7f21200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.439+0000 7f2126efe640 1 -- 172.21.15.12:0/3396013437 shutdown_connections 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.439+0000 7f2126efe640 1 -- 172.21.15.12:0/3396013437 wait complete. 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.439+0000 7f2126efe640 1 Processor -- start 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2126efe640 1 -- start start 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2126efe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2120101de0 0x7f21200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2126efe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2120102790 0x7f2120074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2126efe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2120106f10 0x7f2120074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2126efe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2120111f30 con 0x7f2120101de0 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2126efe640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2120111db0 con 0x7f2120106f10 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2126efe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f21201120b0 con 0x7f2120102790 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2124c9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2120101de0 0x7f21200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2124c9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2120101de0 0x7f21200744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46306/0 (socket says 172.21.15.12:46306) 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2124c9a640 1 -- 172.21.15.12:0/1475308291 learned_addr learned my addr 172.21.15.12:0/1475308291 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f212549b640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2120106f10 0x7f2120074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f211ffff640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2120102790 0x7f2120074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2124c9a640 1 -- 172.21.15.12:0/1475308291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2120102790 msgr2=0x7f2120074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2124c9a640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2120102790 0x7f2120074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2124c9a640 1 -- 172.21.15.12:0/1475308291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2120106f10 msgr2=0x7f2120074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:40.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2124c9a640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2120106f10 0x7f2120074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2124c9a640 1 -- 172.21.15.12:0/1475308291 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21201a68f0 con 0x7f2120101de0 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f211ffff640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2120102790 0x7f2120074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.440+0000 7f2124c9a640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2120101de0 0x7f21200744f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f211000d950 tx=0x7f211000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.441+0000 7f211dffb640 1 -- 172.21.15.12:0/1475308291 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110017070 con 0x7f2120101de0 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.441+0000 7f211dffb640 1 -- 172.21.15.12:0/1475308291 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2110009c30 con 0x7f2120101de0 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.441+0000 7f2126efe640 1 -- 172.21.15.12:0/1475308291 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21201a6be0 con 0x7f2120101de0 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.441+0000 7f211dffb640 1 -- 172.21.15.12:0/1475308291 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211000f6b0 con 0x7f2120101de0 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.441+0000 7f2126efe640 1 -- 172.21.15.12:0/1475308291 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21201a7120 con 0x7f2120101de0 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.442+0000 7f2126efe640 1 -- 172.21.15.12:0/1475308291 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21201021c0 con 0x7f2120101de0 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.443+0000 7f211dffb640 1 -- 172.21.15.12:0/1475308291 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f21100109d0 con 0x7f2120101de0 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.444+0000 7f211dffb640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f210c0a3240 0x7f210c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.444+0000 7f211ffff640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f210c0a3240 0x7f210c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.444+0000 7f211dffb640 1 -- 172.21.15.12:0/1475308291 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9100+0+0 (secure 0 0 0) 0x7f21100cf8e0 con 0x7f2120101de0 2024-09-16T01:04:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.444+0000 7f211ffff640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f210c0a3240 0x7f210c0a5700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2120075f80 tx=0x7f2108005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.448+0000 7f211dffb640 1 -- 172.21.15.12:0/1475308291 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2110009de0 con 0x7f2120101de0 2024-09-16T01:04:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.659+0000 7f2126efe640 1 -- 172.21.15.12:0/1475308291 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2120109b60 con 0x7f2120101de0 2024-09-16T01:04:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.661+0000 7f211dffb640 1 -- 172.21.15.12:0/1475308291 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f211009c240 con 0x7f2120101de0 2024-09-16T01:04:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:04:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.663+0000 7f2126efe640 1 -- 172.21.15.12:0/1475308291 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f210c0a3240 msgr2=0x7f210c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.663+0000 7f2126efe640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f210c0a3240 0x7f210c0a5700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2120075f80 tx=0x7f2108005a20 comp rx=0 tx=0).stop 2024-09-16T01:04:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.663+0000 7f2126efe640 1 -- 172.21.15.12:0/1475308291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2120101de0 msgr2=0x7f21200744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.663+0000 7f2126efe640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2120101de0 0x7f21200744f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f211000d950 tx=0x7f211000de10 comp rx=0 tx=0).stop 2024-09-16T01:04:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.664+0000 7f2126efe640 1 -- 172.21.15.12:0/1475308291 shutdown_connections 2024-09-16T01:04:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.664+0000 7f2126efe640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f210c0a3240 0x7f210c0a5700 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.664+0000 7f2126efe640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2120106f10 0x7f2120074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.664+0000 7f2126efe640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2120102790 0x7f2120074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.664+0000 7f2126efe640 1 --2- 172.21.15.12:0/1475308291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2120101de0 0x7f21200744f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.664+0000 7f2126efe640 1 -- 172.21.15.12:0/1475308291 >> 172.21.15.12:0/1475308291 conn(0x7f21200fd8c0 msgr2=0x7f21200fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.664+0000 7f2126efe640 1 -- 172.21.15.12:0/1475308291 shutdown_connections 2024-09-16T01:04:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:40.664+0000 7f2126efe640 1 -- 172.21.15.12:0/1475308291 wait complete. 2024-09-16T01:04:40.963 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b[65547]: ignoring --setuser ceph since I am not root 2024-09-16T01:04:40.963 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b[65547]: ignoring --setgroup ceph since I am not root 2024-09-16T01:04:40.963 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mds[65551]: -- 172.21.15.98:0/3012000798 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a45f00f860 con 0x55a45efec800 2024-09-16T01:04:40.963 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b[65547]: starting mds.b at 2024-09-16T01:04:40.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e[64928]: ignoring --setuser ceph since I am not root 2024-09-16T01:04:40.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e[64928]: ignoring --setgroup ceph since I am not root 2024-09-16T01:04:40.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mds[64932]: -- 172.21.15.98:0/3057569036 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5633e51cf860 con 0x5633e51ad400 2024-09-16T01:04:40.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e[64928]: starting mds.e at 2024-09-16T01:04:40.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mon[35346]: pgmap v467: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:04:40.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1475308291' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-16T01:04:40.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mon[35346]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T01:04:40.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mon[35346]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:04:40.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1475308291' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-16T01:04:40.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mon[35346]: osdmap e90: 12 total, 12 up, 12 in 2024-09-16T01:04:40.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mon[35346]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-16T01:04:40.964 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h[65234]: ignoring --setuser ceph since I am not root 2024-09-16T01:04:40.965 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h[65234]: ignoring --setgroup ceph since I am not root 2024-09-16T01:04:40.965 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mds[65238]: -- 172.21.15.98:0/359460580 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b8ce0c1860 con 0x55b8ce09f000 2024-09-16T01:04:40.965 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h[65234]: starting mds.h at 2024-09-16T01:04:40.965 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k[64625]: ignoring --setuser ceph since I am not root 2024-09-16T01:04:40.965 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k[64625]: ignoring --setgroup ceph since I am not root 2024-09-16T01:04:40.965 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-mds[64629]: -- 172.21.15.98:0/2306382746 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ddb2d7f860 con 0x55ddb2d5d400 2024-09-16T01:04:40.965 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 01:04:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k[64625]: starting mds.k at 2024-09-16T01:04:41.028 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a[69737]: ignoring --setuser ceph since I am not root 2024-09-16T01:04:41.028 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a[69737]: ignoring --setgroup ceph since I am not root 2024-09-16T01:04:41.028 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-mds[69754]: -- 172.21.15.12:0/3179743067 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55feecc1b860 con 0x55feecbf8800 2024-09-16T01:04:41.029 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a[69737]: starting mds.a at 2024-09-16T01:04:41.029 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-g[69412]: ignoring --setuser ceph since I am not root 2024-09-16T01:04:41.029 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-g[69412]: ignoring --setgroup ceph since I am not root 2024-09-16T01:04:41.029 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-mds[69420]: -- 172.21.15.12:0/3072893011 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564432a83c20 con 0x564432a61400 2024-09-16T01:04:41.029 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-g[69412]: starting mds.g at 2024-09-16T01:04:41.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a[31193]: 2024-09-16T01:04:40.660+0000 7fde1610d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:04:41.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-mon[31197]: pgmap v467: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:04:41.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1475308291' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-16T01:04:41.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-mon[31197]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T01:04:41.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-mon[31197]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:04:41.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1475308291' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-16T01:04:41.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-mon[31197]: osdmap e90: 12 total, 12 up, 12 in 2024-09-16T01:04:41.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:40 smithi012 ceph-mon[31197]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-16T01:04:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mon[35049]: pgmap v467: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:04:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1475308291' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-16T01:04:41.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mon[35049]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T01:04:41.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mon[35049]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:04:41.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1475308291' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-16T01:04:41.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mon[35049]: osdmap e90: 12 total, 12 up, 12 in 2024-09-16T01:04:41.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mon[35049]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-16T01:04:41.097 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c[65082]: ignoring --setuser ceph since I am not root 2024-09-16T01:04:41.097 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c[65082]: ignoring --setgroup ceph since I am not root 2024-09-16T01:04:41.097 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mds[65086]: -- 172.21.15.119:0/3703166769 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55da485d7c20 con 0x55da485b5000 2024-09-16T01:04:41.097 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c[65082]: starting mds.c at 2024-09-16T01:04:41.098 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l[64477]: ignoring --setuser ceph since I am not root 2024-09-16T01:04:41.098 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l[64477]: ignoring --setgroup ceph since I am not root 2024-09-16T01:04:41.098 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mds[64481]: -- 172.21.15.119:0/2210097138 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e011ba5860 con 0x55e011b83400 2024-09-16T01:04:41.098 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l[64477]: starting mds.l at 2024-09-16T01:04:41.098 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f[64779]: ignoring --setuser ceph since I am not root 2024-09-16T01:04:41.098 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f[64779]: ignoring --setgroup ceph since I am not root 2024-09-16T01:04:41.098 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mds[64783]: -- 172.21.15.119:0/2428010597 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5558c831b860 con 0x5558c82f8800 2024-09-16T01:04:41.098 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f[64779]: starting mds.f at 2024-09-16T01:04:41.099 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-i[65383]: ignoring --setuser ceph since I am not root 2024-09-16T01:04:41.099 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-i[65383]: ignoring --setgroup ceph since I am not root 2024-09-16T01:04:41.099 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-mds[65387]: -- 172.21.15.119:0/1967138822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5611194ed860 con 0x5611194ca800 2024-09-16T01:04:41.099 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 01:04:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-i[65383]: starting mds.i at 2024-09-16T01:04:41.501 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:04:41.770 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.271+0000 7fdb351fc640 1 -- 172.21.15.12:0/405577260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb30106f10 msgr2=0x7fdb3010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.271+0000 7fdb351fc640 1 --2- 172.21.15.12:0/405577260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb30106f10 0x7fdb3010ea90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009ca0 tx=0x7fdb2802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.271+0000 7fdb351fc640 1 -- 172.21.15.12:0/405577260 shutdown_connections 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.271+0000 7fdb351fc640 1 --2- 172.21.15.12:0/405577260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb30106f10 0x7fdb3010ea90 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.271+0000 7fdb351fc640 1 --2- 172.21.15.12:0/405577260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb30102790 0x7fdb301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.271+0000 7fdb351fc640 1 --2- 172.21.15.12:0/405577260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb30101de0 0x7fdb301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.271+0000 7fdb351fc640 1 -- 172.21.15.12:0/405577260 >> 172.21.15.12:0/405577260 conn(0x7fdb300fd8c0 msgr2=0x7fdb300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.271+0000 7fdb351fc640 1 -- 172.21.15.12:0/405577260 shutdown_connections 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.271+0000 7fdb351fc640 1 -- 172.21.15.12:0/405577260 wait complete. 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.272+0000 7fdb351fc640 1 Processor -- start 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.272+0000 7fdb351fc640 1 -- start start 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.272+0000 7fdb351fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb30101de0 0x7fdb30198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.272+0000 7fdb351fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb30102790 0x7fdb30198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.272+0000 7fdb351fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb30106f10 0x7fdb3019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.272+0000 7fdb351fc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdb30111f70 con 0x7fdb30102790 2024-09-16T01:04:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.272+0000 7fdb351fc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdb30111df0 con 0x7fdb30101de0 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.272+0000 7fdb351fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb301120f0 con 0x7fdb30106f10 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb30102790 0x7fdb30198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb30101de0 0x7fdb30198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb30102790 0x7fdb30198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46352/0 (socket says 172.21.15.12:46352) 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2e59c640 1 -- 172.21.15.12:0/1516269746 learned_addr learned my addr 172.21.15.12:0/1516269746 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2f59e640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb30106f10 0x7fdb3019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2e59c640 1 -- 172.21.15.12:0/1516269746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb30106f10 msgr2=0x7fdb3019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2e59c640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb30106f10 0x7fdb3019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2e59c640 1 -- 172.21.15.12:0/1516269746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb30101de0 msgr2=0x7fdb30198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2e59c640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb30101de0 0x7fdb30198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2e59c640 1 -- 172.21.15.12:0/1516269746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3019d2e0 con 0x7fdb30102790 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2f59e640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb30106f10 0x7fdb3019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:04:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2ed9d640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb30101de0 0x7fdb30198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb2e59c640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb30102790 0x7fdb30198870 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c890 tx=0x7fdb2400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.273+0000 7fdb17fff640 1 -- 172.21.15.12:0/1516269746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24004220 con 0x7fdb30102790 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.274+0000 7fdb351fc640 1 -- 172.21.15.12:0/1516269746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb3019d5d0 con 0x7fdb30102790 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.274+0000 7fdb17fff640 1 -- 172.21.15.12:0/1516269746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb240043c0 con 0x7fdb30102790 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.274+0000 7fdb17fff640 1 -- 172.21.15.12:0/1516269746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24004a00 con 0x7fdb30102790 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.274+0000 7fdb351fc640 1 -- 172.21.15.12:0/1516269746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb301a4eb0 con 0x7fdb30102790 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.275+0000 7fdb351fc640 1 -- 172.21.15.12:0/1516269746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb301021c0 con 0x7fdb30102790 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.276+0000 7fdb17fff640 1 -- 172.21.15.12:0/1516269746 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdb240079b0 con 0x7fdb30102790 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.277+0000 7fdb17fff640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdb180a3240 0x7fdb180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.277+0000 7fdb2ed9d640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdb180a3240 0x7fdb180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.277+0000 7fdb17fff640 1 -- 172.21.15.12:0/1516269746 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9530+0+0 (secure 0 0 0) 0x7fdb240cfda0 con 0x7fdb30102790 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.277+0000 7fdb2ed9d640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdb180a3240 0x7fdb180a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000afb0 tx=0x7fdb2000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.280+0000 7fdb17fff640 1 -- 172.21.15.12:0/1516269746 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb24014030 con 0x7fdb30102790 2024-09-16T01:04:42.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:42.496+0000 7fdb351fc640 1 -- 172.21.15.12:0/1516269746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdb3002d7c0 con 0x7fdb30102790 2024-09-16T01:04:42.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: pgmap v469: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-16T01:04:42.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.12:6838/2275223752,v1:172.21.15.12:6840/2275223752] up:boot 2024-09-16T01:04:42.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.12:6839/817557370,v1:172.21.15.12:6841/817557370] up:boot 2024-09-16T01:04:42.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6832/2878363091,v1:172.21.15.98:6833/2878363091] up:boot 2024-09-16T01:04:42.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.119:6832/3959132842,v1:172.21.15.119:6834/3959132842] up:boot 2024-09-16T01:04:42.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.119:6833/2504095640,v1:172.21.15.119:6835/2504095640] up:boot 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6834/673281613,v1:172.21.15.98:6835/673281613] up:boot 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.119:6836/3045781739,v1:172.21.15.119:6838/3045781739] up:boot 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.119:6837/2932108069,v1:172.21.15.119:6839/2932108069] up:boot 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6836/1816798412,v1:172.21.15.98:6837/1816798412] up:boot 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: mds.? [v2:172.21.15.98:6838/3841502528,v1:172.21.15.98:6839/3841502528] up:boot 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:04:42.858 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:04:42.859 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:04:42.859 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:04:42.859 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:04:42.859 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:04:42.859 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:04:42.859 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:04:42.859 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:42 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1516269746' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:04:42.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: pgmap v469: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.12:6838/2275223752,v1:172.21.15.12:6840/2275223752] up:boot 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.12:6839/817557370,v1:172.21.15.12:6841/817557370] up:boot 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6832/2878363091,v1:172.21.15.98:6833/2878363091] up:boot 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.119:6832/3959132842,v1:172.21.15.119:6834/3959132842] up:boot 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.119:6833/2504095640,v1:172.21.15.119:6835/2504095640] up:boot 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6834/673281613,v1:172.21.15.98:6835/673281613] up:boot 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.119:6836/3045781739,v1:172.21.15.119:6838/3045781739] up:boot 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.119:6837/2932108069,v1:172.21.15.119:6839/2932108069] up:boot 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6836/1816798412,v1:172.21.15.98:6837/1816798412] up:boot 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: mds.? [v2:172.21.15.98:6838/3841502528,v1:172.21.15.98:6839/3841502528] up:boot 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:04:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:04:42.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:42 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1516269746' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: pgmap v469: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.12:6838/2275223752,v1:172.21.15.12:6840/2275223752] up:boot 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.12:6839/817557370,v1:172.21.15.12:6841/817557370] up:boot 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6832/2878363091,v1:172.21.15.98:6833/2878363091] up:boot 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.119:6832/3959132842,v1:172.21.15.119:6834/3959132842] up:boot 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.119:6833/2504095640,v1:172.21.15.119:6835/2504095640] up:boot 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6834/673281613,v1:172.21.15.98:6835/673281613] up:boot 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.119:6836/3045781739,v1:172.21.15.119:6838/3045781739] up:boot 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.119:6837/2932108069,v1:172.21.15.119:6839/2932108069] up:boot 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6836/1816798412,v1:172.21.15.98:6837/1816798412] up:boot 2024-09-16T01:04:43.097 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: mds.? [v2:172.21.15.98:6838/3841502528,v1:172.21.15.98:6839/3841502528] up:boot 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:04:43.098 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:04:43.099 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='mgr.14150 172.21.15.12:0/3148409073' entity='mgr.x' 2024-09-16T01:04:43.099 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:42 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1516269746' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:04:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.235+0000 7fdb17fff640 1 -- 172.21.15.12:0/1516269746 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7fdb2409c5b0 con 0x7fdb30102790 2024-09-16T01:04:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 -- 172.21.15.12:0/1516269746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdb180a3240 msgr2=0x7fdb180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdb180a3240 0x7fdb180a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000afb0 tx=0x7fdb2000a2d0 comp rx=0 tx=0).stop 2024-09-16T01:04:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 -- 172.21.15.12:0/1516269746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb30102790 msgr2=0x7fdb30198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb30102790 0x7fdb30198870 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c890 tx=0x7fdb2400cc90 comp rx=0 tx=0).stop 2024-09-16T01:04:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 -- 172.21.15.12:0/1516269746 shutdown_connections 2024-09-16T01:04:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fdb180a3240 0x7fdb180a5700 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb30106f10 0x7fdb3019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:43.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb30102790 0x7fdb30198870 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:43.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 --2- 172.21.15.12:0/1516269746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb30101de0 0x7fdb30198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:43.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 -- 172.21.15.12:0/1516269746 >> 172.21.15.12:0/1516269746 conn(0x7fdb300fd8c0 msgr2=0x7fdb300febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:43.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 -- 172.21.15.12:0/1516269746 shutdown_connections 2024-09-16T01:04:43.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:43.237+0000 7fdb351fc640 1 -- 172.21.15.12:0/1516269746 wait complete. 2024-09-16T01:04:43.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:43 smithi012 ceph-mon[31197]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T01:04:43.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:43 smithi012 ceph-mon[31197]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T01:04:43.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:43 smithi012 ceph-mon[31197]: Cluster is now healthy 2024-09-16T01:04:43.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:43 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/1516269746' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:04:43.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:43 smithi012 ceph-mon[31197]: fsmap 12 up:standby 2024-09-16T01:04:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:43 smithi098 ceph-mon[35346]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T01:04:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:43 smithi098 ceph-mon[35346]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T01:04:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:43 smithi098 ceph-mon[35346]: Cluster is now healthy 2024-09-16T01:04:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:43 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/1516269746' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:04:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:43 smithi098 ceph-mon[35346]: fsmap 12 up:standby 2024-09-16T01:04:43.986 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:04:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:43 smithi119 ceph-mon[35049]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T01:04:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:43 smithi119 ceph-mon[35049]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T01:04:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:43 smithi119 ceph-mon[35049]: Cluster is now healthy 2024-09-16T01:04:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:43 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/1516269746' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:04:44.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:43 smithi119 ceph-mon[35049]: fsmap 12 up:standby 2024-09-16T01:04:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:44.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.749+0000 7fe1158b4640 1 -- 172.21.15.12:0/2297150541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe110100370 msgr2=0x7fe110100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.749+0000 7fe1158b4640 1 --2- 172.21.15.12:0/2297150541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe110100370 0x7fe110100750 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe100009930 tx=0x7fe10002a420 comp rx=0 tx=0).stop 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.749+0000 7fe1158b4640 1 -- 172.21.15.12:0/2297150541 shutdown_connections 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.749+0000 7fe1158b4640 1 --2- 172.21.15.12:0/2297150541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe110106fc0 0x7fe11010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.749+0000 7fe1158b4640 1 --2- 172.21.15.12:0/2297150541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe110100d20 0x7fe110106860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.749+0000 7fe1158b4640 1 --2- 172.21.15.12:0/2297150541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe110100370 0x7fe110100750 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.749+0000 7fe1158b4640 1 -- 172.21.15.12:0/2297150541 >> 172.21.15.12:0/2297150541 conn(0x7fe110077210 msgr2=0x7fe1100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.749+0000 7fe1158b4640 1 -- 172.21.15.12:0/2297150541 shutdown_connections 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.749+0000 7fe1158b4640 1 -- 172.21.15.12:0/2297150541 wait complete. 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe1158b4640 1 Processor -- start 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe1158b4640 1 -- start start 2024-09-16T01:04:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe1158b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe110100370 0x7fe110198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe1158b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe110100d20 0x7fe110198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe1158b4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe110106fc0 0x7fe11019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe1158b4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe110111fa0 con 0x7fe110100370 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe1158b4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe110111e20 con 0x7fe110106fc0 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe1158b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe110112120 con 0x7fe110100d20 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe10effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe110100370 0x7fe110198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe10effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe110100370 0x7fe110198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46370/0 (socket says 172.21.15.12:46370) 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe10effd640 1 -- 172.21.15.12:0/325535422 learned_addr learned my addr 172.21.15.12:0/325535422 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe10f7fe640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe110106fc0 0x7fe11019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe10e7fc640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe110100d20 0x7fe110198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe10effd640 1 -- 172.21.15.12:0/325535422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe110100d20 msgr2=0x7fe110198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe10effd640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe110100d20 0x7fe110198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe10effd640 1 -- 172.21.15.12:0/325535422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe110106fc0 msgr2=0x7fe11019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.750+0000 7fe10effd640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe110106fc0 0x7fe11019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.751+0000 7fe10effd640 1 -- 172.21.15.12:0/325535422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11019d3b0 con 0x7fe110100370 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.751+0000 7fe10f7fe640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe110106fc0 0x7fe11019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.751+0000 7fe10effd640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe110100370 0x7fe110198400 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe100009230 tx=0x7fe100004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.751+0000 7fe1148b2640 1 -- 172.21.15.12:0/325535422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10003f030 con 0x7fe110100370 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.751+0000 7fe1148b2640 1 -- 172.21.15.12:0/325535422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe100003ad0 con 0x7fe110100370 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.751+0000 7fe1158b4640 1 -- 172.21.15.12:0/325535422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11019d640 con 0x7fe110100370 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.751+0000 7fe1148b2640 1 -- 172.21.15.12:0/325535422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe100035070 con 0x7fe110100370 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.751+0000 7fe1158b4640 1 -- 172.21.15.12:0/325535422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1101a4f80 con 0x7fe110100370 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.752+0000 7fe1158b4640 1 -- 172.21.15.12:0/325535422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe110103430 con 0x7fe110100370 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.753+0000 7fe1148b2640 1 -- 172.21.15.12:0/325535422 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe100042030 con 0x7fe110100370 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.754+0000 7fe1148b2640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe0f80a3240 0x7fe0f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.754+0000 7fe10e7fc640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe0f80a3240 0x7fe0f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.754+0000 7fe1148b2640 1 -- 172.21.15.12:0/325535422 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9530+0+0 (secure 0 0 0) 0x7fe1000f03d0 con 0x7fe110100370 2024-09-16T01:04:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.755+0000 7fe10e7fc640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe0f80a3240 0x7fe0f80a5700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe1100ff810 tx=0x7fe10400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.759+0000 7fe1148b2640 1 -- 172.21.15.12:0/325535422 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe1000bcbe0 con 0x7fe110100370 2024-09-16T01:04:44.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:44 smithi012 ceph-mon[31197]: pgmap v470: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-16T01:04:44.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:44.934+0000 7fe1158b4640 1 -- 172.21.15.12:0/325535422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe11010a100 con 0x7fe110100370 2024-09-16T01:04:44.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:44 smithi098 ceph-mon[35346]: pgmap v470: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-16T01:04:45.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:44 smithi119 ceph-mon[35049]: pgmap v470: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-16T01:04:45.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.678+0000 7fe1148b2640 1 -- 172.21.15.12:0/325535422 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7fe1000bc4e0 con 0x7fe110100370 2024-09-16T01:04:45.679 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:04:45.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.682+0000 7fe1158b4640 1 -- 172.21.15.12:0/325535422 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe0f80a3240 msgr2=0x7fe0f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:45.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.682+0000 7fe1158b4640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe0f80a3240 0x7fe0f80a5700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe1100ff810 tx=0x7fe10400a4c0 comp rx=0 tx=0).stop 2024-09-16T01:04:45.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.682+0000 7fe1158b4640 1 -- 172.21.15.12:0/325535422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe110100370 msgr2=0x7fe110198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:45.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.682+0000 7fe1158b4640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe110100370 0x7fe110198400 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe100009230 tx=0x7fe100004270 comp rx=0 tx=0).stop 2024-09-16T01:04:45.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.683+0000 7fe1158b4640 1 -- 172.21.15.12:0/325535422 shutdown_connections 2024-09-16T01:04:45.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.683+0000 7fe1158b4640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7fe0f80a3240 0x7fe0f80a5700 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:45.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.683+0000 7fe1158b4640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe110106fc0 0x7fe11019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:45.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.683+0000 7fe1158b4640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe110100d20 0x7fe110198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:45.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.683+0000 7fe1158b4640 1 --2- 172.21.15.12:0/325535422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe110100370 0x7fe110198400 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:45.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.683+0000 7fe1158b4640 1 -- 172.21.15.12:0/325535422 >> 172.21.15.12:0/325535422 conn(0x7fe110077210 msgr2=0x7fe1100fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:45.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.683+0000 7fe1158b4640 1 -- 172.21.15.12:0/325535422 shutdown_connections 2024-09-16T01:04:45.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:45.684+0000 7fe1158b4640 1 -- 172.21.15.12:0/325535422 wait complete. 2024-09-16T01:04:45.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:45 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/325535422' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:04:46.075 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:45 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/325535422' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:04:46.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:45 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/325535422' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:04:46.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:04:46.805 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:46.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:46 smithi012 ceph-mon[31197]: pgmap v471: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 8 op/s 2024-09-16T01:04:46.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:46 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/325535422' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:04:46.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:46 smithi012 ceph-mon[31197]: osdmap e91: 12 total, 12 up, 12 in 2024-09-16T01:04:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:46 smithi098 ceph-mon[35346]: pgmap v471: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 8 op/s 2024-09-16T01:04:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:46 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/325535422' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:04:46.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:46 smithi098 ceph-mon[35346]: osdmap e91: 12 total, 12 up, 12 in 2024-09-16T01:04:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:46 smithi119 ceph-mon[35049]: pgmap v471: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 307 B/s wr, 8 op/s 2024-09-16T01:04:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:46 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/325535422' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:04:47.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:46 smithi119 ceph-mon[35049]: osdmap e91: 12 total, 12 up, 12 in 2024-09-16T01:04:47.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.284+0000 7f90f2e3b640 1 -- 172.21.15.12:0/682576288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec102790 msgr2=0x7f90ec1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:47.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.284+0000 7f90f2e3b640 1 --2- 172.21.15.12:0/682576288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec102790 0x7f90ec1067e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009900 tx=0x7f90d802a410 comp rx=0 tx=0).stop 2024-09-16T01:04:47.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.284+0000 7f90f2e3b640 1 -- 172.21.15.12:0/682576288 shutdown_connections 2024-09-16T01:04:47.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.284+0000 7f90f2e3b640 1 --2- 172.21.15.12:0/682576288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90ec106f10 0x7f90ec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:47.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.284+0000 7f90f2e3b640 1 --2- 172.21.15.12:0/682576288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec102790 0x7f90ec1067e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.284+0000 7f90f2e3b640 1 --2- 172.21.15.12:0/682576288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ec101de0 0x7f90ec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.284+0000 7f90f2e3b640 1 -- 172.21.15.12:0/682576288 >> 172.21.15.12:0/682576288 conn(0x7f90ec0fd8c0 msgr2=0x7f90ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.284+0000 7f90f2e3b640 1 -- 172.21.15.12:0/682576288 shutdown_connections 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.284+0000 7f90f2e3b640 1 -- 172.21.15.12:0/682576288 wait complete. 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f2e3b640 1 Processor -- start 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f2e3b640 1 -- start start 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f2e3b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec101de0 0x7f90ec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f2e3b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90ec102790 0x7f90ec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f2e3b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ec106f10 0x7f90ec074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f2e3b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec111f90 con 0x7f90ec101de0 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f2e3b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec111e10 con 0x7f90ec102790 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f2e3b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec112110 con 0x7f90ec106f10 2024-09-16T01:04:47.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f0bd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec101de0 0x7f90ec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f0bd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec101de0 0x7f90ec0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37792/0 (socket says 172.21.15.12:37792) 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f0bd7640 1 -- 172.21.15.12:0/989724904 learned_addr learned my addr 172.21.15.12:0/989724904 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.285+0000 7f90f13d8640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ec106f10 0x7f90ec074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90ebfff640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90ec102790 0x7f90ec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90f0bd7640 1 -- 172.21.15.12:0/989724904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ec106f10 msgr2=0x7f90ec074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90f0bd7640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ec106f10 0x7f90ec074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90f0bd7640 1 -- 172.21.15.12:0/989724904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90ec102790 msgr2=0x7f90ec074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90f0bd7640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90ec102790 0x7f90ec074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90f0bd7640 1 -- 172.21.15.12:0/989724904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec1a69e0 con 0x7f90ec101de0 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90f13d8640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ec106f10 0x7f90ec074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90ebfff640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90ec102790 0x7f90ec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90f0bd7640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec101de0 0x7f90ec0744f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f90e000d950 tx=0x7f90e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:47.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90e9ffb640 1 -- 172.21.15.12:0/989724904 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0017070 con 0x7f90ec101de0 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90e9ffb640 1 -- 172.21.15.12:0/989724904 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90e0009c30 con 0x7f90ec101de0 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90f2e3b640 1 -- 172.21.15.12:0/989724904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ec1a6cd0 con 0x7f90ec101de0 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90e9ffb640 1 -- 172.21.15.12:0/989724904 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e000f6b0 con 0x7f90ec101de0 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.286+0000 7f90f2e3b640 1 -- 172.21.15.12:0/989724904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ec1a71c0 con 0x7f90ec101de0 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.287+0000 7f90f2e3b640 1 -- 172.21.15.12:0/989724904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ec1021c0 con 0x7f90ec101de0 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.288+0000 7f90e9ffb640 1 -- 172.21.15.12:0/989724904 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f90e00109d0 con 0x7f90ec101de0 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.289+0000 7f90e9ffb640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90dc0a3240 0x7f90dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.289+0000 7f90e9ffb640 1 -- 172.21.15.12:0/989724904 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9005+0+0 (secure 0 0 0) 0x7f90e00cf910 con 0x7f90ec101de0 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.289+0000 7f90ebfff640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90dc0a3240 0x7f90dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.290+0000 7f90ebfff640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90dc0a3240 0x7f90dc0a5700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f90d8000c00 tx=0x7f90d8032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:47.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.293+0000 7f90e9ffb640 1 -- 172.21.15.12:0/989724904 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90e0009de0 con 0x7f90ec101de0 2024-09-16T01:04:47.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.469+0000 7f90f2e3b640 1 -- 172.21.15.12:0/989724904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f90ec10a180 con 0x7f90ec101de0 2024-09-16T01:04:47.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.686+0000 7f90e9ffb640 1 -- 172.21.15.12:0/989724904 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7f90e009c330 con 0x7f90ec101de0 2024-09-16T01:04:47.687 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-16T01:04:47.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 -- 172.21.15.12:0/989724904 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90dc0a3240 msgr2=0x7f90dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:47.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90dc0a3240 0x7f90dc0a5700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f90d8000c00 tx=0x7f90d8032c70 comp rx=0 tx=0).stop 2024-09-16T01:04:47.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 -- 172.21.15.12:0/989724904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec101de0 msgr2=0x7f90ec0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:47.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec101de0 0x7f90ec0744f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f90e000d950 tx=0x7f90e000de10 comp rx=0 tx=0).stop 2024-09-16T01:04:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 -- 172.21.15.12:0/989724904 shutdown_connections 2024-09-16T01:04:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f90dc0a3240 0x7f90dc0a5700 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ec106f10 0x7f90ec074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90ec102790 0x7f90ec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 --2- 172.21.15.12:0/989724904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec101de0 0x7f90ec0744f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 -- 172.21.15.12:0/989724904 >> 172.21.15.12:0/989724904 conn(0x7f90ec0fd8c0 msgr2=0x7f90ec0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 -- 172.21.15.12:0/989724904 shutdown_connections 2024-09-16T01:04:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:47.689+0000 7f90f2e3b640 1 -- 172.21.15.12:0/989724904 wait complete. 2024-09-16T01:04:47.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:47 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/989724904' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:04:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:47 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/989724904' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:04:48.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:47 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/989724904' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:04:48.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-16T01:04:48.785 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:04:48.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:48 smithi012 ceph-mon[31197]: pgmap v473: 97 pgs: 97 active+clean; 577 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:04:48.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:48 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/989724904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:04:48.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:48 smithi012 ceph-mon[31197]: osdmap e92: 12 total, 12 up, 12 in 2024-09-16T01:04:48.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:48 smithi098 ceph-mon[35346]: pgmap v473: 97 pgs: 97 active+clean; 577 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:04:48.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:48 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/989724904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:04:48.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:48 smithi098 ceph-mon[35346]: osdmap e92: 12 total, 12 up, 12 in 2024-09-16T01:04:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:48 smithi119 ceph-mon[35049]: pgmap v473: 97 pgs: 97 active+clean; 577 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:04:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:48 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/989724904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:04:49.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:48 smithi119 ceph-mon[35049]: osdmap e92: 12 total, 12 up, 12 in 2024-09-16T01:04:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.277+0000 7f56a12ab640 1 -- 172.21.15.12:0/4245016187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f569c108290 msgr2=0x7f569c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.277+0000 7f56a12ab640 1 --2- 172.21.15.12:0/4245016187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f569c108290 0x7f569c10ec30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5694009cd0 tx=0x7f569402a8e0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.278+0000 7f56a12ab640 1 -- 172.21.15.12:0/4245016187 shutdown_connections 2024-09-16T01:04:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.278+0000 7f56a12ab640 1 --2- 172.21.15.12:0/4245016187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f569c108290 0x7f569c10ec30 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.278+0000 7f56a12ab640 1 --2- 172.21.15.12:0/4245016187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f569c103740 0x7f569c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.278+0000 7f56a12ab640 1 --2- 172.21.15.12:0/4245016187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f569c102d90 0x7f569c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.278+0000 7f56a12ab640 1 -- 172.21.15.12:0/4245016187 >> 172.21.15.12:0/4245016187 conn(0x7f569c0fc7d0 msgr2=0x7f569c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.278+0000 7f56a12ab640 1 -- 172.21.15.12:0/4245016187 shutdown_connections 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.278+0000 7f56a12ab640 1 -- 172.21.15.12:0/4245016187 wait complete. 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.278+0000 7f56a12ab640 1 Processor -- start 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.278+0000 7f56a12ab640 1 -- start start 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56a12ab640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f569c102d90 0x7f569c1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56a12ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f569c103740 0x7f569c100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56a12ab640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f569c108290 0x7f569c101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56a12ab640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f569c1120d0 con 0x7f569c103740 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56a12ab640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f569c111f50 con 0x7f569c102d90 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56a12ab640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f569c112250 con 0x7f569c108290 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56927fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f569c103740 0x7f569c100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56927fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f569c103740 0x7f569c100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37804/0 (socket says 172.21.15.12:37804) 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56927fc640 1 -- 172.21.15.12:0/3032309548 learned_addr learned my addr 172.21.15.12:0/3032309548 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-16T01:04:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f569b7fe640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f569c108290 0x7f569c101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f569affd640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f569c102d90 0x7f569c1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56927fc640 1 -- 172.21.15.12:0/3032309548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f569c108290 msgr2=0x7f569c101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56927fc640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f569c108290 0x7f569c101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56927fc640 1 -- 172.21.15.12:0/3032309548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f569c102d90 msgr2=0x7f569c1009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56927fc640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f569c102d90 0x7f569c1009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56927fc640 1 -- 172.21.15.12:0/3032309548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569c1a6a60 con 0x7f569c103740 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f569b7fe640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f569c108290 0x7f569c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f569affd640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f569c102d90 0x7f569c1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56927fc640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f569c103740 0x7f569c100f30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f568400b450 tx=0x7f568400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f5698ff9640 1 -- 172.21.15.12:0/3032309548 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684015020 con 0x7f569c103740 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f56a12ab640 1 -- 172.21.15.12:0/3032309548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569c1a6d50 con 0x7f569c103740 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.279+0000 7f5698ff9640 1 -- 172.21.15.12:0/3032309548 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5684011d70 con 0x7f569c103740 2024-09-16T01:04:49.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.280+0000 7f5698ff9640 1 -- 172.21.15.12:0/3032309548 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568400f340 con 0x7f569c103740 2024-09-16T01:04:49.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.280+0000 7f56a12ab640 1 -- 172.21.15.12:0/3032309548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f569c1a7200 con 0x7f569c103740 2024-09-16T01:04:49.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.281+0000 7f56a12ab640 1 -- 172.21.15.12:0/3032309548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569c103170 con 0x7f569c103740 2024-09-16T01:04:49.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.282+0000 7f5698ff9640 1 -- 172.21.15.12:0/3032309548 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5684018020 con 0x7f569c103740 2024-09-16T01:04:49.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.282+0000 7f5698ff9640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56880a3240 0x7f56880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:49.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.282+0000 7f569affd640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56880a3240 0x7f56880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:49.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.282+0000 7f5698ff9640 1 -- 172.21.15.12:0/3032309548 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8475+0+0 (secure 0 0 0) 0x7f56840cf540 con 0x7f569c103740 2024-09-16T01:04:49.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.283+0000 7f569affd640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56880a3240 0x7f56880a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f568c005fd0 tx=0x7f568c00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:49.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.287+0000 7f5698ff9640 1 -- 172.21.15.12:0/3032309548 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f568401f020 con 0x7f569c103740 2024-09-16T01:04:49.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.461+0000 7f56a12ab640 1 -- 172.21.15.12:0/3032309548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f569c10a2a0 con 0x7f569c103740 2024-09-16T01:04:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.694+0000 7f5698ff9640 1 -- 172.21.15.12:0/3032309548 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v93) ==== 178+0+0 (secure 0 0 0) 0x7f568400d040 con 0x7f569c103740 2024-09-16T01:04:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data_ec' removed 2024-09-16T01:04:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.696+0000 7f56a12ab640 1 -- 172.21.15.12:0/3032309548 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56880a3240 msgr2=0x7f56880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.696+0000 7f56a12ab640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56880a3240 0x7f56880a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f568c005fd0 tx=0x7f568c00b5f0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.696+0000 7f56a12ab640 1 -- 172.21.15.12:0/3032309548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f569c103740 msgr2=0x7f569c100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.696+0000 7f56a12ab640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f569c103740 0x7f569c100f30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f568400b450 tx=0x7f568400b910 comp rx=0 tx=0).stop 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.697+0000 7f56a12ab640 1 -- 172.21.15.12:0/3032309548 shutdown_connections 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.697+0000 7f56a12ab640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.12:6800/2160939611,v1:172.21.15.12:6801/2160939611] conn(0x7f56880a3240 0x7f56880a5700 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.697+0000 7f56a12ab640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f569c108290 0x7f569c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.697+0000 7f56a12ab640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f569c103740 0x7f569c100f30 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.697+0000 7f56a12ab640 1 --2- 172.21.15.12:0/3032309548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f569c102d90 0x7f569c1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.697+0000 7f56a12ab640 1 -- 172.21.15.12:0/3032309548 >> 172.21.15.12:0/3032309548 conn(0x7f569c0fc7d0 msgr2=0x7f569c106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.697+0000 7f56a12ab640 1 -- 172.21.15.12:0/3032309548 shutdown_connections 2024-09-16T01:04:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-16T01:04:49.697+0000 7f56a12ab640 1 -- 172.21.15.12:0/3032309548 wait complete. 2024-09-16T01:04:49.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:49 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3032309548' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:04:49.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:49 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3032309548' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:04:50.096 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:49 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3032309548' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:04:50.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:04:50.456 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:04:50.489 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:04:50.522 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-16T01:04:50.522 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:04:50.540 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:04:50.558 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:04:50.580 INFO:tasks.cephadm:Stopping all daemons... 2024-09-16T01:04:50.580 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-16T01:04:50.580 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.a 2024-09-16T01:04:50.696 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:50 smithi012 systemd[1]: Stopping Ceph mon.a for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:04:50.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:50 smithi119 ceph-mon[35049]: pgmap v475: 33 pgs: 33 active+clean; 577 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:04:50.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:50 smithi119 ceph-mon[35049]: from='client.? 172.21.15.12:0/3032309548' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:04:50.847 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:50 smithi119 ceph-mon[35049]: osdmap e93: 12 total, 12 up, 12 in 2024-09-16T01:04:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:50 smithi098 ceph-mon[35346]: pgmap v475: 33 pgs: 33 active+clean; 577 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:04:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:50 smithi098 ceph-mon[35346]: from='client.? 172.21.15.12:0/3032309548' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:04:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:50 smithi098 ceph-mon[35346]: osdmap e93: 12 total, 12 up, 12 in 2024-09-16T01:04:51.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:50 smithi012 ceph-mon[31197]: pgmap v475: 33 pgs: 33 active+clean; 577 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:04:51.106 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:50 smithi012 ceph-mon[31197]: from='client.? 172.21.15.12:0/3032309548' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:04:51.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:50 smithi012 ceph-mon[31197]: osdmap e93: 12 total, 12 up, 12 in 2024-09-16T01:04:51.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:50 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a[31193]: 2024-09-16T01:04:50.901+0000 7fde1b918640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:04:51.107 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:50 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a[31193]: 2024-09-16T01:04:50.901+0000 7fde1b918640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-16T01:04:51.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:51 smithi012 podman[95395]: 2024-09-16 01:04:51.106190237 +0000 UTC m=+0.320382486 container died f5366c394d4579134564679847e4357bc3aa7d08ef5059c59a6c54e64ad2879e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-16T01:04:51.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:51 smithi012 podman[95395]: 2024-09-16 01:04:51.629974116 +0000 UTC m=+0.844166361 container cleanup f5366c394d4579134564679847e4357bc3aa7d08ef5059c59a6c54e64ad2879e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-16T01:04:51.857 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:51 smithi012 bash[95395]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a 2024-09-16T01:04:52.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 16 01:04:51 smithi012 podman[95407]: 2024-09-16 01:04:51.871545242 +0000 UTC m=+0.763947985 container remove f5366c394d4579134564679847e4357bc3aa7d08ef5059c59a6c54e64ad2879e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-16T01:04:52.134 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.a.service' 2024-09-16T01:04:52.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:04:52.181 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-16T01:04:52.181 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-16T01:04:52.181 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.b 2024-09-16T01:04:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:52 smithi098 systemd[1]: Stopping Ceph mon.b for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:04:52.939 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:52 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-b[35342]: 2024-09-16T01:04:52.519+0000 7ff6c270e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:04:52.939 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:52 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-b[35342]: 2024-09-16T01:04:52.519+0000 7ff6c270e640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-16T01:04:52.939 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:52 smithi098 podman[68537]: 2024-09-16 01:04:52.643199094 +0000 UTC m=+0.259151729 container died 6c33642f5f84cbbb1ee84b101e2811b432ebd8ee34565d360020362899680427 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-16T01:04:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:53 smithi098 podman[68537]: 2024-09-16 01:04:53.037848499 +0000 UTC m=+0.653801123 container cleanup 6c33642f5f84cbbb1ee84b101e2811b432ebd8ee34565d360020362899680427 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:04:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Sep 16 01:04:53 smithi098 bash[68537]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-b 2024-09-16T01:04:53.421 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.b.service' 2024-09-16T01:04:53.467 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:04:53.468 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-16T01:04:53.468 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-16T01:04:53.468 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.c 2024-09-16T01:04:53.846 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:53 smithi119 systemd[1]: Stopping Ceph mon.c for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:04:54.286 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:53 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-c[35045]: 2024-09-16T01:04:53.870+0000 7f1edb7d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:04:54.287 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:53 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-c[35045]: 2024-09-16T01:04:53.870+0000 7f1edb7d7640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-16T01:04:54.287 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:53 smithi119 podman[68540]: 2024-09-16 01:04:53.982806141 +0000 UTC m=+0.313129733 container died 5ba633bd207ff2dfc72e06d7c1b74aa79fb06c2a43d7cd6994e2421a22e50365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-c, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:04:54.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:54 smithi119 podman[68540]: 2024-09-16 01:04:54.38593568 +0000 UTC m=+0.716259260 container cleanup 5ba633bd207ff2dfc72e06d7c1b74aa79fb06c2a43d7cd6994e2421a22e50365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-16T01:04:54.596 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:54 smithi119 bash[68540]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-c 2024-09-16T01:04:54.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:54 smithi119 podman[68551]: 2024-09-16 01:04:54.620885672 +0000 UTC m=+0.635707692 container remove 5ba633bd207ff2dfc72e06d7c1b74aa79fb06c2a43d7cd6994e2421a22e50365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mon-c, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-16T01:04:54.769 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:54 smithi119 systemd[1]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-16T01:04:54.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:54 smithi119 systemd[1]: Stopped Ceph mon.c for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:04:54.770 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 16 01:04:54 smithi119 systemd[1]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.c.service: Consumed 8.963s CPU time. 2024-09-16T01:04:54.771 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mon.c.service' 2024-09-16T01:04:54.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:04:54.812 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-16T01:04:54.813 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-16T01:04:54.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.x 2024-09-16T01:04:55.107 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 01:04:54 smithi012 systemd[1]: Stopping Ceph mgr.x for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:04:55.517 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 01:04:55 smithi012 podman[95518]: 2024-09-16 01:04:55.179975488 +0000 UTC m=+0.161087681 container died f5f7edc6258704c57745a20eae384b3c539513cb7b9d69d5cbc53b0bbf1e35e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:04:55.857 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 01:04:55 smithi012 podman[95518]: 2024-09-16 01:04:55.7173456 +0000 UTC m=+0.698457785 container cleanup f5f7edc6258704c57745a20eae384b3c539513cb7b9d69d5cbc53b0bbf1e35e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:04:55.857 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 01:04:55 smithi012 bash[95518]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x 2024-09-16T01:04:56.294 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 16 01:04:56 smithi012 podman[95531]: 2024-09-16 01:04:56.002837128 +0000 UTC m=+0.817630899 container remove f5f7edc6258704c57745a20eae384b3c539513cb7b9d69d5cbc53b0bbf1e35e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:04:56.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-16T01:04:56.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:04:56.344 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-16T01:04:56.344 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-16T01:04:56.344 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.y 2024-09-16T01:04:56.690 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 01:04:56 smithi098 systemd[1]: Stopping Ceph mgr.y for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:04:56.962 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 01:04:56 smithi098 podman[68659]: 2024-09-16 01:04:56.689089041 +0000 UTC m=+0.142701315 container died a9ff6b958502d456a729d95236e7da2a0a552613d67e14380e5d6655ae68635c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:04:57.346 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 01:04:57 smithi098 podman[68659]: 2024-09-16 01:04:57.094081504 +0000 UTC m=+0.547693770 container cleanup a9ff6b958502d456a729d95236e7da2a0a552613d67e14380e5d6655ae68635c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-16T01:04:57.346 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Sep 16 01:04:57 smithi098 bash[68659]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-y 2024-09-16T01:04:57.516 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-16T01:04:57.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:04:57.550 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-16T01:04:57.551 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-16T01:04:57.551 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.z 2024-09-16T01:04:57.846 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 01:04:57 smithi119 systemd[1]: Stopping Ceph mgr.z for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:04:58.115 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 01:04:57 smithi119 podman[68663]: 2024-09-16 01:04:57.870560982 +0000 UTC m=+0.129567337 container died 55522edc958417be3bdac613e2dc7af7aec831c074d54684d63b9a6a38f8feb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-8921c8e) 2024-09-16T01:04:58.544 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 01:04:58 smithi119 podman[68663]: 2024-09-16 01:04:58.291770172 +0000 UTC m=+0.550776519 container cleanup 55522edc958417be3bdac613e2dc7af7aec831c074d54684d63b9a6a38f8feb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T01:04:58.544 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 16 01:04:58 smithi119 bash[68663]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mgr-z 2024-09-16T01:04:58.722 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-16T01:04:58.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:04:58.758 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-16T01:04:58.759 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-16T01:04:58.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.0 2024-09-16T01:04:59.107 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:04:58 smithi012 systemd[1]: Stopping Ceph osd.0 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:04:59.606 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:04:59 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0[42817]: 2024-09-16T01:04:59.113+0000 7f55cec73640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:04:59.607 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:04:59 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0[42817]: 2024-09-16T01:04:59.113+0000 7f55cec73640 -1 osd.0 93 *** Got signal Terminated *** 2024-09-16T01:04:59.607 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:04:59 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0[42817]: 2024-09-16T01:04:59.113+0000 7f55cec73640 -1 osd.0 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:05:04.733 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:05:04 smithi012 podman[95638]: 2024-09-16 01:05:04.446569348 +0000 UTC m=+5.480498251 container died cb0c9f10ae35bbc3115c83832fd0f9ef5ddc5c51d6202bbe4f6fc1aa34b44a85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:05:05.099 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:05:04 smithi012 podman[95638]: 2024-09-16 01:05:04.922271124 +0000 UTC m=+5.956200066 container cleanup cb0c9f10ae35bbc3115c83832fd0f9ef5ddc5c51d6202bbe4f6fc1aa34b44a85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-16T01:05:05.100 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:05:04 smithi012 bash[95638]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0 2024-09-16T01:05:05.357 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:05:05 smithi012 podman[95653]: 2024-09-16 01:05:05.099041618 +0000 UTC m=+0.653570190 container remove cb0c9f10ae35bbc3115c83832fd0f9ef5ddc5c51d6202bbe4f6fc1aa34b44a85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:05:05.690 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:05:05 smithi012 podman[95741]: 2024-09-16 01:05:05.454973339 +0000 UTC m=+0.016402031 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:05:05.690 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:05:05 smithi012 podman[95741]: 2024-09-16 01:05:05.575099375 +0000 UTC m=+0.136528055 container create 9e3c92e28554d5f1b2611d6b396d1fb5060175114b0070f28eee13fd12666102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-16T01:05:06.017 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:05:05 smithi012 podman[95741]: 2024-09-16 01:05:05.819847489 +0000 UTC m=+0.381276184 container init 9e3c92e28554d5f1b2611d6b396d1fb5060175114b0070f28eee13fd12666102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:05:06.017 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:05:05 smithi012 podman[95741]: 2024-09-16 01:05:05.823160873 +0000 UTC m=+0.384589561 container start 9e3c92e28554d5f1b2611d6b396d1fb5060175114b0070f28eee13fd12666102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T01:05:06.017 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:05:05 smithi012 podman[95741]: 2024-09-16 01:05:05.919793391 +0000 UTC m=+0.481222082 container attach 9e3c92e28554d5f1b2611d6b396d1fb5060175114b0070f28eee13fd12666102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True) 2024-09-16T01:05:06.291 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 16 01:05:06 smithi012 podman[95741]: 2024-09-16 01:05:06.017277771 +0000 UTC m=+0.578706468 container died 9e3c92e28554d5f1b2611d6b396d1fb5060175114b0070f28eee13fd12666102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:05:06.927 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.0.service' 2024-09-16T01:05:06.968 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:05:06.968 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-16T01:05:06.969 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-16T01:05:06.969 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.1 2024-09-16T01:05:07.212 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:07 smithi098 systemd[1]: Stopping Ceph osd.1 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:05:07.712 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:07 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-16T01:05:07.281+0000 7fef4c54c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:05:07.712 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:07 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-16T01:05:07.281+0000 7fef4c54c640 -1 osd.1 93 *** Got signal Terminated *** 2024-09-16T01:05:07.712 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:07 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1[39802]: 2024-09-16T01:05:07.281+0000 7fef4c54c640 -1 osd.1 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:05:13.017 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:12 smithi098 podman[68796]: 2024-09-16 01:05:12.71766585 +0000 UTC m=+5.571045023 container died 71024a4a7c46f13005232100c854cc2556bfc0224b793f622e6d688579553aa1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-16T01:05:13.385 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:13 smithi098 podman[68796]: 2024-09-16 01:05:13.108225868 +0000 UTC m=+5.961605037 container cleanup 71024a4a7c46f13005232100c854cc2556bfc0224b793f622e6d688579553aa1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:05:13.385 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:13 smithi098 bash[68796]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1 2024-09-16T01:05:13.712 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:13 smithi098 podman[68811]: 2024-09-16 01:05:13.384867221 +0000 UTC m=+0.661155205 container remove 71024a4a7c46f13005232100c854cc2556bfc0224b793f622e6d688579553aa1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-16T01:05:13.997 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:13 smithi098 podman[68897]: 2024-09-16 01:05:13.629713364 +0000 UTC m=+0.016072353 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:05:13.998 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:13 smithi098 podman[68897]: 2024-09-16 01:05:13.744379423 +0000 UTC m=+0.130738453 container create 4de517bda0c66eec4c8f479c905b0889905e88902d8a047ef595344d8154bce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-16T01:05:13.998 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:13 smithi098 podman[68897]: 2024-09-16 01:05:13.997305187 +0000 UTC m=+0.383664176 container init 4de517bda0c66eec4c8f479c905b0889905e88902d8a047ef595344d8154bce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True) 2024-09-16T01:05:14.462 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:14 smithi098 podman[68897]: 2024-09-16 01:05:14.000742687 +0000 UTC m=+0.387101676 container start 4de517bda0c66eec4c8f479c905b0889905e88902d8a047ef595344d8154bce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T01:05:14.462 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:14 smithi098 podman[68897]: 2024-09-16 01:05:14.080724232 +0000 UTC m=+0.467083226 container attach 4de517bda0c66eec4c8f479c905b0889905e88902d8a047ef595344d8154bce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T01:05:14.463 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 16 01:05:14 smithi098 podman[68897]: 2024-09-16 01:05:14.19085378 +0000 UTC m=+0.577212771 container died 4de517bda0c66eec4c8f479c905b0889905e88902d8a047ef595344d8154bce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=) 2024-09-16T01:05:14.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.1.service' 2024-09-16T01:05:14.870 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:05:14.870 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-16T01:05:14.870 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-16T01:05:14.870 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.2 2024-09-16T01:05:15.188 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:14 smithi119 systemd[1]: Stopping Ceph osd.2 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:05:15.596 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:15 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2[40007]: 2024-09-16T01:05:15.186+0000 7fca10bc7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:05:15.596 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:15 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2[40007]: 2024-09-16T01:05:15.186+0000 7fca10bc7640 -1 osd.2 93 *** Got signal Terminated *** 2024-09-16T01:05:15.596 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:15 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2[40007]: 2024-09-16T01:05:15.186+0000 7fca10bc7640 -1 osd.2 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:05:20.846 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:20 smithi119 podman[68796]: 2024-09-16 01:05:20.565091135 +0000 UTC m=+5.501124431 container died a7d9ab157164dbf2566f0754d2d12839363dc2f472755b992d78aef69af54cfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2) 2024-09-16T01:05:21.231 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:20 smithi119 podman[68796]: 2024-09-16 01:05:20.963129656 +0000 UTC m=+5.899162941 container cleanup a7d9ab157164dbf2566f0754d2d12839363dc2f472755b992d78aef69af54cfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-16T01:05:21.231 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:20 smithi119 bash[68796]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2 2024-09-16T01:05:21.577 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:21 smithi119 podman[68812]: 2024-09-16 01:05:21.231313272 +0000 UTC m=+0.658398648 container remove a7d9ab157164dbf2566f0754d2d12839363dc2f472755b992d78aef69af54cfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-16T01:05:21.846 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:21 smithi119 podman[68901]: 2024-09-16 01:05:21.480128032 +0000 UTC m=+0.016881705 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:05:21.846 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:21 smithi119 podman[68901]: 2024-09-16 01:05:21.607247458 +0000 UTC m=+0.144001131 container create e9d194eb686367d4f643bd9584c78a844e19587cf5cdadae9f0dd7c855e86dd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-16T01:05:22.112 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:21 smithi119 podman[68901]: 2024-09-16 01:05:21.902612792 +0000 UTC m=+0.439366465 container init e9d194eb686367d4f643bd9584c78a844e19587cf5cdadae9f0dd7c855e86dd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:05:22.112 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:21 smithi119 podman[68901]: 2024-09-16 01:05:21.906019025 +0000 UTC m=+0.442772698 container start e9d194eb686367d4f643bd9584c78a844e19587cf5cdadae9f0dd7c855e86dd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-16T01:05:22.113 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:22 smithi119 podman[68901]: 2024-09-16 01:05:22.018676716 +0000 UTC m=+0.555430399 container attach e9d194eb686367d4f643bd9584c78a844e19587cf5cdadae9f0dd7c855e86dd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-16T01:05:22.113 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 16 01:05:22 smithi119 podman[68901]: 2024-09-16 01:05:22.090108958 +0000 UTC m=+0.626862641 container died e9d194eb686367d4f643bd9584c78a844e19587cf5cdadae9f0dd7c855e86dd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-16T01:05:22.818 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.2.service' 2024-09-16T01:05:22.857 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:05:22.858 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-16T01:05:22.858 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-16T01:05:22.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.3 2024-09-16T01:05:23.194 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:22 smithi012 systemd[1]: Stopping Ceph osd.3 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:05:23.607 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:23 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3[49543]: 2024-09-16T01:05:23.192+0000 7fb981238640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:05:23.607 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:23 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3[49543]: 2024-09-16T01:05:23.192+0000 7fb981238640 -1 osd.3 93 *** Got signal Terminated *** 2024-09-16T01:05:23.607 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:23 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3[49543]: 2024-09-16T01:05:23.192+0000 7fb981238640 -1 osd.3 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:05:27.596 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:27 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:27.127+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:27.909 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:27 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3[49543]: 2024-09-16T01:05:27.633+0000 7fb97d84e640 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.445272+0000 front 2024-09-16T01:05:03.445256+0000 (oldest deadline 2024-09-16T01:05:27.545405+0000) 2024-09-16T01:05:27.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:27 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:27.484+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:28.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:27 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:27.733+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:28.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:27 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:27.909+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:28.596 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:28 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:28.119+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:28.785 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:28 smithi012 podman[95855]: 2024-09-16 01:05:28.527092084 +0000 UTC m=+5.464511829 container died 8017828bc4c419f10c43e5fbb5e2b1c52db293afe45825650534afd1184f8d9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:05:28.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:28 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:28.479+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:29.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:28 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:28.712+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:29.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:28 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:28.868+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:29.107 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:28 smithi012 podman[95855]: 2024-09-16 01:05:28.976137831 +0000 UTC m=+5.913557575 container cleanup 8017828bc4c419f10c43e5fbb5e2b1c52db293afe45825650534afd1184f8d9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-16T01:05:29.107 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:28 smithi012 bash[95855]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3 2024-09-16T01:05:29.596 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:29 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:29.143+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:29.602 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:29 smithi012 podman[95870]: 2024-09-16 01:05:29.169651358 +0000 UTC m=+0.634995435 container remove 8017828bc4c419f10c43e5fbb5e2b1c52db293afe45825650534afd1184f8d9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T01:05:29.856 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:29 smithi012 podman[95956]: 2024-09-16 01:05:29.504663568 +0000 UTC m=+0.016621308 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:05:29.857 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:29 smithi012 podman[95956]: 2024-09-16 01:05:29.62039321 +0000 UTC m=+0.132350983 container create 0f8bb61515a5d2b1798993c19cc559a1d18c1e08eb7658cfe32e5afc317fa231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-16T01:05:29.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:29 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:29.494+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:30.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:29 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:29.675+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:30.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:29 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:29.863+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:30.357 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:29 smithi012 podman[95956]: 2024-09-16 01:05:29.856605053 +0000 UTC m=+0.368562789 container init 0f8bb61515a5d2b1798993c19cc559a1d18c1e08eb7658cfe32e5afc317fa231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:05:30.357 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:29 smithi012 podman[95956]: 2024-09-16 01:05:29.860000185 +0000 UTC m=+0.371957915 container start 0f8bb61515a5d2b1798993c19cc559a1d18c1e08eb7658cfe32e5afc317fa231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-16T01:05:30.357 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:29 smithi012 podman[95956]: 2024-09-16 01:05:29.965028338 +0000 UTC m=+0.476986088 container attach 0f8bb61515a5d2b1798993c19cc559a1d18c1e08eb7658cfe32e5afc317fa231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-16T01:05:30.357 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 16 01:05:30 smithi012 podman[95956]: 2024-09-16 01:05:30.054961758 +0000 UTC m=+0.566919491 container died 0f8bb61515a5d2b1798993c19cc559a1d18c1e08eb7658cfe32e5afc317fa231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-16T01:05:30.596 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:30 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:30.167+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:30.712 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:30 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:30.445+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:30.756 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.3.service' 2024-09-16T01:05:30.801 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:05:30.801 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-16T01:05:30.801 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-16T01:05:30.801 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.4 2024-09-16T01:05:31.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:30 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:30.655+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:31.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:30 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:30.874+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:31.113 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:30 smithi098 systemd[1]: Stopping Ceph osd.4 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:05:31.452 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:31 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4[46430]: 2024-09-16T01:05:31.113+0000 7f399dd02640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:05:31.452 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:31 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4[46430]: 2024-09-16T01:05:31.113+0000 7f399dd02640 -1 osd.4 93 *** Got signal Terminated *** 2024-09-16T01:05:31.452 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:31 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4[46430]: 2024-09-16T01:05:31.113+0000 7f399dd02640 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:05:31.596 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:31 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:31.142+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:31.712 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:31 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:31.451+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:32.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:31 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:31.670+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:32.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:31 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:31.895+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:32.597 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:32 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:32.131+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:32.713 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:32 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:32.440+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:33.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:32 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:32.678+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:33.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:32 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:32.902+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:33.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:32 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:32.902+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:33.596 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:33 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:33.146+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:33.712 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:33 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:33.400+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:34.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:33 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:33.716+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:34.258 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:33 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:33.911+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:34.258 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:33 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:33.911+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:34.258 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:34 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:34.143+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:34.542 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:34 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:34.176+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:34.712 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:34 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:34.390+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:34.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:34 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:34.731+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:34.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:34 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:34.541+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:35.141 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:34 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:34.874+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:35.141 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:34 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:34.874+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:35.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:35 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:35.158+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:35.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:35 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:35.364+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:35.552 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:35 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:35.140+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:35.567 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:35 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:35.218+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:35.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:35 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:35.734+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:35.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:35 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:35.566+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:36.356 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:36 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:36.094+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:36.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:35 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:35.903+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:36.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:35 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:35.903+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:36.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:36 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:36.143+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:36.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:36 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:36.319+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:36.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:36 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:36.319+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:36.553 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:36 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:36.222+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:36.553 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:36 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:36.222+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:06.760669+0000 front 2024-09-16T01:05:06.760842+0000 (oldest deadline 2024-09-16T01:05:35.561283+0000) 2024-09-16T01:05:36.773 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:36 smithi098 podman[69000]: 2024-09-16 01:05:36.480130449 +0000 UTC m=+5.485520896 container died cde8a6259f17c73cea010532e79744aeb182835a7a833eab80297d82a60afe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-16T01:05:36.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:36 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:36.777+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:36.847 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:36 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:36.552+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:37.077 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:36 smithi098 podman[69000]: 2024-09-16 01:05:36.863790095 +0000 UTC m=+5.869180533 container cleanup cde8a6259f17c73cea010532e79744aeb182835a7a833eab80297d82a60afe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-16T01:05:37.077 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:36 smithi098 bash[69000]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4 2024-09-16T01:05:37.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:37 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:37.068+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:37.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:36 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:36.950+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:37.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:36 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:36.950+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:37.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:37 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:37.161+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:37.463 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:37 smithi098 podman[69026]: 2024-09-16 01:05:37.073619252 +0000 UTC m=+0.594559455 container remove cde8a6259f17c73cea010532e79744aeb182835a7a833eab80297d82a60afe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-16T01:05:37.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:37 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:37.274+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:37.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:37 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:37.274+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:37.545 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:37 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:37.227+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:37.545 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:37 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:37.227+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:06.760669+0000 front 2024-09-16T01:05:06.760842+0000 (oldest deadline 2024-09-16T01:05:35.561283+0000) 2024-09-16T01:05:37.797 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:37 smithi098 podman[69118]: 2024-09-16 01:05:37.372667653 +0000 UTC m=+0.015877409 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:05:37.797 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:37 smithi098 podman[69118]: 2024-09-16 01:05:37.509864891 +0000 UTC m=+0.153074690 container create 101bc6cae088f2ccc0538881527bf789154b58778021c3a5bd260825379649f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:05:37.797 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:37 smithi098 podman[69118]: 2024-09-16 01:05:37.796414652 +0000 UTC m=+0.439624418 container init 101bc6cae088f2ccc0538881527bf789154b58778021c3a5bd260825379649f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-16T01:05:37.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:37 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:37.768+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:37.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:37 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:37.544+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:38.118 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:37 smithi098 podman[69118]: 2024-09-16 01:05:37.800116667 +0000 UTC m=+0.443326420 container start 101bc6cae088f2ccc0538881527bf789154b58778021c3a5bd260825379649f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-16T01:05:38.119 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:37 smithi098 podman[69118]: 2024-09-16 01:05:37.894384981 +0000 UTC m=+0.537594743 container attach 101bc6cae088f2ccc0538881527bf789154b58778021c3a5bd260825379649f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T01:05:38.119 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 16 01:05:37 smithi098 podman[69118]: 2024-09-16 01:05:37.99035952 +0000 UTC m=+0.633569270 container died 101bc6cae088f2ccc0538881527bf789154b58778021c3a5bd260825379649f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-16T01:05:38.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:38.098+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:38.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:37 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:37.904+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:38.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:37 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:37.904+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:38.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:38 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:38.117+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:38.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:38 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:38.233+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:38.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:38 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:38.233+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:38.574 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:38 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:38.236+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:38.574 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:38 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:38.236+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:06.760669+0000 front 2024-09-16T01:05:06.760842+0000 (oldest deadline 2024-09-16T01:05:35.561283+0000) 2024-09-16T01:05:38.655 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.4.service' 2024-09-16T01:05:38.697 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:05:38.697 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-16T01:05:38.697 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-16T01:05:38.697 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.5 2024-09-16T01:05:38.846 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:38 smithi119 systemd[1]: Stopping Ceph osd.5 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:05:38.847 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:38 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:38.573+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:38.847 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:38 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:38.775+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:39.346 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:39.009+0000 7f93b21ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:05:39.346 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:39.009+0000 7f93b21ce640 -1 osd.5 93 *** Got signal Terminated *** 2024-09-16T01:05:39.346 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:39.009+0000 7f93b21ce640 -1 osd.5 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:05:39.347 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:39.257+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:39.347 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:39.257+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:06.760669+0000 front 2024-09-16T01:05:06.760842+0000 (oldest deadline 2024-09-16T01:05:35.561283+0000) 2024-09-16T01:05:39.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:39 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:39.107+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:39.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:38.921+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:39.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:38.921+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:39.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:39 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:39.117+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:39.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:39 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:39.253+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:39.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:39 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:39.253+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:39.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:39.756+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:39.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:39 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:39.564+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:40.356 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:40.096+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:40.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:39 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:39.947+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:40.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:39 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:39.947+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:40.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:40.071+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:40.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:40.218+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:40.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:40 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:40.218+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:40.535 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:40.227+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:40.535 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:40.227+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:06.760669+0000 front 2024-09-16T01:05:06.760842+0000 (oldest deadline 2024-09-16T01:05:35.561283+0000) 2024-09-16T01:05:40.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:40.534+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:40.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:40 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:40.772+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:41.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:41.127+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:41.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:40.990+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:41.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:40.990+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:41.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:40 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:40.990+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:41.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:41 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:41.038+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:41.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:41 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:41.199+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:41.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:41 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:41.199+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:41.520 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:41.222+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:41.520 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:41.222+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:06.760669+0000 front 2024-09-16T01:05:06.760842+0000 (oldest deadline 2024-09-16T01:05:35.561283+0000) 2024-09-16T01:05:41.793 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:41.520+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:42.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:41 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:41.791+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:42.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:42 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:42.098+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:42.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:41.963+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:42.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:41.963+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:42.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:41.963+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:42.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:42 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:42.087+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:42.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:42 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:42.087+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:42.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:42 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:42.207+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:42.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:42 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:42.207+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:42.537 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:42.231+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:42.537 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:42.231+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:06.760669+0000 front 2024-09-16T01:05:06.760842+0000 (oldest deadline 2024-09-16T01:05:35.561283+0000) 2024-09-16T01:05:42.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:42.752+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:42.847 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:42.752+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:42.847 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:42.536+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:42.847 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:42 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:42.536+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:43.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:43 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:43.052+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:43.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:42 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:42.946+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:43.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:42 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:42.946+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:43.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:42 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:42.946+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:43.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:43 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:43.124+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:43.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:43 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:43.124+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:43.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:43 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:43.233+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:43.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:43 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:43.233+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:43.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:43 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:43.233+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:43.566 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:43 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:43.186+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.260456+0000 front 2024-09-16T01:05:03.260345+0000 (oldest deadline 2024-09-16T01:05:26.760332+0000) 2024-09-16T01:05:43.567 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:43 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:43.186+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:06.760669+0000 front 2024-09-16T01:05:06.760842+0000 (oldest deadline 2024-09-16T01:05:35.561283+0000) 2024-09-16T01:05:43.567 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:43 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5[46908]: 2024-09-16T01:05:43.186+0000 7f93ae7e4640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:20.063220+0000 front 2024-09-16T01:05:20.063151+0000 (oldest deadline 2024-09-16T01:05:42.963219+0000) 2024-09-16T01:05:43.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:43 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:43.565+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:43.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:43 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:43.565+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:43.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:43 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:43.738+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:43.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:43 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:43.738+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:44.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:44 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:44.051+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:44.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:44 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:44.051+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.884123+0000 front 2024-09-16T01:05:17.884141+0000 (oldest deadline 2024-09-16T01:05:43.183740+0000) 2024-09-16T01:05:44.358 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:43 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:43.950+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:44.358 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:43 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:43.950+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:44.358 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:43 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:43.950+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:44.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:44.152+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:44.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:44.152+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:44.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:44.232+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:44.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:44.232+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:44.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:44 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:44.232+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:44.845 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:44 smithi119 podman[69018]: 2024-09-16 01:05:44.553874373 +0000 UTC m=+5.660678493 container died c72e50ac120cf1c521aa68f39b3c1623d14d08b53e69e52d457c53e163b4138b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-16T01:05:44.845 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:44 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:44.544+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:44.845 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:44 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:44.544+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:44.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:44 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:44.767+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:44.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:44 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:44.767+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:45.097 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:44 smithi119 podman[69018]: 2024-09-16 01:05:44.942757685 +0000 UTC m=+6.049561804 container cleanup c72e50ac120cf1c521aa68f39b3c1623d14d08b53e69e52d457c53e163b4138b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-16T01:05:45.097 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:44 smithi119 bash[69018]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5 2024-09-16T01:05:45.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:44 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:44.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:45.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:44 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:44.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:45.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:44 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:44.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:45.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:45.005+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:45.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:45.005+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.884123+0000 front 2024-09-16T01:05:17.884141+0000 (oldest deadline 2024-09-16T01:05:43.183740+0000) 2024-09-16T01:05:45.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:45 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:45.111+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:45.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:45 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:45.111+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:45.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:45 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:45.213+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:45.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:45 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:45.213+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:45.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:45 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:45.213+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:45.565 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:45 smithi119 podman[69034]: 2024-09-16 01:05:45.211026342 +0000 UTC m=+0.656987861 container remove c72e50ac120cf1c521aa68f39b3c1623d14d08b53e69e52d457c53e163b4138b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-16T01:05:45.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:45 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:45.576+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:45.847 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:45 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:45.576+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:45.847 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:45 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:45.813+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:45.847 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:45 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:45.813+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:45.847 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:45 smithi119 podman[69123]: 2024-09-16 01:05:45.467646267 +0000 UTC m=+0.015812232 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:05:45.847 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:45 smithi119 podman[69123]: 2024-09-16 01:05:45.570024126 +0000 UTC m=+0.118190072 container create 7441eb16a49dab9cae4a32cab732223d2d57a0b341b053ce5244cc7c931cd7ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-16T01:05:46.346 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:45 smithi119 podman[69123]: 2024-09-16 01:05:45.87303535 +0000 UTC m=+0.421201296 container init 7441eb16a49dab9cae4a32cab732223d2d57a0b341b053ce5244cc7c931cd7ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:05:46.347 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:45 smithi119 podman[69123]: 2024-09-16 01:05:45.876256491 +0000 UTC m=+0.424422437 container start 7441eb16a49dab9cae4a32cab732223d2d57a0b341b053ce5244cc7c931cd7ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-16T01:05:46.347 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:45 smithi119 podman[69123]: 2024-09-16 01:05:45.947887499 +0000 UTC m=+0.496053454 container attach 7441eb16a49dab9cae4a32cab732223d2d57a0b341b053ce5244cc7c931cd7ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-16T01:05:46.347 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 16 01:05:46 smithi119 podman[69123]: 2024-09-16 01:05:46.065098012 +0000 UTC m=+0.613263959 container died 7441eb16a49dab9cae4a32cab732223d2d57a0b341b053ce5244cc7c931cd7ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-16T01:05:46.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:45.956+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:46.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:45.956+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.884123+0000 front 2024-09-16T01:05:17.884141+0000 (oldest deadline 2024-09-16T01:05:43.183740+0000) 2024-09-16T01:05:46.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:45.975+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:46.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:45.975+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:46.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:45.975+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:46.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:46 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:46.081+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:46.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:46 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:46.081+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:46.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:46 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:46.193+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:46.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:46 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:46.193+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:46.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:46 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:46.193+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:46.735 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:46 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:46.584+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:46.735 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:46 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:46.584+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:46.760 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.5.service' 2024-09-16T01:05:46.799 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:05:46.799 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-16T01:05:46.800 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-16T01:05:46.800 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.6 2024-09-16T01:05:46.946 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:46 smithi012 systemd[1]: Stopping Ceph osd.6 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:05:47.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:46 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:46.774+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:47.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:46 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:46.774+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:47.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:47 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:47.020+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:47.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:47 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:47.020+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:47.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:47 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:47.020+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:47.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:46 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:46.943+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:47.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:46 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:46.943+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.884123+0000 front 2024-09-16T01:05:17.884141+0000 (oldest deadline 2024-09-16T01:05:43.183740+0000) 2024-09-16T01:05:47.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:47 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:47.128+0000 7f197784d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:05:47.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:47 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:47.128+0000 7f197784d640 -1 osd.6 93 *** Got signal Terminated *** 2024-09-16T01:05:47.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:47 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:47.128+0000 7f197784d640 -1 osd.6 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:05:47.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:47 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:47.040+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:47.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:47 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:47.040+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:47.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:47 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:47.161+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:47.464 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:47 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:47.161+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:47.464 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:47 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:47.161+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:47.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:47 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:47.745+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:47.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:47 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:47.745+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:47.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:47 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:47.573+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:47.847 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:47 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:47.573+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:48.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:47 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:47.907+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:48.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:47 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:47.907+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.884123+0000 front 2024-09-16T01:05:17.884141+0000 (oldest deadline 2024-09-16T01:05:43.183740+0000) 2024-09-16T01:05:48.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:48 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:48.030+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:48.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:48 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:48.030+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:48.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:48 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:48.030+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:48.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:48 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:48.056+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:48.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:48 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:48.056+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:48.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:48 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:48.185+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:48.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:48 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:48.185+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:48.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:48 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:48.185+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:48.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:48 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:48.588+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:48.846 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:48 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:48.588+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:48.847 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:48 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:48.769+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:48.847 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:48 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:48.769+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:49.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:48 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:48.952+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:49.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:48 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:48.952+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.884123+0000 front 2024-09-16T01:05:17.884141+0000 (oldest deadline 2024-09-16T01:05:43.183740+0000) 2024-09-16T01:05:49.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:49.004+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:49.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:49.004+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:49.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:49.004+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:49.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:49.004+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:49.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:49 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:49.027+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:49.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:49 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:49.027+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:49.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:49 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:49.212+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:49.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:49 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:49.212+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:49.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:49 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:49.212+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:50.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:49 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:49.621+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:50.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:49 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:49.621+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:50.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:49 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:49.805+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:50.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:49 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:49.805+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:50.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:49 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:49.805+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:05:50.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:49.971+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:50.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:49.971+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.884123+0000 front 2024-09-16T01:05:17.884141+0000 (oldest deadline 2024-09-16T01:05:43.183740+0000) 2024-09-16T01:05:50.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:49.971+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:25.484580+0000 front 2024-09-16T01:05:25.484629+0000 (oldest deadline 2024-09-16T01:05:48.984643+0000) 2024-09-16T01:05:50.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:49.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:50.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:49.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:50.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:49.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:50.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:49 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:49.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:50.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:50 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:50.052+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:50.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:50 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:50.052+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:50.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:50 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:50.052+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:05:50.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:50 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:50.182+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:50.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:50 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:50.182+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:50.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:50 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:50.182+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:50.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:50 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:50.182+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:05:51.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:50 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:50.629+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:51.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:50 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:50.629+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:51.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:50 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:50.830+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:51.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:50 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:50.830+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:51.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:50 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:50.830+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:05:51.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:51 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:51.007+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:51.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:51 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:51.007+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.884123+0000 front 2024-09-16T01:05:17.884141+0000 (oldest deadline 2024-09-16T01:05:43.183740+0000) 2024-09-16T01:05:51.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:51 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:51.007+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:25.484580+0000 front 2024-09-16T01:05:25.484629+0000 (oldest deadline 2024-09-16T01:05:48.984643+0000) 2024-09-16T01:05:51.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:50 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:50.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:51.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:50 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:50.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:51.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:50 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:50.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:51.358 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:50 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:50.978+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:51.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:51 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:51.017+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:51.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:51 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:51.017+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:51.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:51 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:51.017+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:05:51.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:51 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:51.199+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:51.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:51 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:51.199+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:51.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:51 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:51.199+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:51.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:51 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:51.199+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:05:52.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:51 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:51.633+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:52.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:51 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:51.633+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:52.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:51 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:51.633+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:05:52.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:51 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:51.852+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:52.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:51 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:51.852+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:52.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:51 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:51.852+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:05:52.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:52 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:52.039+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:09.682989+0000 front 2024-09-16T01:05:09.682788+0000 (oldest deadline 2024-09-16T01:05:33.182901+0000) 2024-09-16T01:05:52.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:52 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:52.039+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.884123+0000 front 2024-09-16T01:05:17.884141+0000 (oldest deadline 2024-09-16T01:05:43.183740+0000) 2024-09-16T01:05:52.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:52 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6[56306]: 2024-09-16T01:05:52.039+0000 7f1973e63640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:25.484580+0000 front 2024-09-16T01:05:25.484629+0000 (oldest deadline 2024-09-16T01:05:48.984643+0000) 2024-09-16T01:05:52.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:52 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:52.013+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:52.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:52 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:52.013+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:52.358 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:52 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:52.013+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:52.358 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:52 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:52.013+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:52.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:52 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:52.045+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:52.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:52 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:52.045+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:52.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:52 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:52.045+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:05:52.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:52 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:52.216+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:52.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:52 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:52.216+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:52.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:52 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:52.216+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:52.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:52 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:52.216+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:05:52.946 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:52 smithi012 podman[96070]: 2024-09-16 01:05:52.673049555 +0000 UTC m=+5.673185011 container died 748fe6fd2bccc4245866136c108a375ed34e8c93892473570cc144afd9d03ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True) 2024-09-16T01:05:53.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:52 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:52.675+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:53.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:52 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:52.675+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:53.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:52 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:52.675+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:05:53.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:52 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:52.888+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:53.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:52 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:52.888+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:53.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:52 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:52.888+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:05:53.306 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:53 smithi012 podman[96070]: 2024-09-16 01:05:53.103673309 +0000 UTC m=+6.103808806 container cleanup 748fe6fd2bccc4245866136c108a375ed34e8c93892473570cc144afd9d03ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:05:53.306 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:53 smithi012 bash[96070]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6 2024-09-16T01:05:53.306 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:53 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:53.022+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:53.306 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:53 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:53.022+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:53.306 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:53 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:53.022+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:53.306 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:53 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:53.022+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:53.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:53 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:53.093+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:53.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:53 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:53.093+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:53.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:53 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:53.093+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:05:53.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:53 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:53.191+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:53.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:53 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:53.191+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:53.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:53 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:53.191+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:53.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:53 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:53.191+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:05:53.607 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:53 smithi012 podman[96085]: 2024-09-16 01:05:53.305137655 +0000 UTC m=+0.629575414 container remove 748fe6fd2bccc4245866136c108a375ed34e8c93892473570cc144afd9d03ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-16T01:05:53.921 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:53 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:53.666+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:53.922 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:53 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:53.666+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:53.922 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:53 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:53.666+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:05:53.991 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:53 smithi012 podman[96178]: 2024-09-16 01:05:53.633675974 +0000 UTC m=+0.016684454 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:05:53.991 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:53 smithi012 podman[96178]: 2024-09-16 01:05:53.739252733 +0000 UTC m=+0.122261203 container create dd10616b8f314963b2510dd2b07132fe27c90752513e31610c4713f56d371dc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:05:53.991 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:53 smithi012 podman[96178]: 2024-09-16 01:05:53.958364844 +0000 UTC m=+0.341373310 container init dd10616b8f314963b2510dd2b07132fe27c90752513e31610c4713f56d371dc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-16T01:05:53.992 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:53 smithi012 podman[96178]: 2024-09-16 01:05:53.961889665 +0000 UTC m=+0.344898133 container start dd10616b8f314963b2510dd2b07132fe27c90752513e31610c4713f56d371dc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-16T01:05:54.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:53 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:53.920+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:54.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:53 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:53.920+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:54.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:53 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:53.920+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:05:54.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:53 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:53.989+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:54.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:53 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:53.989+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:54.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:53 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:53.989+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:54.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:53 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:53.989+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:54.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:54 smithi012 podman[96178]: 2024-09-16 01:05:54.052436456 +0000 UTC m=+0.435444928 container attach dd10616b8f314963b2510dd2b07132fe27c90752513e31610c4713f56d371dc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-16T01:05:54.357 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 16 01:05:54 smithi012 podman[96178]: 2024-09-16 01:05:54.164377072 +0000 UTC m=+0.547385548 container died dd10616b8f314963b2510dd2b07132fe27c90752513e31610c4713f56d371dc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-8921c8e) 2024-09-16T01:05:54.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:54 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:54.048+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:54.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:54 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:54.048+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:54.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:54 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:54.048+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:05:54.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:54 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:54.164+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:54.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:54 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:54.164+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:54.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:54 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:54.164+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:54.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:54 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:54.164+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:05:54.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.6.service' 2024-09-16T01:05:54.948 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:54 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:54.631+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:54.948 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:54 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:54.631+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:54.948 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:54 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:54.631+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:05:54.963 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:05:54.964 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-16T01:05:54.964 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-16T01:05:54.964 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.7 2024-09-16T01:05:55.288 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:55.130+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:55.289 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:55.130+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:55.289 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:55.130+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:55.289 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:55.130+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:05:55.289 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:55.014+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:55.289 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:55.014+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:55.289 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:55.014+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:05:55.289 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:55 smithi098 systemd[1]: Stopping Ceph osd.7 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:05:55.289 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:55.283+0000 7f566e1c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:05:55.289 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:55.283+0000 7f566e1c6640 -1 osd.7 93 *** Got signal Terminated *** 2024-09-16T01:05:55.289 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:55.283+0000 7f566e1c6640 -1 osd.7 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:05:55.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:54 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:54.946+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:55.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:54 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:54.946+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:55.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:54 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:54.946+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:05:55.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:54 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:54.940+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:55.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:54 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:54.940+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:55.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:54 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:54.940+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:55.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:54 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:54.940+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:55.901 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:55 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:55.605+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:55.901 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:55 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:55.605+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:55.901 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:55 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:55.605+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:05:56.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:55 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:55.899+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:56.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:55 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:55.899+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:56.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:55 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:55.899+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:05:56.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:55 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:55.966+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:56.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:55 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:55.966+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:56.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:55 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:55.966+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:56.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:55 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:55.966+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:56.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:55.976+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:56.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:55.976+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:56.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:55 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:55.976+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:05:56.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:56 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:56.082+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:56.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:56 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:56.082+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:56.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:56 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:56.082+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:56.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:56 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:56.082+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:05:56.951 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:56 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:56.646+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:56.951 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:56 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:56.646+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:56.951 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:56 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:56.646+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:05:57.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:56 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:56.950+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:57.661 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:56 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:56.950+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:57.661 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:56 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:56.950+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:05:57.662 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:56 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:56.982+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:57.662 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:56 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:56.982+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:57.662 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:56 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:56.982+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:05:57.662 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:56 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:56.982+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.944297+0000 front 2024-09-16T01:05:33.944357+0000 (oldest deadline 2024-09-16T01:05:56.844451+0000) 2024-09-16T01:05:57.663 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:56 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:56.918+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:57.663 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:56 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:56.918+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:57.663 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:56 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:56.918+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:57.663 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:56 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:56.918+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:57.663 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:57 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:57.059+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:57.663 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:57 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:57.059+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:57.663 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:57 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:57.059+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:57.663 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:57 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:57.059+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:05:57.967 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:57 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:57.672+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:57.968 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:57 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:57.672+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:57.968 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:57 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:57.672+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:05:57.968 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:57 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:57.672+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:05:58.240 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:57 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:57.966+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:58.240 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:57 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:57.966+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:58.241 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:57 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:57.966+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:05:58.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:57 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:57.904+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:58.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:57 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:57.904+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:58.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:57 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:57.904+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:58.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:57 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:57.904+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:58.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:57 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:57.904+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:05:58.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:58 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:58.007+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:58.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:58 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:58.007+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:58.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:58 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:58.007+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:05:58.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:58 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:58.007+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.944297+0000 front 2024-09-16T01:05:33.944357+0000 (oldest deadline 2024-09-16T01:05:56.844451+0000) 2024-09-16T01:05:58.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:58 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:58.099+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:58.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:58 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:58.099+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:58.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:58 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:58.099+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:58.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:58 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:58.099+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:05:58.981 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:58 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:58.712+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:58.982 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:58 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:58.712+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:58.982 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:58 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:58.712+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:05:58.982 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:58 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:58.712+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:05:59.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:58 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:58.979+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:59.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:58 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:58.979+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:05:59.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:58 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:58.979+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:05:59.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:58 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:58.888+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:05:59.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:58 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:58.888+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:05:59.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:58 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:58.888+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:05:59.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:58 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:58.888+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:05:59.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:58 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:58.888+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:05:59.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:59 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:59.040+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:05:59.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:59 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:59.040+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:05:59.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:59 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:59.040+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:05:59.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:05:59 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:05:59.040+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.944297+0000 front 2024-09-16T01:05:33.944357+0000 (oldest deadline 2024-09-16T01:05:56.844451+0000) 2024-09-16T01:05:59.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:59 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:59.079+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:05:59.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:59 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:59.079+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:05:59.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:59 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:59.079+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:05:59.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:59 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:59.079+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:05:59.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:05:59 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:05:59.079+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:05:59.933 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:59 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:59.932+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:05:59.933 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:59 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:59.677+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:05:59.937 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:59 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:59.677+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:05:59.937 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:59 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:59.677+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:05:59.937 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:05:59 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:05:59.677+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:06:00.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:59 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:59.932+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:00.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:59 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:59.932+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:00.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:05:59 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:05:59.932+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:00.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:59 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:59.884+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:00.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:59 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:59.884+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:00.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:59 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:59.884+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:00.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:59 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:59.884+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:00.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:05:59 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:05:59.884+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:00.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:06:00.038+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.040922+0000 front 2024-09-16T01:05:10.040979+0000 (oldest deadline 2024-09-16T01:05:34.741122+0000) 2024-09-16T01:06:00.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:06:00.038+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:17.042065+0000 front 2024-09-16T01:05:17.042090+0000 (oldest deadline 2024-09-16T01:05:41.742134+0000) 2024-09-16T01:06:00.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:06:00.038+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:26.343468+0000 front 2024-09-16T01:05:26.343455+0000 (oldest deadline 2024-09-16T01:05:49.843496+0000) 2024-09-16T01:06:00.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7[53193]: 2024-09-16T01:06:00.038+0000 7f566a7dc640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.944297+0000 front 2024-09-16T01:05:33.944357+0000 (oldest deadline 2024-09-16T01:05:56.844451+0000) 2024-09-16T01:06:00.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:00.092+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:00.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:00.092+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:00.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:00.092+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:00.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:00.092+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:00.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:00 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:00.092+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:00.962 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:00 smithi098 podman[69221]: 2024-09-16 01:06:00.659812199 +0000 UTC m=+5.492990959 container died 6762acfd1f8efc334586bb6fa84f449d8c482be46ff54b87455be6e6b399bca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-16T01:06:01.100 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:00 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:00.701+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:06:01.101 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:00 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:00.701+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:06:01.101 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:00 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:00.701+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:06:01.101 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:00 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:00.701+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:06:01.101 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:00 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:00.927+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:01.101 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:00 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:00.927+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:01.101 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:00 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:00.927+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:01.102 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:00 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:00.927+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:01.359 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:00 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:00.928+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:01.359 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:00 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:00.928+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:01.360 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:00 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:00.928+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:01.360 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:00 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:00.928+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:01.360 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:00 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:00.928+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:01.390 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:01 smithi098 podman[69221]: 2024-09-16 01:06:01.068055573 +0000 UTC m=+5.901234336 container cleanup 6762acfd1f8efc334586bb6fa84f449d8c482be46ff54b87455be6e6b399bca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-16T01:06:01.390 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:01 smithi098 bash[69221]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7 2024-09-16T01:06:01.391 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:01 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:01.054+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:01.391 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:01 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:01.054+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:01.391 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:01 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:01.054+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:01.391 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:01 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:01.054+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:01.391 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:01 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:01.054+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:01.666 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:01 smithi098 podman[69236]: 2024-09-16 01:06:01.377672542 +0000 UTC m=+0.712863841 container remove 6762acfd1f8efc334586bb6fa84f449d8c482be46ff54b87455be6e6b399bca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-16T01:06:01.970 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:01 smithi098 podman[69323]: 2024-09-16 01:06:01.565347663 +0000 UTC m=+0.016291932 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:06:01.971 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:01 smithi098 podman[69323]: 2024-09-16 01:06:01.686869541 +0000 UTC m=+0.137813802 container create 3a246f46fbf804fa0730edbc3b95edc49d3a366ee3908827d61275680de4c3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-16T01:06:02.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:01 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:01.696+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:06:02.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:01 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:01.696+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:06:02.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:01 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:01.696+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:06:02.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:01 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:01.696+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:06:02.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:01 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:01.909+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:02.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:01 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:01.909+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:02.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:01 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:01.909+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:02.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:01 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:01.909+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:02.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:01 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:01.879+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:02.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:01 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:01.879+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:02.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:01 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:01.879+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:02.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:01 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:01.879+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:02.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:01 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:01.879+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:02.425 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:02 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:02.051+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:02.425 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:02 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:02.051+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:02.425 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:02 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:02.051+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:02.425 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:02 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:02.051+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:02.425 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:02 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:02.051+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:02.425 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:01 smithi098 podman[69323]: 2024-09-16 01:06:01.964299644 +0000 UTC m=+0.415243905 container init 3a246f46fbf804fa0730edbc3b95edc49d3a366ee3908827d61275680de4c3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2) 2024-09-16T01:06:02.425 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:01 smithi098 podman[69323]: 2024-09-16 01:06:01.967618009 +0000 UTC m=+0.418562271 container start 3a246f46fbf804fa0730edbc3b95edc49d3a366ee3908827d61275680de4c3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:06:02.426 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:02 smithi098 podman[69323]: 2024-09-16 01:06:02.064431702 +0000 UTC m=+0.515375966 container attach 3a246f46fbf804fa0730edbc3b95edc49d3a366ee3908827d61275680de4c3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-16T01:06:02.426 INFO:journalctl@ceph.osd.7.smithi098.stdout:Sep 16 01:06:02 smithi098 podman[69323]: 2024-09-16 01:06:02.154654817 +0000 UTC m=+0.605599081 container died 3a246f46fbf804fa0730edbc3b95edc49d3a366ee3908827d61275680de4c3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-16T01:06:02.871 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.7.service' 2024-09-16T01:06:02.909 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:02.909 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-16T01:06:02.909 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-16T01:06:02.910 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.8 2024-09-16T01:06:02.958 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:02 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:02.702+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:06:02.958 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:02 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:02.702+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:06:02.958 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:02 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:02.702+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:06:02.958 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:02 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:02.702+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:06:02.958 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:02 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:02.927+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:02.958 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:02 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:02.927+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:02.958 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:02 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:02.927+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:02.959 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:02 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:02.927+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:03.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:02 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:02.855+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:03.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:02 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:02.855+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:03.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:02 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:02.855+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:03.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:02 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:02.855+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:03.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:02 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:02.855+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:03.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:03 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:03.072+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:03.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:03 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:03.072+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:03.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:03 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:03.072+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:03.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:03 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:03.072+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:03.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:03 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:03.072+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:03.222 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:02 smithi119 systemd[1]: Stopping Ceph osd.8 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:03.222 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:03.220+0000 7fc7b94a1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:03.596 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:03.220+0000 7fc7b94a1640 -1 osd.8 93 *** Got signal Terminated *** 2024-09-16T01:06:03.596 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:03.220+0000 7fc7b94a1640 -1 osd.8 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:06:04.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:03.725+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:06:04.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:03.725+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:06:04.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:03.725+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:06:04.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:03.725+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:06:04.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:03.899+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:04.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:03.899+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:04.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:03.899+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:04.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:03 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:03.899+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:04.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:03 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:03.882+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:04.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:03 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:03.882+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:04.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:03 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:03.882+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:04.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:03 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:03.882+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:04.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:03 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:03.882+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:04.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:04 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:04.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:04.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:04 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:04.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:04.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:04 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:04.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:04.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:04 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:04.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:04.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:04 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:04.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:05.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:04 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:04.773+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:06:05.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:04 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:04.773+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:06:05.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:04 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:04.773+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:06:05.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:04 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:04.773+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:06:05.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:04 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:04.903+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:05.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:04 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:04.903+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:05.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:04 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:04.903+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:05.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:04 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:04.903+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:05.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:04.871+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:05.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:04.871+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:05.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:04.871+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:05.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:04.871+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:05.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:04 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:04.871+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:05.364 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:05 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:05.085+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:05.364 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:05 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:05.086+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:05.364 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:05 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:05.086+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:05.364 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:05 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:05.086+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:05.364 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:05 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:05.086+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:05.364 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:05 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:05.086+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:06.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:05 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:05.904+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:06.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:05 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:05.904+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:06.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:05 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:05.904+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:06.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:05 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:05.904+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:06.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:05 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:05.745+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:06:06.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:05 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:05.745+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:06:06.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:05 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:05.745+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:06:06.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:05 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:05.745+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:06:06.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:05 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:05.745+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:39.707805+0000 front 2024-09-16T01:05:39.707771+0000 (oldest deadline 2024-09-16T01:06:05.607978+0000) 2024-09-16T01:06:06.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:05 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:05.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:06.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:05 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:05.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:06.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:05 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:05.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:06.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:05 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:05.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:06.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:05 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:05.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:06.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:05 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:05.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:06.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:06 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:06.088+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:06.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:06 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:06.088+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:06.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:06 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:06.088+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:06.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:06 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:06.088+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:06.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:06 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:06.088+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:06.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:06 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:06.088+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:07.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:06.761+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:06:07.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:06.761+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:06:07.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:06.761+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:06:07.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:06.761+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:06:07.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:06.761+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:39.707805+0000 front 2024-09-16T01:05:39.707771+0000 (oldest deadline 2024-09-16T01:06:05.607978+0000) 2024-09-16T01:06:07.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:06.857+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:07.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:06.857+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:07.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:06.857+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:07.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:06.857+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:07.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:06.857+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:07.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:06 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:06.807+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:07.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:06 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:06.807+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:07.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:06 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:06.807+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:07.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:06 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:06.807+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:07.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:06 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:06.807+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:07.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:06 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:06.807+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:07.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:07 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:07.052+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:07.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:07 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:07.052+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:07.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:07 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:07.052+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:07.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:07 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:07.052+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:07.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:07 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:07.052+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:07.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:07 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:07.052+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:08.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:07 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:07.776+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.702698+0000 front 2024-09-16T01:05:10.702912+0000 (oldest deadline 2024-09-16T01:05:34.202700+0000) 2024-09-16T01:06:08.096 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:07 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:07.776+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.903870+0000 front 2024-09-16T01:05:15.903807+0000 (oldest deadline 2024-09-16T01:05:41.803965+0000) 2024-09-16T01:06:08.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:07 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:07.776+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:28.105905+0000 front 2024-09-16T01:05:28.105870+0000 (oldest deadline 2024-09-16T01:05:51.605981+0000) 2024-09-16T01:06:08.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:07 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:07.776+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.906880+0000 front 2024-09-16T01:05:33.906814+0000 (oldest deadline 2024-09-16T01:05:56.806850+0000) 2024-09-16T01:06:08.097 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:07 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8[53399]: 2024-09-16T01:06:07.776+0000 7fc7b1aaf640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:39.707805+0000 front 2024-09-16T01:05:39.707771+0000 (oldest deadline 2024-09-16T01:06:05.607978+0000) 2024-09-16T01:06:08.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:07 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:07.896+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:08.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:07 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:07.896+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:08.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:07 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:07.896+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:08.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:07 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:07.896+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:08.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:07 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:07.896+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:08.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:07.837+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:08.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:07.837+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:08.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:07.837+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:08.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:07.837+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:08.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:07.837+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:08.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:07 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:07.837+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:08.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:08 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:08.043+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:08.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:08 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:08.043+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:08.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:08 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:08.043+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:08.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:08 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:08.043+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:08.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:08 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:08.043+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:08.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:08 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:08.043+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:08.922 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:08 smithi119 podman[69239]: 2024-09-16 01:06:08.629735184 +0000 UTC m=+5.523893528 container died e3c9177618a69c56bdacfc90b9abfbed742df286f377101a6440fbaf679184aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-16T01:06:08.922 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:08 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:08.850+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:08.923 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:08 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:08.850+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:08.923 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:08 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:08.850+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:08.923 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:08 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:08.850+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:08.923 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:08 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:08.850+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:09.247 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:09 smithi119 podman[69239]: 2024-09-16 01:06:09.029206899 +0000 UTC m=+5.923365228 container cleanup e3c9177618a69c56bdacfc90b9abfbed742df286f377101a6440fbaf679184aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:06:09.247 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:09 smithi119 bash[69239]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8 2024-09-16T01:06:09.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:08.877+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:09.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:08.877+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:09.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:08.877+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:09.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:08.877+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:09.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:08.877+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:09.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:08 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:08.877+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:09.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:09 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:09.040+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:09.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:09 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:09.040+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:09.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:09 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:09.040+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:09.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:09 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:09.040+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:09.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:09 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:09.040+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:09.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:09 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:09.040+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:09.596 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:09 smithi119 podman[69255]: 2024-09-16 01:06:09.313954841 +0000 UTC m=+0.677273427 container remove e3c9177618a69c56bdacfc90b9abfbed742df286f377101a6440fbaf679184aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-16T01:06:09.959 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:09 smithi119 podman[69344]: 2024-09-16 01:06:09.544789505 +0000 UTC m=+0.016110973 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:06:09.959 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:09 smithi119 podman[69344]: 2024-09-16 01:06:09.656333462 +0000 UTC m=+0.127654970 container create 2f7d2e0ad61a3ad4ddef3bd26b1293a573c8e85ddb7acaa3167037b8828a5230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-16T01:06:09.959 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:09 smithi119 podman[69344]: 2024-09-16 01:06:09.958976359 +0000 UTC m=+0.430297834 container init 2f7d2e0ad61a3ad4ddef3bd26b1293a573c8e85ddb7acaa3167037b8828a5230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:06:09.959 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:09 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:09.882+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:09.959 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:09 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:09.882+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:09.960 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:09 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:09.882+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:09.960 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:09 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:09.882+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:09.960 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:09 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:09.882+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:10.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:09 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:09.843+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:10.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:09 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:09.843+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:10.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:09 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:09.843+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:10.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:09 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:09.843+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:10.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:09 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:09.843+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:10.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:09 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:09.843+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:10.346 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:09 smithi119 podman[69344]: 2024-09-16 01:06:09.963381412 +0000 UTC m=+0.434702879 container start 2f7d2e0ad61a3ad4ddef3bd26b1293a573c8e85ddb7acaa3167037b8828a5230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-16T01:06:10.346 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:10 smithi119 podman[69344]: 2024-09-16 01:06:10.058959686 +0000 UTC m=+0.530281162 container attach 2f7d2e0ad61a3ad4ddef3bd26b1293a573c8e85ddb7acaa3167037b8828a5230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True) 2024-09-16T01:06:10.347 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 16 01:06:10 smithi119 podman[69344]: 2024-09-16 01:06:10.154362464 +0000 UTC m=+0.625683947 container died 2f7d2e0ad61a3ad4ddef3bd26b1293a573c8e85ddb7acaa3167037b8828a5230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T01:06:10.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:10 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:10.071+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:10.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:10 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:10.071+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:10.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:10 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:10.071+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:10.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:10 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:10.071+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:10.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:10 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:10.071+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:10.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:10 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:10.071+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:10.777 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.8.service' 2024-09-16T01:06:10.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:10.816 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-16T01:06:10.816 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-16T01:06:10.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.9 2024-09-16T01:06:11.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:10 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:10.855+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:11.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:10 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:10.855+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:11.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:10 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:10.855+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:11.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:10 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:10.855+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:11.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:10 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:10.855+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:11.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:10 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:10.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:11.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:10 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:10.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:11.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:10 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:10.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:11.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:10 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:10.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:11.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:10 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:10.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:11.107 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:10 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:10.850+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:11.108 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:10 smithi012 systemd[1]: Stopping Ceph osd.9 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:11.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:11 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:11.035+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:11.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:11 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:11.035+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:11.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:11 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:11.035+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:11.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:11 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:11.035+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:11.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:11 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:11.035+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:11.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:11 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:11.035+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:11.607 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:11 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:11.115+0000 7fe7e365f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:11.607 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:11 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:11.115+0000 7fe7e365f640 -1 osd.9 93 *** Got signal Terminated *** 2024-09-16T01:06:11.607 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:11 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:11.115+0000 7fe7e365f640 -1 osd.9 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:06:12.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:11 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:11.844+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:12.096 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:11 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:11.844+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:12.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:11 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:11.844+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:12.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:11 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:11.844+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:12.097 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:11 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:11.844+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:12.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:11 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:11.886+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:12.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:11 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:11.886+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:12.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:11 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:11.886+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:12.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:11 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:11.886+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:12.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:11 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:11.886+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:12.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:11 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:11.886+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:12.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:12 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:12.047+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:12.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:12 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:12.047+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:12.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:12 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:12.047+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:12.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:12 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:12.047+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:12.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:12 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:12.047+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:12.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:12 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:12.047+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:13.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:12 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:12.873+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:13.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:12 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:12.873+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:13.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:12 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:12.873+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:13.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:12 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:12.873+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:13.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:12 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:12.873+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:13.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:12 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:12.930+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:13.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:12 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:12.930+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:13.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:12 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:12.930+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:13.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:12 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:12.930+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:13.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:12 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:12.930+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:13.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:12 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:12.930+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:13.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:13 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:13.087+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:13.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:13 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:13.087+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:13.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:13 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:13.087+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:13.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:13 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:13.087+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:13.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:13 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:13.087+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:13.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:13 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:13.087+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:14.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:13 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:13.904+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:14.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:13 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:13.904+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:14.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:13 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:13.904+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:14.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:13 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:13.904+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:14.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:13 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:13.904+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:14.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:13 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:13.904+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:14.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:13 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:13.933+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:14.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:13 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:13.933+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:14.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:13 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:13.933+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:14.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:13 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:13.933+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:14.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:13 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:13.933+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:14.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:13 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:13.933+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:14.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:14 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:14.067+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:14.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:14 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:14.067+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:14.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:14 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:14.067+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:14.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:14 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:14.067+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:14.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:14 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:14.067+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:14.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:14 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:14.067+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:14.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:14 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:14.067+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:15.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:14 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:14.928+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:15.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:14 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:14.928+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:15.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:14 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:14.928+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:15.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:14 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:14.928+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:15.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:14 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:14.928+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:15.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:14 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:14.928+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:15.356 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:14.891+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:15.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:14.891+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:15.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:14.891+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:15.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:14.891+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:15.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:14.891+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:15.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:14 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:14.891+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:15.421 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:15 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:15.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:15.421 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:15 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:15.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:15.421 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:15 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:15.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:15.421 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:15 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:15.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:15.421 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:15 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:15.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:15.421 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:15 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:15.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:15.421 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:15 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:15.041+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:16.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:15 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:15.974+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:16.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:15 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:15.974+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:16.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:15 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:15.974+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:16.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:15 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:15.974+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:16.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:15 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:15.974+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:16.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:15 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:15.974+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:16.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:15.935+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:04.015423+0000 front 2024-09-16T01:05:04.015888+0000 (oldest deadline 2024-09-16T01:05:26.915554+0000) 2024-09-16T01:06:16.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:15.935+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:07.416713+0000 front 2024-09-16T01:05:07.416703+0000 (oldest deadline 2024-09-16T01:05:32.716498+0000) 2024-09-16T01:06:16.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:15.935+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:15.017587+0000 front 2024-09-16T01:05:15.017610+0000 (oldest deadline 2024-09-16T01:05:40.917683+0000) 2024-09-16T01:06:16.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:15.935+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:22.919783+0000 front 2024-09-16T01:05:22.919847+0000 (oldest deadline 2024-09-16T01:05:48.819861+0000) 2024-09-16T01:06:16.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:15.935+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.520958+0000 front 2024-09-16T01:05:33.521034+0000 (oldest deadline 2024-09-16T01:05:57.020803+0000) 2024-09-16T01:06:16.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:15 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9[62820]: 2024-09-16T01:06:15.935+0000 7fe7dbc6d640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.022038+0000 front 2024-09-16T01:05:41.022069+0000 (oldest deadline 2024-09-16T01:06:05.722010+0000) 2024-09-16T01:06:16.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:16 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:16.029+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:16.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:16 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:16.029+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:16.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:16 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:16.029+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:16.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:16 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:16.029+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:16.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:16 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:16.029+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:16.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:16 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:16.029+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:16.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:16 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:16.029+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:17.057 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:16 smithi012 podman[96292]: 2024-09-16 01:06:16.64966093 +0000 UTC m=+5.630390379 container died e6e78ee8bfe24691dec978068b52f487d3e8240167d72d2f32da57c8fcb24727 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-16T01:06:17.057 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:17 smithi012 podman[96292]: 2024-09-16 01:06:17.056716236 +0000 UTC m=+6.037445676 container cleanup e6e78ee8bfe24691dec978068b52f487d3e8240167d72d2f32da57c8fcb24727 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e) 2024-09-16T01:06:17.333 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:17 smithi012 bash[96292]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9 2024-09-16T01:06:17.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:16 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:16.944+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:17.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:16 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:16.944+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:17.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:16 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:16.944+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:17.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:16 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:16.944+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:17.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:16 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:16.944+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:17.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:16 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:16.944+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:17.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:17 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:17.074+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:17.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:17 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:17.074+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:17.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:17 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:17.074+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:17.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:17 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:17.074+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:17.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:17 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:17.074+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:17.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:17 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:17.074+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:17.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:17 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:17.074+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:17.607 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:17 smithi012 podman[96307]: 2024-09-16 01:06:17.333274783 +0000 UTC m=+0.684440249 container remove e6e78ee8bfe24691dec978068b52f487d3e8240167d72d2f32da57c8fcb24727 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:06:17.961 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:17 smithi012 podman[96392]: 2024-09-16 01:06:17.578452332 +0000 UTC m=+0.016439228 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:06:17.961 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:17 smithi012 podman[96392]: 2024-09-16 01:06:17.684226932 +0000 UTC m=+0.122213870 container create 54904e88fb63438d64413bd17fba2e2d61a790beb9445cbeff7535c8d6fdab26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-16T01:06:17.961 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:17 smithi012 podman[96392]: 2024-09-16 01:06:17.88640146 +0000 UTC m=+0.324388357 container init 54904e88fb63438d64413bd17fba2e2d61a790beb9445cbeff7535c8d6fdab26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:06:17.962 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:17 smithi012 podman[96392]: 2024-09-16 01:06:17.889680323 +0000 UTC m=+0.327667225 container start 54904e88fb63438d64413bd17fba2e2d61a790beb9445cbeff7535c8d6fdab26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-16T01:06:17.962 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:17 smithi012 podman[96392]: 2024-09-16 01:06:17.961092822 +0000 UTC m=+0.399079724 container attach 54904e88fb63438d64413bd17fba2e2d61a790beb9445cbeff7535c8d6fdab26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:06:18.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:17 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:17.962+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:18.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:17 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:17.962+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:18.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:17 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:17.962+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:18.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:17 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:17.962+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:18.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:17 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:17.962+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:18.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:17 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:17.962+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:18.357 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 16 01:06:18 smithi012 podman[96392]: 2024-09-16 01:06:18.090072227 +0000 UTC m=+0.528059124 container died 54904e88fb63438d64413bd17fba2e2d61a790beb9445cbeff7535c8d6fdab26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-16T01:06:18.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:18 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:18.025+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:18.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:18 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:18.025+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:18.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:18 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:18.025+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:18.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:18 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:18.025+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:18.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:18 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:18.025+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:18.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:18 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:18.025+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:18.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:18 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:18.025+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:18.702 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.9.service' 2024-09-16T01:06:18.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:18.744 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-16T01:06:18.744 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-16T01:06:18.744 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.10 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:18 smithi098 systemd[1]: Stopping Ceph osd.10 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:19 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:19.009+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:19 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:19.009+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:19 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:19.009+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:19 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:19.009+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:19 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:19.009+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:19 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:19.009+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:19 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:19.009+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:19 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:19.029+0000 7f553cef6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:19 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:19.029+0000 7f553cef6640 -1 osd.10 93 *** Got signal Terminated *** 2024-09-16T01:06:19.031 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:19 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:19.029+0000 7f553cef6640 -1 osd.10 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:06:19.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:18 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:18.917+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:19.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:18 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:18.917+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:19.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:18 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:18.917+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:19.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:18 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:18.917+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:19.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:18 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:18.917+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:19.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:18 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:18.917+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:20.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:19 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:19.933+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:20.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:19 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:19.933+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:20.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:19 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:19.933+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:20.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:19 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:19.933+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:20.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:19 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:19.933+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:20.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:19 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:19.933+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:20.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:20 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:20.018+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:20.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:20 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:20.018+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:20.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:20 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:20.018+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:20.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:20 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:20.018+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:20.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:20 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:20.018+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:20.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:20 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:20.018+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:20.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:20 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:20.018+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:21.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:20 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:20.934+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:21.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:20 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:20.934+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:21.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:20 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:20.934+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:21.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:20 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:20.934+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:21.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:20 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:20.934+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:21.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:20 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:20.934+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:21.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:21 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.010+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:21.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:21 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.010+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:21.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:21 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.010+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:21.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:21 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.010+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:21.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:21 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.010+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:21.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:21 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.010+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:21.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:21 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.010+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:22.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:21 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:21.959+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:22.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:21 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:21.959+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:22.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:21 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:21.959+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:22.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:21 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:21.959+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:22.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:21 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:21.959+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:22.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:21 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:21.959+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:22.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:22 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.999+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:22.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:22 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.999+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:22.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:22 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.999+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:22.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:22 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.999+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:22.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:22 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.999+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:22.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:22 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.999+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:22.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:22 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:21.999+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:23.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.006+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:23.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.006+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:23.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.006+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:23.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.006+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:23.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.006+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:23.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.006+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:23.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:23 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:23.048+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:23.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:23 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:23.048+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:23.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:23 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:23.048+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:23.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:23 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:23.048+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:23.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:23 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:23.048+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:23.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:23 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:23.048+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:23.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:23 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:23.048+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:24.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.992+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:24.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.992+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:24.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.992+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:24.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.992+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:24.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.992+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:24.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:23 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:23.992+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:24.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:24 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:24.011+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:03.236622+0000 front 2024-09-16T01:05:03.236386+0000 (oldest deadline 2024-09-16T01:05:26.636772+0000) 2024-09-16T01:06:24.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:24 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:24.012+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-09-16T01:05:10.638261+0000 front 2024-09-16T01:05:10.638289+0000 (oldest deadline 2024-09-16T01:05:35.838741+0000) 2024-09-16T01:06:24.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:24 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:24.012+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:19.140903+0000 front 2024-09-16T01:05:19.141016+0000 (oldest deadline 2024-09-16T01:05:42.640779+0000) 2024-09-16T01:06:24.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:24 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:24.012+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.941853+0000 front 2024-09-16T01:05:24.941922+0000 (oldest deadline 2024-09-16T01:05:49.641661+0000) 2024-09-16T01:06:24.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:24 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:24.012+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:35.943192+0000 front 2024-09-16T01:05:35.943218+0000 (oldest deadline 2024-09-16T01:05:58.243281+0000) 2024-09-16T01:06:24.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:24 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:24.012+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:41.044860+0000 front 2024-09-16T01:05:41.044938+0000 (oldest deadline 2024-09-16T01:06:04.544321+0000) 2024-09-16T01:06:24.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:24 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10[59891]: 2024-09-16T01:06:24.012+0000 7f5535504640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:48.446403+0000 front 2024-09-16T01:05:48.446296+0000 (oldest deadline 2024-09-16T01:06:13.746146+0000) 2024-09-16T01:06:24.731 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:24 smithi098 podman[69437]: 2024-09-16 01:06:24.462543431 +0000 UTC m=+5.526726599 container died cacf2c851c5c9938bf2c85cd6c17ae62b04ca0d3bc2b898b1187ebf14ece01f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-16T01:06:25.106 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:24 smithi098 podman[69437]: 2024-09-16 01:06:24.821567576 +0000 UTC m=+5.885750740 container cleanup cacf2c851c5c9938bf2c85cd6c17ae62b04ca0d3bc2b898b1187ebf14ece01f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:06:25.107 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:24 smithi098 bash[69437]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10 2024-09-16T01:06:25.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:24 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:24.980+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:25.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:24 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:24.980+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:25.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:24 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:24.980+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:25.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:24 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:24.980+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:25.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:24 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:24.980+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:25.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:24 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:24.980+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:25.440 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:25 smithi098 podman[69455]: 2024-09-16 01:06:25.10610826 +0000 UTC m=+0.640199689 container remove cacf2c851c5c9938bf2c85cd6c17ae62b04ca0d3bc2b898b1187ebf14ece01f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-16T01:06:25.712 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:25 smithi098 podman[69543]: 2024-09-16 01:06:25.440108951 +0000 UTC m=+0.113230875 container create 968177cff3c750f7deac48fe2177be276e4b4a04af823f261620ad019fb865c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-16T01:06:25.712 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:25 smithi098 podman[69543]: 2024-09-16 01:06:25.342716318 +0000 UTC m=+0.015838253 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:06:25.712 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:25 smithi098 podman[69543]: 2024-09-16 01:06:25.650966547 +0000 UTC m=+0.324088469 container init 968177cff3c750f7deac48fe2177be276e4b4a04af823f261620ad019fb865c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-16T01:06:25.712 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:25 smithi098 podman[69543]: 2024-09-16 01:06:25.654560281 +0000 UTC m=+0.327682205 container start 968177cff3c750f7deac48fe2177be276e4b4a04af823f261620ad019fb865c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-16T01:06:26.128 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:25 smithi098 podman[69543]: 2024-09-16 01:06:25.743177724 +0000 UTC m=+0.416299658 container attach 968177cff3c750f7deac48fe2177be276e4b4a04af823f261620ad019fb865c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-16T01:06:26.129 INFO:journalctl@ceph.osd.10.smithi098.stdout:Sep 16 01:06:25 smithi098 podman[69543]: 2024-09-16 01:06:25.844452465 +0000 UTC m=+0.517574408 container died 968177cff3c750f7deac48fe2177be276e4b4a04af823f261620ad019fb865c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:06:26.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:25 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:25.981+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:26.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:25 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:25.981+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:26.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:25 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:25.981+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:26.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:25 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:25.981+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:26.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:25 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:25.981+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:26.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:25 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:25.981+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:26.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:25 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:25.981+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-16T01:05:55.852712+0000 front 2024-09-16T01:05:55.852828+0000 (oldest deadline 2024-09-16T01:06:25.253041+0000) 2024-09-16T01:06:26.394 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.10.service' 2024-09-16T01:06:26.433 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:26.433 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-16T01:06:26.433 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-16T01:06:26.433 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.11 2024-09-16T01:06:26.732 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 systemd[1]: Stopping Ceph osd.11 for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:26.993 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:26.731+0000 7fb375ec7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:26.993 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:26.731+0000 7fb375ec7640 -1 osd.11 93 *** Got signal Terminated *** 2024-09-16T01:06:26.994 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:26.731+0000 7fb375ec7640 -1 osd.11 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:06:27.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:26.993+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:27.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:26.993+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:27.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:26.993+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:27.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:26.993+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:27.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:26.993+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:27.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:26.993+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:27.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:26 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:26.993+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-16T01:05:55.852712+0000 front 2024-09-16T01:05:55.852828+0000 (oldest deadline 2024-09-16T01:06:25.253041+0000) 2024-09-16T01:06:28.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:28 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:28.038+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:28.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:28 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:28.038+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:28.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:28 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:28.038+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:28.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:28 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:28.038+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:28.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:28 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:28.038+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:28.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:28 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:28.038+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:28.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:28 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:28.038+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-16T01:05:55.852712+0000 front 2024-09-16T01:05:55.852828+0000 (oldest deadline 2024-09-16T01:06:25.253041+0000) 2024-09-16T01:06:29.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:29 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:29.023+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:29.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:29 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:29.023+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:29.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:29 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:29.023+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:29.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:29 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:29.023+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:29.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:29 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:29.023+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:29.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:29 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:29.023+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:29.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:29 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:29.023+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-16T01:05:55.852712+0000 front 2024-09-16T01:05:55.852828+0000 (oldest deadline 2024-09-16T01:06:25.253041+0000) 2024-09-16T01:06:30.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:30 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:30.050+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:30.346 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:30 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:30.050+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:30.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:30 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:30.050+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:30.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:30 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:30.050+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:30.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:30 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:30.050+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:30.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:30 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:30.050+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:30.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:30 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:30.050+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-16T01:05:55.852712+0000 front 2024-09-16T01:05:55.852828+0000 (oldest deadline 2024-09-16T01:06:25.253041+0000) 2024-09-16T01:06:31.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:31 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:31.075+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-16T01:05:02.244386+0000 front 2024-09-16T01:05:02.244463+0000 (oldest deadline 2024-09-16T01:05:27.544261+0000) 2024-09-16T01:06:31.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:31 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:31.075+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-16T01:05:18.745715+0000 front 2024-09-16T01:05:18.745815+0000 (oldest deadline 2024-09-16T01:05:42.245865+0000) 2024-09-16T01:06:31.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:31 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:31.075+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-16T01:05:24.447475+0000 front 2024-09-16T01:05:24.447575+0000 (oldest deadline 2024-09-16T01:05:49.147407+0000) 2024-09-16T01:06:31.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:31 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:31.075+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-09-16T01:05:33.848421+0000 front 2024-09-16T01:05:33.848399+0000 (oldest deadline 2024-09-16T01:05:59.649079+0000) 2024-09-16T01:06:31.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:31 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:31.075+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-16T01:05:40.749859+0000 front 2024-09-16T01:05:40.749876+0000 (oldest deadline 2024-09-16T01:06:06.049852+0000) 2024-09-16T01:06:31.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:31 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:31.075+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-16T01:05:51.251461+0000 front 2024-09-16T01:05:51.251447+0000 (oldest deadline 2024-09-16T01:06:13.551242+0000) 2024-09-16T01:06:31.347 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:31 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11[59948]: 2024-09-16T01:06:31.075+0000 7fb36e4d5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-09-16T01:05:55.852712+0000 front 2024-09-16T01:05:55.852828+0000 (oldest deadline 2024-09-16T01:06:25.253041+0000) 2024-09-16T01:06:32.533 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:32 smithi119 podman[69457]: 2024-09-16 01:06:32.235712539 +0000 UTC m=+5.605044151 container died dffab6824b5037699a13ba3a5ad797b7eab7ebb0b61dde8202bc81916e4a75d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2) 2024-09-16T01:06:32.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:32 smithi119 podman[69457]: 2024-09-16 01:06:32.6227885 +0000 UTC m=+5.992120121 container cleanup dffab6824b5037699a13ba3a5ad797b7eab7ebb0b61dde8202bc81916e4a75d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-16T01:06:32.846 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:32 smithi119 bash[69457]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11 2024-09-16T01:06:33.191 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:32 smithi119 podman[69486]: 2024-09-16 01:06:32.857378107 +0000 UTC m=+0.614458569 container remove dffab6824b5037699a13ba3a5ad797b7eab7ebb0b61dde8202bc81916e4a75d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:06:33.460 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:33 smithi119 podman[69574]: 2024-09-16 01:06:33.093721548 +0000 UTC m=+0.015778709 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:06:33.461 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:33 smithi119 podman[69574]: 2024-09-16 01:06:33.216363447 +0000 UTC m=+0.138420598 container create b54bd833db84e81d78909e49e67faa537b1783492d5ba594c67550c3dbb429b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-16T01:06:33.461 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:33 smithi119 podman[69574]: 2024-09-16 01:06:33.460300146 +0000 UTC m=+0.382357296 container init b54bd833db84e81d78909e49e67faa537b1783492d5ba594c67550c3dbb429b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-16T01:06:33.847 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:33 smithi119 podman[69574]: 2024-09-16 01:06:33.463568338 +0000 UTC m=+0.385625497 container start b54bd833db84e81d78909e49e67faa537b1783492d5ba594c67550c3dbb429b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-16T01:06:33.847 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:33 smithi119 podman[69574]: 2024-09-16 01:06:33.543603123 +0000 UTC m=+0.465660276 container attach b54bd833db84e81d78909e49e67faa537b1783492d5ba594c67550c3dbb429b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-16T01:06:33.847 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 16 01:06:33 smithi119 podman[69574]: 2024-09-16 01:06:33.653072329 +0000 UTC m=+0.575129489 container died b54bd833db84e81d78909e49e67faa537b1783492d5ba594c67550c3dbb429b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-16T01:06:34.267 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@osd.11.service' 2024-09-16T01:06:34.305 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:34.306 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-16T01:06:34.306 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-16T01:06:34.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.a 2024-09-16T01:06:34.607 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:06:34 smithi012 systemd[1]: Stopping Ceph mds.a for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:34.928 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:06:34 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a[69737]: 2024-09-16T01:06:34.614+0000 7f68de32f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:34.928 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:06:34 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a[69737]: 2024-09-16T01:06:34.614+0000 7f68de32f640 -1 mds.a *** got signal Terminated *** 2024-09-16T01:06:37.091 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:06:36 smithi012 podman[96495]: 2024-09-16 01:06:36.72497613 +0000 UTC m=+2.215817153 container died 138edc3f38ea9ebfdd10e07969e67c1d34767223c67bd3dd1854fd78e0deed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-16T01:06:37.357 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:06:37 smithi012 podman[96495]: 2024-09-16 01:06:37.248044944 +0000 UTC m=+2.738886013 container cleanup 138edc3f38ea9ebfdd10e07969e67c1d34767223c67bd3dd1854fd78e0deed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:06:37.357 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:06:37 smithi012 bash[96495]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a 2024-09-16T01:06:37.694 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 16 01:06:37 smithi012 podman[96519]: 2024-09-16 01:06:37.441133867 +0000 UTC m=+0.711937492 container remove 138edc3f38ea9ebfdd10e07969e67c1d34767223c67bd3dd1854fd78e0deed70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:06:37.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.a.service' 2024-09-16T01:06:37.737 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:37.738 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-16T01:06:37.738 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-16T01:06:37.738 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.d 2024-09-16T01:06:38.086 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 01:06:37 smithi012 systemd[1]: Stopping Ceph mds.d for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:38.357 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 01:06:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-d[68534]: 2024-09-16T01:06:38.085+0000 7f6781510640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:38.357 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 01:06:38 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-d[68534]: 2024-09-16T01:06:38.085+0000 7f6781510640 -1 mds.d *** got signal Terminated *** 2024-09-16T01:06:40.857 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 01:06:40 smithi012 podman[96629]: 2024-09-16 01:06:40.599195277 +0000 UTC m=+2.624428715 container died a5e8bab2b624c6282eca9700048099f5b41529902c4c876b68a43f8231596cec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-16T01:06:41.328 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 01:06:41 smithi012 podman[96629]: 2024-09-16 01:06:41.051909824 +0000 UTC m=+3.077143262 container cleanup a5e8bab2b624c6282eca9700048099f5b41529902c4c876b68a43f8231596cec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-16T01:06:41.328 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 16 01:06:41 smithi012 bash[96629]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-d 2024-09-16T01:06:41.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.d.service' 2024-09-16T01:06:41.521 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:41.521 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-16T01:06:41.521 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-16T01:06:41.521 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.g 2024-09-16T01:06:41.856 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 01:06:41 smithi012 systemd[1]: Stopping Ceph mds.g for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:42.107 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 01:06:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-g[69412]: 2024-09-16T01:06:41.855+0000 7fe25714b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:42.107 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 01:06:41 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-g[69412]: 2024-09-16T01:06:41.855+0000 7fe25714b640 -1 mds.g *** got signal Terminated *** 2024-09-16T01:06:44.972 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 01:06:44 smithi012 podman[96750]: 2024-09-16 01:06:44.721352095 +0000 UTC m=+2.973740413 container died 955595e5529ed4136bde2c20c2489decbfa682c988d65955bafaeaac9628aad4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T01:06:45.231 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 01:06:45 smithi012 podman[96750]: 2024-09-16 01:06:45.021422993 +0000 UTC m=+3.273811312 container cleanup 955595e5529ed4136bde2c20c2489decbfa682c988d65955bafaeaac9628aad4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-16T01:06:45.231 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 16 01:06:45 smithi012 bash[96750]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-g 2024-09-16T01:06:45.454 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.g.service' 2024-09-16T01:06:45.487 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:45.487 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-16T01:06:45.487 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-16T01:06:45.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.j 2024-09-16T01:06:45.778 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 01:06:45 smithi012 systemd[1]: Stopping Ceph mds.j for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:46.107 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 01:06:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-j[68141]: 2024-09-16T01:06:45.950+0000 7fa8f1678640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:46.107 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 01:06:45 smithi012 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-j[68141]: 2024-09-16T01:06:45.950+0000 7fa8f1678640 -1 mds.j *** got signal Terminated *** 2024-09-16T01:06:49.093 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 01:06:48 smithi012 podman[96870]: 2024-09-16 01:06:48.814533806 +0000 UTC m=+3.105528547 container died 0b8a1996b3596a7d056fd08bf48b79aad989721b6860b9b501935f3a158f7c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-16T01:06:49.357 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 01:06:49 smithi012 podman[96870]: 2024-09-16 01:06:49.241866422 +0000 UTC m=+3.532861164 container cleanup 0b8a1996b3596a7d056fd08bf48b79aad989721b6860b9b501935f3a158f7c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-16T01:06:49.357 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 01:06:49 smithi012 bash[96870]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-j 2024-09-16T01:06:49.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.j.service' 2024-09-16T01:06:49.694 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 01:06:49 smithi012 podman[96883]: 2024-09-16 01:06:49.442920067 +0000 UTC m=+0.623637749 container remove 0b8a1996b3596a7d056fd08bf48b79aad989721b6860b9b501935f3a158f7c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:06:49.695 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 01:06:49 smithi012 systemd[1]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.j.service: Deactivated successfully. 2024-09-16T01:06:49.695 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 16 01:06:49 smithi012 systemd[1]: Stopped Ceph mds.j for 9a476aac-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:06:49.708 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:49.708 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-16T01:06:49.708 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-16T01:06:49.709 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.b 2024-09-16T01:06:50.006 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 01:06:49 smithi098 systemd[1]: Stopping Ceph mds.b for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:50.265 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 01:06:50 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b[65547]: 2024-09-16T01:06:50.005+0000 7fac20781640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:50.265 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 01:06:50 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b[65547]: 2024-09-16T01:06:50.005+0000 7fac20781640 -1 mds.b *** got signal Terminated *** 2024-09-16T01:06:53.149 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 01:06:52 smithi098 podman[69646]: 2024-09-16 01:06:52.741164686 +0000 UTC m=+2.833343055 container died 8ddc78de04377cb88020002e8af35b94b5eecbe59fc634146fe2a2b0749b80e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:06:53.462 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 01:06:53 smithi098 podman[69646]: 2024-09-16 01:06:53.247162649 +0000 UTC m=+3.339341017 container cleanup 8ddc78de04377cb88020002e8af35b94b5eecbe59fc634146fe2a2b0749b80e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T01:06:53.463 INFO:journalctl@ceph.mds.b.smithi098.stdout:Sep 16 01:06:53 smithi098 bash[69646]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-b 2024-09-16T01:06:53.615 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.b.service' 2024-09-16T01:06:53.651 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:53.651 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-16T01:06:53.651 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-16T01:06:53.651 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.e 2024-09-16T01:06:54.214 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:06:53 smithi098 systemd[1]: Stopping Ceph mds.e for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:54.214 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:06:53 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e[64928]: 2024-09-16T01:06:53.967+0000 7fb0f2b62640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:54.214 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:06:53 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e[64928]: 2024-09-16T01:06:53.967+0000 7fb0f2b62640 -1 mds.e *** got signal Terminated *** 2024-09-16T01:06:57.002 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:06:56 smithi098 podman[69780]: 2024-09-16 01:06:56.73464425 +0000 UTC m=+2.861103394 container died 62b2d106249f03fb2e0c52e884c378ab768e19c6fa9cce690a5f8a8dbc15b123 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-16T01:06:57.462 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:06:57 smithi098 podman[69780]: 2024-09-16 01:06:57.076044314 +0000 UTC m=+3.202503515 container cleanup 62b2d106249f03fb2e0c52e884c378ab768e19c6fa9cce690a5f8a8dbc15b123 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-16T01:06:57.463 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:06:57 smithi098 bash[69780]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e 2024-09-16T01:06:57.463 INFO:journalctl@ceph.mds.e.smithi098.stdout:Sep 16 01:06:57 smithi098 podman[69793]: 2024-09-16 01:06:57.243855504 +0000 UTC m=+0.503470394 container remove 62b2d106249f03fb2e0c52e884c378ab768e19c6fa9cce690a5f8a8dbc15b123 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-16T01:06:57.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.e.service' 2024-09-16T01:06:57.530 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:06:57.530 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-16T01:06:57.530 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-16T01:06:57.531 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.h 2024-09-16T01:06:57.846 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 01:06:57 smithi098 systemd[1]: Stopping Ceph mds.h for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:06:58.212 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 01:06:57 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h[65234]: 2024-09-16T01:06:57.846+0000 7fda66abb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:06:58.212 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 01:06:57 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h[65234]: 2024-09-16T01:06:57.846+0000 7fda66abb640 -1 mds.h *** got signal Terminated *** 2024-09-16T01:07:01.047 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 01:07:00 smithi098 podman[69901]: 2024-09-16 01:07:00.734919878 +0000 UTC m=+2.988144258 container died 9e69ba55b170f5780276ed93620ef5f5c90bcd5cc5ffc02fd9ce5b7988da222e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T01:07:01.331 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 01:07:01 smithi098 podman[69901]: 2024-09-16 01:07:01.129362852 +0000 UTC m=+3.382587228 container cleanup 9e69ba55b170f5780276ed93620ef5f5c90bcd5cc5ffc02fd9ce5b7988da222e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-16T01:07:01.331 INFO:journalctl@ceph.mds.h.smithi098.stdout:Sep 16 01:07:01 smithi098 bash[69901]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-h 2024-09-16T01:07:01.557 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.h.service' 2024-09-16T01:07:01.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:07:01.590 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-16T01:07:01.590 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-16T01:07:01.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.k 2024-09-16T01:07:01.908 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 01:07:01 smithi098 systemd[1]: Stopping Ceph mds.k for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:07:02.212 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 01:07:01 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k[64625]: 2024-09-16T01:07:01.907+0000 7f370eaed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:07:02.212 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 01:07:01 smithi098 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k[64625]: 2024-09-16T01:07:01.907+0000 7f370eaed640 -1 mds.k *** got signal Terminated *** 2024-09-16T01:07:05.075 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 01:07:04 smithi098 podman[70022]: 2024-09-16 01:07:04.726948255 +0000 UTC m=+2.923563295 container died 3638a1ad9e48b00603ed0d2c3d85a3c2fdb5c9a9009e05d0f978049fd1a6b025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:07:05.359 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 01:07:05 smithi098 podman[70022]: 2024-09-16 01:07:05.149981275 +0000 UTC m=+3.346596304 container cleanup 3638a1ad9e48b00603ed0d2c3d85a3c2fdb5c9a9009e05d0f978049fd1a6b025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:07:05.359 INFO:journalctl@ceph.mds.k.smithi098.stdout:Sep 16 01:07:05 smithi098 bash[70022]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-k 2024-09-16T01:07:05.566 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.k.service' 2024-09-16T01:07:05.600 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:07:05.600 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-16T01:07:05.600 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-16T01:07:05.600 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.c 2024-09-16T01:07:06.096 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 01:07:05 smithi119 systemd[1]: Stopping Ceph mds.c for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:07:06.596 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 01:07:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c[65082]: 2024-09-16T01:07:06.205+0000 7fee550ef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:07:06.597 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 01:07:06 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c[65082]: 2024-09-16T01:07:06.205+0000 7fee550ef640 -1 mds.c *** got signal Terminated *** 2024-09-16T01:07:09.013 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 01:07:08 smithi119 podman[69678]: 2024-09-16 01:07:08.741262864 +0000 UTC m=+2.947957349 container died c2178b95243f2a6c50a2e16fb2e44ef1b4518cfb8303a19964d4e839b10d9956 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T01:07:09.346 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 01:07:09 smithi119 podman[69678]: 2024-09-16 01:07:09.112394458 +0000 UTC m=+3.319088942 container cleanup c2178b95243f2a6c50a2e16fb2e44ef1b4518cfb8303a19964d4e839b10d9956 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T01:07:09.347 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 16 01:07:09 smithi119 bash[69678]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-c 2024-09-16T01:07:09.544 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.c.service' 2024-09-16T01:07:09.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:07:09.581 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-16T01:07:09.581 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-16T01:07:09.581 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.f 2024-09-16T01:07:09.901 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 01:07:09 smithi119 systemd[1]: Stopping Ceph mds.f for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:07:10.346 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 01:07:09 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f[64779]: 2024-09-16T01:07:09.899+0000 7f22047f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:07:10.346 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 01:07:09 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f[64779]: 2024-09-16T01:07:09.899+0000 7f22047f5640 -1 mds.f *** got signal Terminated *** 2024-09-16T01:07:13.018 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 01:07:12 smithi119 podman[69812]: 2024-09-16 01:07:12.73726782 +0000 UTC m=+2.942751475 container died deb74c504e4c98e7410ca6ba2ae3a74f0ec443a585954bda47c62dae9d26a7c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-16T01:07:13.346 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 01:07:13 smithi119 podman[69812]: 2024-09-16 01:07:13.108079171 +0000 UTC m=+3.313562829 container cleanup deb74c504e4c98e7410ca6ba2ae3a74f0ec443a585954bda47c62dae9d26a7c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-16T01:07:13.346 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 16 01:07:13 smithi119 bash[69812]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-f 2024-09-16T01:07:13.543 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.f.service' 2024-09-16T01:07:13.576 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:07:13.576 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-16T01:07:13.576 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-16T01:07:13.576 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.i 2024-09-16T01:07:13.895 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 01:07:13 smithi119 systemd[1]: Stopping Ceph mds.i for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:07:14.346 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 01:07:13 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-i[65383]: 2024-09-16T01:07:13.893+0000 7f8621862640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:07:14.346 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 01:07:13 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-i[65383]: 2024-09-16T01:07:13.893+0000 7f8621862640 -1 mds.i *** got signal Terminated *** 2024-09-16T01:07:16.995 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 01:07:16 smithi119 podman[69932]: 2024-09-16 01:07:16.732449665 +0000 UTC m=+2.933056947 container died 8edf38410664bac76c4aad85eab9f74f6033a4cfaebd04518cea58b742c1a1bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:07:17.346 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 01:07:17 smithi119 podman[69932]: 2024-09-16 01:07:17.094645301 +0000 UTC m=+3.295252583 container cleanup 8edf38410664bac76c4aad85eab9f74f6033a4cfaebd04518cea58b742c1a1bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-16T01:07:17.346 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 16 01:07:17 smithi119 bash[69932]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-i 2024-09-16T01:07:17.523 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.i.service' 2024-09-16T01:07:17.555 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:07:17.555 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-16T01:07:17.555 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-16T01:07:17.555 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.l 2024-09-16T01:07:18.096 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 01:07:17 smithi119 systemd[1]: Stopping Ceph mds.l for 9a476aac-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:07:18.096 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 01:07:17 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l[64477]: 2024-09-16T01:07:17.873+0000 7fb357ab5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:07:18.097 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 01:07:17 smithi119 ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l[64477]: 2024-09-16T01:07:17.873+0000 7fb357ab5640 -1 mds.l *** got signal Terminated *** 2024-09-16T01:07:20.999 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 01:07:20 smithi119 podman[70049]: 2024-09-16 01:07:20.725455068 +0000 UTC m=+2.953754853 container died f24e9cb767c8c6cf1d3583121388662d4a4ff6207c8b6b511571150d4b0309d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-16T01:07:21.341 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 01:07:21 smithi119 podman[70049]: 2024-09-16 01:07:21.090327716 +0000 UTC m=+3.318627501 container cleanup f24e9cb767c8c6cf1d3583121388662d4a4ff6207c8b6b511571150d4b0309d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:07:21.341 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 16 01:07:21 smithi119 bash[70049]: ceph-9a476aac-73c5-11ef-bceb-c7b262605968-mds-l 2024-09-16T01:07:21.461 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a476aac-73c5-11ef-bceb-c7b262605968@mds.l.service' 2024-09-16T01:07:21.493 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:07:21.493 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-16T01:07:21.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:07:21.706 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T01:07:24.292 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:07:24.506 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T01:07:26.978 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:07:27.178 INFO:teuthology.orchestra.run.smithi119.stdout:Deleting cluster with fsid: 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T01:07:29.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:07:29.595 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:07:29.629 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:07:29.656 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-16T01:07:29.659 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420/remote/smithi012/crash 2024-09-16T01:07:29.659 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:07:29.698 INFO:teuthology.orchestra.run.smithi012.stderr:tar: /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:07:29.698 INFO:teuthology.orchestra.run.smithi012.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:07:29.700 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420/remote/smithi098/crash 2024-09-16T01:07:29.701 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:07:29.744 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:07:29.744 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:07:29.746 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420/remote/smithi119/crash 2024-09-16T01:07:29.747 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:07:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:07:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:07:29.781 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-16T01:07:29.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-16T01:07:29.823 INFO:tasks.cephadm:Compressing logs... 2024-09-16T01:07:29.823 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:07:29.866 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:07:29.869 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:07:29.892 INFO:teuthology.orchestra.run.smithi012.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2024-09-16T01:07:29.892 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-16T01:07:29.892 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-16T01:07:29.894 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-16T01:07:29.894 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.log: /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:07:29.894 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:07:29.894 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-16T01:07:29.894 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:07:29.895 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-16T01:07:29.895 INFO:teuthology.orchestra.run.smithi012.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-16T01:07:29.896 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:07:29.896 INFO:teuthology.orchestra.run.smithi119.stderr:: No such file or directory 2024-09-16T01:07:29.896 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:07:29.896 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-16T01:07:29.896 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-16T01:07:29.896 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:07:29.896 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-16T01:07:29.897 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-16T01:07:29.897 INFO:teuthology.orchestra.run.smithi012.stderr: 82.7% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:07:29.898 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-16T01:07:29.898 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:07:29.898 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.g.log: /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:07:29.903 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-16T01:07:29.903 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.log: 86.5% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:07:29.903 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-16T01:07:29.906 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-16T01:07:29.906 INFO:teuthology.orchestra.run.smithi119.stderr: 82.7% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:07:29.906 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-16T01:07:29.906 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:07:29.906 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-16T01:07:29.906 INFO:teuthology.orchestra.run.smithi119.stderr: 90.3% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:07:29.906 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.log: 86.5% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:07:29.906 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-16T01:07:29.906 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:: No such file or directory 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:07:29.908 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-16T01:07:29.909 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.8% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:07:29.909 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:07:29.910 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.d.log: 94.7% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-16T01:07:29.910 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-16T01:07:29.910 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mgr.x.log: 91.0% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:07:29.910 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:07:29.911 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-16T01:07:29.912 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mgr.y.log: 92.2% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-16T01:07:29.912 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-16T01:07:29.913 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.log: 91.0% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:07:29.913 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-16T01:07:29.914 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-16T01:07:29.914 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-16T01:07:29.915 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.h.log: 86.5% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:07:29.915 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-16T01:07:29.919 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-16T01:07:29.921 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-16T01:07:29.926 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:07:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:07:29.927 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:07:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.3.log: 94.0% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-16T01:07:29.936 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.f.log: 92.1% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-16T01:07:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-16T01:07:29.938 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/cephadm.log: 92.2% 93.9% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-16T01:07:29.938 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:07:29.939 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 94.0% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-16T01:07:29.945 INFO:teuthology.orchestra.run.smithi012.stderr: 94.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:07:29.949 INFO:teuthology.orchestra.run.smithi098.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:07:29.954 INFO:teuthology.orchestra.run.smithi119.stderr: 94.0% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-16T01:07:29.955 INFO:teuthology.orchestra.run.smithi098.stderr: 92.3% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-16T01:07:29.978 INFO:teuthology.orchestra.run.smithi119.stderr: 93.5% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-16T01:07:29.984 INFO:teuthology.orchestra.run.smithi098.stderr: 91.8% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-16T01:07:30.064 INFO:teuthology.orchestra.run.smithi012.stderr: 90.0% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-16T01:07:30.117 INFO:teuthology.orchestra.run.smithi098.stderr: 92.9% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-16T01:07:30.129 INFO:teuthology.orchestra.run.smithi119.stderr: 91.8% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-16T01:07:30.206 INFO:teuthology.orchestra.run.smithi098.stderr: 91.8% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-16T01:07:30.538 INFO:teuthology.orchestra.run.smithi012.stderr: 90.5% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-16T01:07:30.620 INFO:teuthology.orchestra.run.smithi098.stderr: 92.5% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-16T01:07:30.717 INFO:teuthology.orchestra.run.smithi012.stderr: 92.4% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-16T01:07:30.743 INFO:teuthology.orchestra.run.smithi012.stderr: 92.4% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-16T01:07:30.770 INFO:teuthology.orchestra.run.smithi119.stderr: 92.4% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-16T01:07:30.778 INFO:teuthology.orchestra.run.smithi098.stderr: 92.4% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-16T01:07:30.912 INFO:teuthology.orchestra.run.smithi119.stderr: 93.3% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-16T01:07:31.019 INFO:teuthology.orchestra.run.smithi119.stderr: 93.1% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-16T01:07:31.128 INFO:teuthology.orchestra.run.smithi098.stderr: 93.1% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-16T01:07:31.130 INFO:teuthology.orchestra.run.smithi119.stderr: 92.9% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-16T01:07:31.132 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-16T01:07:31.133 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m1.249s 2024-09-16T01:07:31.133 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m4.505s 2024-09-16T01:07:31.133 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.181s 2024-09-16T01:07:31.143 INFO:teuthology.orchestra.run.smithi098.stderr: 92.9% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-16T01:07:31.144 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-16T01:07:31.145 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m1.260s 2024-09-16T01:07:31.145 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m4.576s 2024-09-16T01:07:31.145 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.193s 2024-09-16T01:07:31.168 INFO:teuthology.orchestra.run.smithi012.stderr: 92.9% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-16T01:07:31.317 INFO:teuthology.orchestra.run.smithi012.stderr: 93.0% -- replaced with /var/log/ceph/9a476aac-73c5-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-16T01:07:31.319 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-16T01:07:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m1.438s 2024-09-16T01:07:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m5.107s 2024-09-16T01:07:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m0.177s 2024-09-16T01:07:31.319 INFO:tasks.cephadm:Archiving logs... 2024-09-16T01:07:31.319 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420/remote/smithi012/log 2024-09-16T01:07:31.320 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:07:32.106 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420/remote/smithi098/log 2024-09-16T01:07:32.107 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:07:32.783 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420/remote/smithi119/log 2024-09-16T01:07:32.784 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:07:33.599 INFO:tasks.cephadm:Removing cluster... 2024-09-16T01:07:33.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 --force 2024-09-16T01:07:33.806 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T01:07:34.075 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 --force 2024-09-16T01:07:34.276 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T01:07:34.533 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a476aac-73c5-11ef-bceb-c7b262605968 --force 2024-09-16T01:07:34.736 INFO:teuthology.orchestra.run.smithi119.stdout:Deleting cluster with fsid: 9a476aac-73c5-11ef-bceb-c7b262605968 2024-09-16T01:07:34.990 INFO:tasks.cephadm:Removing cephadm ... 2024-09-16T01:07:34.990 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:07:35.010 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:07:35.027 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:07:35.042 INFO:tasks.cephadm:Teardown complete 2024-09-16T01:07:35.043 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T01:07:35.055 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T01:07:35.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:07:35.058 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:07:35.070 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:07:35.182 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T01:07:35.199 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T01:07:35.199 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:07:35.202 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:07:35.205 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:07:35.218 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:07:35.218 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:07:35.219 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:07:35.222 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:07:35.222 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-16T01:07:35.222 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 -227us[ -265us] +/- 35ms 2024-09-16T01:07:35.222 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -423us[ -461us] +/- 42ms 2024-09-16T01:07:35.222 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +1420us[+1381us] +/- 89ms 2024-09-16T01:07:35.222 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:07:35.224 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 -255us[ -288us] +/- 35ms 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -436us[ -436us] +/- 42ms 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +1393us[+1393us] +/- 89ms 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 -240us[ -262us] +/- 35ms 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -425us[ -425us] +/- 42ms 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +1408us[+1408us] +/- 89ms 2024-09-16T01:07:35.225 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:07:35.226 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T01:07:35.243 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T01:07:35.244 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T01:07:35.261 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:07:35.355 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:07:35.425 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:07:35.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:07:35.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:07:35.524 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:07:35.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:07:35.557 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:07:35.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:07:35.586 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T01:07:35.597 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T01:07:35.611 INFO:teuthology.task.internal:Duration was 1390.343868 seconds 2024-09-16T01:07:35.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T01:07:35.623 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T01:07:35.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:07:35.626 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:07:35.629 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:07:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:07:35.668 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:07:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:07:35.999 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T01:07:35.999 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-09-16T01:07:35.999 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:07:36.022 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T01:07:36.023 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:07:36.060 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-09-16T01:07:36.060 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:07:36.090 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T01:07:36.090 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:07:36.092 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:07:36.103 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:07:36.156 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T01:07:36.156 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:07:36.161 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:07:36.171 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:07:37.018 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T01:07:37.029 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T01:07:37.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:07:37.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:07:37.084 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:07:37.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T01:07:37.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:07:37.123 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:07:37.126 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:07:37.145 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-09-16T01:07:37.149 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-16T01:07:37.174 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-09-16T01:07:37.194 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:07:37.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:07:37.210 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:07:37.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:07:37.226 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:07:37.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:07:37.248 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T01:07:37.260 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T01:07:37.261 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420/remote/smithi012 2024-09-16T01:07:37.261 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:07:37.314 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420/remote/smithi098 2024-09-16T01:07:37.314 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:07:37.351 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906420/remote/smithi119 2024-09-16T01:07:37.351 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:07:37.393 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T01:07:37.393 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:07:37.398 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:07:37.400 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:07:37.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T01:07:37.454 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T01:07:37.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T01:07:37.500 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T01:07:37.501 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:07:37.503 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:07:37.505 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:07:37.517 INFO:teuthology.orchestra.run.smithi012.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:07 /home/ubuntu/cephtest 2024-09-16T01:07:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:07 /home/ubuntu/cephtest 2024-09-16T01:07:37.520 INFO:teuthology.orchestra.run.smithi119.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:07 /home/ubuntu/cephtest 2024-09-16T01:07:37.522 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T01:07:37.539 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T01:07:37.573 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} duration: 1390.343867778778 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T01:07:37.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T01:07:37.665 INFO:teuthology.run:pass